2023-12-16T20:03:09.608 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-16T20:03:09.608 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} --owner scheduled_yuriw@teuthology --name yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi --verbose --archive /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494750 -- /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494750/orig.config.yaml 2023-12-16T20:03:09.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:03:09.738 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494750 branch: wip-yuri8-testing-2023-12-15-0911 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7494750' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri8-testing-2023-12-15-0911 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes install: ceph: debuginfo: true flavor: default sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri8-testing-2023-12-15-0911 sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 2960 sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri8-testing-2023-12-15-0911 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE8IaRhqnFsfjORsL88XrUajDD+7iM2CtXcgqXVyXcph/SyzSRgHkjytgzBDQpdTqcSlM0p5u7d85wvJCRozKpc= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBhvuffNgRWHW3O4nRlKM77Upb3PLN91wIhtrzCOIupJyg2xpAzZ9SqJrDvC8H/kpuFTfmm/KwVKIEPZrbc6RPI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-16_15:45:14 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-16T20:03:09.739 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa; will attempt to use it 2023-12-16T20:03:09.739 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks 2023-12-16T20:03:09.740 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-16T20:03:09.741 INFO:teuthology.task.internal:Checking packages... 2023-12-16T20:03:09.765 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c7586e95519b7be76f3b6e3a4b333888baf46bc9' 2023-12-16T20:03:09.765 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T20:03:09.765 INFO:teuthology.packaging:ref: None 2023-12-16T20:03:09.765 INFO:teuthology.packaging:tag: None 2023-12-16T20:03:09.765 INFO:teuthology.packaging:branch: wip-yuri8-testing-2023-12-15-0911 2023-12-16T20:03:09.765 INFO:teuthology.packaging:sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:03:09.765 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri8-testing-2023-12-15-0911 2023-12-16T20:03:10.000 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-202.gc7586e95 2023-12-16T20:03:10.001 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-16T20:03:10.008 INFO:teuthology.task.internal:no buildpackages task found 2023-12-16T20:03:10.008 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-16T20:03:10.018 INFO:teuthology.task.internal:Saving configuration 2023-12-16T20:03:10.035 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-16T20:03:10.043 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T20:03:10.065 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494750', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 19:58:23.039712', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE8IaRhqnFsfjORsL88XrUajDD+7iM2CtXcgqXVyXcph/SyzSRgHkjytgzBDQpdTqcSlM0p5u7d85wvJCRozKpc='} 2023-12-16T20:03:10.085 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494750', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 19:58:23.038121', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBhvuffNgRWHW3O4nRlKM77Upb3PLN91wIhtrzCOIupJyg2xpAzZ9SqJrDvC8H/kpuFTfmm/KwVKIEPZrbc6RPI='} 2023-12-16T20:03:10.085 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-16T20:03:10.093 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-12-16T20:03:10.093 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-12-16T20:03:10.093 INFO:teuthology.run_tasks:Running task console_log... 2023-12-16T20:03:10.178 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7feba7804e50>, signals=[15]) 2023-12-16T20:03:10.179 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-16T20:03:10.190 INFO:teuthology.task.internal:Opening connections... 2023-12-16T20:03:10.190 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2023-12-16T20:03:10.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T20:03:10.276 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2023-12-16T20:03:10.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T20:03:10.361 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-16T20:03:10.372 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2023-12-16T20:03:10.390 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2023-12-16T20:03:10.390 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2023-12-16T20:03:10.447 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2023-12-16T20:03:10.447 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9" 2023-12-16T20:03:10.447 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2023-12-16T20:03:10.447 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2023-12-16T20:03:10.447 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9" 2023-12-16T20:03:10.448 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9" 2023-12-16T20:03:10.448 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-16T20:03:10.448 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2023-12-16T20:03:10.448 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon" 2023-12-16T20:03:10.448 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-16T20:03:10.448 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2023-12-16T20:03:10.448 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T20:03:10.448 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-16T20:03:10.448 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T20:03:10.449 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2023-12-16T20:03:10.470 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-12-16T20:03:10.487 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-12-16T20:03:10.488 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-12-16T20:03:10.544 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2023-12-16T20:03:10.544 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2023-12-16T20:03:10.544 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2023-12-16T20:03:10.544 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2023-12-16T20:03:10.544 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2023-12-16T20:03:10.544 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2023-12-16T20:03:10.544 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-16T20:03:10.544 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-12-16T20:03:10.544 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2023-12-16T20:03:10.544 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-16T20:03:10.544 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2023-12-16T20:03:10.544 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T20:03:10.545 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-16T20:03:10.545 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T20:03:10.545 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-12-16T20:03:10.578 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-16T20:03:10.592 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-16T20:03:10.605 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-16T20:03:10.605 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2023-12-16T20:03:10.607 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2023-12-16T20:03:10.623 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-16T20:03:10.634 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-16T20:03:10.634 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2023-12-16T20:03:10.664 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2023-12-16T20:03:10.768 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-16T20:03:10.826 INFO:teuthology.run_tasks:Running task kernel... 2023-12-16T20:03:10.845 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-16T20:03:10.846 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-16T20:03:10.846 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-16T20:03:10.846 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-16T20:03:10.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T20:03:10.862 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2023-12-16T20:03:10.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T20:03:10.863 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2023-12-16T20:03:10.918 INFO:teuthology.orchestra.run.smithi087.stdout:5.14.0-361.el9.x86_64 2023-12-16T20:03:10.918 INFO:teuthology.task.kernel:Running kernel on smithi087: 5.14.0-361.el9.x86_64 2023-12-16T20:03:10.918 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum install -y kernel 2023-12-16T20:03:10.919 INFO:teuthology.orchestra.run.smithi195.stdout:5.14.0-361.el9.x86_64 2023-12-16T20:03:10.919 INFO:teuthology.task.kernel:Running kernel on smithi195: 5.14.0-361.el9.x86_64 2023-12-16T20:03:10.919 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum install -y kernel 2023-12-16T20:03:12.939 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS-9 - AppStream 16 MB/s | 6.4 MB 00:00 2023-12-16T20:03:12.998 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS-9 - AppStream 14 MB/s | 6.4 MB 00:00 2023-12-16T20:03:14.298 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.0 MB 00:00 2023-12-16T20:03:14.308 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2023-12-16T20:03:15.865 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 7.9 MB 00:01 2023-12-16T20:03:16.080 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 7.9 MB 00:01 2023-12-16T20:03:18.541 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 11 MB/s | 18 MB 00:01 2023-12-16T20:03:19.273 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 18 MB 00:02 2023-12-16T20:03:23.194 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 5.8 MB 00:01 2023-12-16T20:03:23.948 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 5.8 MB 00:01 2023-12-16T20:03:24.659 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 15 kB 00:00 2023-12-16T20:03:25.257 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 15 kB 00:00 2023-12-16T20:03:26.171 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2023-12-16T20:03:26.351 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 20 MB/s | 20 MB 00:00 2023-12-16T20:03:30.843 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2023-12-16T20:03:31.026 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2023-12-16T20:03:32.950 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-16T20:03:32.950 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-16T20:03:33.062 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2023-12-16T20:03:33.063 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2023-12-16T20:03:33.063 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2023-12-16T20:03:33.063 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2023-12-16T20:03:33.063 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2023-12-16T20:03:33.063 INFO:teuthology.orchestra.run.smithi087.stdout: kernel x86_64 5.14.0-391.el9 baseos 5.6 M 2023-12-16T20:03:33.063 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2023-12-16T20:03:33.063 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-core x86_64 5.14.0-391.el9 baseos 20 M 2023-12-16T20:03:33.063 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules x86_64 5.14.0-391.el9 baseos 38 M 2023-12-16T20:03:33.063 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-core x86_64 5.14.0-391.el9 baseos 32 M 2023-12-16T20:03:33.063 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:03:33.063 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2023-12-16T20:03:33.063 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2023-12-16T20:03:33.063 INFO:teuthology.orchestra.run.smithi087.stdout:Install 4 Packages 2023-12-16T20:03:33.064 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:03:33.064 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 96 M 2023-12-16T20:03:33.064 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 121 M 2023-12-16T20:03:33.064 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2023-12-16T20:03:33.158 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-16T20:03:33.158 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-16T20:03:33.256 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2023-12-16T20:03:33.272 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2023-12-16T20:03:33.272 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2023-12-16T20:03:33.272 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2023-12-16T20:03:33.272 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2023-12-16T20:03:33.272 INFO:teuthology.orchestra.run.smithi195.stdout: kernel x86_64 5.14.0-391.el9 baseos 5.6 M 2023-12-16T20:03:33.273 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2023-12-16T20:03:33.273 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-core x86_64 5.14.0-391.el9 baseos 20 M 2023-12-16T20:03:33.273 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules x86_64 5.14.0-391.el9 baseos 38 M 2023-12-16T20:03:33.273 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-core x86_64 5.14.0-391.el9 baseos 32 M 2023-12-16T20:03:33.273 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:03:33.273 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2023-12-16T20:03:33.273 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2023-12-16T20:03:33.273 INFO:teuthology.orchestra.run.smithi195.stdout:Install 4 Packages 2023-12-16T20:03:33.273 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:03:33.274 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 96 M 2023-12-16T20:03:33.274 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 121 M 2023-12-16T20:03:33.274 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2023-12-16T20:03:33.852 INFO:teuthology.orchestra.run.smithi195.stdout:(1/4): kernel-5.14.0-391.el9.x86_64.rpm 10 MB/s | 5.6 MB 00:00 2023-12-16T20:03:33.861 INFO:teuthology.orchestra.run.smithi087.stdout:(1/4): kernel-5.14.0-391.el9.x86_64.rpm 7.4 MB/s | 5.6 MB 00:00 2023-12-16T20:03:34.419 INFO:teuthology.orchestra.run.smithi195.stdout:(2/4): kernel-core-5.14.0-391.el9.x86_64.rpm 18 MB/s | 20 MB 00:01 2023-12-16T20:03:35.027 INFO:teuthology.orchestra.run.smithi195.stdout:(3/4): kernel-modules-5.14.0-391.el9.x86_64.rpm 22 MB/s | 38 MB 00:01 2023-12-16T20:03:35.319 INFO:teuthology.orchestra.run.smithi195.stdout:(4/4): kernel-modules-core-5.14.0-391.el9.x86_6 22 MB/s | 32 MB 00:01 2023-12-16T20:03:35.320 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:03:35.320 INFO:teuthology.orchestra.run.smithi195.stdout:Total 47 MB/s | 96 MB 00:02 2023-12-16T20:03:36.175 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2023-12-16T20:03:36.527 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2023-12-16T20:03:36.527 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2023-12-16T20:03:36.778 INFO:teuthology.orchestra.run.smithi087.stdout:(2/4): kernel-modules-5.14.0-391.el9.x86_64.rpm 10 MB/s | 38 MB 00:03 2023-12-16T20:03:37.179 INFO:teuthology.orchestra.run.smithi087.stdout:(3/4): kernel-modules-core-5.14.0-391.el9.x86_6 9.8 MB/s | 32 MB 00:03 2023-12-16T20:03:37.829 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2023-12-16T20:03:37.829 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2023-12-16T20:03:38.062 INFO:teuthology.orchestra.run.smithi087.stdout:(4/4): kernel-core-5.14.0-391.el9.x86_64.rpm 4.1 MB/s | 20 MB 00:04 2023-12-16T20:03:38.062 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:03:38.062 INFO:teuthology.orchestra.run.smithi087.stdout:Total 19 MB/s | 96 MB 00:04 2023-12-16T20:03:38.916 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2023-12-16T20:03:39.274 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2023-12-16T20:03:39.275 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2023-12-16T20:03:40.584 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2023-12-16T20:03:40.584 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2023-12-16T20:03:40.707 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2023-12-16T20:03:41.365 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-modules-core-5.14.0-391.el9.x86_64 1/4 2023-12-16T20:03:41.494 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T20:03:43.482 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2023-12-16T20:03:44.116 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-modules-core-5.14.0-391.el9.x86_64 1/4 2023-12-16T20:03:44.235 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T20:03:44.246 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T20:03:44.413 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T20:03:46.992 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T20:03:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T20:03:49.053 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T20:03:49.164 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-5.14.0-391.el9.x86_64 4/4 2023-12-16T20:03:51.822 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T20:03:51.948 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-5.14.0-391.el9.x86_64 4/4 2023-12-16T20:03:53.826 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T20:03:56.573 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T20:04:22.945 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T20:04:22.989 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 4/4 2023-12-16T20:04:23.418 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-5.14.0-391.el9.x86_64 4/4 2023-12-16T20:04:23.418 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-5.14.0-391.el9.x86_64 1/4 2023-12-16T20:04:23.418 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T20:04:23.418 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T20:04:23.844 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T20:04:23.844 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:04:23.845 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2023-12-16T20:04:23.845 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-5.14.0-391.el9.x86_64 2023-12-16T20:04:23.845 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-core-5.14.0-391.el9.x86_64 2023-12-16T20:04:23.845 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-5.14.0-391.el9.x86_64 2023-12-16T20:04:23.845 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-core-5.14.0-391.el9.x86_64 2023-12-16T20:04:23.845 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:04:23.845 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2023-12-16T20:04:24.355 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T20:04:24.500 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-16T20:04:24.500 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-16T20:04:24.501 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-391.el9.x86_64 2023-12-16T20:04:24.501 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-16T20:04:24.501 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-16T20:04:24.501 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-12-16T20:04:24.501 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi195.front.sepia.ceph.com, path=None, version=distro) 2023-12-16T20:04:24.501 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T20:04:24.619 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-16T20:04:24.619 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-16T20:04:24.619 DEBUG:teuthology.orchestra.run.smithi195:> sudo rpm -qi grub2-tools 2023-12-16T20:04:24.655 INFO:teuthology.orchestra.run.smithi195.stdout:Name : grub2-tools 2023-12-16T20:04:24.655 INFO:teuthology.orchestra.run.smithi195.stdout:Epoch : 1 2023-12-16T20:04:24.655 INFO:teuthology.orchestra.run.smithi195.stdout:Version : 2.06 2023-12-16T20:04:24.655 INFO:teuthology.orchestra.run.smithi195.stdout:Release : 68.el9 2023-12-16T20:04:24.656 INFO:teuthology.orchestra.run.smithi195.stdout:Architecture: x86_64 2023-12-16T20:04:24.656 INFO:teuthology.orchestra.run.smithi195.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-16T20:04:24.656 INFO:teuthology.orchestra.run.smithi195.stdout:Group : Unspecified 2023-12-16T20:04:24.656 INFO:teuthology.orchestra.run.smithi195.stdout:Size : 8264254 2023-12-16T20:04:24.656 INFO:teuthology.orchestra.run.smithi195.stdout:License : GPLv3+ 2023-12-16T20:04:24.656 INFO:teuthology.orchestra.run.smithi195.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-16T20:04:24.656 INFO:teuthology.orchestra.run.smithi195.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-16T20:04:24.656 INFO:teuthology.orchestra.run.smithi195.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-16T20:04:24.656 INFO:teuthology.orchestra.run.smithi195.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-16T20:04:24.656 INFO:teuthology.orchestra.run.smithi195.stdout:Packager : builder@centos.org 2023-12-16T20:04:24.656 INFO:teuthology.orchestra.run.smithi195.stdout:Vendor : CentOS 2023-12-16T20:04:24.656 INFO:teuthology.orchestra.run.smithi195.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-16T20:04:24.656 INFO:teuthology.orchestra.run.smithi195.stdout:Summary : Support tools for GRUB. 2023-12-16T20:04:24.656 INFO:teuthology.orchestra.run.smithi195.stdout:Description : 2023-12-16T20:04:24.657 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:04:24.657 INFO:teuthology.orchestra.run.smithi195.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-16T20:04:24.657 INFO:teuthology.orchestra.run.smithi195.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-16T20:04:24.657 INFO:teuthology.orchestra.run.smithi195.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-16T20:04:24.657 INFO:teuthology.orchestra.run.smithi195.stdout:hardware devices. 2023-12-16T20:04:24.657 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:04:24.657 INFO:teuthology.orchestra.run.smithi195.stdout:This subpackage provides tools for support of all platforms. 2023-12-16T20:04:24.658 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-16T20:04:24.658 INFO:teuthology.task.kernel:Updating grub on smithi195 to boot 5.14.0-391.el9.x86_64 2023-12-16T20:04:24.658 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-16T20:04:25.239 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2023-12-16T20:04:25.588 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T20:04:25.630 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 4/4 2023-12-16T20:04:26.014 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-5.14.0-391.el9.x86_64 4/4 2023-12-16T20:04:26.014 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-5.14.0-391.el9.x86_64 1/4 2023-12-16T20:04:26.014 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-16T20:04:26.014 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-16T20:04:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-16T20:04:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:04:26.453 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2023-12-16T20:04:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-5.14.0-391.el9.x86_64 2023-12-16T20:04:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-core-5.14.0-391.el9.x86_64 2023-12-16T20:04:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-5.14.0-391.el9.x86_64 2023-12-16T20:04:26.454 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-core-5.14.0-391.el9.x86_64 2023-12-16T20:04:26.454 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:04:26.454 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2023-12-16T20:04:26.567 INFO:teuthology.orchestra.run.smithi195.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-16T20:04:26.598 INFO:teuthology.orchestra.run.smithi195.stderr:done 2023-12-16T20:04:26.600 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2023-12-16T20:04:26.615 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.h9Gz740z1u 2023-12-16T20:04:26.615 DEBUG:teuthology.orchestra.run.smithi195:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.h9Gz740z1u 2023-12-16T20:04:26.683 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.h9Gz740z1u 2023-12-16T20:04:26.827 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.h9Gz740z1u is 6KB 2023-12-16T20:04:26.875 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.h9Gz740z1u 2023-12-16T20:04:26.889 DEBUG:teuthology.orchestra.run.smithi195:> sudo /bin/ls /boot/loader/entries || true 2023-12-16T20:04:26.951 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T20:04:26.954 INFO:teuthology.orchestra.run.smithi195.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-16T20:04:26.954 INFO:teuthology.orchestra.run.smithi195.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-16T20:04:26.954 INFO:teuthology.orchestra.run.smithi195.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-16T20:04:26.954 INFO:teuthology.orchestra.run.smithi195.stdout:15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64.conf 2023-12-16T20:04:26.955 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64 2023-12-16T20:04:27.097 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-16T20:04:27.098 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-16T20:04:27.098 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-391.el9.x86_64 2023-12-16T20:04:27.098 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-16T20:04:27.098 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-16T20:04:27.099 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-12-16T20:04:27.099 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi087.front.sepia.ceph.com, path=None, version=distro) 2023-12-16T20:04:27.099 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T20:04:27.121 DEBUG:teuthology.orchestra.run.smithi195:> sudo shutdown -r now 2023-12-16T20:04:27.216 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-16T20:04:27.216 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-16T20:04:27.216 DEBUG:teuthology.orchestra.run.smithi087:> sudo rpm -qi grub2-tools 2023-12-16T20:04:27.259 INFO:teuthology.orchestra.run.smithi087.stdout:Name : grub2-tools 2023-12-16T20:04:27.259 INFO:teuthology.orchestra.run.smithi087.stdout:Epoch : 1 2023-12-16T20:04:27.259 INFO:teuthology.orchestra.run.smithi087.stdout:Version : 2.06 2023-12-16T20:04:27.259 INFO:teuthology.orchestra.run.smithi087.stdout:Release : 68.el9 2023-12-16T20:04:27.260 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: x86_64 2023-12-16T20:04:27.260 INFO:teuthology.orchestra.run.smithi087.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-16T20:04:27.260 INFO:teuthology.orchestra.run.smithi087.stdout:Group : Unspecified 2023-12-16T20:04:27.260 INFO:teuthology.orchestra.run.smithi087.stdout:Size : 8264254 2023-12-16T20:04:27.260 INFO:teuthology.orchestra.run.smithi087.stdout:License : GPLv3+ 2023-12-16T20:04:27.260 INFO:teuthology.orchestra.run.smithi087.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-16T20:04:27.260 INFO:teuthology.orchestra.run.smithi087.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-16T20:04:27.261 INFO:teuthology.orchestra.run.smithi087.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-16T20:04:27.261 INFO:teuthology.orchestra.run.smithi087.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-16T20:04:27.261 INFO:teuthology.orchestra.run.smithi087.stdout:Packager : builder@centos.org 2023-12-16T20:04:27.261 INFO:teuthology.orchestra.run.smithi087.stdout:Vendor : CentOS 2023-12-16T20:04:27.261 INFO:teuthology.orchestra.run.smithi087.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-16T20:04:27.261 INFO:teuthology.orchestra.run.smithi087.stdout:Summary : Support tools for GRUB. 2023-12-16T20:04:27.261 INFO:teuthology.orchestra.run.smithi087.stdout:Description : 2023-12-16T20:04:27.262 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:04:27.262 INFO:teuthology.orchestra.run.smithi087.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-16T20:04:27.262 INFO:teuthology.orchestra.run.smithi087.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-16T20:04:27.262 INFO:teuthology.orchestra.run.smithi087.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-16T20:04:27.262 INFO:teuthology.orchestra.run.smithi087.stdout:hardware devices. 2023-12-16T20:04:27.262 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:04:27.262 INFO:teuthology.orchestra.run.smithi087.stdout:This subpackage provides tools for support of all platforms. 2023-12-16T20:04:27.263 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-16T20:04:27.263 INFO:teuthology.task.kernel:Updating grub on smithi087 to boot 5.14.0-391.el9.x86_64 2023-12-16T20:04:27.264 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-16T20:04:27.897 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2023-12-16T20:04:29.293 INFO:teuthology.orchestra.run.smithi087.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-16T20:04:29.336 INFO:teuthology.orchestra.run.smithi087.stderr:done 2023-12-16T20:04:29.339 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2023-12-16T20:04:29.354 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.jVTiJF9DGY 2023-12-16T20:04:29.354 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jVTiJF9DGY 2023-12-16T20:04:29.422 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.jVTiJF9DGY 2023-12-16T20:04:29.567 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.jVTiJF9DGY is 6KB 2023-12-16T20:04:29.587 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.jVTiJF9DGY 2023-12-16T20:04:29.601 DEBUG:teuthology.orchestra.run.smithi087:> sudo /bin/ls /boot/loader/entries || true 2023-12-16T20:04:29.666 INFO:teuthology.orchestra.run.smithi087.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-16T20:04:29.666 INFO:teuthology.orchestra.run.smithi087.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-16T20:04:29.666 INFO:teuthology.orchestra.run.smithi087.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-16T20:04:29.666 INFO:teuthology.orchestra.run.smithi087.stdout:15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64.conf 2023-12-16T20:04:29.667 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64 2023-12-16T20:04:29.822 DEBUG:teuthology.orchestra.run.smithi087:> sudo shutdown -r now 2023-12-16T20:04:57.149 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-16T20:04:57.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-12-16T20:04:57.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T20:04:59.826 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-16T20:04:59.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-12-16T20:04:59.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T20:05:15.666 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-16T20:05:18.229 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-12-16T20:05:24.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-12-16T20:05:24.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T20:05:27.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-12-16T20:05:27.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T20:05:27.733 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-16T20:05:30.293 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-12-16T20:05:39.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-12-16T20:05:39.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T20:05:42.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-12-16T20:05:42.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T20:06:11.949 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-12-16T20:06:12.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-12-16T20:06:12.428 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-391.el9.x86_64"... 2023-12-16T20:06:12.429 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2023-12-16T20:06:12.451 INFO:teuthology.orchestra.run.smithi195.stdout:5.14.0-391.el9.x86_64 2023-12-16T20:06:12.451 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-391.el9.x86_64 vs 5.14.0-391.el9.x86_64 2023-12-16T20:06:12.451 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-16T20:06:12.451 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-16T20:06:13.452 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-16T20:06:13.452 DEBUG:teuthology.orchestra.run.smithi195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-16T20:06:13.515 INFO:teuthology.orchestra.run.smithi195.stdout:ttyS1 2023-12-16T20:06:13.641 DEBUG:teuthology.parallel:result is None 2023-12-16T20:06:14.140 DEBUG:teuthology.orchestra.run.smithi087:> true 2023-12-16T20:06:14.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-12-16T20:06:14.502 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-391.el9.x86_64"... 2023-12-16T20:06:14.502 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2023-12-16T20:06:14.516 INFO:teuthology.orchestra.run.smithi087.stdout:5.14.0-391.el9.x86_64 2023-12-16T20:06:14.516 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-391.el9.x86_64 vs 5.14.0-391.el9.x86_64 2023-12-16T20:06:14.516 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-16T20:06:14.516 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-16T20:06:15.517 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-16T20:06:15.517 DEBUG:teuthology.orchestra.run.smithi087:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-16T20:06:15.602 INFO:teuthology.orchestra.run.smithi087.stdout:ttyS1 2023-12-16T20:06:15.641 DEBUG:teuthology.parallel:result is None 2023-12-16T20:06:15.642 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-16T20:06:15.649 INFO:teuthology.task.internal:Creating test directory... 2023-12-16T20:06:15.649 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-16T20:06:15.652 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-16T20:06:15.675 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-16T20:06:15.682 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-16T20:06:15.689 INFO:teuthology.task.internal:Creating archive directory... 2023-12-16T20:06:15.689 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-16T20:06:15.718 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-16T20:06:15.756 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-16T20:06:15.763 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-16T20:06:15.764 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-16T20:06:15.794 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-16T20:06:15.834 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T20:06:15.849 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T20:06:15.853 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T20:06:15.873 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T20:06:15.875 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-16T20:06:15.882 INFO:teuthology.task.internal:Configuring sudo... 2023-12-16T20:06:15.882 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-16T20:06:15.885 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-16T20:06:15.928 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-16T20:06:15.937 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-16T20:06:15.937 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-16T20:06:15.940 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-16T20:06:15.975 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T20:06:16.059 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T20:06:16.108 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T20:06:16.189 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T20:06:16.231 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:06:16.231 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-16T20:06:16.299 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T20:06:16.344 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T20:06:16.396 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T20:06:16.479 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T20:06:16.523 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:06:16.523 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-16T20:06:16.591 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2023-12-16T20:06:16.593 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2023-12-16T20:06:16.672 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T20:06:16.709 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T20:06:17.179 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-16T20:06:17.188 INFO:teuthology.task.internal:Starting timer... 2023-12-16T20:06:17.188 INFO:teuthology.run_tasks:Running task pcp... 2023-12-16T20:06:17.198 INFO:teuthology.run_tasks:Running task selinux... 2023-12-16T20:06:17.207 DEBUG:teuthology.orchestra.run.smithi087:> sudo service auditd rotate 2023-12-16T20:06:17.267 INFO:teuthology.orchestra.run.smithi087.stdout:Rotating logs: 2023-12-16T20:06:17.268 DEBUG:teuthology.orchestra.run.smithi195:> sudo service auditd rotate 2023-12-16T20:06:17.331 INFO:teuthology.orchestra.run.smithi195.stdout:Rotating logs: 2023-12-16T20:06:17.333 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-16T20:06:17.333 DEBUG:teuthology.orchestra.run.smithi087:> /usr/sbin/getenforce 2023-12-16T20:06:17.353 INFO:teuthology.orchestra.run.smithi087.stdout:Permissive 2023-12-16T20:06:17.353 DEBUG:teuthology.orchestra.run.smithi195:> /usr/sbin/getenforce 2023-12-16T20:06:17.393 INFO:teuthology.orchestra.run.smithi195.stdout:Permissive 2023-12-16T20:06:17.393 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi087.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi195.front.sepia.ceph.com': 'permissive'} 2023-12-16T20:06:17.394 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T20:06:17.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T20:06:17.421 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T20:06:17.461 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T20:06:17.461 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-16T20:06:17.462 DEBUG:teuthology.orchestra.run.smithi087:> sudo /usr/sbin/setenforce permissive 2023-12-16T20:06:17.497 DEBUG:teuthology.orchestra.run.smithi195:> sudo /usr/sbin/setenforce permissive 2023-12-16T20:06:17.536 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-16T20:06:17.547 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-16T20:06:17.554 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-16T20:06:17.679 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-16T20:06:17.698 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-16T20:06:17.699 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi087.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-16T20:11:56.522 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi087.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2023-12-16T20:11:56.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-12-16T20:11:56.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T20:11:56.608 DEBUG:teuthology.orchestra.run.smithi087:> true 2023-12-16T20:11:56.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-12-16T20:11:56.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-12-16T20:11:56.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T20:11:56.765 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-12-16T20:11:56.833 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-12-16T20:11:56.834 INFO:teuthology.run_tasks:Running task clock... 2023-12-16T20:11:56.844 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-16T20:11:56.844 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-16T20:11:56.844 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T20:11:56.847 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-16T20:11:56.847 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T20:11:56.875 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-16T20:11:56.892 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-16T20:11:56.905 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-16T20:11:56.920 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: ntpd: command not found 2023-12-16T20:11:56.924 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-16T20:11:56.934 INFO:teuthology.orchestra.run.smithi087.stdout:506 Cannot talk to daemon 2023-12-16T20:11:56.950 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-16T20:11:56.951 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: ntpd: command not found 2023-12-16T20:11:56.965 INFO:teuthology.orchestra.run.smithi195.stdout:506 Cannot talk to daemon 2023-12-16T20:11:56.967 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-16T20:11:56.981 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-16T20:11:56.997 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-16T20:11:57.009 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2023-12-16T20:11:57.012 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T20:11:57.012 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2023-12-16T20:11:57.012 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:11:57.012 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:11:57.012 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:11:57.012 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:11:57.040 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2023-12-16T20:11:57.043 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T20:11:57.043 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2023-12-16T20:11:57.043 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:11:57.043 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:11:57.043 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:11:57.043 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:11:57.044 INFO:teuthology.run_tasks:Running task install... 2023-12-16T20:11:57.053 DEBUG:teuthology.task.install:project ceph 2023-12-16T20:11:57.053 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9'}} 2023-12-16T20:11:57.053 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9'} 2023-12-16T20:11:57.053 INFO:teuthology.task.install:Using flavor: default 2023-12-16T20:11:57.059 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2023-12-16T20:11:57.059 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-16T20:11:57.059 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9', 'tag': None, 'wait_for_package': False} 2023-12-16T20:11:57.060 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:11:57.062 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9', 'tag': None, 'wait_for_package': False} 2023-12-16T20:11:57.062 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:11:57.282 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/centos/9/flavors/default/ 2023-12-16T20:11:57.282 INFO:teuthology.task.install.rpm:Package version is 19.0.0-202.gc7586e95 2023-12-16T20:11:57.287 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/centos/9/flavors/default/ 2023-12-16T20:11:57.287 INFO:teuthology.task.install.rpm:Package version is 19.0.0-202.gc7586e95 2023-12-16T20:11:57.392 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-16T20:11:57.393 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:11:57.393 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-16T20:11:57.410 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-16T20:11:57.410 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:11:57.410 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-16T20:11:57.421 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-16T20:11:57.422 DEBUG:teuthology.orchestra.run.smithi087:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c7586e95519b7be76f3b6e3a4b333888baf46bc9/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-16T20:11:57.438 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-16T20:11:57.438 DEBUG:teuthology.orchestra.run.smithi195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c7586e95519b7be76f3b6e3a4b333888baf46bc9/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-16T20:11:57.490 DEBUG:teuthology.orchestra.run.smithi087:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-16T20:11:57.506 DEBUG:teuthology.orchestra.run.smithi195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-16T20:11:57.570 DEBUG:teuthology.orchestra.run.smithi087:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-16T20:11:57.587 DEBUG:teuthology.orchestra.run.smithi195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-16T20:11:57.636 INFO:teuthology.orchestra.run.smithi087.stdout:check_obsoletes = 1 2023-12-16T20:11:57.638 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum clean all 2023-12-16T20:11:57.652 INFO:teuthology.orchestra.run.smithi195.stdout:check_obsoletes = 1 2023-12-16T20:11:57.655 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum clean all 2023-12-16T20:11:57.876 INFO:teuthology.orchestra.run.smithi087.stdout:73 files removed 2023-12-16T20:11:57.888 INFO:teuthology.orchestra.run.smithi195.stdout:73 files removed 2023-12-16T20:11:57.902 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-16T20:11:57.916 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-16T20:11:58.651 INFO:teuthology.orchestra.run.smithi195.stdout:ceph packages for x86_64 187 kB/s | 78 kB 00:00 2023-12-16T20:11:58.685 INFO:teuthology.orchestra.run.smithi087.stdout:ceph packages for x86_64 170 kB/s | 78 kB 00:00 2023-12-16T20:11:58.985 INFO:teuthology.orchestra.run.smithi195.stdout:ceph noarch packages 33 kB/s | 9.5 kB 00:00 2023-12-16T20:11:59.044 INFO:teuthology.orchestra.run.smithi087.stdout:ceph noarch packages 31 kB/s | 9.5 kB 00:00 2023-12-16T20:11:59.361 INFO:teuthology.orchestra.run.smithi195.stdout:ceph source packages 5.5 kB/s | 1.9 kB 00:00 2023-12-16T20:11:59.420 INFO:teuthology.orchestra.run.smithi087.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2023-12-16T20:11:59.738 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS-9 - AppStream 19 MB/s | 6.4 MB 00:00 2023-12-16T20:11:59.956 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2023-12-16T20:12:01.063 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS-9 - BaseOS 7.9 MB/s | 2.0 MB 00:00 2023-12-16T20:12:01.281 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS-9 - BaseOS 7.5 MB/s | 2.0 MB 00:00 2023-12-16T20:12:02.162 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 7.9 MB 00:00 2023-12-16T20:12:02.397 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 7.9 MB 00:00 2023-12-16T20:12:03.855 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 30 MB/s | 18 MB 00:00 2023-12-16T20:12:07.798 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 11 MB/s | 5.8 MB 00:00 2023-12-16T20:12:09.474 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 15 kB 00:00 2023-12-16T20:12:11.411 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-12-16T20:12:16.200 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2023-12-16T20:12:16.797 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 1.4 MB/s | 18 MB 00:13 2023-12-16T20:12:18.582 INFO:teuthology.orchestra.run.smithi195.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-16T20:12:18.583 INFO:teuthology.orchestra.run.smithi195.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-16T20:12:18.610 INFO:teuthology.orchestra.run.smithi195.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-16T20:12:18.610 INFO:teuthology.orchestra.run.smithi195.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-16T20:12:18.611 INFO:teuthology.orchestra.run.smithi195.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-16T20:12:18.613 INFO:teuthology.orchestra.run.smithi195.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-16T20:12:18.614 INFO:teuthology.orchestra.run.smithi195.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-16T20:12:18.616 INFO:teuthology.orchestra.run.smithi195.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-16T20:12:18.617 INFO:teuthology.orchestra.run.smithi195.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-16T20:12:18.691 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2023-12-16T20:12:18.713 INFO:teuthology.orchestra.run.smithi195.stdout:=================================================================================================== 2023-12-16T20:12:18.713 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2023-12-16T20:12:18.713 INFO:teuthology.orchestra.run.smithi195.stdout:=================================================================================================== 2023-12-16T20:12:18.713 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2023-12-16T20:12:18.713 INFO:teuthology.orchestra.run.smithi195.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-16T20:12:18.714 INFO:teuthology.orchestra.run.smithi195.stdout: ceph x86_64 2:19.0.0-202.gc7586e95.el9 ceph 6.5 k 2023-12-16T20:12:18.714 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base x86_64 2:19.0.0-202.gc7586e95.el9 ceph 5.2 M 2023-12-16T20:12:18.714 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 73 M 2023-12-16T20:12:18.714 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 409 M 2023-12-16T20:12:18.714 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse x86_64 2:19.0.0-202.gc7586e95.el9 ceph 861 k 2023-12-16T20:12:18.714 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 5.8 M 2023-12-16T20:12:18.714 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-202.gc7586e95.el9 ceph 141 k 2023-12-16T20:12:18.714 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 1.4 M 2023-12-16T20:12:18.714 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 47 M 2023-12-16T20:12:18.714 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr x86_64 2:19.0.0-202.gc7586e95.el9 ceph 1.5 M 2023-12-16T20:12:18.714 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 133 k 2023-12-16T20:12:18.715 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 1.8 M 2023-12-16T20:12:18.715 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 19 M 2023-12-16T20:12:18.715 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 7.4 M 2023-12-16T20:12:18.715 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 50 k 2023-12-16T20:12:18.715 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 112 M 2023-12-16T20:12:18.715 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 312 M 2023-12-16T20:12:18.715 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw x86_64 2:19.0.0-202.gc7586e95.el9 ceph 8.6 M 2023-12-16T20:12:18.715 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 171 M 2023-12-16T20:12:18.715 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test x86_64 2:19.0.0-202.gc7586e95.el9 ceph 41 M 2023-12-16T20:12:18.715 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 622 M 2023-12-16T20:12:18.715 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 262 k 2023-12-16T20:12:18.715 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 805 k 2023-12-16T20:12:18.715 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror x86_64 2:19.0.0-202.gc7586e95.el9 ceph 217 k 2023-12-16T20:12:18.715 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-shell x86_64 2:19.0.0-202.gc7586e95.el9 ceph 27 k 2023-12-16T20:12:18.716 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-top noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 18 k 2023-12-16T20:12:18.716 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-16T20:12:18.716 INFO:teuthology.orchestra.run.smithi195.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-16T20:12:18.716 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-16T20:12:18.716 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel x86_64 2:19.0.0-202.gc7586e95.el9 ceph 31 k 2023-12-16T20:12:18.716 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 x86_64 2:19.0.0-202.gc7586e95.el9 ceph 719 k 2023-12-16T20:12:18.716 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 5.2 M 2023-12-16T20:12:18.716 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel x86_64 2:19.0.0-202.gc7586e95.el9 ceph 126 k 2023-12-16T20:12:18.716 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 108 k 2023-12-16T20:12:18.716 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 44 M 2023-12-16T20:12:18.716 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 50 M 2023-12-16T20:12:18.716 INFO:teuthology.orchestra.run.smithi195.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-16T20:12:18.716 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-16T20:12:18.717 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-16T20:12:18.717 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-16T20:12:18.717 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-16T20:12:18.717 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-16T20:12:18.717 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs x86_64 2:19.0.0-202.gc7586e95.el9 ceph 162 k 2023-12-16T20:12:18.717 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 615 k 2023-12-16T20:12:18.717 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados x86_64 2:19.0.0-202.gc7586e95.el9 ceph 320 k 2023-12-16T20:12:18.717 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 770 k 2023-12-16T20:12:18.717 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd x86_64 2:19.0.0-202.gc7586e95.el9 ceph 298 k 2023-12-16T20:12:18.717 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 1.1 M 2023-12-16T20:12:18.717 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw x86_64 2:19.0.0-202.gc7586e95.el9 ceph 99 k 2023-12-16T20:12:18.717 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 337 k 2023-12-16T20:12:18.717 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse x86_64 2:19.0.0-202.gc7586e95.el9 ceph 85 k 2023-12-16T20:12:18.717 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 507 k 2023-12-16T20:12:18.718 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror x86_64 2:19.0.0-202.gc7586e95.el9 ceph 3.0 M 2023-12-16T20:12:18.718 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 50 M 2023-12-16T20:12:18.718 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd x86_64 2:19.0.0-202.gc7586e95.el9 ceph 170 k 2023-12-16T20:12:18.718 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 1.2 M 2023-12-16T20:12:18.718 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-16T20:12:18.718 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrading: 2023-12-16T20:12:18.718 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-16T20:12:18.718 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-16T20:12:18.718 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-16T20:12:18.718 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-16T20:12:18.718 INFO:teuthology.orchestra.run.smithi195.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-16T20:12:18.718 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-16T20:12:18.718 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-16T20:12:18.718 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-16T20:12:18.719 INFO:teuthology.orchestra.run.smithi195.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-16T20:12:18.719 INFO:teuthology.orchestra.run.smithi195.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-16T20:12:18.719 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 x86_64 2:19.0.0-202.gc7586e95.el9 ceph 3.3 M 2023-12-16T20:12:18.719 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1 x86_64 2:19.0.0-202.gc7586e95.el9 ceph 3.0 M 2023-12-16T20:12:18.719 INFO:teuthology.orchestra.run.smithi195.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-16T20:12:18.719 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-16T20:12:18.719 INFO:teuthology.orchestra.run.smithi195.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-16T20:12:18.719 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2023-12-16T20:12:18.719 INFO:teuthology.orchestra.run.smithi195.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-16T20:12:18.719 INFO:teuthology.orchestra.run.smithi195.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-16T20:12:18.719 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common x86_64 2:19.0.0-202.gc7586e95.el9 ceph 19 M 2023-12-16T20:12:18.719 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 21 M 2023-12-16T20:12:18.719 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 28 k 2023-12-16T20:12:18.720 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds x86_64 2:19.0.0-202.gc7586e95.el9 ceph 2.1 M 2023-12-16T20:12:18.720 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 243 k 2023-12-16T20:12:18.720 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon x86_64 2:19.0.0-202.gc7586e95.el9 ceph 4.4 M 2023-12-16T20:12:18.720 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd x86_64 2:19.0.0-202.gc7586e95.el9 ceph 18 M 2023-12-16T20:12:18.720 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 15 k 2023-12-16T20:12:18.720 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux x86_64 2:19.0.0-202.gc7586e95.el9 ceph 24 k 2023-12-16T20:12:18.720 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-16T20:12:18.720 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-16T20:12:18.720 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-16T20:12:18.720 INFO:teuthology.orchestra.run.smithi195.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-16T20:12:18.720 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-16T20:12:18.720 INFO:teuthology.orchestra.run.smithi195.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-16T20:12:18.720 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-16T20:12:18.720 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-16T20:12:18.721 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite x86_64 2:19.0.0-202.gc7586e95.el9 ceph 164 k 2023-12-16T20:12:18.721 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-16T20:12:18.721 INFO:teuthology.orchestra.run.smithi195.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-16T20:12:18.721 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-16T20:12:18.721 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-16T20:12:18.721 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-16T20:12:18.721 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 x86_64 2:19.0.0-202.gc7586e95.el9 ceph 476 k 2023-12-16T20:12:18.721 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-16T20:12:18.721 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 x86_64 2:19.0.0-202.gc7586e95.el9 ceph 4.8 M 2023-12-16T20:12:18.721 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-16T20:12:18.721 INFO:teuthology.orchestra.run.smithi195.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-16T20:12:18.721 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-16T20:12:18.721 INFO:teuthology.orchestra.run.smithi195.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-16T20:12:18.722 INFO:teuthology.orchestra.run.smithi195.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-16T20:12:18.722 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-16T20:12:18.722 INFO:teuthology.orchestra.run.smithi195.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-16T20:12:18.722 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-16T20:12:18.722 INFO:teuthology.orchestra.run.smithi195.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-16T20:12:18.722 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-16T20:12:18.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-16T20:12:18.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-16T20:12:18.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-16T20:12:18.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-16T20:12:18.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-16T20:12:18.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse x86_64 2:19.0.0-202.gc7586e95.el9 ceph 45 k 2023-12-16T20:12:18.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common x86_64 2:19.0.0-202.gc7586e95.el9 ceph 130 k 2023-12-16T20:12:18.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-16T20:12:18.722 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-16T20:12:18.723 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-16T20:12:18.723 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-16T20:12:18.723 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-16T20:12:18.723 INFO:teuthology.orchestra.run.smithi195.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-16T20:12:18.723 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-16T20:12:18.723 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-16T20:12:18.723 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-16T20:12:18.723 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-16T20:12:18.723 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-16T20:12:18.723 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-16T20:12:18.723 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-16T20:12:18.723 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-16T20:12:18.723 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-16T20:12:18.723 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-16T20:12:18.724 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-16T20:12:18.724 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-16T20:12:18.724 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-16T20:12:18.724 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-16T20:12:18.724 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-16T20:12:18.724 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-16T20:12:18.724 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-16T20:12:18.724 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-16T20:12:18.724 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-16T20:12:18.724 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-16T20:12:18.724 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-16T20:12:18.724 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-16T20:12:18.724 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-16T20:12:18.724 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-16T20:12:18.724 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-16T20:12:18.725 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-16T20:12:18.725 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-16T20:12:18.725 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-16T20:12:18.725 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-16T20:12:18.725 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-16T20:12:18.725 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-16T20:12:18.725 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-16T20:12:18.725 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-16T20:12:18.725 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-16T20:12:18.725 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-16T20:12:18.725 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-16T20:12:18.725 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-16T20:12:18.725 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-16T20:12:18.726 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-16T20:12:18.726 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-16T20:12:18.726 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-16T20:12:18.726 INFO:teuthology.orchestra.run.smithi195.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-16T20:12:18.726 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-16T20:12:18.726 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-16T20:12:18.726 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-16T20:12:18.726 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-16T20:12:18.726 INFO:teuthology.orchestra.run.smithi195.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-16T20:12:18.726 INFO:teuthology.orchestra.run.smithi195.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-16T20:12:18.726 INFO:teuthology.orchestra.run.smithi195.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-16T20:12:18.726 INFO:teuthology.orchestra.run.smithi195.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-16T20:12:18.726 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-16T20:12:18.726 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-16T20:12:18.726 INFO:teuthology.orchestra.run.smithi195.stdout:Installing weak dependencies: 2023-12-16T20:12:18.727 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-16T20:12:18.727 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:12:18.727 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2023-12-16T20:12:18.727 INFO:teuthology.orchestra.run.smithi195.stdout:=================================================================================================== 2023-12-16T20:12:18.727 INFO:teuthology.orchestra.run.smithi195.stdout:Install 162 Packages 2023-12-16T20:12:18.727 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrade 15 Packages 2023-12-16T20:12:18.727 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:12:18.728 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 2.1 G 2023-12-16T20:12:18.728 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2023-12-16T20:12:19.323 INFO:teuthology.orchestra.run.smithi195.stdout:(1/177): ceph-19.0.0-202.gc7586e95.el9.x86_64.r 39 kB/s | 6.5 kB 00:00 2023-12-16T20:12:20.914 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 5.8 MB 00:00 2023-12-16T20:12:21.315 INFO:teuthology.orchestra.run.smithi195.stdout:(2/177): ceph-common-19.0.0-202.gc7586e95.el9.x 9.6 MB/s | 19 MB 00:01 2023-12-16T20:12:21.508 INFO:teuthology.orchestra.run.smithi195.stdout:(3/177): ceph-base-19.0.0-202.gc7586e95.el9.x86 2.2 MB/s | 5.2 MB 00:02 2023-12-16T20:12:22.757 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 15 kB 00:00 2023-12-16T20:12:23.892 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2023-12-16T20:12:24.916 INFO:teuthology.orchestra.run.smithi195.stdout:(4/177): ceph-base-debuginfo-19.0.0-202.gc7586e 13 MB/s | 73 MB 00:05 2023-12-16T20:12:25.041 INFO:teuthology.orchestra.run.smithi195.stdout:(5/177): ceph-fuse-19.0.0-202.gc7586e95.el9.x86 6.7 MB/s | 861 kB 00:00 2023-12-16T20:12:25.541 INFO:teuthology.orchestra.run.smithi195.stdout:(6/177): ceph-fuse-debuginfo-19.0.0-202.gc7586e 12 MB/s | 5.8 MB 00:00 2023-12-16T20:12:25.600 INFO:teuthology.orchestra.run.smithi195.stdout:(7/177): ceph-immutable-object-cache-19.0.0-202 2.4 MB/s | 141 kB 00:00 2023-12-16T20:12:25.750 INFO:teuthology.orchestra.run.smithi195.stdout:(8/177): ceph-immutable-object-cache-debuginfo- 9.3 MB/s | 1.4 MB 00:00 2023-12-16T20:12:25.967 INFO:teuthology.orchestra.run.smithi195.stdout:(9/177): ceph-mds-19.0.0-202.gc7586e95.el9.x86_ 9.6 MB/s | 2.1 MB 00:00 2023-12-16T20:12:28.658 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2023-12-16T20:12:29.667 INFO:teuthology.orchestra.run.smithi195.stdout:(10/177): ceph-mds-debuginfo-19.0.0-202.gc7586e 13 MB/s | 47 MB 00:03 2023-12-16T20:12:29.884 INFO:teuthology.orchestra.run.smithi195.stdout:(11/177): ceph-debuginfo-19.0.0-202.gc7586e95.e 2.5 MB/s | 21 MB 00:08 2023-12-16T20:12:29.925 INFO:teuthology.orchestra.run.smithi195.stdout:(12/177): ceph-mgr-19.0.0-202.gc7586e95.el9.x86 5.7 MB/s | 1.5 MB 00:00 2023-12-16T20:12:30.326 INFO:teuthology.orchestra.run.smithi195.stdout:(13/177): ceph-mon-19.0.0-202.gc7586e95.el9.x86 11 MB/s | 4.4 MB 00:00 2023-12-16T20:12:31.081 INFO:teuthology.orchestra.run.smithi087.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-16T20:12:31.082 INFO:teuthology.orchestra.run.smithi087.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-16T20:12:31.115 INFO:teuthology.orchestra.run.smithi087.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-16T20:12:31.116 INFO:teuthology.orchestra.run.smithi087.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-16T20:12:31.117 INFO:teuthology.orchestra.run.smithi087.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-16T20:12:31.118 INFO:teuthology.orchestra.run.smithi087.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-16T20:12:31.120 INFO:teuthology.orchestra.run.smithi087.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-16T20:12:31.122 INFO:teuthology.orchestra.run.smithi087.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-16T20:12:31.124 INFO:teuthology.orchestra.run.smithi087.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-16T20:12:31.201 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2023-12-16T20:12:31.222 INFO:teuthology.orchestra.run.smithi087.stdout:=================================================================================================== 2023-12-16T20:12:31.222 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2023-12-16T20:12:31.222 INFO:teuthology.orchestra.run.smithi087.stdout:=================================================================================================== 2023-12-16T20:12:31.222 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2023-12-16T20:12:31.222 INFO:teuthology.orchestra.run.smithi087.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-16T20:12:31.223 INFO:teuthology.orchestra.run.smithi087.stdout: ceph x86_64 2:19.0.0-202.gc7586e95.el9 ceph 6.5 k 2023-12-16T20:12:31.223 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base x86_64 2:19.0.0-202.gc7586e95.el9 ceph 5.2 M 2023-12-16T20:12:31.223 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 73 M 2023-12-16T20:12:31.223 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 409 M 2023-12-16T20:12:31.223 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse x86_64 2:19.0.0-202.gc7586e95.el9 ceph 861 k 2023-12-16T20:12:31.223 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 5.8 M 2023-12-16T20:12:31.223 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-202.gc7586e95.el9 ceph 141 k 2023-12-16T20:12:31.223 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 1.4 M 2023-12-16T20:12:31.223 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 47 M 2023-12-16T20:12:31.223 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr x86_64 2:19.0.0-202.gc7586e95.el9 ceph 1.5 M 2023-12-16T20:12:31.223 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 133 k 2023-12-16T20:12:31.223 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 1.8 M 2023-12-16T20:12:31.224 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 19 M 2023-12-16T20:12:31.224 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 7.4 M 2023-12-16T20:12:31.224 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 50 k 2023-12-16T20:12:31.224 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 112 M 2023-12-16T20:12:31.224 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 312 M 2023-12-16T20:12:31.224 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw x86_64 2:19.0.0-202.gc7586e95.el9 ceph 8.6 M 2023-12-16T20:12:31.224 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 171 M 2023-12-16T20:12:31.224 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test x86_64 2:19.0.0-202.gc7586e95.el9 ceph 41 M 2023-12-16T20:12:31.224 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 622 M 2023-12-16T20:12:31.224 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 262 k 2023-12-16T20:12:31.224 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 805 k 2023-12-16T20:12:31.224 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-mirror x86_64 2:19.0.0-202.gc7586e95.el9 ceph 217 k 2023-12-16T20:12:31.224 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-shell x86_64 2:19.0.0-202.gc7586e95.el9 ceph 27 k 2023-12-16T20:12:31.224 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-top noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 18 k 2023-12-16T20:12:31.225 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-16T20:12:31.225 INFO:teuthology.orchestra.run.smithi087.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-16T20:12:31.225 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-16T20:12:31.225 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel x86_64 2:19.0.0-202.gc7586e95.el9 ceph 31 k 2023-12-16T20:12:31.225 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2 x86_64 2:19.0.0-202.gc7586e95.el9 ceph 719 k 2023-12-16T20:12:31.225 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 5.2 M 2023-12-16T20:12:31.225 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel x86_64 2:19.0.0-202.gc7586e95.el9 ceph 126 k 2023-12-16T20:12:31.225 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 108 k 2023-12-16T20:12:31.225 INFO:teuthology.orchestra.run.smithi087.stdout: librados2-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 44 M 2023-12-16T20:12:31.225 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 50 M 2023-12-16T20:12:31.225 INFO:teuthology.orchestra.run.smithi087.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-16T20:12:31.225 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-16T20:12:31.225 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-16T20:12:31.225 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-16T20:12:31.226 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-16T20:12:31.226 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-16T20:12:31.226 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs x86_64 2:19.0.0-202.gc7586e95.el9 ceph 162 k 2023-12-16T20:12:31.226 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 615 k 2023-12-16T20:12:31.226 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados x86_64 2:19.0.0-202.gc7586e95.el9 ceph 320 k 2023-12-16T20:12:31.226 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 770 k 2023-12-16T20:12:31.226 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd x86_64 2:19.0.0-202.gc7586e95.el9 ceph 298 k 2023-12-16T20:12:31.226 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 1.1 M 2023-12-16T20:12:31.226 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw x86_64 2:19.0.0-202.gc7586e95.el9 ceph 99 k 2023-12-16T20:12:31.226 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 337 k 2023-12-16T20:12:31.226 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse x86_64 2:19.0.0-202.gc7586e95.el9 ceph 85 k 2023-12-16T20:12:31.226 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 507 k 2023-12-16T20:12:31.226 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror x86_64 2:19.0.0-202.gc7586e95.el9 ceph 3.0 M 2023-12-16T20:12:31.226 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 50 M 2023-12-16T20:12:31.227 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd x86_64 2:19.0.0-202.gc7586e95.el9 ceph 170 k 2023-12-16T20:12:31.227 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 1.2 M 2023-12-16T20:12:31.227 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-16T20:12:31.227 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrading: 2023-12-16T20:12:31.227 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-16T20:12:31.227 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-16T20:12:31.227 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-16T20:12:31.227 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-16T20:12:31.227 INFO:teuthology.orchestra.run.smithi087.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-16T20:12:31.227 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-16T20:12:31.227 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-16T20:12:31.227 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-16T20:12:31.227 INFO:teuthology.orchestra.run.smithi087.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-16T20:12:31.227 INFO:teuthology.orchestra.run.smithi087.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-16T20:12:31.228 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 x86_64 2:19.0.0-202.gc7586e95.el9 ceph 3.3 M 2023-12-16T20:12:31.228 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1 x86_64 2:19.0.0-202.gc7586e95.el9 ceph 3.0 M 2023-12-16T20:12:31.228 INFO:teuthology.orchestra.run.smithi087.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-16T20:12:31.228 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-16T20:12:31.228 INFO:teuthology.orchestra.run.smithi087.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-16T20:12:31.228 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2023-12-16T20:12:31.228 INFO:teuthology.orchestra.run.smithi087.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-16T20:12:31.228 INFO:teuthology.orchestra.run.smithi087.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-16T20:12:31.228 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common x86_64 2:19.0.0-202.gc7586e95.el9 ceph 19 M 2023-12-16T20:12:31.228 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-debuginfo x86_64 2:19.0.0-202.gc7586e95.el9 ceph 21 M 2023-12-16T20:12:31.228 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 28 k 2023-12-16T20:12:31.228 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds x86_64 2:19.0.0-202.gc7586e95.el9 ceph 2.1 M 2023-12-16T20:12:31.228 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 243 k 2023-12-16T20:12:31.228 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon x86_64 2:19.0.0-202.gc7586e95.el9 ceph 4.4 M 2023-12-16T20:12:31.229 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd x86_64 2:19.0.0-202.gc7586e95.el9 ceph 18 M 2023-12-16T20:12:31.229 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts noarch 2:19.0.0-202.gc7586e95.el9 ceph-noarch 15 k 2023-12-16T20:12:31.229 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux x86_64 2:19.0.0-202.gc7586e95.el9 ceph 24 k 2023-12-16T20:12:31.229 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-16T20:12:31.229 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-16T20:12:31.229 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-16T20:12:31.229 INFO:teuthology.orchestra.run.smithi087.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-16T20:12:31.229 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-16T20:12:31.229 INFO:teuthology.orchestra.run.smithi087.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-16T20:12:31.229 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-16T20:12:31.229 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-16T20:12:31.229 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite x86_64 2:19.0.0-202.gc7586e95.el9 ceph 164 k 2023-12-16T20:12:31.229 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-16T20:12:31.229 INFO:teuthology.orchestra.run.smithi087.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-16T20:12:31.230 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-16T20:12:31.230 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-16T20:12:31.230 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-16T20:12:31.230 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 x86_64 2:19.0.0-202.gc7586e95.el9 ceph 476 k 2023-12-16T20:12:31.230 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-16T20:12:31.230 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2 x86_64 2:19.0.0-202.gc7586e95.el9 ceph 4.8 M 2023-12-16T20:12:31.230 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-16T20:12:31.230 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-16T20:12:31.230 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-16T20:12:31.230 INFO:teuthology.orchestra.run.smithi087.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-16T20:12:31.230 INFO:teuthology.orchestra.run.smithi087.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-16T20:12:31.230 INFO:teuthology.orchestra.run.smithi087.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-16T20:12:31.230 INFO:teuthology.orchestra.run.smithi087.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-16T20:12:31.230 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-16T20:12:31.231 INFO:teuthology.orchestra.run.smithi087.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-16T20:12:31.231 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-16T20:12:31.231 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-16T20:12:31.231 INFO:teuthology.orchestra.run.smithi087.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-16T20:12:31.231 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-16T20:12:31.231 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-16T20:12:31.231 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-16T20:12:31.231 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse x86_64 2:19.0.0-202.gc7586e95.el9 ceph 45 k 2023-12-16T20:12:31.231 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common x86_64 2:19.0.0-202.gc7586e95.el9 ceph 130 k 2023-12-16T20:12:31.231 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-16T20:12:31.231 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-16T20:12:31.231 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-16T20:12:31.231 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-16T20:12:31.231 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-16T20:12:31.231 INFO:teuthology.orchestra.run.smithi087.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-16T20:12:31.232 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-16T20:12:31.232 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-16T20:12:31.232 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-16T20:12:31.232 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-16T20:12:31.232 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-16T20:12:31.232 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-16T20:12:31.232 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-16T20:12:31.232 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-16T20:12:31.232 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-16T20:12:31.232 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-16T20:12:31.232 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-16T20:12:31.232 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-16T20:12:31.232 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-16T20:12:31.233 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-16T20:12:31.233 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-16T20:12:31.233 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-16T20:12:31.233 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-16T20:12:31.233 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-16T20:12:31.233 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-16T20:12:31.233 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-16T20:12:31.233 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-16T20:12:31.233 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-16T20:12:31.233 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-16T20:12:31.233 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-16T20:12:31.233 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-16T20:12:31.233 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-16T20:12:31.233 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-16T20:12:31.233 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-16T20:12:31.234 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-16T20:12:31.234 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-16T20:12:31.234 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-16T20:12:31.234 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-16T20:12:31.234 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-16T20:12:31.234 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-16T20:12:31.234 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-16T20:12:31.234 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-16T20:12:31.234 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-16T20:12:31.234 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-16T20:12:31.234 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-16T20:12:31.234 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-16T20:12:31.234 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-16T20:12:31.234 INFO:teuthology.orchestra.run.smithi087.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-16T20:12:31.235 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-16T20:12:31.235 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-16T20:12:31.235 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-16T20:12:31.235 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-16T20:12:31.235 INFO:teuthology.orchestra.run.smithi087.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-16T20:12:31.235 INFO:teuthology.orchestra.run.smithi087.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-16T20:12:31.235 INFO:teuthology.orchestra.run.smithi087.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-16T20:12:31.235 INFO:teuthology.orchestra.run.smithi087.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-16T20:12:31.235 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-16T20:12:31.235 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-16T20:12:31.235 INFO:teuthology.orchestra.run.smithi087.stdout:Installing weak dependencies: 2023-12-16T20:12:31.235 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-16T20:12:31.235 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:12:31.235 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2023-12-16T20:12:31.235 INFO:teuthology.orchestra.run.smithi087.stdout:=================================================================================================== 2023-12-16T20:12:31.236 INFO:teuthology.orchestra.run.smithi087.stdout:Install 162 Packages 2023-12-16T20:12:31.236 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrade 15 Packages 2023-12-16T20:12:31.236 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:12:31.236 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 2.1 G 2023-12-16T20:12:31.236 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2023-12-16T20:12:32.018 INFO:teuthology.orchestra.run.smithi087.stdout:(1/177): ceph-19.0.0-202.gc7586e95.el9.x86_64.r 15 kB/s | 6.5 kB 00:00 2023-12-16T20:12:34.401 INFO:teuthology.orchestra.run.smithi087.stdout:(2/177): ceph-base-19.0.0-202.gc7586e95.el9.x86 1.9 MB/s | 5.2 MB 00:02 2023-12-16T20:12:36.375 INFO:teuthology.orchestra.run.smithi195.stdout:(14/177): ceph-mgr-debuginfo-19.0.0-202.gc7586e 2.9 MB/s | 19 MB 00:06 2023-12-16T20:12:40.309 INFO:teuthology.orchestra.run.smithi195.stdout:(15/177): ceph-mon-debuginfo-19.0.0-202.gc7586e 11 MB/s | 112 MB 00:09 2023-12-16T20:12:42.634 INFO:teuthology.orchestra.run.smithi195.stdout:(16/177): ceph-osd-19.0.0-202.gc7586e95.el9.x86 2.8 MB/s | 18 MB 00:06 2023-12-16T20:12:45.392 INFO:teuthology.orchestra.run.smithi087.stdout:(3/177): ceph-common-19.0.0-202.gc7586e95.el9.x 1.4 MB/s | 19 MB 00:13 2023-12-16T20:12:45.775 INFO:teuthology.orchestra.run.smithi195.stdout:(17/177): ceph-radosgw-19.0.0-202.gc7586e95.el9 2.7 MB/s | 8.6 MB 00:03 2023-12-16T20:12:55.350 INFO:teuthology.orchestra.run.smithi087.stdout:(4/177): ceph-debuginfo-19.0.0-202.gc7586e95.el 2.1 MB/s | 21 MB 00:09 2023-12-16T20:12:55.642 INFO:teuthology.orchestra.run.smithi087.stdout:(5/177): ceph-fuse-19.0.0-202.gc7586e95.el9.x86 2.9 MB/s | 861 kB 00:00 2023-12-16T20:12:57.292 INFO:teuthology.orchestra.run.smithi087.stdout:(6/177): ceph-fuse-debuginfo-19.0.0-202.gc7586e 3.5 MB/s | 5.8 MB 00:01 2023-12-16T20:12:57.401 INFO:teuthology.orchestra.run.smithi087.stdout:(7/177): ceph-immutable-object-cache-19.0.0-202 1.3 MB/s | 141 kB 00:00 2023-12-16T20:12:57.826 INFO:teuthology.orchestra.run.smithi087.stdout:(8/177): ceph-immutable-object-cache-debuginfo- 3.3 MB/s | 1.4 MB 00:00 2023-12-16T20:12:58.434 INFO:teuthology.orchestra.run.smithi087.stdout:(9/177): ceph-mds-19.0.0-202.gc7586e95.el9.x86_ 3.4 MB/s | 2.1 MB 00:00 2023-12-16T20:13:02.651 INFO:teuthology.orchestra.run.smithi087.stdout:(10/177): ceph-base-debuginfo-19.0.0-202.gc7586 2.4 MB/s | 73 MB 00:31 2023-12-16T20:13:03.443 INFO:teuthology.orchestra.run.smithi087.stdout:(11/177): ceph-mgr-19.0.0-202.gc7586e95.el9.x86 1.8 MB/s | 1.5 MB 00:00 2023-12-16T20:13:09.401 INFO:teuthology.orchestra.run.smithi087.stdout:(12/177): ceph-mds-debuginfo-19.0.0-202.gc7586e 4.3 MB/s | 47 MB 00:10 2023-12-16T20:13:09.751 INFO:teuthology.orchestra.run.smithi087.stdout:(13/177): ceph-mgr-debuginfo-19.0.0-202.gc7586e 3.0 MB/s | 19 MB 00:06 2023-12-16T20:13:09.902 INFO:teuthology.orchestra.run.smithi087.stdout:(14/177): ceph-mon-19.0.0-202.gc7586e95.el9.x86 8.8 MB/s | 4.4 MB 00:00 2023-12-16T20:13:11.294 INFO:teuthology.orchestra.run.smithi087.stdout:(15/177): ceph-osd-19.0.0-202.gc7586e95.el9.x86 13 MB/s | 18 MB 00:01 2023-12-16T20:13:11.466 INFO:teuthology.orchestra.run.smithi195.stdout:(18/177): ceph-osd-debuginfo-19.0.0-202.gc7586e 10 MB/s | 312 MB 00:31 2023-12-16T20:13:11.549 INFO:teuthology.orchestra.run.smithi195.stdout:(19/177): ceph-selinux-19.0.0-202.gc7586e95.el9 291 kB/s | 24 kB 00:00 2023-12-16T20:13:19.057 INFO:teuthology.orchestra.run.smithi195.stdout:(20/177): ceph-test-19.0.0-202.gc7586e95.el9.x8 5.5 MB/s | 41 MB 00:07 2023-12-16T20:13:24.165 INFO:teuthology.orchestra.run.smithi195.stdout:(21/177): ceph-common-debuginfo-19.0.0-202.gc75 6.5 MB/s | 409 MB 01:02 2023-12-16T20:13:24.540 INFO:teuthology.orchestra.run.smithi195.stdout:(22/177): cephfs-mirror-19.0.0-202.gc7586e95.el 580 kB/s | 217 kB 00:00 2023-12-16T20:13:24.631 INFO:teuthology.orchestra.run.smithi195.stdout:(23/177): cephfs-shell-19.0.0-202.gc7586e95.el9 296 kB/s | 27 kB 00:00 2023-12-16T20:13:24.723 INFO:teuthology.orchestra.run.smithi195.stdout:(24/177): libcephfs-devel-19.0.0-202.gc7586e95. 340 kB/s | 31 kB 00:00 2023-12-16T20:13:25.032 INFO:teuthology.orchestra.run.smithi195.stdout:(25/177): libcephfs2-19.0.0-202.gc7586e95.el9.x 2.3 MB/s | 719 kB 00:00 2023-12-16T20:13:26.682 INFO:teuthology.orchestra.run.smithi195.stdout:(26/177): libcephfs2-debuginfo-19.0.0-202.gc758 3.1 MB/s | 5.2 MB 00:01 2023-12-16T20:13:26.782 INFO:teuthology.orchestra.run.smithi195.stdout:(27/177): libcephsqlite-19.0.0-202.gc7586e95.el 1.6 MB/s | 164 kB 00:00 2023-12-16T20:13:26.883 INFO:teuthology.orchestra.run.smithi195.stdout:(28/177): librados-devel-19.0.0-202.gc7586e95.e 1.2 MB/s | 126 kB 00:00 2023-12-16T20:13:26.983 INFO:teuthology.orchestra.run.smithi195.stdout:(29/177): librados-devel-debuginfo-19.0.0-202.g 1.1 MB/s | 108 kB 00:00 2023-12-16T20:13:38.594 INFO:teuthology.orchestra.run.smithi087.stdout:(16/177): ceph-mon-debuginfo-19.0.0-202.gc7586e 3.9 MB/s | 112 MB 00:28 2023-12-16T20:13:40.697 INFO:teuthology.orchestra.run.smithi087.stdout:(17/177): ceph-radosgw-19.0.0-202.gc7586e95.el9 4.1 MB/s | 8.6 MB 00:02 2023-12-16T20:13:48.181 INFO:teuthology.orchestra.run.smithi195.stdout:(30/177): librados2-debuginfo-19.0.0-202.gc7586 2.1 MB/s | 44 MB 00:21 2023-12-16T20:13:48.556 INFO:teuthology.orchestra.run.smithi195.stdout:(31/177): libradosstriper1-19.0.0-202.gc7586e95 1.2 MB/s | 476 kB 00:00 2023-12-16T20:13:53.239 INFO:teuthology.orchestra.run.smithi195.stdout:(32/177): ceph-radosgw-debuginfo-19.0.0-202.gc7 2.5 MB/s | 171 MB 01:07 2023-12-16T20:13:55.047 INFO:teuthology.orchestra.run.smithi195.stdout:(33/177): librgw2-19.0.0-202.gc7586e95.el9.x86_ 2.6 MB/s | 4.8 MB 00:01 2023-12-16T20:13:55.147 INFO:teuthology.orchestra.run.smithi195.stdout:(34/177): python3-ceph-argparse-19.0.0-202.gc75 452 kB/s | 45 kB 00:00 2023-12-16T20:13:55.281 INFO:teuthology.orchestra.run.smithi195.stdout:(35/177): python3-ceph-common-19.0.0-202.gc7586 973 kB/s | 130 kB 00:00 2023-12-16T20:13:55.381 INFO:teuthology.orchestra.run.smithi195.stdout:(36/177): python3-cephfs-19.0.0-202.gc7586e95.e 1.6 MB/s | 162 kB 00:00 2023-12-16T20:13:55.690 INFO:teuthology.orchestra.run.smithi195.stdout:(37/177): python3-cephfs-debuginfo-19.0.0-202.g 1.9 MB/s | 615 kB 00:00 2023-12-16T20:13:55.867 INFO:teuthology.orchestra.run.smithi195.stdout:(38/177): python3-rados-19.0.0-202.gc7586e95.el 1.8 MB/s | 320 kB 00:00 2023-12-16T20:13:56.217 INFO:teuthology.orchestra.run.smithi195.stdout:(39/177): python3-rados-debuginfo-19.0.0-202.gc 2.1 MB/s | 770 kB 00:00 2023-12-16T20:13:56.392 INFO:teuthology.orchestra.run.smithi195.stdout:(40/177): python3-rbd-19.0.0-202.gc7586e95.el9. 1.7 MB/s | 298 kB 00:00 2023-12-16T20:13:56.901 INFO:teuthology.orchestra.run.smithi195.stdout:(41/177): python3-rbd-debuginfo-19.0.0-202.gc75 2.2 MB/s | 1.1 MB 00:00 2023-12-16T20:13:57.010 INFO:teuthology.orchestra.run.smithi195.stdout:(42/177): python3-rgw-19.0.0-202.gc7586e95.el9. 917 kB/s | 99 kB 00:00 2023-12-16T20:13:57.201 INFO:teuthology.orchestra.run.smithi195.stdout:(43/177): python3-rgw-debuginfo-19.0.0-202.gc75 1.7 MB/s | 337 kB 00:00 2023-12-16T20:13:57.302 INFO:teuthology.orchestra.run.smithi195.stdout:(44/177): rbd-fuse-19.0.0-202.gc7586e95.el9.x86 852 kB/s | 85 kB 00:00 2023-12-16T20:13:57.577 INFO:teuthology.orchestra.run.smithi195.stdout:(45/177): rbd-fuse-debuginfo-19.0.0-202.gc7586e 1.8 MB/s | 507 kB 00:00 2023-12-16T20:13:58.760 INFO:teuthology.orchestra.run.smithi195.stdout:(46/177): rbd-mirror-19.0.0-202.gc7586e95.el9.x 2.5 MB/s | 3.0 MB 00:01 2023-12-16T20:14:01.227 INFO:teuthology.orchestra.run.smithi195.stdout:(47/177): librbd1-debuginfo-19.0.0-202.gc7586e9 4.0 MB/s | 50 MB 00:12 2023-12-16T20:14:01.427 INFO:teuthology.orchestra.run.smithi195.stdout:(48/177): rbd-nbd-19.0.0-202.gc7586e95.el9.x86_ 854 kB/s | 170 kB 00:00 2023-12-16T20:14:01.844 INFO:teuthology.orchestra.run.smithi195.stdout:(49/177): rbd-nbd-debuginfo-19.0.0-202.gc7586e9 3.0 MB/s | 1.2 MB 00:00 2023-12-16T20:14:01.920 INFO:teuthology.orchestra.run.smithi195.stdout:(50/177): ceph-grafana-dashboards-19.0.0-202.gc 376 kB/s | 28 kB 00:00 2023-12-16T20:14:02.003 INFO:teuthology.orchestra.run.smithi195.stdout:(51/177): ceph-mgr-cephadm-19.0.0-202.gc7586e95 1.6 MB/s | 133 kB 00:00 2023-12-16T20:14:02.528 INFO:teuthology.orchestra.run.smithi195.stdout:(52/177): ceph-mgr-dashboard-19.0.0-202.gc7586e 3.4 MB/s | 1.8 MB 00:00 2023-12-16T20:14:04.529 INFO:teuthology.orchestra.run.smithi195.stdout:(53/177): ceph-mgr-diskprediction-local-19.0.0- 3.7 MB/s | 7.4 MB 00:01 2023-12-16T20:14:04.629 INFO:teuthology.orchestra.run.smithi195.stdout:(54/177): ceph-mgr-modules-core-19.0.0-202.gc75 2.4 MB/s | 243 kB 00:00 2023-12-16T20:14:04.712 INFO:teuthology.orchestra.run.smithi195.stdout:(55/177): ceph-mgr-rook-19.0.0-202.gc7586e95.el 604 kB/s | 50 kB 00:00 2023-12-16T20:14:04.804 INFO:teuthology.orchestra.run.smithi195.stdout:(56/177): ceph-prometheus-alerts-19.0.0-202.gc7 165 kB/s | 15 kB 00:00 2023-12-16T20:14:04.896 INFO:teuthology.orchestra.run.smithi195.stdout:(57/177): ceph-volume-19.0.0-202.gc7586e95.el9. 2.8 MB/s | 262 kB 00:00 2023-12-16T20:14:05.138 INFO:teuthology.orchestra.run.smithi195.stdout:(58/177): cephadm-19.0.0-202.gc7586e95.el9.noar 3.3 MB/s | 805 kB 00:00 2023-12-16T20:14:05.222 INFO:teuthology.orchestra.run.smithi195.stdout:(59/177): cephfs-top-19.0.0-202.gc7586e95.el9.n 219 kB/s | 18 kB 00:00 2023-12-16T20:14:05.364 INFO:teuthology.orchestra.run.smithi195.stdout:(60/177): automake-1.16.2-8.el9.noarch.rpm 4.6 MB/s | 662 kB 00:00 2023-12-16T20:14:05.414 INFO:teuthology.orchestra.run.smithi195.stdout:(61/177): bison-3.7.4-5.el9.x86_64.rpm 18 MB/s | 920 kB 00:00 2023-12-16T20:14:05.448 INFO:teuthology.orchestra.run.smithi195.stdout:(62/177): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2023-12-16T20:14:05.473 INFO:teuthology.orchestra.run.smithi195.stdout:(63/177): elfutils-libelf-devel-0.190-1.el9.x86 869 kB/s | 21 kB 00:00 2023-12-16T20:14:05.507 INFO:teuthology.orchestra.run.smithi195.stdout:(64/177): flex-2.6.4-9.el9.x86_64.rpm 9.0 MB/s | 307 kB 00:00 2023-12-16T20:14:05.532 INFO:teuthology.orchestra.run.smithi195.stdout:(65/177): flexiblas-3.0.4-8.el9.x86_64.rpm 1.2 MB/s | 32 kB 00:00 2023-12-16T20:14:05.616 INFO:teuthology.orchestra.run.smithi195.stdout:(66/177): flexiblas-netlib-3.0.4-8.el9.x86_64.r 36 MB/s | 3.0 MB 00:00 2023-12-16T20:14:05.641 INFO:teuthology.orchestra.run.smithi195.stdout:(67/177): flexiblas-openblas-openmp-3.0.4-8.el9 688 kB/s | 17 kB 00:00 2023-12-16T20:14:05.675 INFO:teuthology.orchestra.run.smithi195.stdout:(68/177): jq-1.6-16.el9.x86_64.rpm 5.5 MB/s | 186 kB 00:00 2023-12-16T20:14:05.700 INFO:teuthology.orchestra.run.smithi195.stdout:(69/177): libaio-devel-0.3.111-13.el9.x86_64.rp 402 kB/s | 10 kB 00:00 2023-12-16T20:14:05.733 INFO:teuthology.orchestra.run.smithi195.stdout:(70/177): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2023-12-16T20:14:05.759 INFO:teuthology.orchestra.run.smithi195.stdout:(71/177): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.7 MB/s | 44 kB 00:00 2023-12-16T20:14:05.792 INFO:teuthology.orchestra.run.smithi195.stdout:(72/177): librdkafka-1.6.1-102.el9.x86_64.rpm 19 MB/s | 661 kB 00:00 2023-12-16T20:14:05.834 INFO:teuthology.orchestra.run.smithi195.stdout:(73/177): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2023-12-16T20:14:05.868 INFO:teuthology.orchestra.run.smithi195.stdout:(74/177): libuuid-devel-2.37.4-15.el9.x86_64.rp 735 kB/s | 24 kB 00:00 2023-12-16T20:14:05.902 INFO:teuthology.orchestra.run.smithi195.stdout:(75/177): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-12-16T20:14:05.936 INFO:teuthology.orchestra.run.smithi195.stdout:(76/177): lttng-ust-2.12.0-6.el9.x86_64.rpm 8.3 MB/s | 282 kB 00:00 2023-12-16T20:14:05.969 INFO:teuthology.orchestra.run.smithi195.stdout:(77/177): lua-5.4.4-4.el9.x86_64.rpm 5.5 MB/s | 187 kB 00:00 2023-12-16T20:14:06.003 INFO:teuthology.orchestra.run.smithi195.stdout:(78/177): oniguruma-6.9.6-1.el9.5.x86_64.rpm 6.4 MB/s | 217 kB 00:00 2023-12-16T20:14:06.036 INFO:teuthology.orchestra.run.smithi195.stdout:(79/177): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-12-16T20:14:06.120 INFO:teuthology.orchestra.run.smithi195.stdout:(80/177): openblas-openmp-0.3.21-2.el9.x86_64.r 57 MB/s | 4.7 MB 00:00 2023-12-16T20:14:06.170 INFO:teuthology.orchestra.run.smithi195.stdout:(81/177): postgresql-13.11-1.el9.x86_64.rpm 31 MB/s | 1.5 MB 00:00 2023-12-16T20:14:06.212 INFO:teuthology.orchestra.run.smithi195.stdout:(82/177): postgresql-contrib-13.11-1.el9.x86_64 19 MB/s | 811 kB 00:00 2023-12-16T20:14:06.246 INFO:teuthology.orchestra.run.smithi195.stdout:(83/177): postgresql-private-libs-13.11-1.el9.x 3.9 MB/s | 134 kB 00:00 2023-12-16T20:14:06.388 INFO:teuthology.orchestra.run.smithi195.stdout:(84/177): postgresql-server-13.11-1.el9.x86_64. 40 MB/s | 5.7 MB 00:00 2023-12-16T20:14:06.421 INFO:teuthology.orchestra.run.smithi195.stdout:(85/177): python3-attrs-20.3.0-7.el9.noarch.rpm 2.3 MB/s | 78 kB 00:00 2023-12-16T20:14:06.522 INFO:teuthology.orchestra.run.smithi195.stdout:(86/177): python3-babel-2.9.1-2.el9.noarch.rpm 58 MB/s | 5.8 MB 00:00 2023-12-16T20:14:06.555 INFO:teuthology.orchestra.run.smithi195.stdout:(87/177): python3-jinja2-2.11.3-4.el9.noarch.rp 6.8 MB/s | 228 kB 00:00 2023-12-16T20:14:06.589 INFO:teuthology.orchestra.run.smithi195.stdout:(88/177): python3-jsonpatch-1.21-16.el9.noarch. 733 kB/s | 24 kB 00:00 2023-12-16T20:14:06.623 INFO:teuthology.orchestra.run.smithi195.stdout:(89/177): python3-jsonpointer-2.0-4.el9.noarch. 542 kB/s | 18 kB 00:00 2023-12-16T20:14:06.656 INFO:teuthology.orchestra.run.smithi195.stdout:(90/177): python3-mako-1.1.4-6.el9.noarch.rpm 4.2 MB/s | 144 kB 00:00 2023-12-16T20:14:06.681 INFO:teuthology.orchestra.run.smithi195.stdout:(91/177): python3-markupsafe-1.1.1-12.el9.x86_6 1.2 MB/s | 32 kB 00:00 2023-12-16T20:14:06.765 INFO:teuthology.orchestra.run.smithi195.stdout:(92/177): python3-numpy-1.20.1-5.el9.x86_64.rpm 58 MB/s | 4.8 MB 00:00 2023-12-16T20:14:06.799 INFO:teuthology.orchestra.run.smithi195.stdout:(93/177): python3-numpy-f2py-1.20.1-5.el9.x86_6 6.4 MB/s | 217 kB 00:00 2023-12-16T20:14:06.833 INFO:teuthology.orchestra.run.smithi195.stdout:(94/177): python3-oauthlib-3.1.1-5.el9.noarch.r 5.1 MB/s | 174 kB 00:00 2023-12-16T20:14:06.858 INFO:teuthology.orchestra.run.smithi195.stdout:(95/177): python3-prettytable-0.7.2-27.el9.noar 1.6 MB/s | 41 kB 00:00 2023-12-16T20:14:06.892 INFO:teuthology.orchestra.run.smithi195.stdout:(96/177): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.9 MB/s | 132 kB 00:00 2023-12-16T20:14:06.925 INFO:teuthology.orchestra.run.smithi195.stdout:(97/177): python3-pyasn1-modules-0.4.8-6.el9.no 6.2 MB/s | 211 kB 00:00 2023-12-16T20:14:06.950 INFO:teuthology.orchestra.run.smithi195.stdout:(98/177): python3-pytz-2021.1-5.el9.noarch.rpm 1.9 MB/s | 47 kB 00:00 2023-12-16T20:14:06.976 INFO:teuthology.orchestra.run.smithi195.stdout:(99/177): python3-requests-oauthlib-1.3.0-12.el 1.7 MB/s | 43 kB 00:00 2023-12-16T20:14:07.176 INFO:teuthology.orchestra.run.smithi195.stdout:(100/177): python3-scipy-1.6.2-8.el9.x86_64.rpm 78 MB/s | 16 MB 00:00 2023-12-16T20:14:07.201 INFO:teuthology.orchestra.run.smithi195.stdout:(101/177): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 39 kB 00:00 2023-12-16T20:14:07.226 INFO:teuthology.orchestra.run.smithi195.stdout:(102/177): python3-wcwidth-0.2.5-8.el9.noarch.r 1.6 MB/s | 41 kB 00:00 2023-12-16T20:14:07.260 INFO:teuthology.orchestra.run.smithi195.stdout:(103/177): socat-1.7.4.1-5.el9.x86_64.rpm 8.8 MB/s | 300 kB 00:00 2023-12-16T20:14:07.285 INFO:teuthology.orchestra.run.smithi195.stdout:(104/177): uuid-1.6.2-55.el9.x86_64.rpm 2.2 MB/s | 56 kB 00:00 2023-12-16T20:14:07.319 INFO:teuthology.orchestra.run.smithi195.stdout:(105/177): xfsprogs-devel-5.19.0-4.el9.x86_64.r 2.5 MB/s | 85 kB 00:00 2023-12-16T20:14:07.344 INFO:teuthology.orchestra.run.smithi195.stdout:(106/177): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 63 kB 00:00 2023-12-16T20:14:07.370 INFO:teuthology.orchestra.run.smithi195.stdout:(107/177): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.7 MB/s | 44 kB 00:00 2023-12-16T20:14:07.403 INFO:teuthology.orchestra.run.smithi195.stdout:(108/177): fuse-2.9.9-15.el9.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2023-12-16T20:14:07.446 INFO:teuthology.orchestra.run.smithi195.stdout:(109/177): libgfortran-11.4.1-2.3.el9.x86_64.rp 19 MB/s | 803 kB 00:00 2023-12-16T20:14:07.479 INFO:teuthology.orchestra.run.smithi195.stdout:(110/177): libquadmath-11.4.1-2.3.el9.x86_64.rp 5.7 MB/s | 195 kB 00:00 2023-12-16T20:14:07.513 INFO:teuthology.orchestra.run.smithi195.stdout:(111/177): python3-cffi-1.14.5-5.el9.x86_64.rpm 7.1 MB/s | 241 kB 00:00 2023-12-16T20:14:07.563 INFO:teuthology.orchestra.run.smithi195.stdout:(112/177): python3-cryptography-36.0.1-4.el9.x8 23 MB/s | 1.1 MB 00:00 2023-12-16T20:14:07.597 INFO:teuthology.orchestra.run.smithi195.stdout:(113/177): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-12-16T20:14:07.630 INFO:teuthology.orchestra.run.smithi195.stdout:(114/177): python3-pycparser-2.20-6.el9.noarch. 3.7 MB/s | 124 kB 00:00 2023-12-16T20:14:07.664 INFO:teuthology.orchestra.run.smithi195.stdout:(115/177): python3-requests-2.25.1-7.el9.noarch 3.3 MB/s | 113 kB 00:00 2023-12-16T20:14:07.698 INFO:teuthology.orchestra.run.smithi195.stdout:(116/177): python3-urllib3-1.26.5-4.el9.noarch. 5.5 MB/s | 187 kB 00:00 2023-12-16T20:14:08.606 INFO:teuthology.orchestra.run.smithi195.stdout:(117/177): openssl-devel-3.0.7-25.el9.x86_64.rp 4.5 MB/s | 4.1 MB 00:00 2023-12-16T20:14:08.714 INFO:teuthology.orchestra.run.smithi195.stdout:(118/177): python3-devel-3.9.17-2.el9.x86_64.rp 2.2 MB/s | 245 kB 00:00 2023-12-16T20:14:09.248 INFO:teuthology.orchestra.run.smithi195.stdout:(119/177): gperftools-libs-2.9.1-2.el9.x86_64.r 579 kB/s | 309 kB 00:00 2023-12-16T20:14:09.690 INFO:teuthology.orchestra.run.smithi195.stdout:(120/177): libarrow-9.0.0-10.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2023-12-16T20:14:09.790 INFO:teuthology.orchestra.run.smithi195.stdout:(121/177): libarrow-doc-9.0.0-10.el9.noarch.rpm 260 kB/s | 26 kB 00:00 2023-12-16T20:14:09.891 INFO:teuthology.orchestra.run.smithi195.stdout:(122/177): liboath-2.6.7-2.el9.x86_64.rpm 484 kB/s | 49 kB 00:00 2023-12-16T20:14:09.991 INFO:teuthology.orchestra.run.smithi195.stdout:(123/177): libunwind-1.6.2-1.el9.x86_64.rpm 675 kB/s | 67 kB 00:00 2023-12-16T20:14:10.091 INFO:teuthology.orchestra.run.smithi195.stdout:(124/177): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2023-12-16T20:14:10.208 INFO:teuthology.orchestra.run.smithi195.stdout:(125/177): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.0 MB/s | 838 kB 00:00 2023-12-16T20:14:10.317 INFO:teuthology.orchestra.run.smithi195.stdout:(126/177): python3-asyncssh-2.13.2-3.el9.noarch 4.9 MB/s | 548 kB 00:00 2023-12-16T20:14:10.409 INFO:teuthology.orchestra.run.smithi195.stdout:(127/177): python3-bcrypt-3.2.2-1.el9.x86_64.rp 474 kB/s | 43 kB 00:00 2023-12-16T20:14:10.509 INFO:teuthology.orchestra.run.smithi195.stdout:(128/177): python3-cachetools-4.2.4-1.el9.noarc 322 kB/s | 32 kB 00:00 2023-12-16T20:14:10.601 INFO:teuthology.orchestra.run.smithi195.stdout:(129/177): python3-certifi-2021.10.8-2.el9.noar 164 kB/s | 15 kB 00:00 2023-12-16T20:14:10.701 INFO:teuthology.orchestra.run.smithi195.stdout:(130/177): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2023-12-16T20:14:10.802 INFO:teuthology.orchestra.run.smithi195.stdout:(131/177): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2023-12-16T20:14:10.902 INFO:teuthology.orchestra.run.smithi195.stdout:(132/177): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2023-12-16T20:14:10.994 INFO:teuthology.orchestra.run.smithi195.stdout:(133/177): python3-colorama-0.4.4-12.el9.noarch 385 kB/s | 35 kB 00:00 2023-12-16T20:14:11.094 INFO:teuthology.orchestra.run.smithi195.stdout:(134/177): python3-google-auth-2.23.4-1.el9.noa 1.9 MB/s | 197 kB 00:00 2023-12-16T20:14:11.178 INFO:teuthology.orchestra.run.smithi195.stdout:(135/177): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2023-12-16T20:14:11.261 INFO:teuthology.orchestra.run.smithi195.stdout:(136/177): python3-jaraco-classes-3.2.1-5.el9.n 212 kB/s | 18 kB 00:00 2023-12-16T20:14:11.354 INFO:teuthology.orchestra.run.smithi195.stdout:(137/177): python3-jaraco-collections-3.0.0-8.e 253 kB/s | 23 kB 00:00 2023-12-16T20:14:11.445 INFO:teuthology.orchestra.run.smithi195.stdout:(138/177): python3-jaraco-functools-3.5.0-2.el9 212 kB/s | 19 kB 00:00 2023-12-16T20:14:11.537 INFO:teuthology.orchestra.run.smithi195.stdout:(139/177): python3-jaraco-text-3.2.0-6.el9.noar 215 kB/s | 20 kB 00:00 2023-12-16T20:14:11.629 INFO:teuthology.orchestra.run.smithi195.stdout:(140/177): python3-jwt+crypto-2.4.0-1.el9.noarc 99 kB/s | 9.0 kB 00:00 2023-12-16T20:14:11.730 INFO:teuthology.orchestra.run.smithi195.stdout:(141/177): python3-jwt-2.4.0-1.el9.noarch.rpm 410 kB/s | 41 kB 00:00 2023-12-16T20:14:11.847 INFO:teuthology.orchestra.run.smithi195.stdout:(142/177): python3-kubernetes-26.1.0-2.el9.noar 8.8 MB/s | 1.0 MB 00:00 2023-12-16T20:14:11.947 INFO:teuthology.orchestra.run.smithi195.stdout:(143/177): python3-logutils-0.3.5-21.el9.noarch 464 kB/s | 46 kB 00:00 2023-12-16T20:14:12.047 INFO:teuthology.orchestra.run.smithi195.stdout:(144/177): python3-more-itertools-8.12.0-2.el9. 788 kB/s | 79 kB 00:00 2023-12-16T20:14:12.147 INFO:teuthology.orchestra.run.smithi195.stdout:(145/177): python3-natsort-7.1.1-5.el9.noarch.r 579 kB/s | 58 kB 00:00 2023-12-16T20:14:12.248 INFO:teuthology.orchestra.run.smithi195.stdout:(146/177): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2023-12-16T20:14:12.340 INFO:teuthology.orchestra.run.smithi195.stdout:(147/177): python3-portend-3.1.0-2.el9.noarch.r 179 kB/s | 16 kB 00:00 2023-12-16T20:14:12.440 INFO:teuthology.orchestra.run.smithi195.stdout:(148/177): python3-pyOpenSSL-21.0.0-1.el9.noarc 899 kB/s | 90 kB 00:00 2023-12-16T20:14:12.542 INFO:teuthology.orchestra.run.smithi195.stdout:(149/177): python3-pyperclip-1.8.2-2.el9.noarch 276 kB/s | 28 kB 00:00 2023-12-16T20:14:12.643 INFO:teuthology.orchestra.run.smithi195.stdout:(150/177): python3-repoze-lru-0.7-16.el9.noarch 308 kB/s | 31 kB 00:00 2023-12-16T20:14:12.743 INFO:teuthology.orchestra.run.smithi195.stdout:(151/177): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2023-12-16T20:14:12.835 INFO:teuthology.orchestra.run.smithi195.stdout:(152/177): python3-rsa-4.9-2.el9.noarch.rpm 645 kB/s | 59 kB 00:00 2023-12-16T20:14:12.919 INFO:teuthology.orchestra.run.smithi195.stdout:(153/177): python3-tempora-5.0.0-2.el9.noarch.r 429 kB/s | 36 kB 00:00 2023-12-16T20:14:13.011 INFO:teuthology.orchestra.run.smithi195.stdout:(154/177): python3-typing-extensions-4.4.0-2.el 556 kB/s | 51 kB 00:00 2023-12-16T20:14:13.111 INFO:teuthology.orchestra.run.smithi195.stdout:(155/177): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2023-12-16T20:14:13.211 INFO:teuthology.orchestra.run.smithi195.stdout:(156/177): python3-websocket-client-1.2.3-2.el9 897 kB/s | 90 kB 00:00 2023-12-16T20:14:13.311 INFO:teuthology.orchestra.run.smithi195.stdout:(157/177): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2023-12-16T20:14:13.403 INFO:teuthology.orchestra.run.smithi195.stdout:(158/177): python3-zc-lockfile-2.0-10.el9.noarc 218 kB/s | 20 kB 00:00 2023-12-16T20:14:13.504 INFO:teuthology.orchestra.run.smithi195.stdout:(159/177): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2023-12-16T20:14:13.646 INFO:teuthology.orchestra.run.smithi195.stdout:(160/177): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2023-12-16T20:14:15.271 INFO:teuthology.orchestra.run.smithi195.stdout:(161/177): librados2-19.0.0-202.gc7586e95.el9.x 2.0 MB/s | 3.3 MB 00:01 2023-12-16T20:14:15.386 INFO:teuthology.orchestra.run.smithi087.stdout:(18/177): ceph-radosgw-debuginfo-19.0.0-202.gc7 4.9 MB/s | 171 MB 00:34 2023-12-16T20:14:15.469 INFO:teuthology.orchestra.run.smithi087.stdout:(19/177): ceph-selinux-19.0.0-202.gc7586e95.el9 289 kB/s | 24 kB 00:00 2023-12-16T20:14:16.371 INFO:teuthology.orchestra.run.smithi195.stdout:(162/177): rbd-mirror-debuginfo-19.0.0-202.gc75 2.9 MB/s | 50 MB 00:17 2023-12-16T20:14:16.396 INFO:teuthology.orchestra.run.smithi195.stdout:(163/177): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.7 MB/s | 68 kB 00:00 2023-12-16T20:14:16.430 INFO:teuthology.orchestra.run.smithi195.stdout:(164/177): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-12-16T20:14:16.463 INFO:teuthology.orchestra.run.smithi195.stdout:(165/177): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-16T20:14:16.497 INFO:teuthology.orchestra.run.smithi195.stdout:(166/177): elfutils-libelf-0.190-1.el9.x86_64.r 5.7 MB/s | 192 kB 00:00 2023-12-16T20:14:16.532 INFO:teuthology.orchestra.run.smithi195.stdout:(167/177): elfutils-libs-0.190-1.el9.x86_64.rpm 7.5 MB/s | 255 kB 00:00 2023-12-16T20:14:16.564 INFO:teuthology.orchestra.run.smithi195.stdout:(168/177): libacl-2.3.1-4.el9.x86_64.rpm 660 kB/s | 22 kB 00:00 2023-12-16T20:14:16.598 INFO:teuthology.orchestra.run.smithi195.stdout:(169/177): xfsdump-3.1.12-4.el9.x86_64.rpm 9.4 MB/s | 321 kB 00:00 2023-12-16T20:14:16.723 INFO:teuthology.orchestra.run.smithi195.stdout:(170/177): librbd1-19.0.0-202.gc7586e95.el9.x86 2.1 MB/s | 3.0 MB 00:01 2023-12-16T20:14:16.882 INFO:teuthology.orchestra.run.smithi195.stdout:(171/177): NetworkManager-1.45.7-1.el9.x86_64.r 8.0 MB/s | 2.3 MB 00:00 2023-12-16T20:14:16.924 INFO:teuthology.orchestra.run.smithi195.stdout:(172/177): NetworkManager-team-1.45.7-1.el9.x86 1.0 MB/s | 43 kB 00:00 2023-12-16T20:14:16.966 INFO:teuthology.orchestra.run.smithi195.stdout:(173/177): NetworkManager-libnm-1.45.7-1.el9.x8 7.3 MB/s | 1.8 MB 00:00 2023-12-16T20:14:16.991 INFO:teuthology.orchestra.run.smithi195.stdout:(174/177): NetworkManager-tui-1.45.7-1.el9.x86_ 3.6 MB/s | 246 kB 00:00 2023-12-16T20:14:17.025 INFO:teuthology.orchestra.run.smithi195.stdout:(175/177): openssl-3.0.7-25.el9.x86_64.rpm 21 MB/s | 1.2 MB 00:00 2023-12-16T20:14:17.075 INFO:teuthology.orchestra.run.smithi195.stdout:(176/177): openssl-libs-3.0.7-25.el9.x86_64.rpm 26 MB/s | 2.2 MB 00:00 2023-12-16T20:14:19.819 INFO:teuthology.orchestra.run.smithi087.stdout:(20/177): ceph-test-19.0.0-202.gc7586e95.el9.x8 9.5 MB/s | 41 MB 00:04 2023-12-16T20:15:01.532 INFO:teuthology.orchestra.run.smithi087.stdout:(21/177): ceph-osd-debuginfo-19.0.0-202.gc7586e 2.8 MB/s | 312 MB 01:50 2023-12-16T20:15:01.865 INFO:teuthology.orchestra.run.smithi087.stdout:(22/177): cephfs-mirror-19.0.0-202.gc7586e95.el 652 kB/s | 217 kB 00:00 2023-12-16T20:15:01.957 INFO:teuthology.orchestra.run.smithi087.stdout:(23/177): cephfs-shell-19.0.0-202.gc7586e95.el9 296 kB/s | 27 kB 00:00 2023-12-16T20:15:02.057 INFO:teuthology.orchestra.run.smithi087.stdout:(24/177): libcephfs-devel-19.0.0-202.gc7586e95. 311 kB/s | 31 kB 00:00 2023-12-16T20:15:02.383 INFO:teuthology.orchestra.run.smithi087.stdout:(25/177): libcephfs2-19.0.0-202.gc7586e95.el9.x 2.2 MB/s | 719 kB 00:00 2023-12-16T20:15:03.791 INFO:teuthology.orchestra.run.smithi087.stdout:(26/177): libcephfs2-debuginfo-19.0.0-202.gc758 3.7 MB/s | 5.2 MB 00:01 2023-12-16T20:15:03.875 INFO:teuthology.orchestra.run.smithi087.stdout:(27/177): libcephsqlite-19.0.0-202.gc7586e95.el 1.9 MB/s | 164 kB 00:00 2023-12-16T20:15:03.958 INFO:teuthology.orchestra.run.smithi087.stdout:(28/177): librados-devel-19.0.0-202.gc7586e95.e 1.5 MB/s | 126 kB 00:00 2023-12-16T20:15:04.042 INFO:teuthology.orchestra.run.smithi087.stdout:(29/177): librados-devel-debuginfo-19.0.0-202.g 1.3 MB/s | 108 kB 00:00 2023-12-16T20:15:07.177 INFO:teuthology.orchestra.run.smithi195.stdout:(177/177): ceph-test-debuginfo-19.0.0-202.gc758 5.8 MB/s | 622 MB 01:48 2023-12-16T20:15:07.182 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:15:07.182 INFO:teuthology.orchestra.run.smithi195.stdout:Total 13 MB/s | 2.1 GB 02:48 2023-12-16T20:15:07.345 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2023-12-16T20:15:07.535 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2023-12-16T20:15:07.535 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2023-12-16T20:15:12.450 INFO:teuthology.orchestra.run.smithi087.stdout:(30/177): librados2-debuginfo-19.0.0-202.gc7586 5.2 MB/s | 44 MB 00:08 2023-12-16T20:15:12.683 INFO:teuthology.orchestra.run.smithi087.stdout:(31/177): libradosstriper1-19.0.0-202.gc7586e95 2.0 MB/s | 476 kB 00:00 2023-12-16T20:15:14.959 INFO:teuthology.orchestra.run.smithi087.stdout:(32/177): ceph-common-debuginfo-19.0.0-202.gc75 2.5 MB/s | 409 MB 02:40 2023-12-16T20:15:15.559 INFO:teuthology.orchestra.run.smithi087.stdout:(33/177): librgw2-19.0.0-202.gc7586e95.el9.x86_ 7.9 MB/s | 4.8 MB 00:00 2023-12-16T20:15:15.617 INFO:teuthology.orchestra.run.smithi087.stdout:(34/177): python3-ceph-argparse-19.0.0-202.gc75 775 kB/s | 45 kB 00:00 2023-12-16T20:15:15.676 INFO:teuthology.orchestra.run.smithi087.stdout:(35/177): python3-ceph-common-19.0.0-202.gc7586 2.2 MB/s | 130 kB 00:00 2023-12-16T20:15:15.734 INFO:teuthology.orchestra.run.smithi087.stdout:(36/177): python3-cephfs-19.0.0-202.gc7586e95.e 2.7 MB/s | 162 kB 00:00 2023-12-16T20:15:15.860 INFO:teuthology.orchestra.run.smithi087.stdout:(37/177): python3-cephfs-debuginfo-19.0.0-202.g 4.8 MB/s | 615 kB 00:00 2023-12-16T20:15:15.927 INFO:teuthology.orchestra.run.smithi087.stdout:(38/177): python3-rados-19.0.0-202.gc7586e95.el 4.7 MB/s | 320 kB 00:00 2023-12-16T20:15:16.052 INFO:teuthology.orchestra.run.smithi087.stdout:(39/177): python3-rados-debuginfo-19.0.0-202.gc 6.0 MB/s | 770 kB 00:00 2023-12-16T20:15:16.127 INFO:teuthology.orchestra.run.smithi087.stdout:(40/177): python3-rbd-19.0.0-202.gc7586e95.el9. 3.9 MB/s | 298 kB 00:00 2023-12-16T20:15:16.294 INFO:teuthology.orchestra.run.smithi087.stdout:(41/177): python3-rbd-debuginfo-19.0.0-202.gc75 6.8 MB/s | 1.1 MB 00:00 2023-12-16T20:15:16.361 INFO:teuthology.orchestra.run.smithi087.stdout:(42/177): python3-rgw-19.0.0-202.gc7586e95.el9. 1.5 MB/s | 99 kB 00:00 2023-12-16T20:15:16.436 INFO:teuthology.orchestra.run.smithi087.stdout:(43/177): python3-rgw-debuginfo-19.0.0-202.gc75 4.4 MB/s | 337 kB 00:00 2023-12-16T20:15:16.503 INFO:teuthology.orchestra.run.smithi087.stdout:(44/177): rbd-fuse-19.0.0-202.gc7586e95.el9.x86 1.3 MB/s | 85 kB 00:00 2023-12-16T20:15:16.587 INFO:teuthology.orchestra.run.smithi087.stdout:(45/177): rbd-fuse-debuginfo-19.0.0-202.gc7586e 6.0 MB/s | 507 kB 00:00 2023-12-16T20:15:16.937 INFO:teuthology.orchestra.run.smithi087.stdout:(46/177): rbd-mirror-19.0.0-202.gc7586e95.el9.x 8.6 MB/s | 3.0 MB 00:00 2023-12-16T20:15:20.471 INFO:teuthology.orchestra.run.smithi087.stdout:(47/177): librbd1-debuginfo-19.0.0-202.gc7586e9 6.5 MB/s | 50 MB 00:07 2023-12-16T20:15:20.554 INFO:teuthology.orchestra.run.smithi087.stdout:(48/177): rbd-nbd-19.0.0-202.gc7586e95.el9.x86_ 2.0 MB/s | 170 kB 00:00 2023-12-16T20:15:20.732 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2023-12-16T20:15:20.732 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2023-12-16T20:15:20.771 INFO:teuthology.orchestra.run.smithi087.stdout:(49/177): rbd-nbd-debuginfo-19.0.0-202.gc7586e9 5.8 MB/s | 1.2 MB 00:00 2023-12-16T20:15:20.846 INFO:teuthology.orchestra.run.smithi087.stdout:(50/177): ceph-grafana-dashboards-19.0.0-202.gc 376 kB/s | 28 kB 00:00 2023-12-16T20:15:20.930 INFO:teuthology.orchestra.run.smithi087.stdout:(51/177): ceph-mgr-cephadm-19.0.0-202.gc7586e95 1.6 MB/s | 133 kB 00:00 2023-12-16T20:15:21.180 INFO:teuthology.orchestra.run.smithi087.stdout:(52/177): ceph-mgr-dashboard-19.0.0-202.gc7586e 7.1 MB/s | 1.8 MB 00:00 2023-12-16T20:15:22.131 INFO:teuthology.orchestra.run.smithi087.stdout:(53/177): rbd-mirror-debuginfo-19.0.0-202.gc758 9.7 MB/s | 50 MB 00:05 2023-12-16T20:15:22.231 INFO:teuthology.orchestra.run.smithi087.stdout:(54/177): ceph-mgr-diskprediction-local-19.0.0- 7.0 MB/s | 7.4 MB 00:01 2023-12-16T20:15:22.256 INFO:teuthology.orchestra.run.smithi087.stdout:(55/177): ceph-mgr-modules-core-19.0.0-202.gc75 1.9 MB/s | 243 kB 00:00 2023-12-16T20:15:22.290 INFO:teuthology.orchestra.run.smithi087.stdout:(56/177): ceph-mgr-rook-19.0.0-202.gc7586e95.el 862 kB/s | 50 kB 00:00 2023-12-16T20:15:22.315 INFO:teuthology.orchestra.run.smithi087.stdout:(57/177): ceph-prometheus-alerts-19.0.0-202.gc7 258 kB/s | 15 kB 00:00 2023-12-16T20:15:22.357 INFO:teuthology.orchestra.run.smithi087.stdout:(58/177): ceph-volume-19.0.0-202.gc7586e95.el9. 3.8 MB/s | 262 kB 00:00 2023-12-16T20:15:22.452 INFO:teuthology.orchestra.run.smithi087.stdout:(59/177): cephadm-19.0.0-202.gc7586e95.el9.noar 5.7 MB/s | 805 kB 00:00 2023-12-16T20:15:22.477 INFO:teuthology.orchestra.run.smithi087.stdout:(60/177): cephfs-top-19.0.0-202.gc7586e95.el9.n 152 kB/s | 18 kB 00:00 2023-12-16T20:15:22.620 INFO:teuthology.orchestra.run.smithi087.stdout:(61/177): bison-3.7.4-5.el9.x86_64.rpm 6.3 MB/s | 920 kB 00:00 2023-12-16T20:15:22.645 INFO:teuthology.orchestra.run.smithi087.stdout:(62/177): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 662 kB 00:00 2023-12-16T20:15:22.670 INFO:teuthology.orchestra.run.smithi087.stdout:(63/177): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 106 kB 00:00 2023-12-16T20:15:22.695 INFO:teuthology.orchestra.run.smithi087.stdout:(64/177): elfutils-libelf-devel-0.190-1.el9.x86 430 kB/s | 21 kB 00:00 2023-12-16T20:15:22.729 INFO:teuthology.orchestra.run.smithi087.stdout:(65/177): flex-2.6.4-9.el9.x86_64.rpm 5.1 MB/s | 307 kB 00:00 2023-12-16T20:15:22.757 INFO:teuthology.orchestra.run.smithi087.stdout:(66/177): flexiblas-3.0.4-8.el9.x86_64.rpm 543 kB/s | 32 kB 00:00 2023-12-16T20:15:22.821 INFO:teuthology.orchestra.run.smithi087.stdout:(67/177): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2023-12-16T20:15:22.846 INFO:teuthology.orchestra.run.smithi087.stdout:(68/177): flexiblas-openblas-openmp-3.0.4-8.el9 190 kB/s | 17 kB 00:00 2023-12-16T20:15:22.880 INFO:teuthology.orchestra.run.smithi087.stdout:(69/177): libaio-devel-0.3.111-13.el9.x86_64.rp 304 kB/s | 10 kB 00:00 2023-12-16T20:15:22.906 INFO:teuthology.orchestra.run.smithi087.stdout:(70/177): jq-1.6-16.el9.x86_64.rpm 3.1 MB/s | 186 kB 00:00 2023-12-16T20:15:22.931 INFO:teuthology.orchestra.run.smithi087.stdout:(71/177): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-12-16T20:15:22.956 INFO:teuthology.orchestra.run.smithi087.stdout:(72/177): librabbitmq-0.11.0-7.el9.x86_64.rpm 884 kB/s | 44 kB 00:00 2023-12-16T20:15:22.981 INFO:teuthology.orchestra.run.smithi087.stdout:(73/177): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-16T20:15:23.015 INFO:teuthology.orchestra.run.smithi087.stdout:(74/177): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 578 kB 00:00 2023-12-16T20:15:23.031 INFO:teuthology.orchestra.run.smithi087.stdout:(75/177): libuuid-devel-2.37.4-15.el9.x86_64.rp 496 kB/s | 24 kB 00:00 2023-12-16T20:15:23.048 INFO:teuthology.orchestra.run.smithi087.stdout:(76/177): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-12-16T20:15:23.074 INFO:teuthology.orchestra.run.smithi087.stdout:(77/177): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2023-12-16T20:15:23.099 INFO:teuthology.orchestra.run.smithi087.stdout:(78/177): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-12-16T20:15:23.132 INFO:teuthology.orchestra.run.smithi087.stdout:(79/177): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.6 MB/s | 217 kB 00:00 2023-12-16T20:15:23.158 INFO:teuthology.orchestra.run.smithi087.stdout:(80/177): openblas-0.3.21-2.el9.x86_64.rpm 586 kB/s | 34 kB 00:00 2023-12-16T20:15:23.233 INFO:teuthology.orchestra.run.smithi087.stdout:(81/177): openblas-openmp-0.3.21-2.el9.x86_64.r 47 MB/s | 4.7 MB 00:00 2023-12-16T20:15:23.275 INFO:teuthology.orchestra.run.smithi087.stdout:(82/177): postgresql-13.11-1.el9.x86_64.rpm 13 MB/s | 1.5 MB 00:00 2023-12-16T20:15:23.309 INFO:teuthology.orchestra.run.smithi087.stdout:(83/177): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2023-12-16T20:15:23.334 INFO:teuthology.orchestra.run.smithi087.stdout:(84/177): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2023-12-16T20:15:23.418 INFO:teuthology.orchestra.run.smithi087.stdout:(85/177): postgresql-server-13.11-1.el9.x86_64. 53 MB/s | 5.7 MB 00:00 2023-12-16T20:15:23.443 INFO:teuthology.orchestra.run.smithi087.stdout:(86/177): python3-attrs-20.3.0-7.el9.noarch.rpm 735 kB/s | 78 kB 00:00 2023-12-16T20:15:23.485 INFO:teuthology.orchestra.run.smithi087.stdout:(87/177): python3-jinja2-2.11.3-4.el9.noarch.rp 5.4 MB/s | 228 kB 00:00 2023-12-16T20:15:23.577 INFO:teuthology.orchestra.run.smithi087.stdout:(88/177): python3-babel-2.9.1-2.el9.noarch.rpm 43 MB/s | 5.8 MB 00:00 2023-12-16T20:15:23.602 INFO:teuthology.orchestra.run.smithi087.stdout:(89/177): python3-jsonpatch-1.21-16.el9.noarch. 214 kB/s | 24 kB 00:00 2023-12-16T20:15:23.636 INFO:teuthology.orchestra.run.smithi087.stdout:(90/177): python3-jsonpointer-2.0-4.el9.noarch. 548 kB/s | 18 kB 00:00 2023-12-16T20:15:23.661 INFO:teuthology.orchestra.run.smithi087.stdout:(91/177): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2023-12-16T20:15:23.686 INFO:teuthology.orchestra.run.smithi087.stdout:(92/177): python3-markupsafe-1.1.1-12.el9.x86_6 635 kB/s | 32 kB 00:00 2023-12-16T20:15:23.761 INFO:teuthology.orchestra.run.smithi087.stdout:(93/177): python3-numpy-1.20.1-5.el9.x86_64.rpm 48 MB/s | 4.8 MB 00:00 2023-12-16T20:15:23.787 INFO:teuthology.orchestra.run.smithi087.stdout:(94/177): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.2 MB/s | 217 kB 00:00 2023-12-16T20:15:23.812 INFO:teuthology.orchestra.run.smithi087.stdout:(95/177): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2023-12-16T20:15:23.837 INFO:teuthology.orchestra.run.smithi087.stdout:(96/177): python3-prettytable-0.7.2-27.el9.noar 829 kB/s | 41 kB 00:00 2023-12-16T20:15:23.862 INFO:teuthology.orchestra.run.smithi087.stdout:(97/177): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-12-16T20:15:23.888 INFO:teuthology.orchestra.run.smithi087.stdout:(98/177): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2023-12-16T20:15:23.913 INFO:teuthology.orchestra.run.smithi087.stdout:(99/177): python3-pytz-2021.1-5.el9.noarch.rpm 952 kB/s | 47 kB 00:00 2023-12-16T20:15:23.938 INFO:teuthology.orchestra.run.smithi087.stdout:(100/177): python3-requests-oauthlib-1.3.0-12.e 854 kB/s | 43 kB 00:00 2023-12-16T20:15:24.039 INFO:teuthology.orchestra.run.smithi087.stdout:(101/177): python3-toml-0.10.2-6.el9.noarch.rpm 397 kB/s | 39 kB 00:00 2023-12-16T20:15:24.189 INFO:teuthology.orchestra.run.smithi087.stdout:(102/177): python3-scipy-1.6.2-8.el9.x86_64.rpm 57 MB/s | 16 MB 00:00 2023-12-16T20:15:24.214 INFO:teuthology.orchestra.run.smithi087.stdout:(103/177): python3-wcwidth-0.2.5-8.el9.noarch.r 235 kB/s | 41 kB 00:00 2023-12-16T20:15:24.239 INFO:teuthology.orchestra.run.smithi087.stdout:(104/177): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2023-12-16T20:15:24.265 INFO:teuthology.orchestra.run.smithi087.stdout:(105/177): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2023-12-16T20:15:24.290 INFO:teuthology.orchestra.run.smithi087.stdout:(106/177): xfsprogs-devel-5.19.0-4.el9.x86_64.r 1.7 MB/s | 85 kB 00:00 2023-12-16T20:15:24.315 INFO:teuthology.orchestra.run.smithi087.stdout:(107/177): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-12-16T20:15:24.340 INFO:teuthology.orchestra.run.smithi087.stdout:(108/177): zlib-devel-1.2.11-40.el9.x86_64.rpm 879 kB/s | 44 kB 00:00 2023-12-16T20:15:24.365 INFO:teuthology.orchestra.run.smithi087.stdout:(109/177): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-12-16T20:15:24.391 INFO:teuthology.orchestra.run.smithi087.stdout:(110/177): libgfortran-11.4.1-2.3.el9.x86_64.rp 16 MB/s | 803 kB 00:00 2023-12-16T20:15:24.417 INFO:teuthology.orchestra.run.smithi087.stdout:(111/177): libquadmath-11.4.1-2.3.el9.x86_64.rp 3.9 MB/s | 195 kB 00:00 2023-12-16T20:15:24.442 INFO:teuthology.orchestra.run.smithi087.stdout:(112/177): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-12-16T20:15:24.475 INFO:teuthology.orchestra.run.smithi087.stdout:(113/177): python3-cryptography-36.0.1-4.el9.x8 20 MB/s | 1.1 MB 00:00 2023-12-16T20:15:24.501 INFO:teuthology.orchestra.run.smithi087.stdout:(114/177): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-12-16T20:15:24.526 INFO:teuthology.orchestra.run.smithi087.stdout:(115/177): python3-pycparser-2.20-6.el9.noarch. 2.4 MB/s | 124 kB 00:00 2023-12-16T20:15:24.551 INFO:teuthology.orchestra.run.smithi087.stdout:(116/177): python3-requests-2.25.1-7.el9.noarch 2.2 MB/s | 113 kB 00:00 2023-12-16T20:15:24.576 INFO:teuthology.orchestra.run.smithi087.stdout:(117/177): python3-urllib3-1.26.5-4.el9.noarch. 3.7 MB/s | 187 kB 00:00 2023-12-16T20:15:24.793 INFO:teuthology.orchestra.run.smithi087.stdout:(118/177): python3-devel-3.9.17-2.el9.x86_64.rp 1.1 MB/s | 245 kB 00:00 2023-12-16T20:15:25.013 INFO:teuthology.orchestra.run.smithi087.stdout:(119/177): gperftools-libs-2.9.1-2.el9.x86_64.r 1.4 MB/s | 309 kB 00:00 2023-12-16T20:15:25.144 INFO:teuthology.orchestra.run.smithi087.stdout:(120/177): openssl-devel-3.0.7-25.el9.x86_64.rp 7.0 MB/s | 4.1 MB 00:00 2023-12-16T20:15:25.227 INFO:teuthology.orchestra.run.smithi087.stdout:(121/177): libarrow-9.0.0-10.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2023-12-16T20:15:25.252 INFO:teuthology.orchestra.run.smithi087.stdout:(122/177): libarrow-doc-9.0.0-10.el9.noarch.rpm 246 kB/s | 26 kB 00:00 2023-12-16T20:15:25.361 INFO:teuthology.orchestra.run.smithi087.stdout:(123/177): liboath-2.6.7-2.el9.x86_64.rpm 365 kB/s | 49 kB 00:00 2023-12-16T20:15:25.637 INFO:teuthology.orchestra.run.smithi087.stdout:(124/177): libunwind-1.6.2-1.el9.x86_64.rpm 176 kB/s | 67 kB 00:00 2023-12-16T20:15:25.945 INFO:teuthology.orchestra.run.smithi087.stdout:(125/177): luarocks-3.9.2-1.el9.noarch.rpm 259 kB/s | 151 kB 00:00 2023-12-16T20:15:26.254 INFO:teuthology.orchestra.run.smithi087.stdout:(126/177): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.3 MB/s | 838 kB 00:00 2023-12-16T20:15:26.504 INFO:teuthology.orchestra.run.smithi087.stdout:(127/177): python3-asyncssh-2.13.2-3.el9.noarch 984 kB/s | 548 kB 00:00 2023-12-16T20:15:26.796 INFO:teuthology.orchestra.run.smithi087.stdout:(128/177): python3-bcrypt-3.2.2-1.el9.x86_64.rp 80 kB/s | 43 kB 00:00 2023-12-16T20:15:27.063 INFO:teuthology.orchestra.run.smithi087.stdout:(129/177): python3-cachetools-4.2.4-1.el9.noarc 58 kB/s | 32 kB 00:00 2023-12-16T20:15:27.088 INFO:teuthology.orchestra.run.smithi087.stdout:(130/177): python3-certifi-2021.10.8-2.el9.noar 51 kB/s | 15 kB 00:00 2023-12-16T20:15:27.130 INFO:teuthology.orchestra.run.smithi087.stdout:(131/177): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2023-12-16T20:15:27.180 INFO:teuthology.orchestra.run.smithi087.stdout:(132/177): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2023-12-16T20:15:27.206 INFO:teuthology.orchestra.run.smithi087.stdout:(133/177): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.0 MB/s | 303 kB 00:00 2023-12-16T20:15:27.231 INFO:teuthology.orchestra.run.smithi087.stdout:(134/177): python3-colorama-0.4.4-12.el9.noarch 710 kB/s | 35 kB 00:00 2023-12-16T20:15:27.256 INFO:teuthology.orchestra.run.smithi087.stdout:(135/177): python3-google-auth-2.23.4-1.el9.noa 3.9 MB/s | 197 kB 00:00 2023-12-16T20:15:27.281 INFO:teuthology.orchestra.run.smithi087.stdout:(136/177): python3-jaraco-8.2.1-3.el9.noarch.rp 215 kB/s | 11 kB 00:00 2023-12-16T20:15:27.307 INFO:teuthology.orchestra.run.smithi087.stdout:(137/177): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2023-12-16T20:15:27.332 INFO:teuthology.orchestra.run.smithi087.stdout:(138/177): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2023-12-16T20:15:27.357 INFO:teuthology.orchestra.run.smithi087.stdout:(139/177): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2023-12-16T20:15:27.383 INFO:teuthology.orchestra.run.smithi087.stdout:(140/177): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2023-12-16T20:15:27.408 INFO:teuthology.orchestra.run.smithi087.stdout:(141/177): python3-jwt+crypto-2.4.0-1.el9.noarc 180 kB/s | 9.0 kB 00:00 2023-12-16T20:15:27.433 INFO:teuthology.orchestra.run.smithi087.stdout:(142/177): python3-jwt-2.4.0-1.el9.noarch.rpm 820 kB/s | 41 kB 00:00 2023-12-16T20:15:27.492 INFO:teuthology.orchestra.run.smithi087.stdout:(143/177): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2023-12-16T20:15:27.517 INFO:teuthology.orchestra.run.smithi087.stdout:(144/177): python3-logutils-0.3.5-21.el9.noarch 563 kB/s | 46 kB 00:00 2023-12-16T20:15:27.543 INFO:teuthology.orchestra.run.smithi087.stdout:(145/177): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2023-12-16T20:15:27.568 INFO:teuthology.orchestra.run.smithi087.stdout:(146/177): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2023-12-16T20:15:27.593 INFO:teuthology.orchestra.run.smithi087.stdout:(147/177): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2023-12-16T20:15:27.610 INFO:teuthology.orchestra.run.smithi087.stdout:(148/177): python3-portend-3.1.0-2.el9.noarch.r 398 kB/s | 16 kB 00:00 2023-12-16T20:15:27.644 INFO:teuthology.orchestra.run.smithi087.stdout:(149/177): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2023-12-16T20:15:27.660 INFO:teuthology.orchestra.run.smithi087.stdout:(150/177): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2023-12-16T20:15:27.686 INFO:teuthology.orchestra.run.smithi087.stdout:(151/177): python3-repoze-lru-0.7-16.el9.noarch 740 kB/s | 31 kB 00:00 2023-12-16T20:15:27.711 INFO:teuthology.orchestra.run.smithi087.stdout:(152/177): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2023-12-16T20:15:27.728 INFO:teuthology.orchestra.run.smithi087.stdout:(153/177): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2023-12-16T20:15:27.753 INFO:teuthology.orchestra.run.smithi087.stdout:(154/177): python3-tempora-5.0.0-2.el9.noarch.r 861 kB/s | 36 kB 00:00 2023-12-16T20:15:27.770 INFO:teuthology.orchestra.run.smithi087.stdout:(155/177): python3-typing-extensions-4.4.0-2.el 1.2 MB/s | 51 kB 00:00 2023-12-16T20:15:27.804 INFO:teuthology.orchestra.run.smithi087.stdout:(156/177): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2023-12-16T20:15:27.829 INFO:teuthology.orchestra.run.smithi087.stdout:(157/177): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2023-12-16T20:15:27.862 INFO:teuthology.orchestra.run.smithi087.stdout:(158/177): python3-werkzeug-2.0.3-3.el9.1.noarc 7.1 MB/s | 427 kB 00:00 2023-12-16T20:15:27.888 INFO:teuthology.orchestra.run.smithi087.stdout:(159/177): python3-zc-lockfile-2.0-10.el9.noarc 346 kB/s | 20 kB 00:00 2023-12-16T20:15:27.913 INFO:teuthology.orchestra.run.smithi087.stdout:(160/177): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2023-12-16T20:15:27.947 INFO:teuthology.orchestra.run.smithi087.stdout:(161/177): thrift-0.15.0-2.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2023-12-16T20:15:28.514 INFO:teuthology.orchestra.run.smithi087.stdout:(162/177): librados2-19.0.0-202.gc7586e95.el9.x 5.6 MB/s | 3.3 MB 00:00 2023-12-16T20:15:28.572 INFO:teuthology.orchestra.run.smithi087.stdout:(163/177): librbd1-19.0.0-202.gc7586e95.el9.x86 4.8 MB/s | 3.0 MB 00:00 2023-12-16T20:15:28.597 INFO:teuthology.orchestra.run.smithi087.stdout:(164/177): libacl-devel-2.3.1-4.el9.x86_64.rpm 811 kB/s | 68 kB 00:00 2023-12-16T20:15:28.614 INFO:teuthology.orchestra.run.smithi087.stdout:(165/177): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-12-16T20:15:28.639 INFO:teuthology.orchestra.run.smithi087.stdout:(166/177): elfutils-debuginfod-client-0.190-1.e 880 kB/s | 36 kB 00:00 2023-12-16T20:15:28.664 INFO:teuthology.orchestra.run.smithi087.stdout:(167/177): elfutils-libelf-0.190-1.el9.x86_64.r 3.8 MB/s | 192 kB 00:00 2023-12-16T20:15:28.690 INFO:teuthology.orchestra.run.smithi087.stdout:(168/177): elfutils-libs-0.190-1.el9.x86_64.rpm 5.0 MB/s | 255 kB 00:00 2023-12-16T20:15:28.715 INFO:teuthology.orchestra.run.smithi087.stdout:(169/177): libacl-2.3.1-4.el9.x86_64.rpm 441 kB/s | 22 kB 00:00 2023-12-16T20:15:28.740 INFO:teuthology.orchestra.run.smithi087.stdout:(170/177): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2023-12-16T20:15:28.941 INFO:teuthology.orchestra.run.smithi087.stdout:(171/177): NetworkManager-libnm-1.45.7-1.el9.x8 8.9 MB/s | 1.8 MB 00:00 2023-12-16T20:15:28.983 INFO:teuthology.orchestra.run.smithi087.stdout:(172/177): NetworkManager-1.45.7-1.el9.x86_64.r 8.5 MB/s | 2.3 MB 00:00 2023-12-16T20:15:29.008 INFO:teuthology.orchestra.run.smithi087.stdout:(173/177): NetworkManager-team-1.45.7-1.el9.x86 649 kB/s | 43 kB 00:00 2023-12-16T20:15:29.033 INFO:teuthology.orchestra.run.smithi087.stdout:(174/177): NetworkManager-tui-1.45.7-1.el9.x86_ 4.8 MB/s | 246 kB 00:00 2023-12-16T20:15:29.075 INFO:teuthology.orchestra.run.smithi087.stdout:(175/177): openssl-3.0.7-25.el9.x86_64.rpm 18 MB/s | 1.2 MB 00:00 2023-12-16T20:15:29.126 INFO:teuthology.orchestra.run.smithi087.stdout:(176/177): openssl-libs-3.0.7-25.el9.x86_64.rpm 23 MB/s | 2.2 MB 00:00 2023-12-16T20:15:40.767 INFO:teuthology.orchestra.run.smithi087.stdout:(177/177): ceph-test-debuginfo-19.0.0-202.gc758 7.7 MB/s | 622 MB 01:20 2023-12-16T20:15:40.773 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2023-12-16T20:15:40.773 INFO:teuthology.orchestra.run.smithi087.stdout:Total 11 MB/s | 2.1 GB 03:09 2023-12-16T20:15:40.899 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2023-12-16T20:15:40.934 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2023-12-16T20:15:41.029 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 1/192 2023-12-16T20:15:41.119 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 2/192 2023-12-16T20:15:41.124 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2023-12-16T20:15:41.125 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2023-12-16T20:15:41.145 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : thrift-0.15.0-2.el9.x86_64 3/192 2023-12-16T20:15:41.193 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/192 2023-12-16T20:15:41.228 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/192 2023-12-16T20:15:41.254 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/192 2023-12-16T20:15:41.304 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/192 2023-12-16T20:15:41.628 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/192 2023-12-16T20:15:41.688 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados2-2:19.0.0-202.gc7586e95.el9.x86_64 9/192 2023-12-16T20:15:41.791 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:19.0.0-202.gc7586e95.el9.x86_64 9/192 2023-12-16T20:15:41.823 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs2-2:19.0.0-202.gc7586e95.el9.x86_64 10/192 2023-12-16T20:15:41.896 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:19.0.0-202.gc7586e95.el9.x86_64 10/192 2023-12-16T20:15:41.932 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rados-2:19.0.0-202.gc7586e95.el9.x86_64 11/192 2023-12-16T20:15:41.973 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 12/192 2023-12-16T20:15:42.148 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 13/192 2023-12-16T20:15:42.200 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/192 2023-12-16T20:15:42.228 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephsqlite-2:19.0.0-202.gc7586e95.el9.x86_64 15/192 2023-12-16T20:15:42.329 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:19.0.0-202.gc7586e95.el9.x86_64 15/192 2023-12-16T20:15:42.354 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libradosstriper1-2:19.0.0-202.gc7586e95.el9.x86_ 16/192 2023-12-16T20:15:42.580 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:19.0.0-202.gc7586e95.el9.x86_ 16/192 2023-12-16T20:15:42.691 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 17/192 2023-12-16T20:15:42.751 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 17/192 2023-12-16T20:15:42.838 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 18/192 2023-12-16T20:15:42.886 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 18/192 2023-12-16T20:15:43.109 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 18/192 2023-12-16T20:15:43.205 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 19/192 2023-12-16T20:15:43.240 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/192 2023-12-16T20:15:43.311 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/192 2023-12-16T20:15:43.364 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 22/192 2023-12-16T20:15:43.394 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/192 2023-12-16T20:15:43.438 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 24/192 2023-12-16T20:15:43.478 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 25/192 2023-12-16T20:15:43.541 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/192 2023-12-16T20:15:43.577 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/192 2023-12-16T20:15:43.605 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/192 2023-12-16T20:15:43.675 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/192 2023-12-16T20:15:43.709 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-common-2:19.0.0-202.gc7586e95.el9.x 30/192 2023-12-16T20:15:43.753 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-argparse-2:19.0.0-202.gc7586e95.el9 31/192 2023-12-16T20:15:43.883 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cephfs-2:19.0.0-202.gc7586e95.el9.x86_64 32/192 2023-12-16T20:15:44.215 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/192 2023-12-16T20:15:44.271 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/192 2023-12-16T20:15:44.793 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/192 2023-12-16T20:15:44.875 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/192 2023-12-16T20:15:44.924 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/192 2023-12-16T20:15:44.972 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 38/192 2023-12-16T20:15:45.010 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados-devel-2:19.0.0-202.gc7586e95.el9.x86_64 39/192 2023-12-16T20:15:45.052 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/192 2023-12-16T20:15:45.206 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 41/192 2023-12-16T20:15:45.257 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 42/192 2023-12-16T20:15:45.360 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : re2-1:20211101-3.el9.x86_64 43/192 2023-12-16T20:15:45.391 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 44/192 2023-12-16T20:15:45.437 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/192 2023-12-16T20:15:45.509 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/192 2023-12-16T20:15:45.541 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/192 2023-12-16T20:15:45.578 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/192 2023-12-16T20:15:45.624 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/192 2023-12-16T20:15:45.660 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/192 2023-12-16T20:15:45.703 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/192 2023-12-16T20:15:45.745 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/192 2023-12-16T20:15:45.878 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/192 2023-12-16T20:15:45.918 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/192 2023-12-16T20:15:45.965 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 55/192 2023-12-16T20:15:46.006 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/192 2023-12-16T20:15:46.100 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/192 2023-12-16T20:15:46.133 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 58/192 2023-12-16T20:15:46.178 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/192 2023-12-16T20:15:46.206 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/192 2023-12-16T20:15:46.300 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 61/192 2023-12-16T20:15:46.341 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/192 2023-12-16T20:15:46.390 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/192 2023-12-16T20:15:46.445 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/192 2023-12-16T20:15:46.636 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/192 2023-12-16T20:15:46.679 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/192 2023-12-16T20:15:46.808 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/192 2023-12-16T20:15:46.848 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/192 2023-12-16T20:15:46.878 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/192 2023-12-16T20:15:46.911 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/192 2023-12-16T20:15:46.944 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/192 2023-12-16T20:15:46.974 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/192 2023-12-16T20:15:47.002 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/192 2023-12-16T20:15:47.046 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/192 2023-12-16T20:15:47.084 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/192 2023-12-16T20:15:47.116 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/192 2023-12-16T20:15:47.149 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/192 2023-12-16T20:15:47.222 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/192 2023-12-16T20:15:47.257 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/192 2023-12-16T20:15:47.290 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/192 2023-12-16T20:15:47.331 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/192 2023-12-16T20:15:47.366 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/192 2023-12-16T20:15:47.463 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/192 2023-12-16T20:15:47.502 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/192 2023-12-16T20:15:47.605 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/192 2023-12-16T20:15:47.661 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/192 2023-12-16T20:15:48.395 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/192 2023-12-16T20:15:48.442 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/192 2023-12-16T20:15:48.475 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/192 2023-12-16T20:15:48.523 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/192 2023-12-16T20:15:48.620 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/192 2023-12-16T20:15:48.659 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/192 2023-12-16T20:15:48.836 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/192 2023-12-16T20:15:48.866 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/192 2023-12-16T20:15:48.943 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/192 2023-12-16T20:15:49.628 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/192 2023-12-16T20:15:49.747 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/192 2023-12-16T20:15:50.989 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/192 2023-12-16T20:15:51.075 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/192 2023-12-16T20:15:51.106 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/192 2023-12-16T20:15:51.143 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : jq-1.6-16.el9.x86_64 101/192 2023-12-16T20:15:51.217 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lua-5.4.4-4.el9.x86_64 102/192 2023-12-16T20:15:51.247 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : luarocks-3.9.2-1.el9.noarch 103/192 2023-12-16T20:15:51.276 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/192 2023-12-16T20:15:51.309 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 105/192 2023-12-16T20:15:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 106/192 2023-12-16T20:15:51.639 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librbd1-2:19.0.0-202.gc7586e95.el9.x86_64 107/192 2023-12-16T20:15:51.712 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:19.0.0-202.gc7586e95.el9.x86_64 107/192 2023-12-16T20:15:51.743 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rbd-2:19.0.0-202.gc7586e95.el9.x86_64 108/192 2023-12-16T20:15:51.779 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 109/192 2023-12-16T20:15:52.200 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 110/192 2023-12-16T20:15:52.225 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librgw2-2:19.0.0-202.gc7586e95.el9.x86_64 111/192 2023-12-16T20:15:52.295 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:19.0.0-202.gc7586e95.el9.x86_64 111/192 2023-12-16T20:15:52.318 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rgw-2:19.0.0-202.gc7586e95.el9.x86_64 112/192 2023-12-16T20:15:54.304 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2023-12-16T20:15:54.304 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2023-12-16T20:15:54.371 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:19.0.0-202.gc7586e95.el9.x86_64 113/192 2023-12-16T20:15:54.406 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-common-2:19.0.0-202.gc7586e95.el9.x86_64 113/192 2023-12-16T20:15:54.945 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:19.0.0-202.gc7586e95.el9.x86_64 113/192 2023-12-16T20:15:54.985 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-base-2:19.0.0-202.gc7586e95.el9.x86_64 114/192 2023-12-16T20:15:55.072 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:19.0.0-202.gc7586e95.el9.x86_64 114/192 2023-12-16T20:15:55.072 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-16T20:15:55.072 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-16T20:15:55.072 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:15:55.103 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-selinux-2:19.0.0-202.gc7586e95.el9.x86_64 115/192 2023-12-16T20:16:07.346 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:19.0.0-202.gc7586e95.el9.x86_64 115/192 2023-12-16T20:16:07.346 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /sys 2023-12-16T20:16:07.346 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /proc 2023-12-16T20:16:07.346 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /mnt 2023-12-16T20:16:07.346 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /var/tmp 2023-12-16T20:16:07.346 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /home 2023-12-16T20:16:07.346 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /root 2023-12-16T20:16:07.346 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /tmp 2023-12-16T20:16:07.346 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:16:07.507 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-volume-2:19.0.0-202.gc7586e95.el9.noarch 116/192 2023-12-16T20:16:07.521 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-volume-2:19.0.0-202.gc7586e95.el9.noarch 116/192 2023-12-16T20:16:07.521 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:16:07.522 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-16T20:16:07.522 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:16:09.101 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-osd-2:19.0.0-202.gc7586e95.el9.x86_64 117/192 2023-12-16T20:16:09.126 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:19.0.0-202.gc7586e95.el9.x86_64 117/192 2023-12-16T20:16:09.126 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:16:09.127 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-16T20:16:09.127 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-16T20:16:09.127 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-16T20:16:09.127 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:16:09.327 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mds-2:19.0.0-202.gc7586e95.el9.x86_64 118/192 2023-12-16T20:16:09.350 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:19.0.0-202.gc7586e95.el9.x86_64 118/192 2023-12-16T20:16:09.350 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:16:09.350 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-16T20:16:09.350 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-16T20:16:09.350 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-16T20:16:09.350 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:16:09.796 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mon-2:19.0.0-202.gc7586e95.el9.x86_64 119/192 2023-12-16T20:16:09.818 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:19.0.0-202.gc7586e95.el9.x86_64 119/192 2023-12-16T20:16:09.818 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:16:09.818 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-16T20:16:09.818 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-16T20:16:09.818 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-16T20:16:09.819 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:16:09.914 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : automake-1.16.2-8.el9.noarch 120/192 2023-12-16T20:16:10.334 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:19.0.0-202.gc7586e95.el9.noarch 121/192 2023-12-16T20:16:10.363 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephadm-2:19.0.0-202.gc7586e95.el9.noarch 121/192 2023-12-16T20:16:10.393 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-202.gc7586e95.el 122/192 2023-12-16T20:16:10.454 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-202.gc7586e95.e 123/192 2023-12-16T20:16:10.478 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-202.gc7586e95.el9.noar 124/192 2023-12-16T20:16:10.702 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-202.gc7586e95.el9.noar 124/192 2023-12-16T20:16:10.746 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-202.gc7586e95.el9.no 125/192 2023-12-16T20:16:11.712 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-202.gc7586e95.el9.no 125/192 2023-12-16T20:16:11.737 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-202.gc758 126/192 2023-12-16T20:16:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-202.gc758 126/192 2023-12-16T20:16:11.996 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-202.gc7586e95.el9 127/192 2023-12-16T20:16:12.023 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-2:19.0.0-202.gc7586e95.el9.x86_64 128/192 2023-12-16T20:16:12.046 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:19.0.0-202.gc7586e95.el9.x86_64 128/192 2023-12-16T20:16:12.046 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:16:12.046 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-16T20:16:12.046 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-16T20:16:12.046 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-16T20:16:12.046 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:16:12.091 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-rook-2:19.0.0-202.gc7586e95.el9.noarch 129/192 2023-12-16T20:16:12.101 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-202.gc7586e95.el9.noarch 129/192 2023-12-16T20:16:12.149 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-2:19.0.0-202.gc7586e95.el9.x86_64 130/192 2023-12-16T20:16:12.919 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/192 2023-12-16T20:16:12.951 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-radosgw-2:19.0.0-202.gc7586e95.el9.x86_64 132/192 2023-12-16T20:16:12.973 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-202.gc7586e95.el9.x86_64 132/192 2023-12-16T20:16:12.973 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:16:12.973 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-16T20:16:12.973 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-16T20:16:12.973 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-16T20:16:12.973 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:16:13.010 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-202.gc7586e 133/192 2023-12-16T20:16:13.032 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-202.gc7586e 133/192 2023-12-16T20:16:13.032 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:16:13.032 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-16T20:16:13.032 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:16:13.077 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-mirror-2:19.0.0-202.gc7586e95.el9.x86_64 134/192 2023-12-16T20:16:13.099 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-202.gc7586e95.el9.x86_64 134/192 2023-12-16T20:16:13.099 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:16:13.099 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-16T20:16:13.099 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-16T20:16:13.099 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-16T20:16:13.099 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:16:13.395 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-mirror-2:19.0.0-202.gc7586e95.el9.x86_64 135/192 2023-12-16T20:16:13.417 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:19.0.0-202.gc7586e95.el9.x86_64 135/192 2023-12-16T20:16:13.417 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:16:13.417 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-16T20:16:13.417 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-16T20:16:13.418 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-16T20:16:13.418 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:16:14.561 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2023-12-16T20:16:14.794 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 1/192 2023-12-16T20:16:14.892 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 2/192 2023-12-16T20:16:14.918 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : thrift-0.15.0-2.el9.x86_64 3/192 2023-12-16T20:16:14.956 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/192 2023-12-16T20:16:15.001 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/192 2023-12-16T20:16:15.027 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/192 2023-12-16T20:16:15.080 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/192 2023-12-16T20:16:15.414 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/192 2023-12-16T20:16:15.478 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librados2-2:19.0.0-202.gc7586e95.el9.x86_64 9/192 2023-12-16T20:16:15.579 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:19.0.0-202.gc7586e95.el9.x86_64 9/192 2023-12-16T20:16:15.604 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs2-2:19.0.0-202.gc7586e95.el9.x86_64 10/192 2023-12-16T20:16:15.694 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs2-2:19.0.0-202.gc7586e95.el9.x86_64 10/192 2023-12-16T20:16:15.729 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rados-2:19.0.0-202.gc7586e95.el9.x86_64 11/192 2023-12-16T20:16:15.776 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 12/192 2023-12-16T20:16:15.970 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 13/192 2023-12-16T20:16:16.022 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/192 2023-12-16T20:16:16.041 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephsqlite-2:19.0.0-202.gc7586e95.el9.x86_64 15/192 2023-12-16T20:16:16.141 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephsqlite-2:19.0.0-202.gc7586e95.el9.x86_64 15/192 2023-12-16T20:16:16.167 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libradosstriper1-2:19.0.0-202.gc7586e95.el9.x86_ 16/192 2023-12-16T20:16:16.350 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libradosstriper1-2:19.0.0-202.gc7586e95.el9.x86_ 16/192 2023-12-16T20:16:16.463 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 17/192 2023-12-16T20:16:16.506 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 17/192 2023-12-16T20:16:16.601 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 18/192 2023-12-16T20:16:16.649 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 18/192 2023-12-16T20:16:16.874 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 18/192 2023-12-16T20:16:16.983 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 19/192 2023-12-16T20:16:17.153 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/192 2023-12-16T20:16:17.224 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-test-2:19.0.0-202.gc7586e95.el9.x86_64 136/192 2023-12-16T20:16:17.264 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-fuse-2:19.0.0-202.gc7586e95.el9.x86_64 137/192 2023-12-16T20:16:17.309 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/192 2023-12-16T20:16:17.313 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-nbd-2:19.0.0-202.gc7586e95.el9.x86_64 138/192 2023-12-16T20:16:17.354 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 139/192 2023-12-16T20:16:17.381 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 140/192 2023-12-16T20:16:17.410 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 22/192 2023-12-16T20:16:17.440 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/192 2023-12-16T20:16:17.500 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 24/192 2023-12-16T20:16:17.541 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 25/192 2023-12-16T20:16:17.572 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-shell-2:19.0.0-202.gc7586e95.el9.x86_64 141/192 2023-12-16T20:16:17.606 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/192 2023-12-16T20:16:17.640 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/192 2023-12-16T20:16:17.667 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/192 2023-12-16T20:16:17.677 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 142/192 2023-12-16T20:16:17.713 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-fuse-2:19.0.0-202.gc7586e95.el9.x86_64 143/192 2023-12-16T20:16:17.737 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/192 2023-12-16T20:16:17.743 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs-devel-2:19.0.0-202.gc7586e95.el9.x86_6 144/192 2023-12-16T20:16:17.772 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-common-2:19.0.0-202.gc7586e95.el9.x 30/192 2023-12-16T20:16:17.815 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 145/192 2023-12-16T20:16:17.815 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-argparse-2:19.0.0-202.gc7586e95.el9 31/192 2023-12-16T20:16:17.882 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 146/192 2023-12-16T20:16:17.890 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cephfs-2:19.0.0-202.gc7586e95.el9.x86_64 32/192 2023-12-16T20:16:17.922 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 147/192 2023-12-16T20:16:17.952 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 148/192 2023-12-16T20:16:17.997 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 149/192 2023-12-16T20:16:18.029 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/192 2023-12-16T20:16:18.085 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/192 2023-12-16T20:16:18.599 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/192 2023-12-16T20:16:18.639 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 150/192 2023-12-16T20:16:18.640 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/192 2023-12-16T20:16:18.658 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/192 2023-12-16T20:16:18.731 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/192 2023-12-16T20:16:18.764 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/192 2023-12-16T20:16:18.810 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 38/192 2023-12-16T20:16:18.848 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librados-devel-2:19.0.0-202.gc7586e95.el9.x86_64 39/192 2023-12-16T20:16:18.890 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/192 2023-12-16T20:16:19.037 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 41/192 2023-12-16T20:16:19.090 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 42/192 2023-12-16T20:16:19.195 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : re2-1:20211101-3.el9.x86_64 43/192 2023-12-16T20:16:19.226 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 44/192 2023-12-16T20:16:19.282 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/192 2023-12-16T20:16:19.355 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/192 2023-12-16T20:16:19.393 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/192 2023-12-16T20:16:19.430 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/192 2023-12-16T20:16:19.457 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-top-2:19.0.0-202.gc7586e95.el9.noarch 151/192 2023-12-16T20:16:19.476 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/192 2023-12-16T20:16:19.512 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/192 2023-12-16T20:16:19.555 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/192 2023-12-16T20:16:19.597 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/192 2023-12-16T20:16:19.735 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/192 2023-12-16T20:16:19.778 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/192 2023-12-16T20:16:19.814 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 55/192 2023-12-16T20:16:19.856 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/192 2023-12-16T20:16:19.952 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/192 2023-12-16T20:16:19.990 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 58/192 2023-12-16T20:16:20.030 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/192 2023-12-16T20:16:20.060 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/192 2023-12-16T20:16:20.161 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 61/192 2023-12-16T20:16:20.208 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/192 2023-12-16T20:16:20.265 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/192 2023-12-16T20:16:20.322 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/192 2023-12-16T20:16:20.515 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/192 2023-12-16T20:16:20.562 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/192 2023-12-16T20:16:20.704 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/192 2023-12-16T20:16:20.748 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/192 2023-12-16T20:16:20.777 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/192 2023-12-16T20:16:20.811 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/192 2023-12-16T20:16:20.843 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/192 2023-12-16T20:16:20.873 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/192 2023-12-16T20:16:20.901 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/192 2023-12-16T20:16:20.943 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/192 2023-12-16T20:16:20.975 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/192 2023-12-16T20:16:21.006 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/192 2023-12-16T20:16:21.036 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/192 2023-12-16T20:16:21.114 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/192 2023-12-16T20:16:21.164 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/192 2023-12-16T20:16:21.196 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/192 2023-12-16T20:16:21.238 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/192 2023-12-16T20:16:21.272 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/192 2023-12-16T20:16:21.364 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/192 2023-12-16T20:16:21.400 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/192 2023-12-16T20:16:21.498 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/192 2023-12-16T20:16:21.551 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/192 2023-12-16T20:16:22.309 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/192 2023-12-16T20:16:22.348 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/192 2023-12-16T20:16:22.382 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/192 2023-12-16T20:16:22.430 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/192 2023-12-16T20:16:22.520 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/192 2023-12-16T20:16:22.566 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/192 2023-12-16T20:16:22.747 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/192 2023-12-16T20:16:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/192 2023-12-16T20:16:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/192 2023-12-16T20:16:23.554 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/192 2023-12-16T20:16:23.670 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/192 2023-12-16T20:16:24.947 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/192 2023-12-16T20:16:25.030 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/192 2023-12-16T20:16:25.078 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/192 2023-12-16T20:16:25.114 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : jq-1.6-16.el9.x86_64 101/192 2023-12-16T20:16:25.196 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lua-5.4.4-4.el9.x86_64 102/192 2023-12-16T20:16:25.227 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : luarocks-3.9.2-1.el9.noarch 103/192 2023-12-16T20:16:25.256 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/192 2023-12-16T20:16:25.288 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 105/192 2023-12-16T20:16:25.590 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 106/192 2023-12-16T20:16:25.622 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librbd1-2:19.0.0-202.gc7586e95.el9.x86_64 107/192 2023-12-16T20:16:25.709 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:19.0.0-202.gc7586e95.el9.x86_64 107/192 2023-12-16T20:16:25.739 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rbd-2:19.0.0-202.gc7586e95.el9.x86_64 108/192 2023-12-16T20:16:25.775 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 109/192 2023-12-16T20:16:26.202 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 110/192 2023-12-16T20:16:26.229 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librgw2-2:19.0.0-202.gc7586e95.el9.x86_64 111/192 2023-12-16T20:16:26.283 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librgw2-2:19.0.0-202.gc7586e95.el9.x86_64 111/192 2023-12-16T20:16:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rgw-2:19.0.0-202.gc7586e95.el9.x86_64 112/192 2023-12-16T20:16:27.104 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/192 2023-12-16T20:16:28.426 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:19.0.0-202.gc7586e95.el9.x86_64 113/192 2023-12-16T20:16:28.469 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-common-2:19.0.0-202.gc7586e95.el9.x86_64 113/192 2023-12-16T20:16:29.007 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:19.0.0-202.gc7586e95.el9.x86_64 113/192 2023-12-16T20:16:29.039 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-base-2:19.0.0-202.gc7586e95.el9.x86_64 114/192 2023-12-16T20:16:29.110 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-base-2:19.0.0-202.gc7586e95.el9.x86_64 114/192 2023-12-16T20:16:29.111 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-16T20:16:29.111 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-16T20:16:29.111 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:16:29.149 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-selinux-2:19.0.0-202.gc7586e95.el9.x86_64 115/192 2023-12-16T20:16:41.273 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-selinux-2:19.0.0-202.gc7586e95.el9.x86_64 115/192 2023-12-16T20:16:41.273 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /sys 2023-12-16T20:16:41.273 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /proc 2023-12-16T20:16:41.274 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /mnt 2023-12-16T20:16:41.274 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /var/tmp 2023-12-16T20:16:41.274 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /home 2023-12-16T20:16:41.274 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /root 2023-12-16T20:16:41.274 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /tmp 2023-12-16T20:16:41.274 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:16:41.434 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-volume-2:19.0.0-202.gc7586e95.el9.noarch 116/192 2023-12-16T20:16:41.449 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-volume-2:19.0.0-202.gc7586e95.el9.noarch 116/192 2023-12-16T20:16:41.449 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:16:41.450 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-16T20:16:41.450 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:16:42.979 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-osd-2:19.0.0-202.gc7586e95.el9.x86_64 117/192 2023-12-16T20:16:43.004 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-osd-2:19.0.0-202.gc7586e95.el9.x86_64 117/192 2023-12-16T20:16:43.004 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:16:43.004 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-16T20:16:43.004 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-16T20:16:43.004 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-16T20:16:43.004 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:16:43.204 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mds-2:19.0.0-202.gc7586e95.el9.x86_64 118/192 2023-12-16T20:16:43.226 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mds-2:19.0.0-202.gc7586e95.el9.x86_64 118/192 2023-12-16T20:16:43.226 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:16:43.226 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-16T20:16:43.227 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-16T20:16:43.227 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-16T20:16:43.227 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:16:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mon-2:19.0.0-202.gc7586e95.el9.x86_64 119/192 2023-12-16T20:16:43.685 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mon-2:19.0.0-202.gc7586e95.el9.x86_64 119/192 2023-12-16T20:16:43.685 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:16:43.685 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-16T20:16:43.685 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-16T20:16:43.685 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-16T20:16:43.686 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:16:43.775 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : automake-1.16.2-8.el9.noarch 120/192 2023-12-16T20:16:44.169 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephadm-2:19.0.0-202.gc7586e95.el9.noarch 121/192 2023-12-16T20:16:44.207 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephadm-2:19.0.0-202.gc7586e95.el9.noarch 121/192 2023-12-16T20:16:44.236 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-202.gc7586e95.el 122/192 2023-12-16T20:16:44.298 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-202.gc7586e95.e 123/192 2023-12-16T20:16:44.324 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-202.gc7586e95.el9.noar 124/192 2023-12-16T20:16:44.549 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-202.gc7586e95.el9.noar 124/192 2023-12-16T20:16:44.572 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-202.gc7586e95.el9.no 125/192 2023-12-16T20:16:45.527 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-202.gc7586e95.el9.no 125/192 2023-12-16T20:16:45.548 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-202.gc758 126/192 2023-12-16T20:16:45.648 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-202.gc758 126/192 2023-12-16T20:16:45.813 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-202.gc7586e95.el9 127/192 2023-12-16T20:16:45.842 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-2:19.0.0-202.gc7586e95.el9.x86_64 128/192 2023-12-16T20:16:45.864 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-2:19.0.0-202.gc7586e95.el9.x86_64 128/192 2023-12-16T20:16:45.864 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:16:45.864 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-16T20:16:45.865 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-16T20:16:45.865 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-16T20:16:45.865 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:16:45.909 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-rook-2:19.0.0-202.gc7586e95.el9.noarch 129/192 2023-12-16T20:16:45.919 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-202.gc7586e95.el9.noarch 129/192 2023-12-16T20:16:45.973 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-2:19.0.0-202.gc7586e95.el9.x86_64 130/192 2023-12-16T20:16:46.749 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/192 2023-12-16T20:16:46.778 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-radosgw-2:19.0.0-202.gc7586e95.el9.x86_64 132/192 2023-12-16T20:16:46.800 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-202.gc7586e95.el9.x86_64 132/192 2023-12-16T20:16:46.800 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:16:46.800 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-16T20:16:46.800 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-16T20:16:46.800 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-16T20:16:46.800 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:16:46.836 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-202.gc7586e 133/192 2023-12-16T20:16:46.858 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-202.gc7586e 133/192 2023-12-16T20:16:46.858 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:16:46.858 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-16T20:16:46.858 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:16:46.912 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-mirror-2:19.0.0-202.gc7586e95.el9.x86_64 134/192 2023-12-16T20:16:46.934 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-202.gc7586e95.el9.x86_64 134/192 2023-12-16T20:16:46.934 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:16:46.934 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-16T20:16:46.934 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-16T20:16:46.934 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-16T20:16:46.934 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:16:47.229 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-mirror-2:19.0.0-202.gc7586e95.el9.x86_64 135/192 2023-12-16T20:16:47.251 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-mirror-2:19.0.0-202.gc7586e95.el9.x86_64 135/192 2023-12-16T20:16:47.251 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-16T20:16:47.251 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-16T20:16:47.251 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-16T20:16:47.251 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-16T20:16:47.251 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:16:51.042 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-test-2:19.0.0-202.gc7586e95.el9.x86_64 136/192 2023-12-16T20:16:51.082 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-fuse-2:19.0.0-202.gc7586e95.el9.x86_64 137/192 2023-12-16T20:16:51.123 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-nbd-2:19.0.0-202.gc7586e95.el9.x86_64 138/192 2023-12-16T20:16:51.146 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 139/192 2023-12-16T20:16:51.174 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 140/192 2023-12-16T20:16:51.366 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-shell-2:19.0.0-202.gc7586e95.el9.x86_64 141/192 2023-12-16T20:16:51.479 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 142/192 2023-12-16T20:16:51.512 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-fuse-2:19.0.0-202.gc7586e95.el9.x86_64 143/192 2023-12-16T20:16:51.553 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs-devel-2:19.0.0-202.gc7586e95.el9.x86_6 144/192 2023-12-16T20:16:51.630 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 145/192 2023-12-16T20:16:51.691 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 146/192 2023-12-16T20:16:51.731 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 147/192 2023-12-16T20:16:51.759 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 148/192 2023-12-16T20:16:51.813 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 149/192 2023-12-16T20:16:52.378 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/192 2023-12-16T20:16:52.411 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 150/192 2023-12-16T20:16:52.430 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/192 2023-12-16T20:16:53.269 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-top-2:19.0.0-202.gc7586e95.el9.noarch 151/192 2023-12-16T20:17:00.843 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/192 2023-12-16T20:17:05.995 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-base-debuginfo-2:19.0.0-202.gc7586e95.el9.x 153/192 2023-12-16T20:17:06.602 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-common-debuginfo-2:19.0.0-202.gc7586e95.el9 154/192 2023-12-16T20:17:07.015 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-202.gc7586e95.el9.x 155/192 2023-12-16T20:17:11.552 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-2 156/192 2023-12-16T20:17:13.522 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 157/192 2023-12-16T20:17:24.607 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 158/192 2023-12-16T20:17:39.461 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-base-debuginfo-2:19.0.0-202.gc7586e95.el9.x 153/192 2023-12-16T20:17:40.237 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-common-debuginfo-2:19.0.0-202.gc7586e95.el9 154/192 2023-12-16T20:17:40.652 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-202.gc7586e95.el9.x 155/192 2023-12-16T20:17:45.197 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-2 156/192 2023-12-16T20:17:47.248 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 157/192 2023-12-16T20:17:54.642 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 159/192 2023-12-16T20:17:58.351 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 158/192 2023-12-16T20:18:11.130 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 160/192 2023-12-16T20:18:28.280 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 159/192 2023-12-16T20:18:44.691 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 160/192 2023-12-16T20:19:12.854 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-202.gc7586e95.el 161/192 2023-12-16T20:19:13.458 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-test-debuginfo-2:19.0.0-202.gc7586e95.el9.x 162/192 2023-12-16T20:19:13.505 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-202.gc7586e95.el9. 163/192 2023-12-16T20:19:18.137 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados-devel-debuginfo-2:19.0.0-202.gc7586e95. 164/192 2023-12-16T20:19:23.660 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados2-debuginfo-2:19.0.0-202.gc7586e95.el9.x 165/192 2023-12-16T20:19:24.011 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librbd1-debuginfo-2:19.0.0-202.gc7586e95.el9.x86 166/192 2023-12-16T20:19:24.116 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-202.gc7586e95. 167/192 2023-12-16T20:19:24.251 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rados-debuginfo-2:19.0.0-202.gc7586e95.e 168/192 2023-12-16T20:19:24.309 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-202.gc7586e95.el9 169/192 2023-12-16T20:19:24.389 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-202.gc7586e95.el9 170/192 2023-12-16T20:19:29.738 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 171/192 2023-12-16T20:19:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-202.gc7586e95.el9. 172/192 2023-12-16T20:19:31.241 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-202.gc7586e95.el9.x86 173/192 2023-12-16T20:19:31.425 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 174/192 2023-12-16T20:19:31.475 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 175/192 2023-12-16T20:19:31.562 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flex-2.6.4-9.el9.x86_64 176/192 2023-12-16T20:19:31.605 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : bison-3.7.4-5.el9.x86_64 177/192 2023-12-16T20:19:31.629 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 178/192 2023-12-16T20:19:31.655 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 179/192 2023-12-16T20:19:31.681 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 180/192 2023-12-16T20:19:31.681 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 181/192 2023-12-16T20:19:31.775 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 181/192 2023-12-16T20:19:31.811 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 182/192 2023-12-16T20:19:31.841 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 183/192 2023-12-16T20:19:31.868 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 184/192 2023-12-16T20:19:31.869 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 185/192 2023-12-16T20:19:31.951 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 185/192 2023-12-16T20:19:31.976 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 186/192 2023-12-16T20:19:31.995 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 187/192 2023-12-16T20:19:31.995 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 187/192 2023-12-16T20:19:32.178 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 187/192 2023-12-16T20:19:32.178 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 188/192 2023-12-16T20:19:32.271 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 188/192 2023-12-16T20:19:32.295 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 189/192 2023-12-16T20:19:32.320 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 190/192 2023-12-16T20:19:32.346 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 191/192 2023-12-16T20:19:32.411 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 192/192 2023-12-16T20:19:41.497 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 192/192 2023-12-16T20:19:41.497 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:19.0.0-202.gc7586e95.el9.x86_64 1/192 2023-12-16T20:19:41.497 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:19.0.0-202.gc7586e95.el9.x86_64 2/192 2023-12-16T20:19:41.497 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-202.gc7586e95.el9.x 3/192 2023-12-16T20:19:41.497 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:19.0.0-202.gc7586e95.el9.x86_64 4/192 2023-12-16T20:19:41.497 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-202.gc7586e95.el9 5/192 2023-12-16T20:19:41.498 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 6/192 2023-12-16T20:19:41.498 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:19.0.0-202.gc7586e95.el9.x86_64 7/192 2023-12-16T20:19:41.498 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-202.gc7586e95.el9.x 8/192 2023-12-16T20:19:41.498 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-202.gc7586e 9/192 2023-12-16T20:19:41.498 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-2 10/192 2023-12-16T20:19:41.498 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:19.0.0-202.gc7586e95.el9.x86_64 11/192 2023-12-16T20:19:41.498 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 12/192 2023-12-16T20:19:41.498 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:19.0.0-202.gc7586e95.el9.x86_64 13/192 2023-12-16T20:19:41.498 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 14/192 2023-12-16T20:19:41.498 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:19.0.0-202.gc7586e95.el9.x86_64 15/192 2023-12-16T20:19:41.498 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 16/192 2023-12-16T20:19:41.498 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:19.0.0-202.gc7586e95.el9.x86_64 17/192 2023-12-16T20:19:41.498 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 18/192 2023-12-16T20:19:41.498 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:19.0.0-202.gc7586e95.el9.x86_64 19/192 2023-12-16T20:19:41.499 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-202.gc7586e95.el 20/192 2023-12-16T20:19:41.499 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:19.0.0-202.gc7586e95.el9.x86_64 21/192 2023-12-16T20:19:41.499 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:19.0.0-202.gc7586e95.el9.x86_64 22/192 2023-12-16T20:19:41.499 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-202.gc7586e95.el9.x 23/192 2023-12-16T20:19:41.499 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-mirror-2:19.0.0-202.gc7586e95.el9.x86_64 24/192 2023-12-16T20:19:41.499 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-shell-2:19.0.0-202.gc7586e95.el9.x86_64 25/192 2023-12-16T20:19:41.499 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:19.0.0-202.gc7586e95.el9.x86_6 26/192 2023-12-16T20:19:41.499 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:19.0.0-202.gc7586e95.el9.x86_64 27/192 2023-12-16T20:19:41.499 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-202.gc7586e95.el9. 28/192 2023-12-16T20:19:41.499 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:19.0.0-202.gc7586e95.el9.x86_64 29/192 2023-12-16T20:19:41.514 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:19.0.0-202.gc7586e95.el9.x86_64 30/192 2023-12-16T20:19:41.514 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-202.gc7586e95. 31/192 2023-12-16T20:19:41.514 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-debuginfo-2:19.0.0-202.gc7586e95.el9.x 32/192 2023-12-16T20:19:41.514 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:19.0.0-202.gc7586e95.el9.x86_ 33/192 2023-12-16T20:19:41.514 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-debuginfo-2:19.0.0-202.gc7586e95.el9.x86 34/192 2023-12-16T20:19:41.514 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:19.0.0-202.gc7586e95.el9.x86_64 35/192 2023-12-16T20:19:41.514 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:19.0.0-202.gc7586e95.el9 36/192 2023-12-16T20:19:41.514 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:19.0.0-202.gc7586e95.el9.x 37/192 2023-12-16T20:19:41.514 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:19.0.0-202.gc7586e95.el9.x86_64 38/192 2023-12-16T20:19:41.514 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-202.gc7586e95. 39/192 2023-12-16T20:19:41.514 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:19.0.0-202.gc7586e95.el9.x86_64 40/192 2023-12-16T20:19:41.514 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-202.gc7586e95.e 41/192 2023-12-16T20:19:41.515 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:19.0.0-202.gc7586e95.el9.x86_64 42/192 2023-12-16T20:19:41.515 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-202.gc7586e95.el9 43/192 2023-12-16T20:19:41.515 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:19.0.0-202.gc7586e95.el9.x86_64 44/192 2023-12-16T20:19:41.515 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-202.gc7586e95.el9 45/192 2023-12-16T20:19:41.515 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:19.0.0-202.gc7586e95.el9.x86_64 46/192 2023-12-16T20:19:41.515 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 47/192 2023-12-16T20:19:41.515 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:19.0.0-202.gc7586e95.el9.x86_64 48/192 2023-12-16T20:19:41.515 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-202.gc7586e95.el9. 49/192 2023-12-16T20:19:41.515 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:19.0.0-202.gc7586e95.el9.x86_64 50/192 2023-12-16T20:19:41.515 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-202.gc7586e95.el9.x86 51/192 2023-12-16T20:19:41.515 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-202.gc7586e95.e 52/192 2023-12-16T20:19:41.515 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-202.gc7586e95.el9.noar 53/192 2023-12-16T20:19:41.515 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-202.gc7586e95.el9.no 54/192 2023-12-16T20:19:41.515 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-202.gc758 55/192 2023-12-16T20:19:41.515 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-202.gc7586e95.el9 56/192 2023-12-16T20:19:41.516 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:19.0.0-202.gc7586e95.el9.noarch 57/192 2023-12-16T20:19:41.516 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-202.gc7586e95.el 58/192 2023-12-16T20:19:41.516 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-volume-2:19.0.0-202.gc7586e95.el9.noarch 59/192 2023-12-16T20:19:41.516 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephadm-2:19.0.0-202.gc7586e95.el9.noarch 60/192 2023-12-16T20:19:41.516 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-top-2:19.0.0-202.gc7586e95.el9.noarch 61/192 2023-12-16T20:19:41.516 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/192 2023-12-16T20:19:41.516 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/192 2023-12-16T20:19:41.516 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/192 2023-12-16T20:19:41.516 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 65/192 2023-12-16T20:19:41.516 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flex-2.6.4-9.el9.x86_64 66/192 2023-12-16T20:19:41.516 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 67/192 2023-12-16T20:19:41.516 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 68/192 2023-12-16T20:19:41.516 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 69/192 2023-12-16T20:19:41.517 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : jq-1.6-16.el9.x86_64 70/192 2023-12-16T20:19:41.517 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 71/192 2023-12-16T20:19:41.517 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 72/192 2023-12-16T20:19:41.517 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 73/192 2023-12-16T20:19:41.517 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 74/192 2023-12-16T20:19:41.517 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 75/192 2023-12-16T20:19:41.517 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 76/192 2023-12-16T20:19:41.517 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 77/192 2023-12-16T20:19:41.517 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 78/192 2023-12-16T20:19:41.517 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lua-5.4.4-4.el9.x86_64 79/192 2023-12-16T20:19:41.517 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 80/192 2023-12-16T20:19:41.517 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 81/192 2023-12-16T20:19:41.517 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 82/192 2023-12-16T20:19:41.517 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-13.11-1.el9.x86_64 83/192 2023-12-16T20:19:41.518 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 84/192 2023-12-16T20:19:41.518 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 85/192 2023-12-16T20:19:41.518 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 86/192 2023-12-16T20:19:41.518 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 87/192 2023-12-16T20:19:41.518 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 88/192 2023-12-16T20:19:41.518 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 89/192 2023-12-16T20:19:41.518 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 90/192 2023-12-16T20:19:41.518 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 91/192 2023-12-16T20:19:41.518 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 92/192 2023-12-16T20:19:41.518 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 93/192 2023-12-16T20:19:41.518 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 94/192 2023-12-16T20:19:41.518 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/192 2023-12-16T20:19:41.518 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 96/192 2023-12-16T20:19:41.518 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 97/192 2023-12-16T20:19:41.519 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 98/192 2023-12-16T20:19:41.519 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 99/192 2023-12-16T20:19:41.519 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 100/192 2023-12-16T20:19:41.519 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 101/192 2023-12-16T20:19:41.519 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 102/192 2023-12-16T20:19:41.519 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 103/192 2023-12-16T20:19:41.519 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 104/192 2023-12-16T20:19:41.519 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 105/192 2023-12-16T20:19:41.519 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 106/192 2023-12-16T20:19:41.519 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 107/192 2023-12-16T20:19:41.519 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 108/192 2023-12-16T20:19:41.519 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 109/192 2023-12-16T20:19:41.519 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 110/192 2023-12-16T20:19:41.519 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 111/192 2023-12-16T20:19:41.520 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 112/192 2023-12-16T20:19:41.520 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 113/192 2023-12-16T20:19:41.520 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 114/192 2023-12-16T20:19:41.520 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ply-3.11-14.el9.noarch 115/192 2023-12-16T20:19:41.520 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 116/192 2023-12-16T20:19:41.520 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 117/192 2023-12-16T20:19:41.520 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 118/192 2023-12-16T20:19:41.520 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 119/192 2023-12-16T20:19:41.520 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 120/192 2023-12-16T20:19:41.520 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 121/192 2023-12-16T20:19:41.520 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 122/192 2023-12-16T20:19:41.520 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 123/192 2023-12-16T20:19:41.520 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 124/192 2023-12-16T20:19:41.520 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/192 2023-12-16T20:19:41.521 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 126/192 2023-12-16T20:19:41.521 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 127/192 2023-12-16T20:19:41.521 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 128/192 2023-12-16T20:19:41.521 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 129/192 2023-12-16T20:19:41.521 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 130/192 2023-12-16T20:19:41.521 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 131/192 2023-12-16T20:19:41.521 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 132/192 2023-12-16T20:19:41.521 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 133/192 2023-12-16T20:19:41.521 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 134/192 2023-12-16T20:19:41.521 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 135/192 2023-12-16T20:19:41.521 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 136/192 2023-12-16T20:19:41.521 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 137/192 2023-12-16T20:19:41.521 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 138/192 2023-12-16T20:19:41.521 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 139/192 2023-12-16T20:19:41.522 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 140/192 2023-12-16T20:19:41.522 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 141/192 2023-12-16T20:19:41.522 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 142/192 2023-12-16T20:19:41.522 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 143/192 2023-12-16T20:19:41.522 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 144/192 2023-12-16T20:19:41.522 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 145/192 2023-12-16T20:19:41.522 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 146/192 2023-12-16T20:19:41.522 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 147/192 2023-12-16T20:19:41.522 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 148/192 2023-12-16T20:19:41.522 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/192 2023-12-16T20:19:41.522 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/192 2023-12-16T20:19:41.522 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/192 2023-12-16T20:19:41.522 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/192 2023-12-16T20:19:41.522 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/192 2023-12-16T20:19:41.523 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/192 2023-12-16T20:19:41.523 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/192 2023-12-16T20:19:41.523 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 156/192 2023-12-16T20:19:41.523 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 157/192 2023-12-16T20:19:41.523 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 158/192 2023-12-16T20:19:41.523 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 159/192 2023-12-16T20:19:41.523 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 160/192 2023-12-16T20:19:41.523 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : re2-1:20211101-3.el9.x86_64 161/192 2023-12-16T20:19:41.523 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 162/192 2023-12-16T20:19:41.523 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:19.0.0-202.gc7586e95.el9.x86_64 163/192 2023-12-16T20:19:41.523 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/192 2023-12-16T20:19:41.523 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:19.0.0-202.gc7586e95.el9.x86_64 165/192 2023-12-16T20:19:41.523 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/192 2023-12-16T20:19:41.523 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 167/192 2023-12-16T20:19:41.524 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 168/192 2023-12-16T20:19:41.524 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : acl-2.3.1-4.el9.x86_64 169/192 2023-12-16T20:19:41.524 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : acl-2.3.1-3.el9.x86_64 170/192 2023-12-16T20:19:41.524 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 171/192 2023-12-16T20:19:41.524 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 172/192 2023-12-16T20:19:41.524 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 173/192 2023-12-16T20:19:41.524 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 174/192 2023-12-16T20:19:41.524 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 175/192 2023-12-16T20:19:41.524 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 176/192 2023-12-16T20:19:41.524 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/192 2023-12-16T20:19:41.524 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/192 2023-12-16T20:19:41.524 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 179/192 2023-12-16T20:19:41.524 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 180/192 2023-12-16T20:19:41.524 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 181/192 2023-12-16T20:19:41.524 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 182/192 2023-12-16T20:19:41.525 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 183/192 2023-12-16T20:19:41.525 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 184/192 2023-12-16T20:19:41.525 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 185/192 2023-12-16T20:19:41.525 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 186/192 2023-12-16T20:19:41.525 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 187/192 2023-12-16T20:19:41.525 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 188/192 2023-12-16T20:19:41.525 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/192 2023-12-16T20:19:41.525 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/192 2023-12-16T20:19:41.525 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/192 2023-12-16T20:19:44.405 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/192 2023-12-16T20:19:44.406 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:19:44.406 INFO:teuthology.orchestra.run.smithi195.stdout:Upgraded: 2023-12-16T20:19:44.406 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-16T20:19:44.406 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-16T20:19:44.406 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-16T20:19:44.406 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-16T20:19:44.406 INFO:teuthology.orchestra.run.smithi195.stdout: acl-2.3.1-4.el9.x86_64 2023-12-16T20:19:44.406 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-16T20:19:44.406 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-16T20:19:44.406 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-16T20:19:44.406 INFO:teuthology.orchestra.run.smithi195.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-16T20:19:44.406 INFO:teuthology.orchestra.run.smithi195.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-16T20:19:44.407 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.407 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.407 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-16T20:19:44.407 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-16T20:19:44.407 INFO:teuthology.orchestra.run.smithi195.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-16T20:19:44.407 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2023-12-16T20:19:44.407 INFO:teuthology.orchestra.run.smithi195.stdout: automake-1.16.2-8.el9.noarch 2023-12-16T20:19:44.407 INFO:teuthology.orchestra.run.smithi195.stdout: bison-3.7.4-5.el9.x86_64 2023-12-16T20:19:44.407 INFO:teuthology.orchestra.run.smithi195.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-16T20:19:44.407 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.407 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.407 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.407 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.407 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.407 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.408 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.408 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.408 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:19:44.408 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.408 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.408 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.408 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.408 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.408 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:19:44.408 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:19:44.408 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.408 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:19:44.408 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:19:44.408 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:19:44.409 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.409 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.409 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.409 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.409 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:19:44.409 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.409 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.409 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.409 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.409 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.409 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:19:44.409 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:19:44.409 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.409 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-shell-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.410 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-top-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:19:44.410 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-16T20:19:44.410 INFO:teuthology.orchestra.run.smithi195.stdout: flex-2.6.4-9.el9.x86_64 2023-12-16T20:19:44.410 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-16T20:19:44.410 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-16T20:19:44.410 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-16T20:19:44.410 INFO:teuthology.orchestra.run.smithi195.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-16T20:19:44.410 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-16T20:19:44.410 INFO:teuthology.orchestra.run.smithi195.stdout: jq-1.6-16.el9.x86_64 2023-12-16T20:19:44.411 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-16T20:19:44.411 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-16T20:19:44.411 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-16T20:19:44.411 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.411 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.412 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.412 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.412 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-16T20:19:44.412 INFO:teuthology.orchestra.run.smithi195.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-16T20:19:44.412 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-16T20:19:44.412 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-16T20:19:44.412 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-16T20:19:44.412 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.412 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.412 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.412 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.412 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.412 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-16T20:19:44.412 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.412 INFO:teuthology.orchestra.run.smithi195.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-16T20:19:44.413 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-16T20:19:44.413 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-16T20:19:44.413 INFO:teuthology.orchestra.run.smithi195.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-16T20:19:44.413 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-16T20:19:44.413 INFO:teuthology.orchestra.run.smithi195.stdout: lua-5.4.4-4.el9.x86_64 2023-12-16T20:19:44.413 INFO:teuthology.orchestra.run.smithi195.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-16T20:19:44.413 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-16T20:19:44.413 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-16T20:19:44.413 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-16T20:19:44.413 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-16T20:19:44.413 INFO:teuthology.orchestra.run.smithi195.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-16T20:19:44.413 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-13.11-1.el9.x86_64 2023-12-16T20:19:44.413 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-16T20:19:44.414 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-16T20:19:44.414 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-16T20:19:44.414 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-16T20:19:44.414 INFO:teuthology.orchestra.run.smithi195.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-16T20:19:44.414 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-16T20:19:44.414 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-16T20:19:44.414 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-16T20:19:44.414 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.414 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.414 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.414 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.414 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-16T20:19:44.414 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-16T20:19:44.415 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-16T20:19:44.415 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-16T20:19:44.415 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-16T20:19:44.415 INFO:teuthology.orchestra.run.smithi195.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-16T20:19:44.415 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-16T20:19:44.415 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-16T20:19:44.415 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-16T20:19:44.415 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-16T20:19:44.415 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-16T20:19:44.415 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-16T20:19:44.415 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-16T20:19:44.415 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-16T20:19:44.415 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-16T20:19:44.415 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-16T20:19:44.416 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-16T20:19:44.416 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-16T20:19:44.416 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-16T20:19:44.416 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-16T20:19:44.416 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-16T20:19:44.416 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-16T20:19:44.416 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-16T20:19:44.416 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-16T20:19:44.416 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-16T20:19:44.416 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-16T20:19:44.416 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-16T20:19:44.416 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-16T20:19:44.416 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-16T20:19:44.416 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply-3.11-14.el9.noarch 2023-12-16T20:19:44.416 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-16T20:19:44.417 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-16T20:19:44.417 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-16T20:19:44.417 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-16T20:19:44.417 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-16T20:19:44.417 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-16T20:19:44.417 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-16T20:19:44.417 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-16T20:19:44.417 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.417 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.417 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.417 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.417 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-16T20:19:44.417 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-16T20:19:44.417 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-16T20:19:44.417 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.418 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.418 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-16T20:19:44.418 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-16T20:19:44.418 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-16T20:19:44.418 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-16T20:19:44.418 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-16T20:19:44.418 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-16T20:19:44.418 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-16T20:19:44.418 INFO:teuthology.orchestra.run.smithi195.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-16T20:19:44.418 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-16T20:19:44.418 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-16T20:19:44.418 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-16T20:19:44.418 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-16T20:19:44.418 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.418 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.419 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.419 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.419 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.419 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:19:44.419 INFO:teuthology.orchestra.run.smithi195.stdout: re2-1:20211101-3.el9.x86_64 2023-12-16T20:19:44.419 INFO:teuthology.orchestra.run.smithi195.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-16T20:19:44.419 INFO:teuthology.orchestra.run.smithi195.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-16T20:19:44.419 INFO:teuthology.orchestra.run.smithi195.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-16T20:19:44.419 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-16T20:19:44.420 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-16T20:19:44.420 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-16T20:19:44.420 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:19:44.420 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2023-12-16T20:19:45.050 DEBUG:teuthology.parallel:result is None 2023-12-16T20:19:46.220 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-202.gc7586e95.el 161/192 2023-12-16T20:19:46.804 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-test-debuginfo-2:19.0.0-202.gc7586e95.el9.x 162/192 2023-12-16T20:19:46.844 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-202.gc7586e95.el9. 163/192 2023-12-16T20:19:51.451 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librados-devel-debuginfo-2:19.0.0-202.gc7586e95. 164/192 2023-12-16T20:19:56.928 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librados2-debuginfo-2:19.0.0-202.gc7586e95.el9.x 165/192 2023-12-16T20:19:57.276 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librbd1-debuginfo-2:19.0.0-202.gc7586e95.el9.x86 166/192 2023-12-16T20:19:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-202.gc7586e95. 167/192 2023-12-16T20:19:57.969 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rados-debuginfo-2:19.0.0-202.gc7586e95.e 168/192 2023-12-16T20:19:58.321 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-202.gc7586e95.el9 169/192 2023-12-16T20:19:58.397 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-202.gc7586e95.el9 170/192 2023-12-16T20:20:03.742 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 171/192 2023-12-16T20:20:04.186 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-202.gc7586e95.el9. 172/192 2023-12-16T20:20:05.066 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-202.gc7586e95.el9.x86 173/192 2023-12-16T20:20:05.324 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 174/192 2023-12-16T20:20:05.697 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 175/192 2023-12-16T20:20:05.794 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flex-2.6.4-9.el9.x86_64 176/192 2023-12-16T20:20:05.836 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : bison-3.7.4-5.el9.x86_64 177/192 2023-12-16T20:20:05.861 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 178/192 2023-12-16T20:20:05.886 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 179/192 2023-12-16T20:20:05.913 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 180/192 2023-12-16T20:20:05.913 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 181/192 2023-12-16T20:20:05.989 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 181/192 2023-12-16T20:20:06.017 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 182/192 2023-12-16T20:20:06.047 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 183/192 2023-12-16T20:20:06.072 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 184/192 2023-12-16T20:20:06.072 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 185/192 2023-12-16T20:20:06.157 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 185/192 2023-12-16T20:20:06.182 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 186/192 2023-12-16T20:20:06.196 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 187/192 2023-12-16T20:20:06.196 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 187/192 2023-12-16T20:20:06.401 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 187/192 2023-12-16T20:20:06.401 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 188/192 2023-12-16T20:20:06.488 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 188/192 2023-12-16T20:20:06.518 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 189/192 2023-12-16T20:20:06.552 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 190/192 2023-12-16T20:20:06.594 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 191/192 2023-12-16T20:20:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 192/192 2023-12-16T20:20:15.253 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 192/192 2023-12-16T20:20:15.254 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-2:19.0.0-202.gc7586e95.el9.x86_64 1/192 2023-12-16T20:20:15.254 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-base-2:19.0.0-202.gc7586e95.el9.x86_64 2/192 2023-12-16T20:20:15.254 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-202.gc7586e95.el9.x 3/192 2023-12-16T20:20:15.254 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-common-2:19.0.0-202.gc7586e95.el9.x86_64 4/192 2023-12-16T20:20:15.254 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-202.gc7586e95.el9 5/192 2023-12-16T20:20:15.254 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 6/192 2023-12-16T20:20:15.254 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-fuse-2:19.0.0-202.gc7586e95.el9.x86_64 7/192 2023-12-16T20:20:15.254 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-202.gc7586e95.el9.x 8/192 2023-12-16T20:20:15.254 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-202.gc7586e 9/192 2023-12-16T20:20:15.255 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-2 10/192 2023-12-16T20:20:15.255 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mds-2:19.0.0-202.gc7586e95.el9.x86_64 11/192 2023-12-16T20:20:15.255 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 12/192 2023-12-16T20:20:15.255 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-2:19.0.0-202.gc7586e95.el9.x86_64 13/192 2023-12-16T20:20:15.255 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 14/192 2023-12-16T20:20:15.255 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mon-2:19.0.0-202.gc7586e95.el9.x86_64 15/192 2023-12-16T20:20:15.255 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 16/192 2023-12-16T20:20:15.255 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-osd-2:19.0.0-202.gc7586e95.el9.x86_64 17/192 2023-12-16T20:20:15.255 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 18/192 2023-12-16T20:20:15.255 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-radosgw-2:19.0.0-202.gc7586e95.el9.x86_64 19/192 2023-12-16T20:20:15.255 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-202.gc7586e95.el 20/192 2023-12-16T20:20:15.255 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-selinux-2:19.0.0-202.gc7586e95.el9.x86_64 21/192 2023-12-16T20:20:15.256 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-test-2:19.0.0-202.gc7586e95.el9.x86_64 22/192 2023-12-16T20:20:15.256 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-202.gc7586e95.el9.x 23/192 2023-12-16T20:20:15.256 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-mirror-2:19.0.0-202.gc7586e95.el9.x86_64 24/192 2023-12-16T20:20:15.256 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-shell-2:19.0.0-202.gc7586e95.el9.x86_64 25/192 2023-12-16T20:20:15.256 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs-devel-2:19.0.0-202.gc7586e95.el9.x86_6 26/192 2023-12-16T20:20:15.256 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs2-2:19.0.0-202.gc7586e95.el9.x86_64 27/192 2023-12-16T20:20:15.256 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-202.gc7586e95.el9. 28/192 2023-12-16T20:20:15.256 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephsqlite-2:19.0.0-202.gc7586e95.el9.x86_64 29/192 2023-12-16T20:20:15.256 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados-devel-2:19.0.0-202.gc7586e95.el9.x86_64 30/192 2023-12-16T20:20:15.256 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-202.gc7586e95. 31/192 2023-12-16T20:20:15.256 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-debuginfo-2:19.0.0-202.gc7586e95.el9.x 32/192 2023-12-16T20:20:15.256 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libradosstriper1-2:19.0.0-202.gc7586e95.el9.x86_ 33/192 2023-12-16T20:20:15.256 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-debuginfo-2:19.0.0-202.gc7586e95.el9.x86 34/192 2023-12-16T20:20:15.256 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librgw2-2:19.0.0-202.gc7586e95.el9.x86_64 35/192 2023-12-16T20:20:15.256 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-argparse-2:19.0.0-202.gc7586e95.el9 36/192 2023-12-16T20:20:15.257 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-common-2:19.0.0-202.gc7586e95.el9.x 37/192 2023-12-16T20:20:15.257 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cephfs-2:19.0.0-202.gc7586e95.el9.x86_64 38/192 2023-12-16T20:20:15.257 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-202.gc7586e95. 39/192 2023-12-16T20:20:15.257 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rados-2:19.0.0-202.gc7586e95.el9.x86_64 40/192 2023-12-16T20:20:15.257 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-202.gc7586e95.e 41/192 2023-12-16T20:20:15.257 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rbd-2:19.0.0-202.gc7586e95.el9.x86_64 42/192 2023-12-16T20:20:15.257 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-202.gc7586e95.el9 43/192 2023-12-16T20:20:15.257 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rgw-2:19.0.0-202.gc7586e95.el9.x86_64 44/192 2023-12-16T20:20:15.257 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-202.gc7586e95.el9 45/192 2023-12-16T20:20:15.257 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-fuse-2:19.0.0-202.gc7586e95.el9.x86_64 46/192 2023-12-16T20:20:15.257 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-202.gc7586e95.el9.x8 47/192 2023-12-16T20:20:15.257 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-mirror-2:19.0.0-202.gc7586e95.el9.x86_64 48/192 2023-12-16T20:20:15.257 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-202.gc7586e95.el9. 49/192 2023-12-16T20:20:15.258 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-nbd-2:19.0.0-202.gc7586e95.el9.x86_64 50/192 2023-12-16T20:20:15.258 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-202.gc7586e95.el9.x86 51/192 2023-12-16T20:20:15.258 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-202.gc7586e95.e 52/192 2023-12-16T20:20:15.258 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-202.gc7586e95.el9.noar 53/192 2023-12-16T20:20:15.258 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-202.gc7586e95.el9.no 54/192 2023-12-16T20:20:15.258 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-202.gc758 55/192 2023-12-16T20:20:15.258 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-202.gc7586e95.el9 56/192 2023-12-16T20:20:15.258 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-rook-2:19.0.0-202.gc7586e95.el9.noarch 57/192 2023-12-16T20:20:15.258 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-202.gc7586e95.el 58/192 2023-12-16T20:20:15.258 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-volume-2:19.0.0-202.gc7586e95.el9.noarch 59/192 2023-12-16T20:20:15.258 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephadm-2:19.0.0-202.gc7586e95.el9.noarch 60/192 2023-12-16T20:20:15.258 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-top-2:19.0.0-202.gc7586e95.el9.noarch 61/192 2023-12-16T20:20:15.259 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/192 2023-12-16T20:20:15.259 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/192 2023-12-16T20:20:15.259 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/192 2023-12-16T20:20:15.259 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 65/192 2023-12-16T20:20:15.259 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flex-2.6.4-9.el9.x86_64 66/192 2023-12-16T20:20:15.259 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 67/192 2023-12-16T20:20:15.259 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 68/192 2023-12-16T20:20:15.259 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 69/192 2023-12-16T20:20:15.259 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : jq-1.6-16.el9.x86_64 70/192 2023-12-16T20:20:15.259 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 71/192 2023-12-16T20:20:15.259 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 72/192 2023-12-16T20:20:15.259 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 73/192 2023-12-16T20:20:15.259 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 74/192 2023-12-16T20:20:15.260 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 75/192 2023-12-16T20:20:15.260 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 76/192 2023-12-16T20:20:15.260 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 77/192 2023-12-16T20:20:15.260 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 78/192 2023-12-16T20:20:15.260 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lua-5.4.4-4.el9.x86_64 79/192 2023-12-16T20:20:15.260 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 80/192 2023-12-16T20:20:15.260 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 81/192 2023-12-16T20:20:15.260 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 82/192 2023-12-16T20:20:15.260 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-13.11-1.el9.x86_64 83/192 2023-12-16T20:20:15.260 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 84/192 2023-12-16T20:20:15.260 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 85/192 2023-12-16T20:20:15.260 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 86/192 2023-12-16T20:20:15.260 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 87/192 2023-12-16T20:20:15.260 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 88/192 2023-12-16T20:20:15.260 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 89/192 2023-12-16T20:20:15.261 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 90/192 2023-12-16T20:20:15.261 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 91/192 2023-12-16T20:20:15.261 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 92/192 2023-12-16T20:20:15.261 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 93/192 2023-12-16T20:20:15.261 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 94/192 2023-12-16T20:20:15.261 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/192 2023-12-16T20:20:15.261 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 96/192 2023-12-16T20:20:15.261 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 97/192 2023-12-16T20:20:15.261 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 98/192 2023-12-16T20:20:15.261 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 99/192 2023-12-16T20:20:15.261 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 100/192 2023-12-16T20:20:15.261 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 101/192 2023-12-16T20:20:15.262 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 102/192 2023-12-16T20:20:15.262 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 103/192 2023-12-16T20:20:15.262 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 104/192 2023-12-16T20:20:15.262 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 105/192 2023-12-16T20:20:15.262 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 106/192 2023-12-16T20:20:15.262 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 107/192 2023-12-16T20:20:15.262 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 108/192 2023-12-16T20:20:15.262 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 109/192 2023-12-16T20:20:15.262 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 110/192 2023-12-16T20:20:15.262 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 111/192 2023-12-16T20:20:15.262 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 112/192 2023-12-16T20:20:15.262 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 113/192 2023-12-16T20:20:15.263 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 114/192 2023-12-16T20:20:15.263 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ply-3.11-14.el9.noarch 115/192 2023-12-16T20:20:15.263 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 116/192 2023-12-16T20:20:15.263 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 117/192 2023-12-16T20:20:15.263 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 118/192 2023-12-16T20:20:15.263 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 119/192 2023-12-16T20:20:15.263 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 120/192 2023-12-16T20:20:15.263 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 121/192 2023-12-16T20:20:15.263 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 122/192 2023-12-16T20:20:15.263 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 123/192 2023-12-16T20:20:15.263 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 124/192 2023-12-16T20:20:15.263 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/192 2023-12-16T20:20:15.263 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 126/192 2023-12-16T20:20:15.263 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 127/192 2023-12-16T20:20:15.263 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 128/192 2023-12-16T20:20:15.264 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 129/192 2023-12-16T20:20:15.264 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 130/192 2023-12-16T20:20:15.264 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 131/192 2023-12-16T20:20:15.264 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 132/192 2023-12-16T20:20:15.264 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 133/192 2023-12-16T20:20:15.264 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 134/192 2023-12-16T20:20:15.264 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 135/192 2023-12-16T20:20:15.264 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 136/192 2023-12-16T20:20:15.264 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 137/192 2023-12-16T20:20:15.264 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 138/192 2023-12-16T20:20:15.264 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 139/192 2023-12-16T20:20:15.264 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 140/192 2023-12-16T20:20:15.264 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 141/192 2023-12-16T20:20:15.264 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 142/192 2023-12-16T20:20:15.265 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 143/192 2023-12-16T20:20:15.265 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 144/192 2023-12-16T20:20:15.265 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 145/192 2023-12-16T20:20:15.265 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 146/192 2023-12-16T20:20:15.265 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 147/192 2023-12-16T20:20:15.265 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 148/192 2023-12-16T20:20:15.265 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/192 2023-12-16T20:20:15.265 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/192 2023-12-16T20:20:15.265 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/192 2023-12-16T20:20:15.265 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/192 2023-12-16T20:20:15.266 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/192 2023-12-16T20:20:15.266 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/192 2023-12-16T20:20:15.266 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/192 2023-12-16T20:20:15.266 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 156/192 2023-12-16T20:20:15.266 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 157/192 2023-12-16T20:20:15.266 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 158/192 2023-12-16T20:20:15.266 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 159/192 2023-12-16T20:20:15.266 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 160/192 2023-12-16T20:20:15.266 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : re2-1:20211101-3.el9.x86_64 161/192 2023-12-16T20:20:15.266 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 162/192 2023-12-16T20:20:15.266 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:19.0.0-202.gc7586e95.el9.x86_64 163/192 2023-12-16T20:20:15.266 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/192 2023-12-16T20:20:15.266 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:19.0.0-202.gc7586e95.el9.x86_64 165/192 2023-12-16T20:20:15.266 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/192 2023-12-16T20:20:15.266 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 167/192 2023-12-16T20:20:15.267 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 168/192 2023-12-16T20:20:15.267 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : acl-2.3.1-4.el9.x86_64 169/192 2023-12-16T20:20:15.267 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : acl-2.3.1-3.el9.x86_64 170/192 2023-12-16T20:20:15.267 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 171/192 2023-12-16T20:20:15.267 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 172/192 2023-12-16T20:20:15.267 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 173/192 2023-12-16T20:20:15.267 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 174/192 2023-12-16T20:20:15.267 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 175/192 2023-12-16T20:20:15.267 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 176/192 2023-12-16T20:20:15.267 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/192 2023-12-16T20:20:15.267 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/192 2023-12-16T20:20:15.267 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 179/192 2023-12-16T20:20:15.267 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 180/192 2023-12-16T20:20:15.267 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 181/192 2023-12-16T20:20:15.267 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 182/192 2023-12-16T20:20:15.268 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 183/192 2023-12-16T20:20:15.268 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 184/192 2023-12-16T20:20:15.268 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 185/192 2023-12-16T20:20:15.268 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 186/192 2023-12-16T20:20:15.268 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 187/192 2023-12-16T20:20:15.268 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 188/192 2023-12-16T20:20:15.268 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/192 2023-12-16T20:20:15.268 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/192 2023-12-16T20:20:15.268 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/192 2023-12-16T20:20:18.157 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/192 2023-12-16T20:20:18.157 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:18.157 INFO:teuthology.orchestra.run.smithi087.stdout:Upgraded: 2023-12-16T20:20:18.157 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-16T20:20:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-16T20:20:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-16T20:20:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-16T20:20:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: acl-2.3.1-4.el9.x86_64 2023-12-16T20:20:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-16T20:20:18.158 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-16T20:20:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-16T20:20:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-16T20:20:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-16T20:20:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: librados2-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.159 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-16T20:20:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-16T20:20:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-16T20:20:18.160 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2023-12-16T20:20:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: automake-1.16.2-8.el9.noarch 2023-12-16T20:20:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: bison-3.7.4-5.el9.x86_64 2023-12-16T20:20:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-16T20:20:18.160 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.161 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:20:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:20:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:20:18.162 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:20:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:20:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:20:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.163 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:20:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:20:18.164 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:20:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-mirror-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-shell-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-top-2:19.0.0-202.gc7586e95.el9.noarch 2023-12-16T20:20:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-16T20:20:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: flex-2.6.4-9.el9.x86_64 2023-12-16T20:20:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-16T20:20:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-16T20:20:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-16T20:20:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-16T20:20:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-16T20:20:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: jq-1.6-16.el9.x86_64 2023-12-16T20:20:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-16T20:20:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-16T20:20:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-16T20:20:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-16T20:20:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-16T20:20:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-16T20:20:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-16T20:20:18.166 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-16T20:20:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: librados2-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-16T20:20:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-16T20:20:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-16T20:20:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-16T20:20:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-16T20:20:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-16T20:20:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: lua-5.4.4-4.el9.x86_64 2023-12-16T20:20:18.167 INFO:teuthology.orchestra.run.smithi087.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-16T20:20:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-16T20:20:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-16T20:20:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-16T20:20:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-16T20:20:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-16T20:20:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-13.11-1.el9.x86_64 2023-12-16T20:20:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-16T20:20:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-16T20:20:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-16T20:20:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-16T20:20:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-16T20:20:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-16T20:20:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-16T20:20:18.168 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-16T20:20:18.169 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.169 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.169 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.169 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.169 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-16T20:20:18.169 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-16T20:20:18.169 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-16T20:20:18.169 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-16T20:20:18.169 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-16T20:20:18.169 INFO:teuthology.orchestra.run.smithi087.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-16T20:20:18.169 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-16T20:20:18.169 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-16T20:20:18.169 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-16T20:20:18.170 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-16T20:20:18.170 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-16T20:20:18.170 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-16T20:20:18.170 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-16T20:20:18.170 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-16T20:20:18.170 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-16T20:20:18.170 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-16T20:20:18.170 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-16T20:20:18.170 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-16T20:20:18.170 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-16T20:20:18.170 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-16T20:20:18.170 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-16T20:20:18.170 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-16T20:20:18.171 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-16T20:20:18.171 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-16T20:20:18.171 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-16T20:20:18.171 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-16T20:20:18.171 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-16T20:20:18.171 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-16T20:20:18.171 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-16T20:20:18.171 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply-3.11-14.el9.noarch 2023-12-16T20:20:18.171 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-16T20:20:18.171 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-16T20:20:18.171 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-16T20:20:18.171 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-16T20:20:18.171 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-16T20:20:18.171 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-16T20:20:18.172 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-16T20:20:18.172 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-16T20:20:18.172 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.172 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.172 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.172 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.172 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-16T20:20:18.172 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-16T20:20:18.172 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-16T20:20:18.172 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.172 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.172 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-16T20:20:18.172 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-16T20:20:18.173 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-16T20:20:18.173 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-16T20:20:18.173 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-16T20:20:18.173 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-16T20:20:18.173 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-16T20:20:18.173 INFO:teuthology.orchestra.run.smithi087.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-16T20:20:18.173 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-16T20:20:18.173 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-16T20:20:18.173 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-16T20:20:18.173 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-16T20:20:18.173 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.173 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.174 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.174 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.174 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.174 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd-debuginfo-2:19.0.0-202.gc7586e95.el9.x86_64 2023-12-16T20:20:18.174 INFO:teuthology.orchestra.run.smithi087.stdout: re2-1:20211101-3.el9.x86_64 2023-12-16T20:20:18.174 INFO:teuthology.orchestra.run.smithi087.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-16T20:20:18.174 INFO:teuthology.orchestra.run.smithi087.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-16T20:20:18.174 INFO:teuthology.orchestra.run.smithi087.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-16T20:20:18.174 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-16T20:20:18.174 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-16T20:20:18.175 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-16T20:20:18.175 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:18.175 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2023-12-16T20:20:18.804 DEBUG:teuthology.parallel:result is None 2023-12-16T20:20:18.804 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:20:19.027 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-16T20:20:19.049 INFO:teuthology.orchestra.run.smithi087.stdout:19.0.0-202.gc7586e95.el9 2023-12-16T20:20:19.053 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-202.gc7586e95.el9 2023-12-16T20:20:19.053 INFO:teuthology.task.install:The correct ceph version 19.0.0-202.gc7586e95 is installed. 2023-12-16T20:20:19.055 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:20:19.270 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-16T20:20:19.296 INFO:teuthology.orchestra.run.smithi195.stdout:19.0.0-202.gc7586e95.el9 2023-12-16T20:20:19.296 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-202.gc7586e95.el9 2023-12-16T20:20:19.297 INFO:teuthology.task.install:The correct ceph version 19.0.0-202.gc7586e95 is installed. 2023-12-16T20:20:19.298 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-16T20:20:19.298 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:19.298 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-16T20:20:19.328 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:20:19.328 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-16T20:20:19.372 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-16T20:20:19.372 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:19.372 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2023-12-16T20:20:19.400 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-16T20:20:19.467 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:20:19.467 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2023-12-16T20:20:19.498 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-16T20:20:19.567 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-16T20:20:19.568 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:19.568 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-16T20:20:19.594 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-16T20:20:19.661 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:20:19.661 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-16T20:20:19.693 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-16T20:20:19.762 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-16T20:20:19.762 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:19.762 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2023-12-16T20:20:19.789 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-16T20:20:19.855 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:20:19.856 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2023-12-16T20:20:19.883 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-16T20:20:19.952 INFO:teuthology.run_tasks:Running task ceph... 2023-12-16T20:20:20.026 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-16T20:20:20.026 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /var/log/ceph 2023-12-16T20:20:20.029 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /var/log/ceph 2023-12-16T20:20:20.057 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-16T20:20:20.057 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-16T20:20:20.096 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-16T20:20:20.124 INFO:tasks.ceph:Creating extra log directories... 2023-12-16T20:20:20.124 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-16T20:20:20.163 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-16T20:20:20.198 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-16T20:20:20.198 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-16T20:20:20.198 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-16T20:20:20.198 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:20.199 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-16T20:20:20.242 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-16T20:20:20.359 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-16T20:20:20.386 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:20:20.386 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-16T20:20:20.401 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-16T20:20:20.518 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-16T20:20:20.550 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-16T20:20:20.550 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-16T20:20:20.550 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494750', 'branch': 'wip-yuri8-testing-2023-12-15-0911', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7494750', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri8-testing-2023-12-15-0911'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri8-testing-2023-12-15-0911', 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 2960, 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri8-testing-2023-12-15-0911', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi087.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE8IaRhqnFsfjORsL88XrUajDD+7iM2CtXcgqXVyXcph/SyzSRgHkjytgzBDQpdTqcSlM0p5u7d85wvJCRozKpc=', 'smithi195.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBhvuffNgRWHW3O4nRlKM77Upb3PLN91wIhtrzCOIupJyg2xpAzZ9SqJrDvC8H/kpuFTfmm/KwVKIEPZrbc6RPI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-16_15:45:14', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-16T20:20:20.551 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-16T20:20:20.554 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-16T20:20:20.600 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2023-12-16T20:20:20.608 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/run/ceph 2023-12-16T20:20:20.667 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:20.667 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2023-12-16T20:20:20.690 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-16T20:20:20.690 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2023-12-16T20:20:20.745 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-16T20:20:20.745 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T20:20:20.745 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-12-16T20:20:20.745 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:20:20.745 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T20:20:20.745 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2023-12-16 20:20:07.000786330 +0000 2023-12-16T20:20:20.745 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2023-12-16 20:11:27.252190654 +0000 2023-12-16T20:20:20.745 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2023-12-16 20:11:27.252190654 +0000 2023-12-16T20:20:20.745 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2023-12-16 20:11:27.252190654 +0000 2023-12-16T20:20:20.746 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-16T20:20:20.810 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2023-12-16T20:20:20.810 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2023-12-16T20:20:20.810 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000219619 s, 2.3 MB/s 2023-12-16T20:20:20.811 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-16T20:20:20.868 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2023-12-16T20:20:20.923 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-16T20:20:20.923 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T20:20:20.923 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-12-16T20:20:20.923 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:20:20.923 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T20:20:20.923 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2023-12-16 20:20:07.000786330 +0000 2023-12-16T20:20:20.923 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2023-12-16 20:11:27.748179840 +0000 2023-12-16T20:20:20.923 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2023-12-16 20:11:27.748179840 +0000 2023-12-16T20:20:20.923 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2023-12-16 20:11:27.748179840 +0000 2023-12-16T20:20:20.923 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-16T20:20:20.988 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2023-12-16T20:20:20.988 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2023-12-16T20:20:20.988 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.00023488 s, 2.2 MB/s 2023-12-16T20:20:20.989 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-16T20:20:21.045 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2023-12-16T20:20:21.100 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-16T20:20:21.100 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T20:20:21.101 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-12-16T20:20:21.101 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:20:21.101 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T20:20:21.101 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2023-12-16 20:20:07.000786330 +0000 2023-12-16T20:20:21.101 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2023-12-16 20:11:28.241169091 +0000 2023-12-16T20:20:21.101 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2023-12-16 20:11:28.241169091 +0000 2023-12-16T20:20:21.101 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2023-12-16 20:11:28.241169091 +0000 2023-12-16T20:20:21.102 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-16T20:20:21.166 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2023-12-16T20:20:21.166 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2023-12-16T20:20:21.166 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000212559 s, 2.4 MB/s 2023-12-16T20:20:21.167 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-16T20:20:21.223 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2023-12-16T20:20:21.279 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-16T20:20:21.279 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T20:20:21.279 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-12-16T20:20:21.279 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:20:21.279 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T20:20:21.279 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2023-12-16 20:20:07.001786309 +0000 2023-12-16T20:20:21.280 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2023-12-16 20:11:28.726158518 +0000 2023-12-16T20:20:21.280 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2023-12-16 20:11:28.726158518 +0000 2023-12-16T20:20:21.280 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2023-12-16 20:11:28.726158518 +0000 2023-12-16T20:20:21.280 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-16T20:20:21.344 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2023-12-16T20:20:21.344 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2023-12-16T20:20:21.344 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000219127 s, 2.3 MB/s 2023-12-16T20:20:21.345 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-16T20:20:21.401 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-16T20:20:21.401 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:20:21.401 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2023-12-16T20:20:21.417 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-16T20:20:21.418 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2023-12-16T20:20:21.474 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-16T20:20:21.475 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T20:20:21.475 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-12-16T20:20:21.475 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:20:21.475 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T20:20:21.475 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-12-16 20:19:32.729045177 +0000 2023-12-16T20:20:21.476 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-12-16 20:11:27.971130887 +0000 2023-12-16T20:20:21.476 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-12-16 20:11:27.971130887 +0000 2023-12-16T20:20:21.476 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2023-12-16 20:11:27.971130887 +0000 2023-12-16T20:20:21.476 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-16T20:20:21.543 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-12-16T20:20:21.543 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-12-16T20:20:21.543 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 9.4673e-05 s, 5.4 MB/s 2023-12-16T20:20:21.544 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-16T20:20:21.601 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2023-12-16T20:20:21.658 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-16T20:20:21.658 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T20:20:21.658 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 683 Links: 1 2023-12-16T20:20:21.658 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:20:21.658 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T20:20:21.658 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-12-16 20:19:32.729045177 +0000 2023-12-16T20:20:21.658 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-12-16 20:11:28.464121966 +0000 2023-12-16T20:20:21.658 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-12-16 20:11:28.464121966 +0000 2023-12-16T20:20:21.658 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2023-12-16 20:11:28.464121966 +0000 2023-12-16T20:20:21.659 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-16T20:20:21.725 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-12-16T20:20:21.725 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-12-16T20:20:21.725 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 8.7557e-05 s, 5.8 MB/s 2023-12-16T20:20:21.726 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-16T20:20:21.782 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2023-12-16T20:20:21.839 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-16T20:20:21.839 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T20:20:21.839 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-12-16T20:20:21.839 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:20:21.839 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T20:20:21.839 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-12-16 20:19:32.729045177 +0000 2023-12-16T20:20:21.839 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-12-16 20:11:28.971112792 +0000 2023-12-16T20:20:21.839 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-12-16 20:11:28.971112792 +0000 2023-12-16T20:20:21.839 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2023-12-16 20:11:28.971112792 +0000 2023-12-16T20:20:21.840 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-16T20:20:21.905 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-12-16T20:20:21.906 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-12-16T20:20:21.906 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000108224 s, 4.7 MB/s 2023-12-16T20:20:21.907 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-16T20:20:21.963 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2023-12-16T20:20:22.018 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-16T20:20:22.018 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T20:20:22.018 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-12-16T20:20:22.018 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:20:22.019 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T20:20:22.019 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-12-16 20:19:32.730045158 +0000 2023-12-16T20:20:22.019 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-12-16 20:11:29.441104288 +0000 2023-12-16T20:20:22.019 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-12-16 20:11:29.441104288 +0000 2023-12-16T20:20:22.019 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2023-12-16 20:11:29.441104288 +0000 2023-12-16T20:20:22.019 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-16T20:20:22.085 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-12-16T20:20:22.085 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-12-16T20:20:22.085 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000109002 s, 4.7 MB/s 2023-12-16T20:20:22.086 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-16T20:20:22.144 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-16T20:20:22.145 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-16T20:20:22.145 INFO:tasks.ceph:Generating config... 2023-12-16T20:20:22.146 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-16T20:20:22.146 INFO:tasks.ceph:[client] debug client = 20 2023-12-16T20:20:22.146 INFO:tasks.ceph:[client] debug ms = 1 2023-12-16T20:20:22.146 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-16T20:20:22.146 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-16T20:20:22.147 INFO:tasks.ceph:[global] mds beacon grace = 60 2023-12-16T20:20:22.147 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2023-12-16T20:20:22.147 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2023-12-16T20:20:22.147 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-16T20:20:22.147 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-16T20:20:22.147 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-16T20:20:22.147 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-16T20:20:22.147 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-16T20:20:22.147 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-16T20:20:22.147 INFO:tasks.ceph:[mds] mds valgrind exit = True 2023-12-16T20:20:22.147 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-16T20:20:22.147 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-16T20:20:22.147 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-16T20:20:22.147 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-16T20:20:22.147 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-16T20:20:22.148 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-16T20:20:22.148 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-16T20:20:22.148 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-16T20:20:22.148 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-16T20:20:22.148 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-16T20:20:22.148 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2023-12-16T20:20:22.148 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-16T20:20:22.148 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-12-16T20:20:22.148 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-16T20:20:22.148 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-16T20:20:22.148 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-16T20:20:22.148 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-16T20:20:22.148 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-16T20:20:22.148 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-16T20:20:22.148 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-16T20:20:22.149 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-16T20:20:22.149 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-16T20:20:22.149 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-16T20:20:22.149 INFO:tasks.ceph:[osd] osd fast shutdown = False 2023-12-16T20:20:22.149 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-16T20:20:22.149 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-16T20:20:22.149 INFO:tasks.ceph:Setting up mon.a... 2023-12-16T20:20:22.149 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-16T20:20:22.197 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.keyring 2023-12-16T20:20:22.200 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-16T20:20:22.244 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-16T20:20:22.311 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.87'), ('mon.b', '172.21.15.195'), ('mon.c', '[v2:172.21.15.195:3301,v1:172.21.15.195:6790]')] 2023-12-16T20:20:22.312 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.87,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-16T20:20:22.313 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:22.313 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-16T20:20:22.366 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.87 --add b 172.21.15.195 --addv c '[v2:172.21.15.195:3301,v1:172.21.15.195:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-16T20:20:22.451 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-16T20:20:22.451 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: generated fsid 281751e9-025f-43bb-9b42-7cc76907fa5a 2023-12-16T20:20:22.451 INFO:teuthology.orchestra.run.smithi087.stdout:setting min_mon_release = pacific 2023-12-16T20:20:22.451 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 0 2023-12-16T20:20:22.451 INFO:teuthology.orchestra.run.smithi087.stdout:fsid 281751e9-025f-43bb-9b42-7cc76907fa5a 2023-12-16T20:20:22.451 INFO:teuthology.orchestra.run.smithi087.stdout:last_changed 2023-12-16T20:20:22.450893+0000 2023-12-16T20:20:22.451 INFO:teuthology.orchestra.run.smithi087.stdout:created 2023-12-16T20:20:22.450893+0000 2023-12-16T20:20:22.452 INFO:teuthology.orchestra.run.smithi087.stdout:min_mon_release 16 (pacific) 2023-12-16T20:20:22.452 INFO:teuthology.orchestra.run.smithi087.stdout:election_strategy: 1 2023-12-16T20:20:22.452 INFO:teuthology.orchestra.run.smithi087.stdout:0: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.a 2023-12-16T20:20:22.452 INFO:teuthology.orchestra.run.smithi087.stdout:1: [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon.b 2023-12-16T20:20:22.452 INFO:teuthology.orchestra.run.smithi087.stdout:2: [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] mon.c 2023-12-16T20:20:22.452 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-16T20:20:22.453 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-16T20:20:22.467 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 281751e9-025f-43bb-9b42-7cc76907fa5a... 2023-12-16T20:20:22.468 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-16T20:20:22.509 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-16T20:20:22.557 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2023-12-16T20:20:22.557 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2023-12-16T20:20:22.557 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-16T20:20:22.557 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2023-12-16T20:20:22.557 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.557 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2023-12-16T20:20:22.558 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.558 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2023-12-16T20:20:22.558 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.558 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2023-12-16T20:20:22.558 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2023-12-16T20:20:22.558 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.558 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2023-12-16T20:20:22.558 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2023-12-16T20:20:22.558 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.558 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-16T20:20:22.558 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2023-12-16T20:20:22.558 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.558 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2023-12-16T20:20:22.558 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-16T20:20:22.559 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.559 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2023-12-16T20:20:22.559 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.559 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2023-12-16T20:20:22.559 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2023-12-16T20:20:22.559 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2023-12-16T20:20:22.559 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2023-12-16T20:20:22.559 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2023-12-16T20:20:22.559 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2023-12-16T20:20:22.559 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2023-12-16T20:20:22.559 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-16T20:20:22.559 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-16T20:20:22.559 INFO:teuthology.orchestra.run.smithi087.stdout: mon_allow_pool_size_one = true 2023-12-16T20:20:22.559 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.560 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-16T20:20:22.560 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.560 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2023-12-16T20:20:22.560 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.560 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2023-12-16T20:20:22.560 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.560 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2023-12-16T20:20:22.560 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2023-12-16T20:20:22.560 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2023-12-16T20:20:22.560 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = "172.21.15.87,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2023-12-16T20:20:22.560 INFO:teuthology.orchestra.run.smithi087.stdout: mds beacon grace = 60 2023-12-16T20:20:22.560 INFO:teuthology.orchestra.run.smithi087.stdout: mds heartbeat grace = 60 2023-12-16T20:20:22.560 INFO:teuthology.orchestra.run.smithi087.stdout: osd heartbeat grace = 60 2023-12-16T20:20:22.561 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = 281751e9-025f-43bb-9b42-7cc76907fa5a 2023-12-16T20:20:22.561 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.561 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2023-12-16T20:20:22.561 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2023-12-16T20:20:22.561 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.561 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2023-12-16T20:20:22.561 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2023-12-16T20:20:22.561 INFO:teuthology.orchestra.run.smithi087.stdout: osd mclock profile = high_recovery_ops 2023-12-16T20:20:22.561 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.561 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2023-12-16T20:20:22.561 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2023-12-16T20:20:22.561 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.562 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2023-12-16T20:20:22.562 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2023-12-16T20:20:22.562 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2023-12-16T20:20:22.562 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug trim objects = true 2023-12-16T20:20:22.562 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.562 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2023-12-16T20:20:22.562 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2023-12-16T20:20:22.562 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.562 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2023-12-16T20:20:22.562 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.562 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2023-12-16T20:20:22.562 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.562 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2023-12-16T20:20:22.562 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.563 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2023-12-16T20:20:22.563 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2023-12-16T20:20:22.563 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.563 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2023-12-16T20:20:22.563 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2023-12-16T20:20:22.563 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2023-12-16T20:20:22.563 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore compression mode = aggressive 2023-12-16T20:20:22.563 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2023-12-16T20:20:22.563 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 20 2023-12-16T20:20:22.563 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 20 2023-12-16T20:20:22.563 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2023-12-16T20:20:22.563 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2023-12-16T20:20:22.563 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 10 2023-12-16T20:20:22.564 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2023-12-16T20:20:22.564 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2023-12-16T20:20:22.564 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2023-12-16T20:20:22.564 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2023-12-16T20:20:22.564 INFO:teuthology.orchestra.run.smithi087.stdout: osd fast shutdown = False 2023-12-16T20:20:22.564 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2023-12-16T20:20:22.564 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2023-12-16T20:20:22.564 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.564 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2023-12-16T20:20:22.564 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2023-12-16T20:20:22.564 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2023-12-16T20:20:22.564 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2023-12-16T20:20:22.564 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2023-12-16T20:20:22.564 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2023-12-16T20:20:22.565 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2023-12-16T20:20:22.565 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2023-12-16T20:20:22.565 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.565 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2023-12-16T20:20:22.565 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2023-12-16T20:20:22.565 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2023-12-16T20:20:22.565 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2023-12-16T20:20:22.565 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2023-12-16T20:20:22.565 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2023-12-16T20:20:22.565 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2023-12-16T20:20:22.565 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2023-12-16T20:20:22.565 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2023-12-16T20:20:22.565 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2023-12-16T20:20:22.566 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2023-12-16T20:20:22.566 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.566 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-16T20:20:22.566 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2023-12-16T20:20:22.566 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2023-12-16T20:20:22.566 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.566 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2023-12-16T20:20:22.566 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-16T20:20:22.566 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-16T20:20:22.566 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.566 INFO:teuthology.orchestra.run.smithi087.stdout: # 1m isn't quite enough 2023-12-16T20:20:22.566 INFO:teuthology.orchestra.run.smithi087.stdout: mon_down_mkfs_grace = 2m 2023-12-16T20:20:22.566 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.566 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_filestore_osds = false 2023-12-16T20:20:22.566 INFO:teuthology.orchestra.run.smithi087.stdout: mon op complaint time = 120 2023-12-16T20:20:22.567 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd crush smoke test = False 2023-12-16T20:20:22.567 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:20:22.567 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2023-12-16T20:20:22.567 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2023-12-16T20:20:22.567 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2023-12-16T20:20:22.567 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2023-12-16T20:20:22.567 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-16T20:20:22.567 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-16T20:20:22.567 INFO:teuthology.orchestra.run.smithi087.stdout: client mount timeout = 600 2023-12-16T20:20:22.567 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2023-12-16T20:20:22.567 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2023-12-16T20:20:22.567 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 900 2023-12-16T20:20:22.567 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 900 2023-12-16T20:20:22.567 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2023-12-16T20:20:22.568 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.b] 2023-12-16T20:20:22.568 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.c] 2023-12-16T20:20:22.568 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2023-12-16T20:20:22.568 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2023-12-16T20:20:22.568 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.e] 2023-12-16T20:20:22.568 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2023-12-16T20:20:22.568 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.d] 2023-12-16T20:20:22.568 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.f] 2023-12-16T20:20:22.568 INFO:teuthology.orchestra.run.smithi087.stdout:[mds] 2023-12-16T20:20:22.568 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds = 20 2023-12-16T20:20:22.568 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds balancer = 20 2023-12-16T20:20:22.568 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2023-12-16T20:20:22.568 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug frag = True 2023-12-16T20:20:22.568 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug scatterstat = True 2023-12-16T20:20:22.568 INFO:teuthology.orchestra.run.smithi087.stdout: mds op complaint time = 180 2023-12-16T20:20:22.569 INFO:teuthology.orchestra.run.smithi087.stdout: mds valgrind exit = True 2023-12-16T20:20:22.569 INFO:teuthology.orchestra.run.smithi087.stdout: mds verify scatter = True 2023-12-16T20:20:22.569 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2023-12-16T20:20:22.569 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 900 2023-12-16T20:20:22.569 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 900 2023-12-16T20:20:22.569 INFO:teuthology.orchestra.run.smithi195.stdout:[global] 2023-12-16T20:20:22.569 INFO:teuthology.orchestra.run.smithi195.stdout: chdir = "" 2023-12-16T20:20:22.569 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-16T20:20:22.570 INFO:teuthology.orchestra.run.smithi195.stdout: auth supported = cephx 2023-12-16T20:20:22.570 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.570 INFO:teuthology.orchestra.run.smithi195.stdout: filestore xattr use omap = true 2023-12-16T20:20:22.570 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.570 INFO:teuthology.orchestra.run.smithi195.stdout: mon clock drift allowed = 1.000 2023-12-16T20:20:22.570 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.570 INFO:teuthology.orchestra.run.smithi195.stdout: osd crush chooseleaf type = 0 2023-12-16T20:20:22.570 INFO:teuthology.orchestra.run.smithi195.stdout: auth debug = true 2023-12-16T20:20:22.570 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.570 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on old message = true 2023-12-16T20:20:22.570 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on bug = true 2023-12-16T20:20:22.570 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.570 INFO:teuthology.orchestra.run.smithi195.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-16T20:20:22.570 INFO:teuthology.orchestra.run.smithi195.stdout: mon pg warn max object skew = 0 2023-12-16T20:20:22.571 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.571 INFO:teuthology.orchestra.run.smithi195.stdout: # disable pg_autoscaler by default for new pools 2023-12-16T20:20:22.571 INFO:teuthology.orchestra.run.smithi195.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-16T20:20:22.571 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.571 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default size = 2 2023-12-16T20:20:22.571 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.571 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow primary affinity = true 2023-12-16T20:20:22.571 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow pg remap = true 2023-12-16T20:20:22.571 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on legacy crush tunables = false 2023-12-16T20:20:22.571 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on crush straw calc version zero = false 2023-12-16T20:20:22.571 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on no sortbitwise = false 2023-12-16T20:20:22.571 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on osd down out interval zero = false 2023-12-16T20:20:22.571 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on too few osds = false 2023-12-16T20:20:22.571 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-16T20:20:22.571 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-16T20:20:22.572 INFO:teuthology.orchestra.run.smithi195.stdout: mon_allow_pool_size_one = true 2023-12-16T20:20:22.572 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.572 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-16T20:20:22.572 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.572 INFO:teuthology.orchestra.run.smithi195.stdout: osd default data pool replay window = 5 2023-12-16T20:20:22.572 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.572 INFO:teuthology.orchestra.run.smithi195.stdout: mon allow pool delete = true 2023-12-16T20:20:22.572 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.572 INFO:teuthology.orchestra.run.smithi195.stdout: mon cluster log file level = debug 2023-12-16T20:20:22.572 INFO:teuthology.orchestra.run.smithi195.stdout: debug asserts on shutdown = true 2023-12-16T20:20:22.572 INFO:teuthology.orchestra.run.smithi195.stdout: mon health detail to clog = false 2023-12-16T20:20:22.572 INFO:teuthology.orchestra.run.smithi195.stdout: mon host = "172.21.15.87,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2023-12-16T20:20:22.572 INFO:teuthology.orchestra.run.smithi195.stdout: mds beacon grace = 60 2023-12-16T20:20:22.572 INFO:teuthology.orchestra.run.smithi195.stdout: mds heartbeat grace = 60 2023-12-16T20:20:22.573 INFO:teuthology.orchestra.run.smithi195.stdout: osd heartbeat grace = 60 2023-12-16T20:20:22.573 INFO:teuthology.orchestra.run.smithi195.stdout: fsid = 281751e9-025f-43bb-9b42-7cc76907fa5a 2023-12-16T20:20:22.573 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.573 INFO:teuthology.orchestra.run.smithi195.stdout:[osd] 2023-12-16T20:20:22.573 INFO:teuthology.orchestra.run.smithi195.stdout: osd journal size = 100 2023-12-16T20:20:22.573 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.573 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub load threshold = 5.0 2023-12-16T20:20:22.573 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub max interval = 600 2023-12-16T20:20:22.573 INFO:teuthology.orchestra.run.smithi195.stdout: osd mclock profile = high_recovery_ops 2023-12-16T20:20:22.573 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.573 INFO:teuthology.orchestra.run.smithi195.stdout: osd recover clone overlap = true 2023-12-16T20:20:22.573 INFO:teuthology.orchestra.run.smithi195.stdout: osd recovery max chunk = 1048576 2023-12-16T20:20:22.573 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.574 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug shutdown = true 2023-12-16T20:20:22.574 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug op order = true 2023-12-16T20:20:22.574 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug verify stray on activate = true 2023-12-16T20:20:22.574 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug trim objects = true 2023-12-16T20:20:22.574 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.574 INFO:teuthology.orchestra.run.smithi195.stdout: osd open classes on start = true 2023-12-16T20:20:22.574 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug pg log writeout = true 2023-12-16T20:20:22.574 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.574 INFO:teuthology.orchestra.run.smithi195.stdout: osd deep scrub update digest min age = 30 2023-12-16T20:20:22.574 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.574 INFO:teuthology.orchestra.run.smithi195.stdout: osd map max advance = 10 2023-12-16T20:20:22.574 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.574 INFO:teuthology.orchestra.run.smithi195.stdout: journal zero on create = true 2023-12-16T20:20:22.574 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.574 INFO:teuthology.orchestra.run.smithi195.stdout: filestore ondisk finisher threads = 3 2023-12-16T20:20:22.575 INFO:teuthology.orchestra.run.smithi195.stdout: filestore apply finisher threads = 3 2023-12-16T20:20:22.575 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.575 INFO:teuthology.orchestra.run.smithi195.stdout: bdev debug aio = true 2023-12-16T20:20:22.575 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug misdirected ops = true 2023-12-16T20:20:22.575 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore block size = 96636764160 2023-12-16T20:20:22.575 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore compression mode = aggressive 2023-12-16T20:20:22.575 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore fsck on mount = True 2023-12-16T20:20:22.575 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluefs = 20 2023-12-16T20:20:22.575 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluestore = 20 2023-12-16T20:20:22.575 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2023-12-16T20:20:22.575 INFO:teuthology.orchestra.run.smithi195.stdout: debug osd = 20 2023-12-16T20:20:22.575 INFO:teuthology.orchestra.run.smithi195.stdout: debug rocksdb = 10 2023-12-16T20:20:22.575 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd backfillfull_ratio = 0.85 2023-12-16T20:20:22.575 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd full ratio = 0.9 2023-12-16T20:20:22.575 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd nearfull ratio = 0.8 2023-12-16T20:20:22.576 INFO:teuthology.orchestra.run.smithi195.stdout: osd failsafe full ratio = 0.95 2023-12-16T20:20:22.576 INFO:teuthology.orchestra.run.smithi195.stdout: osd fast shutdown = False 2023-12-16T20:20:22.576 INFO:teuthology.orchestra.run.smithi195.stdout: osd objectstore = bluestore 2023-12-16T20:20:22.576 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2023-12-16T20:20:22.576 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.576 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr] 2023-12-16T20:20:22.576 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2023-12-16T20:20:22.576 INFO:teuthology.orchestra.run.smithi195.stdout: debug mgr = 20 2023-12-16T20:20:22.576 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2023-12-16T20:20:22.576 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2023-12-16T20:20:22.576 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2023-12-16T20:20:22.576 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2023-12-16T20:20:22.576 INFO:teuthology.orchestra.run.smithi195.stdout: mgr/telemetry/nag = false 2023-12-16T20:20:22.576 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.577 INFO:teuthology.orchestra.run.smithi195.stdout:[mon] 2023-12-16T20:20:22.577 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2023-12-16T20:20:22.577 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2023-12-16T20:20:22.577 INFO:teuthology.orchestra.run.smithi195.stdout: debug paxos = 20 2023-12-16T20:20:22.577 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2023-12-16T20:20:22.577 INFO:teuthology.orchestra.run.smithi195.stdout: mon data avail warn = 5 2023-12-16T20:20:22.577 INFO:teuthology.orchestra.run.smithi195.stdout: mon mgr mkfs grace = 240 2023-12-16T20:20:22.577 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2023-12-16T20:20:22.577 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd reporter subtree level = osd 2023-12-16T20:20:22.577 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd prime pg temp = true 2023-12-16T20:20:22.577 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2023-12-16T20:20:22.577 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.577 INFO:teuthology.orchestra.run.smithi195.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-16T20:20:22.577 INFO:teuthology.orchestra.run.smithi195.stdout: auth mon ticket ttl = 660 # 11m 2023-12-16T20:20:22.578 INFO:teuthology.orchestra.run.smithi195.stdout: auth service ticket ttl = 240 # 4m 2023-12-16T20:20:22.578 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.578 INFO:teuthology.orchestra.run.smithi195.stdout: # don't complain about insecure global_id in the test suite 2023-12-16T20:20:22.578 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-16T20:20:22.578 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-16T20:20:22.578 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.578 INFO:teuthology.orchestra.run.smithi195.stdout: # 1m isn't quite enough 2023-12-16T20:20:22.578 INFO:teuthology.orchestra.run.smithi195.stdout: mon_down_mkfs_grace = 2m 2023-12-16T20:20:22.578 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.578 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_filestore_osds = false 2023-12-16T20:20:22.578 INFO:teuthology.orchestra.run.smithi195.stdout: mon op complaint time = 120 2023-12-16T20:20:22.578 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd crush smoke test = False 2023-12-16T20:20:22.578 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-16T20:20:22.579 INFO:teuthology.orchestra.run.smithi195.stdout:[client] 2023-12-16T20:20:22.579 INFO:teuthology.orchestra.run.smithi195.stdout: rgw cache enabled = true 2023-12-16T20:20:22.579 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable ops log = true 2023-12-16T20:20:22.579 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable usage log = true 2023-12-16T20:20:22.579 INFO:teuthology.orchestra.run.smithi195.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-16T20:20:22.579 INFO:teuthology.orchestra.run.smithi195.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-16T20:20:22.579 INFO:teuthology.orchestra.run.smithi195.stdout: client mount timeout = 600 2023-12-16T20:20:22.579 INFO:teuthology.orchestra.run.smithi195.stdout: debug client = 20 2023-12-16T20:20:22.579 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2023-12-16T20:20:22.579 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2023-12-16T20:20:22.579 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2023-12-16T20:20:22.579 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.a] 2023-12-16T20:20:22.579 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.b] 2023-12-16T20:20:22.579 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.c] 2023-12-16T20:20:22.580 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2023-12-16T20:20:22.580 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.c] 2023-12-16T20:20:22.580 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.e] 2023-12-16T20:20:22.580 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2023-12-16T20:20:22.580 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.d] 2023-12-16T20:20:22.580 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.f] 2023-12-16T20:20:22.580 INFO:teuthology.orchestra.run.smithi195.stdout:[mds] 2023-12-16T20:20:22.580 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds = 20 2023-12-16T20:20:22.580 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds balancer = 20 2023-12-16T20:20:22.580 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2023-12-16T20:20:22.580 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug frag = True 2023-12-16T20:20:22.580 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug scatterstat = True 2023-12-16T20:20:22.580 INFO:teuthology.orchestra.run.smithi195.stdout: mds op complaint time = 180 2023-12-16T20:20:22.580 INFO:teuthology.orchestra.run.smithi195.stdout: mds valgrind exit = True 2023-12-16T20:20:22.580 INFO:teuthology.orchestra.run.smithi195.stdout: mds verify scatter = True 2023-12-16T20:20:22.581 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2023-12-16T20:20:22.581 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2023-12-16T20:20:22.581 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2023-12-16T20:20:22.582 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-16T20:20:22.582 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-16T20:20:22.678 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-16T20:20:22.678 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:22.678 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-16T20:20:22.692 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:22.693 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-16T20:20:22.748 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2023-12-16T20:20:22.748 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:22.748 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-16T20:20:22.748 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-16T20:20:22.827 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:22.827 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-16T20:20:22.882 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi195.front.sepia.ceph.com 2023-12-16T20:20:22.883 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:20:22.883 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-16T20:20:22.883 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-16T20:20:22.923 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:20:22.923 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-16T20:20:22.978 INFO:tasks.ceph:Setting up mon nodes... 2023-12-16T20:20:22.978 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-16T20:20:22.978 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-16T20:20:23.033 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-16T20:20:23.035 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-16T20:20:23.104 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-16T20:20:23.106 INFO:tasks.ceph:Setting up mds nodes... 2023-12-16T20:20:23.106 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-16T20:20:23.161 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-16T20:20:23.164 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-16T20:20:23.190 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-16T20:20:23.285 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-16T20:20:23.287 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-16T20:20:23.313 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-12-16T20:20:23.410 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-12-16T20:20:23.413 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-12-16T20:20:23.439 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-16T20:20:23.494 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-16T20:20:23.497 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-16T20:20:23.523 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-16T20:20:23.618 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-16T20:20:23.620 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-16T20:20:23.648 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-12-16T20:20:23.743 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-12-16T20:20:23.745 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-12-16T20:20:23.772 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-16T20:20:23.772 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-16T20:20:23.814 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-16T20:20:23.830 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-16T20:20:23.830 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-16T20:20:23.830 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-16T20:20:23.897 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-16T20:20:23.897 INFO:tasks.ceph:role: osd.0 2023-12-16T20:20:23.897 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com 2023-12-16T20:20:23.897 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-16T20:20:23.971 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T20:20:23.971 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T20:20:23.971 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T20:20:23.971 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T20:20:23.971 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T20:20:23.971 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2023-12-16T20:20:23.971 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T20:20:23.972 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T20:20:23.972 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T20:20:23.972 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T20:20:24.484 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2023-12-16T20:20:24.486 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2023-12-16T20:20:24.486 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-16T20:20:24.642 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-16T20:20:24.677 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-16T20:20:24.746 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-16T20:20:24.746 INFO:tasks.ceph:role: osd.1 2023-12-16T20:20:24.746 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com 2023-12-16T20:20:24.746 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-16T20:20:24.820 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T20:20:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T20:20:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T20:20:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T20:20:24.821 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T20:20:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2023-12-16T20:20:24.821 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T20:20:24.821 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T20:20:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T20:20:24.822 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T20:20:25.271 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2023-12-16T20:20:25.273 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2023-12-16T20:20:25.274 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-16T20:20:25.365 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-16T20:20:25.397 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-16T20:20:25.464 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-16T20:20:25.465 INFO:tasks.ceph:role: osd.2 2023-12-16T20:20:25.465 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com 2023-12-16T20:20:25.465 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-16T20:20:25.539 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T20:20:25.539 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T20:20:25.539 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T20:20:25.539 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T20:20:25.539 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T20:20:25.539 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2023-12-16T20:20:25.539 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T20:20:25.539 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T20:20:25.539 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T20:20:25.539 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T20:20:26.039 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2023-12-16T20:20:26.041 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2023-12-16T20:20:26.041 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-16T20:20:26.158 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-16T20:20:26.194 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-16T20:20:26.262 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-16T20:20:26.262 INFO:tasks.ceph:role: osd.3 2023-12-16T20:20:26.262 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com 2023-12-16T20:20:26.262 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-16T20:20:26.337 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T20:20:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T20:20:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T20:20:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T20:20:26.338 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T20:20:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2023-12-16T20:20:26.338 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T20:20:26.338 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T20:20:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T20:20:26.338 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T20:20:26.867 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2023-12-16T20:20:26.869 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2023-12-16T20:20:26.870 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-16T20:20:27.001 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-16T20:20:27.037 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T20:20:27.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:27.142+0000 7f9091be0500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-16T20:20:27.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:27.142+0000 7f9091be0500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-16T20:20:27.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:27.142+0000 7f9091be0500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-16T20:20:27.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:27.142+0000 7f9091be0500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-16T20:20:27.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:27.142+0000 7f9091be0500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-16T20:20:27.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:27.143+0000 7f9091be0500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-16T20:20:29.990 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-16T20:20:30.021 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T20:20:30.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:30.112+0000 7fc8b0f74500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-16T20:20:30.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:30.112+0000 7fc8b0f74500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-16T20:20:30.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:30.112+0000 7fc8b0f74500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-16T20:20:30.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:30.112+0000 7fc8b0f74500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-16T20:20:30.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:30.112+0000 7fc8b0f74500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-16T20:20:30.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:30.112+0000 7fc8b0f74500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-16T20:20:32.962 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-16T20:20:32.992 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T20:20:33.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:33.081+0000 7ff32761c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-16T20:20:33.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:33.081+0000 7ff32761c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-16T20:20:33.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:33.081+0000 7ff32761c500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-16T20:20:33.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:33.081+0000 7ff32761c500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-16T20:20:33.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:33.081+0000 7ff32761c500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-16T20:20:33.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:33.081+0000 7ff32761c500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-16T20:20:35.928 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-16T20:20:35.957 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T20:20:36.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:36.046+0000 7f9679416500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-16T20:20:36.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:36.046+0000 7f9679416500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-16T20:20:36.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:36.046+0000 7f9679416500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-16T20:20:36.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:36.046+0000 7f9679416500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-16T20:20:36.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:36.046+0000 7f9679416500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-16T20:20:36.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:36.047+0000 7f9679416500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-16T20:20:38.902 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-16T20:20:38.931 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-16T20:20:38.964 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-16T20:20:38.964 INFO:tasks.ceph:role: osd.4 2023-12-16T20:20:38.964 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com 2023-12-16T20:20:38.964 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-16T20:20:39.034 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T20:20:39.034 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T20:20:39.034 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T20:20:39.034 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T20:20:39.034 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T20:20:39.034 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2023-12-16T20:20:39.034 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T20:20:39.034 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T20:20:39.035 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T20:20:39.035 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T20:20:39.067 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2023-12-16T20:20:39.069 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2023-12-16T20:20:39.069 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-16T20:20:39.142 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-16T20:20:39.214 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-16T20:20:39.281 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-16T20:20:39.281 INFO:tasks.ceph:role: osd.5 2023-12-16T20:20:39.281 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi195.front.sepia.ceph.com 2023-12-16T20:20:39.281 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-16T20:20:39.347 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T20:20:39.348 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T20:20:39.348 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T20:20:39.348 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T20:20:39.348 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T20:20:39.348 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2023-12-16T20:20:39.348 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T20:20:39.349 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T20:20:39.349 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T20:20:39.349 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T20:20:39.380 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2023-12-16T20:20:39.382 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2023-12-16T20:20:39.383 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-16T20:20:39.455 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-16T20:20:39.526 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-16T20:20:39.594 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-16T20:20:39.595 INFO:tasks.ceph:role: osd.6 2023-12-16T20:20:39.595 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi195.front.sepia.ceph.com 2023-12-16T20:20:39.595 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-16T20:20:39.662 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T20:20:39.662 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T20:20:39.662 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T20:20:39.662 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T20:20:39.662 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T20:20:39.662 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2023-12-16T20:20:39.662 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T20:20:39.662 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T20:20:39.662 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T20:20:39.662 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T20:20:39.694 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2023-12-16T20:20:39.696 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2023-12-16T20:20:39.696 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-16T20:20:39.767 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-16T20:20:39.838 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-16T20:20:39.906 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-16T20:20:39.906 INFO:tasks.ceph:role: osd.7 2023-12-16T20:20:39.906 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi195.front.sepia.ceph.com 2023-12-16T20:20:39.906 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-16T20:20:39.972 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T20:20:39.973 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T20:20:39.973 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T20:20:39.973 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-16T20:20:39.973 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T20:20:39.973 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2023-12-16T20:20:39.973 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T20:20:39.973 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-16T20:20:39.973 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T20:20:39.973 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T20:20:40.005 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2023-12-16T20:20:40.006 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2023-12-16T20:20:40.007 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-16T20:20:40.077 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-16T20:20:40.148 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T20:20:40.242 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:40.241+0000 7f1adae1a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-16T20:20:40.242 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:40.241+0000 7f1adae1a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-16T20:20:40.243 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:40.241+0000 7f1adae1a500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-16T20:20:40.243 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:40.241+0000 7f1adae1a500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-16T20:20:40.243 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:40.241+0000 7f1adae1a500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-16T20:20:40.243 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:40.241+0000 7f1adae1a500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-16T20:20:43.082 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-16T20:20:43.113 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T20:20:43.202 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:43.201+0000 7f7b8cf4a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-16T20:20:43.203 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:43.201+0000 7f7b8cf4a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-16T20:20:43.203 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:43.201+0000 7f7b8cf4a500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-16T20:20:43.203 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:43.201+0000 7f7b8cf4a500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-16T20:20:43.203 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:43.201+0000 7f7b8cf4a500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-16T20:20:43.203 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:43.201+0000 7f7b8cf4a500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-16T20:20:46.044 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-16T20:20:46.074 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T20:20:46.167 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:46.165+0000 7f3b17c0e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-16T20:20:46.167 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:46.165+0000 7f3b17c0e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-16T20:20:46.167 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:46.165+0000 7f3b17c0e500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-16T20:20:46.167 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:46.165+0000 7f3b17c0e500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-16T20:20:46.167 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:46.165+0000 7f3b17c0e500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-16T20:20:46.167 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:46.166+0000 7f3b17c0e500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-16T20:20:49.011 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-16T20:20:49.042 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T20:20:49.136 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:49.134+0000 7f70ba40d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-16T20:20:49.136 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:49.134+0000 7f70ba40d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-16T20:20:49.137 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:49.134+0000 7f70ba40d500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-16T20:20:49.137 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:49.134+0000 7f70ba40d500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-16T20:20:49.137 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:49.134+0000 7f70ba40d500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-16T20:20:49.137 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:20:49.135+0000 7f70ba40d500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-16T20:20:50.552 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:20:50.555 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:20:51.974 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-16T20:20:52.005 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-16T20:20:52.006 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:52.006 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-16T20:20:52.038 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:52.038 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-16T20:20:52.109 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:52.110 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-16T20:20:52.180 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:52.180 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-12-16T20:20:52.252 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:52.253 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-16T20:20:52.322 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:52.322 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-16T20:20:52.390 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:52.391 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-16T20:20:52.459 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:52.459 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-16T20:20:52.526 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:20:52.527 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-16T20:20:52.558 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:20:52.558 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-16T20:20:52.629 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:20:52.629 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-16T20:20:52.699 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:20:52.699 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-12-16T20:20:52.767 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:20:52.768 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-16T20:20:52.837 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:20:52.837 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-16T20:20:52.905 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:20:52.905 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-16T20:20:52.972 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:20:52.972 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-16T20:20:53.039 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:20:53.039 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-16T20:20:53.057 INFO:tasks.ceph:Adding keys to all mons... 2023-12-16T20:20:53.057 DEBUG:teuthology.orchestra.run.smithi087:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-16T20:20:53.099 DEBUG:teuthology.orchestra.run.smithi195:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-16T20:20:53.125 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr.y] 2023-12-16T20:20:53.125 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCHBn5lVcn5ARAAtgZQxX45UueWcTU+QW9gcw== 2023-12-16T20:20:53.125 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2023-12-16T20:20:53.125 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCHBn5lrdeiCRAANdkdOwLS4rjfs3roqgvy6g== 2023-12-16T20:20:53.125 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.c] 2023-12-16T20:20:53.125 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCHBn5lYEL8EBAAQJUIM0SuldMi42J3yyp13A== 2023-12-16T20:20:53.125 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.e] 2023-12-16T20:20:53.126 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCHBn5lltF5GBAAsw2bNyAEExmbRpsaw9ujfQ== 2023-12-16T20:20:53.126 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.0] 2023-12-16T20:20:53.126 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCLBn5lS3eJCBAAHcLcZJVobyW/MiTv34p4Ug== 2023-12-16T20:20:53.126 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.1] 2023-12-16T20:20:53.126 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCOBn5lE9+7BhAAjtgBIHnzMkXIMA+iDTp9Lg== 2023-12-16T20:20:53.126 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.2] 2023-12-16T20:20:53.126 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCRBn5lyqfiBBAAXBICHXqwCcMlGc0rfXBVPA== 2023-12-16T20:20:53.126 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.3] 2023-12-16T20:20:53.126 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCUBn5loZnTAhAAaEMHN1YkTGoB3Yv/gbM+wg== 2023-12-16T20:20:53.126 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr.x] 2023-12-16T20:20:53.126 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCHBn5lJXYwBhAAR+X6J9w3Qfq9EAEYs4CVjw== 2023-12-16T20:20:53.126 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2023-12-16T20:20:53.126 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCHBn5lbg51HRAAzBgIjLDIkl8RV0p9MCMdnw== 2023-12-16T20:20:53.126 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.d] 2023-12-16T20:20:53.126 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCHBn5l3ZzcJBAAN2mAV6bYfZabaXPSpGp2+g== 2023-12-16T20:20:53.127 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.f] 2023-12-16T20:20:53.127 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCHBn5lriZLLBAAQYngisU6a4OypaGbyZYCOg== 2023-12-16T20:20:53.127 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.4] 2023-12-16T20:20:53.127 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCYBn5lNvNrDhAAQ/owJAl0Xg4N9PLyIdHdUw== 2023-12-16T20:20:53.127 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.5] 2023-12-16T20:20:53.127 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCbBn5l7nwMDBAASbFxiP9/ZWoHMj3U8v8/4Q== 2023-12-16T20:20:53.127 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.6] 2023-12-16T20:20:53.127 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCeBn5lHunuCRAAmtx7pcaDOii21KgV8Dz7pQ== 2023-12-16T20:20:53.127 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.7] 2023-12-16T20:20:53.127 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQChBn5lGksVCBAAQnYBdjBfZ5U/oRcr4kzNuQ== 2023-12-16T20:20:53.127 INFO:teuthology.orchestra.run.smithi195.stdout:[client.0] 2023-12-16T20:20:53.127 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCHBn5lQtKNMBAAxeoI/v0qDaRCS51M8AASwQ== 2023-12-16T20:20:53.129 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.y] 2023-12-16T20:20:53.129 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCHBn5lVcn5ARAAtgZQxX45UueWcTU+QW9gcw== 2023-12-16T20:20:53.129 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2023-12-16T20:20:53.129 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCHBn5lrdeiCRAANdkdOwLS4rjfs3roqgvy6g== 2023-12-16T20:20:53.129 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2023-12-16T20:20:53.129 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCHBn5lYEL8EBAAQJUIM0SuldMi42J3yyp13A== 2023-12-16T20:20:53.129 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.e] 2023-12-16T20:20:53.129 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCHBn5lltF5GBAAsw2bNyAEExmbRpsaw9ujfQ== 2023-12-16T20:20:53.129 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.0] 2023-12-16T20:20:53.129 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCLBn5lS3eJCBAAHcLcZJVobyW/MiTv34p4Ug== 2023-12-16T20:20:53.130 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.1] 2023-12-16T20:20:53.130 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCOBn5lE9+7BhAAjtgBIHnzMkXIMA+iDTp9Lg== 2023-12-16T20:20:53.130 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.2] 2023-12-16T20:20:53.130 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCRBn5lyqfiBBAAXBICHXqwCcMlGc0rfXBVPA== 2023-12-16T20:20:53.130 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.3] 2023-12-16T20:20:53.130 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCUBn5loZnTAhAAaEMHN1YkTGoB3Yv/gbM+wg== 2023-12-16T20:20:53.130 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.x] 2023-12-16T20:20:53.130 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCHBn5lJXYwBhAAR+X6J9w3Qfq9EAEYs4CVjw== 2023-12-16T20:20:53.130 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2023-12-16T20:20:53.130 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCHBn5lbg51HRAAzBgIjLDIkl8RV0p9MCMdnw== 2023-12-16T20:20:53.131 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.d] 2023-12-16T20:20:53.131 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCHBn5l3ZzcJBAAN2mAV6bYfZabaXPSpGp2+g== 2023-12-16T20:20:53.131 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.f] 2023-12-16T20:20:53.131 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCHBn5lriZLLBAAQYngisU6a4OypaGbyZYCOg== 2023-12-16T20:20:53.131 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.4] 2023-12-16T20:20:53.131 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCYBn5lNvNrDhAAQ/owJAl0Xg4N9PLyIdHdUw== 2023-12-16T20:20:53.131 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.5] 2023-12-16T20:20:53.131 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCbBn5l7nwMDBAASbFxiP9/ZWoHMj3U8v8/4Q== 2023-12-16T20:20:53.132 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.6] 2023-12-16T20:20:53.132 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCeBn5lHunuCRAAmtx7pcaDOii21KgV8Dz7pQ== 2023-12-16T20:20:53.132 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.7] 2023-12-16T20:20:53.132 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQChBn5lGksVCBAAQnYBdjBfZ5U/oRcr4kzNuQ== 2023-12-16T20:20:53.132 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2023-12-16T20:20:53.132 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCHBn5lQtKNMBAAxeoI/v0qDaRCS51M8AASwQ== 2023-12-16T20:20:53.132 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-16T20:20:53.172 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-16T20:20:53.226 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T20:20:53.228 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T20:20:53.283 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T20:20:53.285 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T20:20:53.340 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T20:20:53.342 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T20:20:53.397 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T20:20:53.399 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T20:20:53.450 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T20:20:53.453 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T20:20:53.504 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T20:20:53.506 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T20:20:53.558 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T20:20:53.561 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T20:20:53.612 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-16T20:20:53.614 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-16T20:20:53.666 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T20:20:53.668 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T20:20:53.722 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T20:20:53.724 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T20:20:53.779 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T20:20:53.782 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T20:20:53.837 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T20:20:53.839 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T20:20:53.891 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T20:20:53.893 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T20:20:53.945 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T20:20:53.947 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T20:20:53.999 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T20:20:54.002 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T20:20:54.053 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-16T20:20:54.055 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-16T20:20:54.109 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-16T20:20:54.110 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-16T20:20:54.137 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-16T20:20:54.235 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-16T20:20:54.262 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-16T20:20:54.289 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-16T20:20:54.386 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-16T20:20:54.412 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-16T20:20:54.479 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-16T20:20:54.575 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-16T20:20:54.601 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-16T20:20:54.603 DEBUG:teuthology.orchestra.run.smithi195:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-16T20:20:54.656 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-16T20:20:54.656 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-16T20:20:54.656 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-16T20:20:54.656 DEBUG:teuthology.orchestra.run.smithi087:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2023-12-16T20:20:54.658 INFO:tasks.ceph.mon.a:Started 2023-12-16T20:20:54.659 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-16T20:20:54.659 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-16T20:20:54.659 DEBUG:teuthology.orchestra.run.smithi195:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2023-12-16T20:20:54.699 INFO:tasks.ceph.mon.b:Started 2023-12-16T20:20:54.700 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-16T20:20:54.700 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-16T20:20:54.700 DEBUG:teuthology.orchestra.run.smithi195:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2023-12-16T20:20:54.702 INFO:tasks.ceph.mon.c:Started 2023-12-16T20:20:54.702 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-16T20:20:54.702 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-16T20:20:54.702 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2023-12-16T20:20:54.706 INFO:tasks.ceph.mgr.y:Started 2023-12-16T20:20:54.706 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-16T20:20:54.706 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2023-12-16T20:20:54.710 INFO:tasks.ceph.mgr.x:Started 2023-12-16T20:20:54.710 INFO:tasks.ceph:Setting crush tunables to default 2023-12-16T20:20:54.711 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd crush tunables default 2023-12-16T20:20:54.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:54.810+0000 7f2887a9b640 1 Processor -- start 2023-12-16T20:20:54.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:54.810+0000 7f2887a9b640 1 -- start start 2023-12-16T20:20:54.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:54.811+0000 7f2887a9b640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2880153d70 0x7f288015ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:20:54.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:54.811+0000 7f2887a9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28800c29f0 0x7f28800c4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:20:54.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:54.811+0000 7f2887a9b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288006f000 con 0x7f28800c5e60 2023-12-16T20:20:54.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:54.811+0000 7f2887a9b640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288006bc90 con 0x7f2880153d70 2023-12-16T20:20:54.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:54.811+0000 7f2887a9b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288006ecd0 con 0x7f28800c29f0 2023-12-16T20:20:54.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:54.811+0000 7f2886038640 1 -- >> v1:172.21.15.87:6789/0 conn(0x7f28800c5e60 legacy=0x7f288006a500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.87:6789/0 2023-12-16T20:20:54.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:54.811+0000 7f2885036640 1 -- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28800c29f0 msgr2=0x7f28800c4220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.195:3301/0 2023-12-16T20:20:54.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:54.811+0000 7f2885837640 1 -- >> v2:172.21.15.195:3300/0 conn(0x7f2880153d70 msgr2=0x7f288015ce70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.195:3300/0 2023-12-16T20:20:54.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:54.811+0000 7f2885036640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28800c29f0 0x7f28800c4220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T20:20:54.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:54.811+0000 7f2885837640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2880153d70 0x7f288015ce70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T20:20:55.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:55.012+0000 7f2886038640 1 -- >> v1:172.21.15.87:6789/0 conn(0x7f28800c5e60 legacy=0x7f288006a500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.87:6789/0 2023-12-16T20:20:55.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:55.012+0000 7f2885036640 1 -- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28800c29f0 msgr2=0x7f28800c4220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.195:3301/0 2023-12-16T20:20:55.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:55.012+0000 7f2885837640 1 -- >> v2:172.21.15.195:3300/0 conn(0x7f2880153d70 msgr2=0x7f288015ce70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.195:3300/0 2023-12-16T20:20:55.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:55.012+0000 7f2885837640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2880153d70 0x7f288015ce70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T20:20:55.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:55.012+0000 7f2885036640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28800c29f0 0x7f28800c4220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T20:20:55.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:55.413+0000 7f2886038640 1 -- >> v1:172.21.15.87:6789/0 conn(0x7f28800c5e60 legacy=0x7f288006a500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.87:6789/0 2023-12-16T20:20:55.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:55.413+0000 7f2885036640 1 -- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28800c29f0 msgr2=0x7f28800c4220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.195:3301/0 2023-12-16T20:20:55.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:55.413+0000 7f2885837640 1 -- >> v2:172.21.15.195:3300/0 conn(0x7f2880153d70 msgr2=0x7f288015ce70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.195:3300/0 2023-12-16T20:20:55.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:55.413+0000 7f2885837640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2880153d70 0x7f288015ce70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T20:20:55.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:55.413+0000 7f2885036640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28800c29f0 0x7f28800c4220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T20:20:56.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:56.214+0000 7f2886038640 1 -- >> v1:172.21.15.87:6789/0 conn(0x7f28800c5e60 legacy=0x7f288006a500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.87:6789/0 2023-12-16T20:20:56.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:56.214+0000 7f2885036640 1 -- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28800c29f0 msgr2=0x7f28800c4220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.195:3301/0 2023-12-16T20:20:56.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:56.214+0000 7f2885837640 1 -- >> v2:172.21.15.195:3300/0 conn(0x7f2880153d70 msgr2=0x7f288015ce70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.195:3300/0 2023-12-16T20:20:56.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:56.214+0000 7f2885036640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28800c29f0 0x7f28800c4220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T20:20:56.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:56.214+0000 7f2885837640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2880153d70 0x7f288015ce70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T20:20:57.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:57.811+0000 7f28777fe640 1 -- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28800c29f0 msgr2=0x7f28800c4220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T20:20:57.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:57.811+0000 7f28777fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28800c29f0 0x7f28800c4220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:20:57.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:57.811+0000 7f28777fe640 1 -- >> v2:172.21.15.195:3300/0 conn(0x7f2880153d70 msgr2=0x7f288015ce70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T20:20:57.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:57.811+0000 7f28777fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2880153d70 0x7f288015ce70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:20:57.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:57.811+0000 7f28777fe640 1 -- >> v1:172.21.15.87:6789/0 conn(0x7f28800c5e60 legacy=0x7f288006a500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T20:20:57.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:57.811+0000 7f28777fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2864007370 0x7f2864009830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:20:57.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:57.811+0000 7f28777fe640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288006fdb0 con 0x7f28640036c0 2023-12-16T20:20:57.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:57.811+0000 7f28777fe640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288006bc90 con 0x7f2864007370 2023-12-16T20:20:57.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:57.811+0000 7f2885036640 1 -- >> v2:172.21.15.87:3300/0 conn(0x7f2864007370 msgr2=0x7f2864009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.87:3300/0 2023-12-16T20:20:57.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:57.811+0000 7f2885036640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2864007370 0x7f2864009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T20:20:57.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:57.811+0000 7f2885837640 1 -- >> v1:172.21.15.195:6789/0 conn(0x7f28640036c0 legacy=0x7f2864005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6789/0 2023-12-16T20:20:58.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:58.012+0000 7f2885036640 1 -- >> v2:172.21.15.87:3300/0 conn(0x7f2864007370 msgr2=0x7f2864009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.87:3300/0 2023-12-16T20:20:58.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:58.012+0000 7f2885036640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2864007370 0x7f2864009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T20:20:58.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:58.012+0000 7f2885837640 1 -- >> v1:172.21.15.195:6789/0 conn(0x7f28640036c0 legacy=0x7f2864005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6789/0 2023-12-16T20:20:58.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:58.413+0000 7f2885036640 1 -- >> v2:172.21.15.87:3300/0 conn(0x7f2864007370 msgr2=0x7f2864009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.87:3300/0 2023-12-16T20:20:58.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:58.413+0000 7f2885036640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2864007370 0x7f2864009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T20:20:58.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:58.413+0000 7f2885837640 1 -- >> v1:172.21.15.195:6789/0 conn(0x7f28640036c0 legacy=0x7f2864005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6789/0 2023-12-16T20:20:59.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:59.214+0000 7f2885036640 1 -- >> v2:172.21.15.87:3300/0 conn(0x7f2864007370 msgr2=0x7f2864009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.87:3300/0 2023-12-16T20:20:59.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:59.214+0000 7f2885036640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2864007370 0x7f2864009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T20:20:59.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:20:59.214+0000 7f2885837640 1 -- >> v1:172.21.15.195:6789/0 conn(0x7f28640036c0 legacy=0x7f2864005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6789/0 2023-12-16T20:21:00.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:00.811+0000 7f28777fe640 1 -- >> v2:172.21.15.87:3300/0 conn(0x7f2864007370 msgr2=0x7f2864009830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T20:21:00.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:00.811+0000 7f28777fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2864007370 0x7f2864009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:00.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:00.811+0000 7f28777fe640 1 -- >> v1:172.21.15.195:6789/0 conn(0x7f28640036c0 legacy=0x7f2864005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T20:21:00.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:00.811+0000 7f2886038640 1 -- reap_dead start 2023-12-16T20:21:00.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:00.811+0000 7f28777fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 0x7f2864009830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:00.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:00.811+0000 7f28777fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f286400a350 0x7f286400a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:00.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:00.811+0000 7f28777fe640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288006f000 con 0x7f2864005ae0 2023-12-16T20:21:00.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:00.811+0000 7f28777fe640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288006bc90 con 0x7f2864009ed0 2023-12-16T20:21:00.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:00.811+0000 7f28777fe640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288006ecd0 con 0x7f286400a350 2023-12-16T20:21:00.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:00.811+0000 7f2885837640 1 -- >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 msgr2=0x7f2864009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.87:3300/0 2023-12-16T20:21:00.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:00.811+0000 7f2885837640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 0x7f2864009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T20:21:00.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:00.811+0000 7f2885036640 1 -- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f286400a350 msgr2=0x7f286400a7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.195:3301/0 2023-12-16T20:21:00.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:00.811+0000 7f2886038640 1 -- >> v1:172.21.15.195:6789/0 conn(0x7f2864005ae0 legacy=0x7f2864006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6789/0 2023-12-16T20:21:00.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:00.811+0000 7f2885036640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f286400a350 0x7f286400a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T20:21:01.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:01.012+0000 7f2885837640 1 -- >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 msgr2=0x7f2864009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.87:3300/0 2023-12-16T20:21:01.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:01.012+0000 7f2885837640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 0x7f2864009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T20:21:01.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:01.012+0000 7f2886038640 1 -- >> v1:172.21.15.195:6789/0 conn(0x7f2864005ae0 legacy=0x7f2864006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6789/0 2023-12-16T20:21:01.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:01.012+0000 7f2885036640 1 -- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f286400a350 msgr2=0x7f286400a7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.195:3301/0 2023-12-16T20:21:01.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:01.012+0000 7f2885036640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f286400a350 0x7f286400a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T20:21:01.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:01.413+0000 7f2885837640 1 -- >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 msgr2=0x7f2864009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.87:3300/0 2023-12-16T20:21:01.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:01.413+0000 7f2885837640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 0x7f2864009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T20:21:01.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:01.413+0000 7f2886038640 1 -- >> v1:172.21.15.195:6789/0 conn(0x7f2864005ae0 legacy=0x7f2864006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6789/0 2023-12-16T20:21:01.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:01.413+0000 7f2885036640 1 -- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f286400a350 msgr2=0x7f286400a7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.195:3301/0 2023-12-16T20:21:01.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:01.413+0000 7f2885036640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f286400a350 0x7f286400a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T20:21:02.201 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:00:07.441 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:21:02.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:02.214+0000 7f2885837640 1 -- >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 msgr2=0x7f2864009830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.87:3300/0 2023-12-16T20:21:02.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:02.214+0000 7f2885837640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 0x7f2864009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T20:21:02.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:02.214+0000 7f2886038640 1 -- >> v1:172.21.15.195:6789/0 conn(0x7f2864005ae0 legacy=0x7f2864006270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6789/0 2023-12-16T20:21:02.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:02.214+0000 7f2885036640 1 -- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f286400a350 msgr2=0x7f286400a7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.195:3301/0 2023-12-16T20:21:02.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:02.214+0000 7f2885036640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f286400a350 0x7f286400a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T20:21:02.394 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:00:07.588 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:21:02.395 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:00:07.588 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:21:02.517 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:00:07.754 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:21:02.707 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:00:07.901 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:21:02.707 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:00:07.901 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:21:03.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:03.811+0000 7f28777fe640 1 -- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f286400a350 msgr2=0x7f286400a7b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T20:21:03.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:03.811+0000 7f28777fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f286400a350 0x7f286400a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:03.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:03.811+0000 7f28777fe640 1 -- >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 msgr2=0x7f2864009830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T20:21:03.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:03.811+0000 7f28777fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 0x7f2864009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:03.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:03.811+0000 7f28777fe640 1 -- >> v1:172.21.15.195:6789/0 conn(0x7f2864005ae0 legacy=0x7f2864006270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T20:21:03.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:03.811+0000 7f28777fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:03.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:03.811+0000 7f28777fe640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288006fdb0 con 0x7f2864010620 2023-12-16T20:21:03.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:03.811+0000 7f28777fe640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288006bc90 con 0x7f2864006a10 2023-12-16T20:21:03.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:03.811+0000 7f2885837640 1 -- >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 msgr2=0x7f28640100e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.195:3300/0 2023-12-16T20:21:03.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:03.811+0000 7f2885837640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T20:21:03.928 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:03.927+0000 7f2885036640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2864010620 0x7f2864012a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57490/0 (socket says 172.21.15.87:57490) 2023-12-16T20:21:03.928 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:03.927+0000 7f2885036640 1 -- 172.21.15.87:0/996211339 learned_addr learned my addr 172.21.15.87:0/996211339 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:04.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:04.105+0000 7f2885036640 1 -- 172.21.15.87:0/996211339 >> v1:172.21.15.87:6789/0 conn(0x7f2864010620 legacy=0x7f2864012a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-16T20:21:04.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:04.105+0000 7f2885036640 1 -- 172.21.15.87:0/996211339 >> v1:172.21.15.87:6789/0 conn(0x7f2864010620 legacy=0x7f2864012a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T20:21:04.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:04.105+0000 7f2885036640 1 --1- 172.21.15.87:0/996211339 >> v1:172.21.15.87:6789/0 conn(0x7f2864010620 0x7f2864012a10 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2023-12-16T20:21:04.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:04.153+0000 7f2885837640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:04.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:04.329+0000 7f2885837640 1 -- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 msgr2=0x7f28640100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T20:21:04.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:04.329+0000 7f2885837640 1 -- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 msgr2=0x7f28640100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T20:21:04.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:04.329+0000 7f2885837640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T20:21:04.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:04.329+0000 7f2885837640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T20:21:04.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:04.875+0000 7f2885837640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:04.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:04.878+0000 7f2885837640 1 -- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 msgr2=0x7f28640100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T20:21:04.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:04.878+0000 7f2885837640 1 -- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 msgr2=0x7f28640100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T20:21:04.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:04.878+0000 7f2885837640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T20:21:04.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:04.878+0000 7f2885837640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T20:21:05.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:05.679+0000 7f2885837640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:05.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:05.680+0000 7f2885837640 1 -- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 msgr2=0x7f28640100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T20:21:05.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:05.680+0000 7f2885837640 1 -- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 msgr2=0x7f28640100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T20:21:05.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:05.680+0000 7f2885837640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T20:21:05.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:05.680+0000 7f2885837640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T20:21:06.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:06.811+0000 7f28777fe640 1 -- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 msgr2=0x7f28640100e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T20:21:06.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:06.811+0000 7f28777fe640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:06.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:06.811+0000 7f28777fe640 1 -- 172.21.15.87:0/996211339 >> v1:172.21.15.87:6789/0 conn(0x7f2864010620 legacy=0x7f2864012a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:06.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:06.811+0000 7f28777fe640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:06.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:06.811+0000 7f2886038640 1 -- 172.21.15.87:0/996211339 reap_dead start 2023-12-16T20:21:06.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:06.811+0000 7f28777fe640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 0x7f2864009830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:06.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:06.811+0000 7f28777fe640 1 -- 172.21.15.87:0/996211339 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288006f000 con 0x7f2864005ae0 2023-12-16T20:21:06.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:06.811+0000 7f28777fe640 1 -- 172.21.15.87:0/996211339 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288006bc90 con 0x7f2864009ed0 2023-12-16T20:21:06.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:06.811+0000 7f28777fe640 1 -- 172.21.15.87:0/996211339 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288006ecd0 con 0x7f2864006a10 2023-12-16T20:21:06.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:06.812+0000 7f2885837640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:06.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:06.815+0000 7f2885837640 1 -- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 msgr2=0x7f28640100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T20:21:06.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:06.815+0000 7f2885837640 1 -- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 msgr2=0x7f28640100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T20:21:06.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:06.815+0000 7f2885837640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T20:21:06.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:06.815+0000 7f2885837640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T20:21:06.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:06.883+0000 7f2886038640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 0x7f2864009830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:07.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.019+0000 7f2886038640 1 -- 172.21.15.87:0/996211339 >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 msgr2=0x7f2864009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-16T20:21:07.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.019+0000 7f2886038640 1 -- 172.21.15.87:0/996211339 >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 msgr2=0x7f2864009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T20:21:07.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.019+0000 7f2886038640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 0x7f2864009830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T20:21:07.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.019+0000 7f2886038640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 0x7f2864009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T20:21:07.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.095+0000 7f2885837640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:07.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.130+0000 7f2885837640 1 -- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 msgr2=0x7f28640100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T20:21:07.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.130+0000 7f2885837640 1 -- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 msgr2=0x7f28640100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T20:21:07.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.130+0000 7f2885837640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T20:21:07.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.130+0000 7f2885837640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T20:21:07.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.220+0000 7f2886038640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 0x7f2864009830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:07.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.223+0000 7f2886038640 1 -- 172.21.15.87:0/996211339 >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 msgr2=0x7f2864009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T20:21:07.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.223+0000 7f2886038640 1 -- 172.21.15.87:0/996211339 >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 msgr2=0x7f2864009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T20:21:07.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.223+0000 7f2886038640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 0x7f2864009830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T20:21:07.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.223+0000 7f2886038640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 0x7f2864009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T20:21:07.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.437+0000 7f2884835640 1 -- 172.21.15.87:0/996211339 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519047457 0 0) 0x7f288006f000 con 0x7f2864005ae0 2023-12-16T20:21:07.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.437+0000 7f2884835640 1 -- 172.21.15.87:0/996211339 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f286c003520 con 0x7f2864005ae0 2023-12-16T20:21:07.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.550+0000 7f2884835640 1 -- 172.21.15.87:0/996211339 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 174123774 0 0) 0x7f286c003520 con 0x7f2864005ae0 2023-12-16T20:21:07.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.550+0000 7f2884835640 1 -- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 msgr2=0x7f28640100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:07.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.550+0000 7f2884835640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.195:3300/0 conn(0x7f2864006a10 0x7f28640100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:07.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.550+0000 7f2884835640 1 -- 172.21.15.87:0/996211339 >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 msgr2=0x7f2864009830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T20:21:07.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.550+0000 7f2884835640 1 --2- 172.21.15.87:0/996211339 >> v2:172.21.15.87:3300/0 conn(0x7f2864009ed0 0x7f2864009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:07.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.550+0000 7f2884835640 1 -- 172.21.15.87:0/996211339 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286400a7b0 con 0x7f2864005ae0 2023-12-16T20:21:07.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.550+0000 7f2884835640 1 -- 172.21.15.87:0/996211339 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1165302485 0 0) 0x7f28700040f0 con 0x7f2864005ae0 2023-12-16T20:21:07.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.550+0000 7f2884835640 1 -- 172.21.15.87:0/996211339 >> v1:172.21.15.195:6789/0 conn(0x7f2864005ae0 legacy=0x7f2864006270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:07.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.550+0000 7f2884835640 1 --2- 172.21.15.87:0/996211339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f286c003970 0x7f286c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:07.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.551+0000 7f2884835640 1 --2- 172.21.15.87:0/996211339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f286c0047c0 0x7f286c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:07.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.551+0000 7f2884835640 1 --2- 172.21.15.87:0/996211339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f286c005180 0x7f286c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:07.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.551+0000 7f2884835640 1 -- 172.21.15.87:0/996211339 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288006bc90 con 0x7f286c005180 2023-12-16T20:21:07.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.551+0000 7f2884835640 1 -- 172.21.15.87:0/996211339 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288006ecd0 con 0x7f286c0047c0 2023-12-16T20:21:07.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.551+0000 7f2884835640 1 -- 172.21.15.87:0/996211339 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286c00c0d0 con 0x7f286c003970 2023-12-16T20:21:07.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.552+0000 7f2886038640 1 --2- 172.21.15.87:0/996211339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f286c005180 0x7f286c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:07.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.556+0000 7f2886038640 1 -- 172.21.15.87:0/996211339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f286c003970 msgr2=0x7f286c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:07.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.556+0000 7f2886038640 1 --2- 172.21.15.87:0/996211339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f286c003970 0x7f286c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:07.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.556+0000 7f2886038640 1 -- 172.21.15.87:0/996211339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f286c0047c0 msgr2=0x7f286c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:07.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.556+0000 7f2886038640 1 --2- 172.21.15.87:0/996211339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f286c0047c0 0x7f286c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:07.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.556+0000 7f2886038640 1 -- 172.21.15.87:0/996211339 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c003520 con 0x7f286c005180 2023-12-16T20:21:07.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.557+0000 7f2886038640 1 -- 172.21.15.87:0/996211339 reap_dead start 2023-12-16T20:21:07.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.568+0000 7f2886038640 1 --2- 172.21.15.87:0/996211339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f286c005180 0x7f286c00b980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f28800c9330 tx=0x7f286c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e8fb7322073141 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:07.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.604+0000 7f2884835640 1 -- 172.21.15.87:0/996211339 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878007470 con 0x7f286c005180 2023-12-16T20:21:07.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.604+0000 7f2884835640 1 -- 172.21.15.87:0/996211339 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2878008040 con 0x7f286c005180 2023-12-16T20:21:07.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.604+0000 7f2884835640 1 -- 172.21.15.87:0/996211339 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287802e6c0 con 0x7f286c005180 2023-12-16T20:21:07.606 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.604+0000 7f2887a9b640 1 -- 172.21.15.87:0/996211339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f286c005180 msgr2=0x7f286c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:07.606 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.604+0000 7f2887a9b640 1 --2- 172.21.15.87:0/996211339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f286c005180 0x7f286c00b980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f28800c9330 tx=0x7f286c0057f0 comp rx=0 tx=0).stop 2023-12-16T20:21:07.606 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.604+0000 7f2887a9b640 1 -- 172.21.15.87:0/996211339 shutdown_connections 2023-12-16T20:21:07.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.604+0000 7f2887a9b640 1 --2- 172.21.15.87:0/996211339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f286c005180 0x7f286c00b980 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:07.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.604+0000 7f2887a9b640 1 -- 172.21.15.87:0/996211339 >> 172.21.15.87:0/996211339 conn(0x7f28800c7f60 msgr2=0x7f28800c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:07.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.605+0000 7f2887a9b640 1 -- 172.21.15.87:0/996211339 shutdown_connections 2023-12-16T20:21:07.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.605+0000 7f2887a9b640 1 -- 172.21.15.87:0/996211339 wait complete. 2023-12-16T20:21:07.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.606+0000 7f2887a9b640 1 Processor -- start 2023-12-16T20:21:07.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.606+0000 7f2887a9b640 1 -- start start 2023-12-16T20:21:07.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.607+0000 7f2887a9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f286c005180 0x7f2880146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:07.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.607+0000 7f2887a9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2880147200 0x7f2880150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:07.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.607+0000 7f2887a9b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2880142b80 0x7f2880150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:07.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.607+0000 7f2887a9b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28801f01a0 con 0x7f286c005180 2023-12-16T20:21:07.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.607+0000 7f2887a9b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28801484e0 con 0x7f2880142b80 2023-12-16T20:21:07.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.607+0000 7f2887a9b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28801efc00 con 0x7f2880147200 2023-12-16T20:21:07.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.619+0000 7f2885036640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2880147200 0x7f2880150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:07.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.620+0000 7f2885036640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2880147200 0x7f2880150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:43534/0 (socket says 172.21.15.87:43534) 2023-12-16T20:21:07.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.620+0000 7f2885036640 1 -- 172.21.15.87:0/2054221187 learned_addr learned my addr 172.21.15.87:0/2054221187 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:07.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.622+0000 7f2886038640 1 --2- 172.21.15.87:0/2054221187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2880142b80 0x7f2880150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:07.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.624+0000 7f2885036640 1 -- 172.21.15.87:0/2054221187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2880142b80 msgr2=0x7f2880150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:07.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.624+0000 7f2885036640 1 --2- 172.21.15.87:0/2054221187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2880142b80 0x7f2880150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:07.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.624+0000 7f2885036640 1 -- 172.21.15.87:0/2054221187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f286c005180 msgr2=0x7f2880146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:07.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.624+0000 7f2885036640 1 --2- 172.21.15.87:0/2054221187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f286c005180 0x7f2880146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:07.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.624+0000 7f2885036640 1 -- 172.21.15.87:0/2054221187 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288006fb80 con 0x7f2880147200 2023-12-16T20:21:07.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.631+0000 7f2885036640 1 --2- 172.21.15.87:0/2054221187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2880147200 0x7f2880150020 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f287000b730 tx=0x7f287000bbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:07.671 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.669+0000 7f28767fc640 1 -- 172.21.15.87:0/2054221187 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287000c930 con 0x7f2880147200 2023-12-16T20:21:07.671 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.670+0000 7f28767fc640 1 -- 172.21.15.87:0/2054221187 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287000ca90 con 0x7f2880147200 2023-12-16T20:21:07.671 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.670+0000 7f28767fc640 1 -- 172.21.15.87:0/2054221187 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287000ce40 con 0x7f2880147200 2023-12-16T20:21:07.671 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.670+0000 7f2887a9b640 1 -- 172.21.15.87:0/2054221187 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28801efec0 con 0x7f2880147200 2023-12-16T20:21:07.671 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.670+0000 7f2887a9b640 1 -- 172.21.15.87:0/2054221187 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2880149690 con 0x7f2880147200 2023-12-16T20:21:07.672 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.670+0000 7f2887a9b640 1 -- 172.21.15.87:0/2054221187 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2880149210 con 0x7f2880147200 2023-12-16T20:21:07.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.908+0000 7f28767fc640 1 -- 172.21.15.87:0/2054221187 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2870012020 con 0x7f2880147200 2023-12-16T20:21:07.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.919+0000 7f28767fc640 1 -- 172.21.15.87:0/2054221187 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f287001f840 con 0x7f2880147200 2023-12-16T20:21:07.921 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.919+0000 7f28767fc640 1 -- 172.21.15.87:0/2054221187 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f2870035cf0 con 0x7f2880147200 2023-12-16T20:21:07.986 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:07.985+0000 7f2887a9b640 1 -- 172.21.15.87:0/2054221187 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f28800740e0 con 0x7f2880147200 2023-12-16T20:21:08.196 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:08.195+0000 7f320e00f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-16T20:21:08.229 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:08.228+0000 7f857381d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-16T20:21:08.260 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:08.259+0000 7f320e00f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-16T20:21:08.285 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:08.284+0000 7f857381d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-16T20:21:08.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:08.311+0000 7f28767fc640 1 -- 172.21.15.87:0/2054221187 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2870024030 con 0x7f2880147200 2023-12-16T20:21:08.313 INFO:teuthology.orchestra.run.smithi087.stderr:adjusted tunables profile to default 2023-12-16T20:21:08.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:08.312+0000 7f2887a9b640 1 -- 172.21.15.87:0/2054221187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2880147200 msgr2=0x7f2880150020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:08.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:08.312+0000 7f2887a9b640 1 --2- 172.21.15.87:0/2054221187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2880147200 0x7f2880150020 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f287000b730 tx=0x7f287000bbf0 comp rx=0 tx=0).stop 2023-12-16T20:21:08.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:08.312+0000 7f2887a9b640 1 -- 172.21.15.87:0/2054221187 shutdown_connections 2023-12-16T20:21:08.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:08.312+0000 7f2887a9b640 1 --2- 172.21.15.87:0/2054221187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2880142b80 0x7f2880150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:08.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:08.312+0000 7f2887a9b640 1 --2- 172.21.15.87:0/2054221187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2880147200 0x7f2880150020 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:08.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:08.312+0000 7f2887a9b640 1 --2- 172.21.15.87:0/2054221187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f286c005180 0x7f2880146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:08.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:08.312+0000 7f2887a9b640 1 -- 172.21.15.87:0/2054221187 >> 172.21.15.87:0/2054221187 conn(0x7f28800c7f60 msgr2=0x7f28800c74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:08.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:08.312+0000 7f2887a9b640 1 -- 172.21.15.87:0/2054221187 shutdown_connections 2023-12-16T20:21:08.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:08.312+0000 7f2887a9b640 1 -- 172.21.15.87:0/2054221187 wait complete. 2023-12-16T20:21:08.324 INFO:tasks.ceph:check_enable_crimson: False 2023-12-16T20:21:08.324 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-16T20:21:08.324 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:21:08.325 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-16T20:21:08.351 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:21:08.352 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-16T20:21:08.419 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:21:08.419 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-16T20:21:08.486 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:21:08.486 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-16T20:21:08.554 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:21:08.554 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-16T20:21:08.582 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:21:08.582 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-16T20:21:08.649 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:21:08.650 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-16T20:21:08.717 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-12-16T20:21:08.717 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-16T20:21:08.784 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 73cae3cf-876f-4902-b7a1-e562f2946ef1 0 2023-12-16T20:21:08.819 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:08.818+0000 7f320e00f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-16T20:21:08.851 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:08.850+0000 7f857381d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-16T20:21:08.875 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:08.874+0000 7f320e00f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-16T20:21:08.907 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:08.906+0000 7f857381d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-16T20:21:08.920 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:08.919+0000 7f320e00f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-16T20:21:08.926 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.924+0000 7fe001c0e640 1 Processor -- start 2023-12-16T20:21:08.926 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.924+0000 7fe001c0e640 1 -- start start 2023-12-16T20:21:08.926 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.925+0000 7fe001c0e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdffc0b1e00 0x7fdffc06e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:08.926 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.925+0000 7fe001c0e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdffc0c1d80 con 0x7fdffc06e020 2023-12-16T20:21:08.926 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.925+0000 7fe001c0e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdffc0c1200 con 0x7fdffc1505a0 2023-12-16T20:21:08.927 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.925+0000 7fe001c0e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdffc1577f0 con 0x7fdffc0b1e00 2023-12-16T20:21:08.927 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.926+0000 7fdffb7fe640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fdffc1505a0 0x7fdffc156ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:42052/0 (socket says 172.21.15.195:42052) 2023-12-16T20:21:08.927 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.926+0000 7fdffb7fe640 1 -- 172.21.15.195:0/2948405910 learned_addr learned my addr 172.21.15.195:0/2948405910 (peer_addr_for_me v1:172.21.15.195:0/0) 2023-12-16T20:21:08.927 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.926+0000 7fdffaffd640 1 --2- 172.21.15.195:0/2948405910 >> v2:172.21.15.87:3300/0 conn(0x7fdffc0b1e00 0x7fdffc06e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:08.930 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.929+0000 7fdffa7fc640 1 -- 172.21.15.195:0/2948405910 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462103929 0 0) 0x7fdffc0c1200 con 0x7fdffc1505a0 2023-12-16T20:21:08.930 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.929+0000 7fdffa7fc640 1 -- 172.21.15.195:0/2948405910 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfe8003520 con 0x7fdffc1505a0 2023-12-16T20:21:08.930 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.929+0000 7fdffaffd640 1 -- 172.21.15.195:0/2948405910 >> v1:172.21.15.195:6789/0 conn(0x7fdffc1505a0 legacy=0x7fdffc156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:08.931 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.929+0000 7fdffaffd640 1 -- 172.21.15.195:0/2948405910 >> v1:172.21.15.87:6789/0 conn(0x7fdffc06e020 legacy=0x7fdffc160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:08.931 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.929+0000 7fdffaffd640 1 -- 172.21.15.195:0/2948405910 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc0c14e0 con 0x7fdffc0b1e00 2023-12-16T20:21:08.932 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.931+0000 7fdffaffd640 1 --2- 172.21.15.195:0/2948405910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdffc0b1e00 0x7fdffc06e500 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40097a0 tx=0x7fdfe402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6b9c597e206fee server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:08.939 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.938+0000 7fdffa7fc640 1 -- 172.21.15.195:0/2948405910 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4031830 con 0x7fdffc0b1e00 2023-12-16T20:21:08.939 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.938+0000 7fdffa7fc640 1 -- 172.21.15.195:0/2948405910 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe4031990 con 0x7fdffc0b1e00 2023-12-16T20:21:08.939 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.938+0000 7fdffa7fc640 1 -- 172.21.15.195:0/2948405910 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4031d20 con 0x7fdffc0b1e00 2023-12-16T20:21:08.940 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.938+0000 7fe001c0e640 1 -- 172.21.15.195:0/2948405910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdffc0b1e00 msgr2=0x7fdffc06e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:08.940 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.938+0000 7fe001c0e640 1 --2- 172.21.15.195:0/2948405910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdffc0b1e00 0x7fdffc06e500 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40097a0 tx=0x7fdfe402b8d0 comp rx=0 tx=0).stop 2023-12-16T20:21:08.940 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.939+0000 7fe001c0e640 1 -- 172.21.15.195:0/2948405910 shutdown_connections 2023-12-16T20:21:08.940 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.939+0000 7fe001c0e640 1 --2- 172.21.15.195:0/2948405910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdffc0b1e00 0x7fdffc06e500 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:08.940 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.939+0000 7fe001c0e640 1 -- 172.21.15.195:0/2948405910 >> 172.21.15.195:0/2948405910 conn(0x7fdffc0c8980 msgr2=0x7fdffc0c8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:08.940 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.939+0000 7fe001c0e640 1 -- 172.21.15.195:0/2948405910 shutdown_connections 2023-12-16T20:21:08.940 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.939+0000 7fe001c0e640 1 -- 172.21.15.195:0/2948405910 wait complete. 2023-12-16T20:21:08.942 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.940+0000 7fe001c0e640 1 Processor -- start 2023-12-16T20:21:08.942 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.941+0000 7fe001c0e640 1 -- start start 2023-12-16T20:21:08.943 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.942+0000 7fe001c0e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdffc06e020 0x7fdffc145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:08.943 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.942+0000 7fe001c0e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdffc0b1e00 0x7fdffc06a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:08.943 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.942+0000 7fe001c0e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdffc1505a0 0x7fdffc06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:08.943 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.942+0000 7fe001c0e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc156380 con 0x7fdffc0b1e00 2023-12-16T20:21:08.943 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.942+0000 7fe001c0e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc154990 con 0x7fdffc06e020 2023-12-16T20:21:08.943 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.942+0000 7fe001c0e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc154c70 con 0x7fdffc1505a0 2023-12-16T20:21:08.944 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.942+0000 7fdffb7fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdffc06e020 0x7fdffc145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:08.944 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.942+0000 7fdffbfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdffc1505a0 0x7fdffc06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:08.944 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.942+0000 7fdffaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdffc0b1e00 0x7fdffc06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:08.944 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.943+0000 7fdffb7fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdffc06e020 0x7fdffc145400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:58860/0 (socket says 172.21.15.195:58860) 2023-12-16T20:21:08.944 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.943+0000 7fdffb7fe640 1 -- 172.21.15.195:0/2472098157 learned_addr learned my addr 172.21.15.195:0/2472098157 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-12-16T20:21:08.947 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.946+0000 7fdffaffd640 1 -- 172.21.15.195:0/2472098157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdffc1505a0 msgr2=0x7fdffc06acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:08.947 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.946+0000 7fdffaffd640 1 --2- 172.21.15.195:0/2472098157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdffc1505a0 0x7fdffc06acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:08.947 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.946+0000 7fdffaffd640 1 -- 172.21.15.195:0/2472098157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdffc06e020 msgr2=0x7fdffc145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:08.947 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.946+0000 7fdffaffd640 1 --2- 172.21.15.195:0/2472098157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdffc06e020 0x7fdffc145400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:08.947 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.946+0000 7fdffaffd640 1 -- 172.21.15.195:0/2472098157 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe4009400 con 0x7fdffc0b1e00 2023-12-16T20:21:08.949 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.948+0000 7fdffaffd640 1 --2- 172.21.15.195:0/2472098157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdffc0b1e00 0x7fdffc06a770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4033000 tx=0x7fdfe40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:08.953 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.951+0000 7fdff3fff640 1 -- 172.21.15.195:0/2472098157 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe403b9f0 con 0x7fdffc0b1e00 2023-12-16T20:21:08.953 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.951+0000 7fdff3fff640 1 -- 172.21.15.195:0/2472098157 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe403bb70 con 0x7fdffc0b1e00 2023-12-16T20:21:08.953 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.951+0000 7fdff3fff640 1 -- 172.21.15.195:0/2472098157 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe40453f0 con 0x7fdffc0b1e00 2023-12-16T20:21:08.953 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.951+0000 7fe001c0e640 1 -- 172.21.15.195:0/2472098157 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdffc14c890 con 0x7fdffc0b1e00 2023-12-16T20:21:08.953 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.952+0000 7fe001c0e640 1 -- 172.21.15.195:0/2472098157 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdffc14ce50 con 0x7fdffc0b1e00 2023-12-16T20:21:08.953 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.952+0000 7fe001c0e640 1 -- 172.21.15.195:0/2472098157 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdffc06a500 con 0x7fdffc0b1e00 2023-12-16T20:21:08.965 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:08.964+0000 7f857381d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-16T20:21:08.969 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.968+0000 7fdff3fff640 1 -- 172.21.15.195:0/2472098157 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdfe4045850 con 0x7fdffc0b1e00 2023-12-16T20:21:08.969 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:08.968+0000 7fdff3fff640 1 -- 172.21.15.195:0/2472098157 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdfe404e710 con 0x7fdffc0b1e00 2023-12-16T20:21:08.977 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:08.976+0000 7f320e00f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-16T20:21:09.021 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:09.020+0000 7f320e00f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-16T20:21:09.021 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:09.020+0000 7f857381d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-16T20:21:09.064 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:09.063+0000 7f857381d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-16T20:21:09.086 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.084+0000 7fdff3fff640 1 -- 172.21.15.195:0/2472098157 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7fdfe4035020 con 0x7fdffc0b1e00 2023-12-16T20:21:09.124 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:09.123+0000 7f320e00f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-16T20:21:09.156 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.154+0000 7fe001c0e640 1 -- 172.21.15.195:0/2472098157 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "73cae3cf-876f-4902-b7a1-e562f2946ef1", "id": 0} v 0) v1 -- 0x7fdffc0740e0 con 0x7fdffc0b1e00 2023-12-16T20:21:09.165 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:09.163+0000 7f857381d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-16T20:21:09.195 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:09.193+0000 7f320e00f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-16T20:21:09.237 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:09.235+0000 7f857381d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-16T20:21:09.243 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:09.242+0000 7f320e00f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-16T20:21:09.246 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.245+0000 7fdff3fff640 1 -- 172.21.15.195:0/2472098157 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "73cae3cf-876f-4902-b7a1-e562f2946ef1", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdfe4005990 con 0x7fdffc0b1e00 2023-12-16T20:21:09.247 INFO:teuthology.orchestra.run.smithi195.stdout:0 2023-12-16T20:21:09.248 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.246+0000 7fe001c0e640 1 -- 172.21.15.195:0/2472098157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdffc0b1e00 msgr2=0x7fdffc06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:09.248 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.246+0000 7fe001c0e640 1 --2- 172.21.15.195:0/2472098157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdffc0b1e00 0x7fdffc06a770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4033000 tx=0x7fdfe40046c0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.248 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.246+0000 7fe001c0e640 1 -- 172.21.15.195:0/2472098157 shutdown_connections 2023-12-16T20:21:09.248 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.246+0000 7fe001c0e640 1 --2- 172.21.15.195:0/2472098157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdffc1505a0 0x7fdffc06acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.248 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.246+0000 7fe001c0e640 1 --2- 172.21.15.195:0/2472098157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdffc0b1e00 0x7fdffc06a770 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.248 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.246+0000 7fe001c0e640 1 --2- 172.21.15.195:0/2472098157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdffc06e020 0x7fdffc145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.248 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.246+0000 7fe001c0e640 1 -- 172.21.15.195:0/2472098157 >> 172.21.15.195:0/2472098157 conn(0x7fdffc0c8980 msgr2=0x7fdffc06f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:09.248 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.246+0000 7fe001c0e640 1 -- 172.21.15.195:0/2472098157 shutdown_connections 2023-12-16T20:21:09.248 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.247+0000 7fe001c0e640 1 -- 172.21.15.195:0/2472098157 wait complete. 2023-12-16T20:21:09.262 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 99320a16-1229-40cc-ad91-52588c0c290b 1 2023-12-16T20:21:09.295 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:09.293+0000 7f857381d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-16T20:21:09.301 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:09.297+0000 7f320e00f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-16T20:21:09.346 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:09.345+0000 7f320e00f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-16T20:21:09.378 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:09.377+0000 7f857381d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-16T20:21:09.399 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.397+0000 7f2fb9ee0640 1 Processor -- start 2023-12-16T20:21:09.399 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.397+0000 7f2fb9ee0640 1 -- start start 2023-12-16T20:21:09.400 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.398+0000 7f2fb9ee0640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2fb40cd230 0x7f2fb40c8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:09.400 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.398+0000 7f2fb9ee0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb40cd610 0x7f2fb406f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:09.400 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.398+0000 7f2fb9ee0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2fb406bb60 0x7f2fb406bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:09.400 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.398+0000 7f2fb9ee0640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb40c8db0 con 0x7f2fb406bb60 2023-12-16T20:21:09.400 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.398+0000 7f2fb9ee0640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb406d180 con 0x7f2fb40cd230 2023-12-16T20:21:09.400 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.398+0000 7f2fb9ee0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb40c9240 con 0x7f2fb40cd610 2023-12-16T20:21:09.400 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.399+0000 7f2fb2ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb40cd610 0x7f2fb406f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:09.401 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.399+0000 7f2fb3fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2fb406bb60 0x7f2fb406bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:09.401 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.399+0000 7f2fb2ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb40cd610 0x7f2fb406f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:40724/0 (socket says 172.21.15.195:40724) 2023-12-16T20:21:09.401 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.399+0000 7f2fb2ffd640 1 -- 172.21.15.195:0/2583210456 learned_addr learned my addr 172.21.15.195:0/2583210456 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-12-16T20:21:09.402 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.401+0000 7f2fb2ffd640 1 -- 172.21.15.195:0/2583210456 >> v2:172.21.15.195:3300/0 conn(0x7f2fb40cd230 msgr2=0x7f2fb40c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:09.402 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.401+0000 7f2fb2ffd640 1 --2- 172.21.15.195:0/2583210456 >> v2:172.21.15.195:3300/0 conn(0x7f2fb40cd230 0x7f2fb40c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.402 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.401+0000 7f2fb2ffd640 1 -- 172.21.15.195:0/2583210456 >> v2:172.21.15.87:3300/0 conn(0x7f2fb406bb60 msgr2=0x7f2fb406bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:09.402 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.401+0000 7f2fb2ffd640 1 --2- 172.21.15.195:0/2583210456 >> v2:172.21.15.87:3300/0 conn(0x7f2fb406bb60 0x7f2fb406bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.403 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.401+0000 7f2fb2ffd640 1 -- 172.21.15.195:0/2583210456 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb415a0d0 con 0x7f2fb40cd610 2023-12-16T20:21:09.405 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.403+0000 7f2fb2ffd640 1 --2- 172.21.15.195:0/2583210456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb40cd610 0x7f2fb406f4e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40cdb90 tx=0x7f2fa802b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41e3936880385fe4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:09.413 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.412+0000 7f2fb27fc640 1 -- 172.21.15.195:0/2583210456 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8030860 con 0x7f2fb40cd610 2023-12-16T20:21:09.413 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.412+0000 7f2fb27fc640 1 -- 172.21.15.195:0/2583210456 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa80309c0 con 0x7f2fb40cd610 2023-12-16T20:21:09.413 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.412+0000 7f2fb27fc640 1 -- 172.21.15.195:0/2583210456 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8030d50 con 0x7f2fb40cd610 2023-12-16T20:21:09.414 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.413+0000 7f2fb9ee0640 1 -- 172.21.15.195:0/2583210456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb40cd610 msgr2=0x7f2fb406f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:09.415 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.413+0000 7f2fb9ee0640 1 --2- 172.21.15.195:0/2583210456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb40cd610 0x7f2fb406f4e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40cdb90 tx=0x7f2fa802b9a0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.415 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.413+0000 7f2fb9ee0640 1 -- 172.21.15.195:0/2583210456 shutdown_connections 2023-12-16T20:21:09.415 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.413+0000 7f2fb9ee0640 1 --2- 172.21.15.195:0/2583210456 >> v2:172.21.15.87:3300/0 conn(0x7f2fb406bb60 0x7f2fb406bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.415 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.413+0000 7f2fb9ee0640 1 --2- 172.21.15.195:0/2583210456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb40cd610 0x7f2fb406f4e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.415 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.413+0000 7f2fb9ee0640 1 --2- 172.21.15.195:0/2583210456 >> v2:172.21.15.195:3300/0 conn(0x7f2fb40cd230 0x7f2fb40c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.415 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.413+0000 7f2fb9ee0640 1 -- 172.21.15.195:0/2583210456 >> 172.21.15.195:0/2583210456 conn(0x7f2fb4061100 msgr2=0x7f2fb40614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:09.415 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.413+0000 7f2fb9ee0640 1 -- 172.21.15.195:0/2583210456 shutdown_connections 2023-12-16T20:21:09.415 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.413+0000 7f2fb9ee0640 1 -- 172.21.15.195:0/2583210456 wait complete. 2023-12-16T20:21:09.416 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.414+0000 7f2fb9ee0640 1 Processor -- start 2023-12-16T20:21:09.416 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.414+0000 7f2fb9ee0640 1 -- start start 2023-12-16T20:21:09.417 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.415+0000 7f2fb9ee0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fb406bb60 0x7f2fb414e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:09.417 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.415+0000 7f2fb9ee0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb40cd230 0x7f2fb415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:09.417 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.415+0000 7f2fb9ee0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fb40cd610 0x7f2fb415d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:09.417 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.415+0000 7f2fb9ee0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb41ef390 con 0x7f2fb406bb60 2023-12-16T20:21:09.417 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.415+0000 7f2fb9ee0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb41f3690 con 0x7f2fb40cd610 2023-12-16T20:21:09.417 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.415+0000 7f2fb9ee0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb41ef650 con 0x7f2fb40cd230 2023-12-16T20:21:09.417 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.416+0000 7f2fb37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fb406bb60 0x7f2fb414e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:09.418 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.416+0000 7f2fb37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fb406bb60 0x7f2fb414e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.195:60796/0 (socket says 172.21.15.195:60796) 2023-12-16T20:21:09.418 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.416+0000 7f2fb37fe640 1 -- 172.21.15.195:0/3514663525 learned_addr learned my addr 172.21.15.195:0/3514663525 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-12-16T20:21:09.418 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.416+0000 7f2fb2ffd640 1 --2- 172.21.15.195:0/3514663525 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb40cd230 0x7f2fb415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:09.418 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.417+0000 7f2fb3fff640 1 --2- 172.21.15.195:0/3514663525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fb40cd610 0x7f2fb415d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:09.420 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.419+0000 7f2fb37fe640 1 -- 172.21.15.195:0/3514663525 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb40cd230 msgr2=0x7f2fb415cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:09.420 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.419+0000 7f2fb37fe640 1 --2- 172.21.15.195:0/3514663525 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb40cd230 0x7f2fb415cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.420 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.419+0000 7f2fb37fe640 1 -- 172.21.15.195:0/3514663525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fb40cd610 msgr2=0x7f2fb415d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:09.421 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.419+0000 7f2fb37fe640 1 --2- 172.21.15.195:0/3514663525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fb40cd610 0x7f2fb415d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.421 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.419+0000 7f2fb37fe640 1 -- 172.21.15.195:0/3514663525 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa80094d0 con 0x7f2fb406bb60 2023-12-16T20:21:09.422 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.421+0000 7f2fb37fe640 1 --2- 172.21.15.195:0/3514663525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fb406bb60 0x7f2fb414e930 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400b4a0 tx=0x7f2fa400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:09.426 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.425+0000 7f2f9bfff640 1 -- 172.21.15.195:0/3514663525 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4010610 con 0x7f2fb406bb60 2023-12-16T20:21:09.426 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.425+0000 7f2f9bfff640 1 -- 172.21.15.195:0/3514663525 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa4010770 con 0x7f2fb406bb60 2023-12-16T20:21:09.426 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.425+0000 7f2fb9ee0640 1 -- 172.21.15.195:0/3514663525 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb406fa20 con 0x7f2fb406bb60 2023-12-16T20:21:09.427 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.425+0000 7f2f9bfff640 1 -- 172.21.15.195:0/3514663525 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4010b20 con 0x7f2fb406bb60 2023-12-16T20:21:09.427 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.425+0000 7f2fb9ee0640 1 -- 172.21.15.195:0/3514663525 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb41efc10 con 0x7f2fb406bb60 2023-12-16T20:21:09.427 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.426+0000 7f2fb9ee0640 1 -- 172.21.15.195:0/3514663525 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb41f0260 con 0x7f2fb406bb60 2023-12-16T20:21:09.439 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:09.438+0000 7f857381d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-16T20:21:09.524 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.523+0000 7f2f9bfff640 1 -- 172.21.15.195:0/3514663525 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2fa4023480 con 0x7f2fb406bb60 2023-12-16T20:21:09.528 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.527+0000 7f2f9bfff640 1 -- 172.21.15.195:0/3514663525 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f2fa4019a00 con 0x7f2fb406bb60 2023-12-16T20:21:09.528 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.527+0000 7f2f9bfff640 1 -- 172.21.15.195:0/3514663525 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f2fa401e060 con 0x7f2fb406bb60 2023-12-16T20:21:09.600 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.599+0000 7f2fb9ee0640 1 -- 172.21.15.195:0/3514663525 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "99320a16-1229-40cc-ad91-52588c0c290b", "id": 1} v 0) v1 -- 0x7f2fb40740e0 con 0x7f2fb406bb60 2023-12-16T20:21:09.639 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.637+0000 7f2f9bfff640 1 -- 172.21.15.195:0/3514663525 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "99320a16-1229-40cc-ad91-52588c0c290b", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2fa4014070 con 0x7f2fb406bb60 2023-12-16T20:21:09.639 INFO:teuthology.orchestra.run.smithi195.stdout:1 2023-12-16T20:21:09.640 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.638+0000 7f2fb9ee0640 1 -- 172.21.15.195:0/3514663525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fb406bb60 msgr2=0x7f2fb414e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:09.640 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.638+0000 7f2fb9ee0640 1 --2- 172.21.15.195:0/3514663525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fb406bb60 0x7f2fb414e930 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400b4a0 tx=0x7f2fa400b960 comp rx=0 tx=0).stop 2023-12-16T20:21:09.640 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.638+0000 7f2fb9ee0640 1 -- 172.21.15.195:0/3514663525 shutdown_connections 2023-12-16T20:21:09.640 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.638+0000 7f2fb9ee0640 1 --2- 172.21.15.195:0/3514663525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fb40cd610 0x7f2fb415d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.640 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.638+0000 7f2fb9ee0640 1 --2- 172.21.15.195:0/3514663525 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2fb40cd230 0x7f2fb415cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.641 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.638+0000 7f2fb9ee0640 1 --2- 172.21.15.195:0/3514663525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fb406bb60 0x7f2fb414e930 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.641 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.638+0000 7f2fb9ee0640 1 -- 172.21.15.195:0/3514663525 >> 172.21.15.195:0/3514663525 conn(0x7f2fb4061100 msgr2=0x7f2fb40614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:09.641 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.639+0000 7f2fb9ee0640 1 -- 172.21.15.195:0/3514663525 shutdown_connections 2023-12-16T20:21:09.641 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.639+0000 7f2fb9ee0640 1 -- 172.21.15.195:0/3514663525 wait complete. 2023-12-16T20:21:09.650 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 5ae08722-d336-40c7-9daa-fbc674119491 2 2023-12-16T20:21:09.744 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:09.743+0000 7f320e00f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-16T20:21:09.753 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.752+0000 7fa661fa9640 1 Processor -- start 2023-12-16T20:21:09.753 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.752+0000 7fa661fa9640 1 -- start start 2023-12-16T20:21:09.755 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.753+0000 7fa661fa9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa65c151630 0x7fa65c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:09.755 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.753+0000 7fa661fa9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa65c157f50 0x7fa65c0c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:09.755 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.753+0000 7fa661fa9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65c15b9c0 con 0x7fa65c0ca130 2023-12-16T20:21:09.755 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.753+0000 7fa661fa9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65c15ab60 con 0x7fa65c151630 2023-12-16T20:21:09.755 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.753+0000 7fa661fa9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c15ae40 con 0x7fa65c157f50 2023-12-16T20:21:09.755 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.753+0000 7fa65affd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa65c157f50 0x7fa65c0c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:09.756 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.753+0000 7fa65b7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa65c151630 0x7fa65c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:09.756 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.753+0000 7fa65affd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa65c157f50 0x7fa65c0c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:40752/0 (socket says 172.21.15.195:40752) 2023-12-16T20:21:09.756 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.753+0000 7fa65affd640 1 -- 172.21.15.195:0/1943109800 learned_addr learned my addr 172.21.15.195:0/1943109800 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-12-16T20:21:09.757 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.755+0000 7fa65affd640 1 -- 172.21.15.195:0/1943109800 >> v2:172.21.15.87:3300/0 conn(0x7fa65c151630 msgr2=0x7fa65c06f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:09.757 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.755+0000 7fa65affd640 1 --2- 172.21.15.195:0/1943109800 >> v2:172.21.15.87:3300/0 conn(0x7fa65c151630 0x7fa65c06f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.757 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.756+0000 7fa65affd640 1 -- 172.21.15.195:0/1943109800 >> v1:172.21.15.87:6789/0 conn(0x7fa65c0ca130 legacy=0x7fa65c0c2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:09.757 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.756+0000 7fa65affd640 1 -- 172.21.15.195:0/1943109800 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c15b120 con 0x7fa65c157f50 2023-12-16T20:21:09.760 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.757+0000 7fa65affd640 1 --2- 172.21.15.195:0/1943109800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa65c157f50 0x7fa65c0c9bf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa650009e50 tx=0x7fa65002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=839c35317a62075a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:09.762 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.761+0000 7fa65a7fc640 1 -- 172.21.15.195:0/1943109800 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65002cb00 con 0x7fa65c157f50 2023-12-16T20:21:09.762 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.761+0000 7fa65a7fc640 1 -- 172.21.15.195:0/1943109800 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65002cc60 con 0x7fa65c157f50 2023-12-16T20:21:09.762 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.761+0000 7fa65a7fc640 1 -- 172.21.15.195:0/1943109800 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6500343f0 con 0x7fa65c157f50 2023-12-16T20:21:09.763 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.762+0000 7fa661fa9640 1 -- 172.21.15.195:0/1943109800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa65c157f50 msgr2=0x7fa65c0c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:09.763 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.762+0000 7fa661fa9640 1 --2- 172.21.15.195:0/1943109800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa65c157f50 0x7fa65c0c9bf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa650009e50 tx=0x7fa65002bf60 comp rx=0 tx=0).stop 2023-12-16T20:21:09.763 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.762+0000 7fa661fa9640 1 -- 172.21.15.195:0/1943109800 shutdown_connections 2023-12-16T20:21:09.763 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.762+0000 7fa661fa9640 1 --2- 172.21.15.195:0/1943109800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa65c157f50 0x7fa65c0c9bf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.763 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.762+0000 7fa661fa9640 1 --2- 172.21.15.195:0/1943109800 >> v2:172.21.15.87:3300/0 conn(0x7fa65c151630 0x7fa65c06f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.763 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.762+0000 7fa661fa9640 1 -- 172.21.15.195:0/1943109800 >> 172.21.15.195:0/1943109800 conn(0x7fa65c061100 msgr2=0x7fa65c0614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:09.763 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.762+0000 7fa661fa9640 1 -- 172.21.15.195:0/1943109800 shutdown_connections 2023-12-16T20:21:09.763 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.762+0000 7fa661fa9640 1 -- 172.21.15.195:0/1943109800 wait complete. 2023-12-16T20:21:09.764 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.763+0000 7fa661fa9640 1 Processor -- start 2023-12-16T20:21:09.764 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.763+0000 7fa661fa9640 1 -- start start 2023-12-16T20:21:09.765 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.764+0000 7fa661fa9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa65c0ca130 0x7fa65c1f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:09.765 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.764+0000 7fa661fa9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa65c151630 0x7fa65c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:09.765 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.764+0000 7fa661fa9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa65c157f50 0x7fa65c159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:09.765 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.764+0000 7fa661fa9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c14f1f0 con 0x7fa65c157f50 2023-12-16T20:21:09.765 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.764+0000 7fa661fa9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c06b610 con 0x7fa65c0ca130 2023-12-16T20:21:09.766 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.764+0000 7fa661fa9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c158690 con 0x7fa65c151630 2023-12-16T20:21:09.766 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.765+0000 7fa65b7fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa65c0ca130 0x7fa65c1f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:09.766 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.765+0000 7fa65bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa65c157f50 0x7fa65c159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:09.766 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.765+0000 7fa65affd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa65c151630 0x7fa65c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:09.767 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.765+0000 7fa65bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa65c157f50 0x7fa65c159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.195:60810/0 (socket says 172.21.15.195:60810) 2023-12-16T20:21:09.767 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.765+0000 7fa65bfff640 1 -- 172.21.15.195:0/148129521 learned_addr learned my addr 172.21.15.195:0/148129521 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-12-16T20:21:09.769 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.768+0000 7fa65bfff640 1 -- 172.21.15.195:0/148129521 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa65c151630 msgr2=0x7fa65c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:09.769 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.768+0000 7fa65bfff640 1 --2- 172.21.15.195:0/148129521 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa65c151630 0x7fa65c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.770 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.768+0000 7fa65bfff640 1 -- 172.21.15.195:0/148129521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa65c0ca130 msgr2=0x7fa65c1f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:09.770 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.768+0000 7fa65bfff640 1 --2- 172.21.15.195:0/148129521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa65c0ca130 0x7fa65c1f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.770 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.768+0000 7fa65bfff640 1 -- 172.21.15.195:0/148129521 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa650009b30 con 0x7fa65c157f50 2023-12-16T20:21:09.771 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.770+0000 7fa65bfff640 1 --2- 172.21.15.195:0/148129521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa65c157f50 0x7fa65c159e50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa65400b410 tx=0x7fa65400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:09.775 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.774+0000 7fa643fff640 1 -- 172.21.15.195:0/148129521 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654004020 con 0x7fa65c157f50 2023-12-16T20:21:09.775 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.774+0000 7fa643fff640 1 -- 172.21.15.195:0/148129521 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa654004180 con 0x7fa65c157f50 2023-12-16T20:21:09.775 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.774+0000 7fa661fa9640 1 -- 172.21.15.195:0/148129521 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65c14ac60 con 0x7fa65c157f50 2023-12-16T20:21:09.775 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.774+0000 7fa643fff640 1 -- 172.21.15.195:0/148129521 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654011630 con 0x7fa65c157f50 2023-12-16T20:21:09.775 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.774+0000 7fa661fa9640 1 -- 172.21.15.195:0/148129521 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65c06b8d0 con 0x7fa65c157f50 2023-12-16T20:21:09.776 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.775+0000 7fa661fa9640 1 -- 172.21.15.195:0/148129521 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65c06bac0 con 0x7fa65c157f50 2023-12-16T20:21:09.832 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:09.831+0000 7f857381d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-16T20:21:09.872 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.871+0000 7fa643fff640 1 -- 172.21.15.195:0/148129521 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa654011a90 con 0x7fa65c157f50 2023-12-16T20:21:09.877 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.875+0000 7fa643fff640 1 -- 172.21.15.195:0/148129521 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fa654003c70 con 0x7fa65c157f50 2023-12-16T20:21:09.877 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.875+0000 7fa643fff640 1 -- 172.21.15.195:0/148129521 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7fa654015030 con 0x7fa65c157f50 2023-12-16T20:21:09.884 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:09.883+0000 7f320e00f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-16T20:21:09.948 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.946+0000 7fa661fa9640 1 -- 172.21.15.195:0/148129521 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5ae08722-d336-40c7-9daa-fbc674119491", "id": 2} v 0) v1 -- 0x7fa65c0740e0 con 0x7fa65c157f50 2023-12-16T20:21:09.968 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:09.967+0000 7f857381d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-16T20:21:09.980 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.978+0000 7fa643fff640 1 -- 172.21.15.195:0/148129521 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5ae08722-d336-40c7-9daa-fbc674119491", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa654003e30 con 0x7fa65c157f50 2023-12-16T20:21:09.980 INFO:teuthology.orchestra.run.smithi195.stdout:2 2023-12-16T20:21:09.981 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.979+0000 7fa661fa9640 1 -- 172.21.15.195:0/148129521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa65c157f50 msgr2=0x7fa65c159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:09.981 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.979+0000 7fa661fa9640 1 --2- 172.21.15.195:0/148129521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa65c157f50 0x7fa65c159e50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa65400b410 tx=0x7fa65400b8d0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.981 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.979+0000 7fa661fa9640 1 -- 172.21.15.195:0/148129521 shutdown_connections 2023-12-16T20:21:09.981 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.979+0000 7fa661fa9640 1 --2- 172.21.15.195:0/148129521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa65c157f50 0x7fa65c159e50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.982 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.979+0000 7fa661fa9640 1 --2- 172.21.15.195:0/148129521 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa65c151630 0x7fa65c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.982 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.979+0000 7fa661fa9640 1 --2- 172.21.15.195:0/148129521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa65c0ca130 0x7fa65c1f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:09.982 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.979+0000 7fa661fa9640 1 -- 172.21.15.195:0/148129521 >> 172.21.15.195:0/148129521 conn(0x7fa65c061100 msgr2=0x7fa65c150ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:09.982 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.979+0000 7fa661fa9640 1 -- 172.21.15.195:0/148129521 shutdown_connections 2023-12-16T20:21:09.982 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:09.979+0000 7fa661fa9640 1 -- 172.21.15.195:0/148129521 wait complete. 2023-12-16T20:21:09.994 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:09.993+0000 7f320e00f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-16T20:21:09.996 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 969d599a-ea7d-4f88-a65c-c3e367c2c27c 3 2023-12-16T20:21:10.041 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:10.040+0000 7f320e00f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-16T20:21:10.092 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:10.091+0000 7f857381d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-16T20:21:10.097 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.096+0000 7fbf0d8d3640 1 Processor -- start 2023-12-16T20:21:10.097 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.096+0000 7fbf0d8d3640 1 -- start start 2023-12-16T20:21:10.098 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.097+0000 7fbf0d8d3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf08153c70 0x7fbf0815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:10.098 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.097+0000 7fbf0d8d3640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbf080ceef0 0x7fbf080cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:10.098 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.097+0000 7fbf0d8d3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0815a700 con 0x7fbf08153890 2023-12-16T20:21:10.098 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.097+0000 7fbf0d8d3640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf080ca870 con 0x7fbf080ceef0 2023-12-16T20:21:10.098 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.097+0000 7fbf0d8d3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf08159af0 con 0x7fbf08153c70 2023-12-16T20:21:10.099 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.097+0000 7fbf067fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf08153c70 0x7fbf0815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:10.099 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.097+0000 7fbf077fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbf080ceef0 0x7fbf080cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:10.099 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.097+0000 7fbf06ffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbf08153890 0x7fbf080c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.195:37382/0 (socket says 172.21.15.195:37382) 2023-12-16T20:21:10.099 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.097+0000 7fbf06ffd640 1 -- 172.21.15.195:0/3048948063 learned_addr learned my addr 172.21.15.195:0/3048948063 (peer_addr_for_me v1:172.21.15.195:0/0) 2023-12-16T20:21:10.101 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.100+0000 7fbf067fc640 1 -- 172.21.15.195:0/3048948063 >> v2:172.21.15.195:3300/0 conn(0x7fbf080ceef0 msgr2=0x7fbf080cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:10.101 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.100+0000 7fbf067fc640 1 --2- 172.21.15.195:0/3048948063 >> v2:172.21.15.195:3300/0 conn(0x7fbf080ceef0 0x7fbf080cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.101 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.100+0000 7fbf067fc640 1 -- 172.21.15.195:0/3048948063 >> v1:172.21.15.87:6789/0 conn(0x7fbf08153890 legacy=0x7fbf080c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:10.101 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.100+0000 7fbf067fc640 1 -- 172.21.15.195:0/3048948063 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf08159dd0 con 0x7fbf08153c70 2023-12-16T20:21:10.102 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.101+0000 7fbf067fc640 1 --2- 172.21.15.195:0/3048948063 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf08153c70 0x7fbf0815d950 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0097a0 tx=0x7fbefc02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fbabfe81c308971 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:10.106 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.105+0000 7fbf05ffb640 1 -- 172.21.15.195:0/3048948063 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc030610 con 0x7fbf08153c70 2023-12-16T20:21:10.106 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.105+0000 7fbf05ffb640 1 -- 172.21.15.195:0/3048948063 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc030770 con 0x7fbf08153c70 2023-12-16T20:21:10.106 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.105+0000 7fbf05ffb640 1 -- 172.21.15.195:0/3048948063 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc030b00 con 0x7fbf08153c70 2023-12-16T20:21:10.108 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.106+0000 7fbf0d8d3640 1 -- 172.21.15.195:0/3048948063 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf08153c70 msgr2=0x7fbf0815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:10.108 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.106+0000 7fbf0d8d3640 1 --2- 172.21.15.195:0/3048948063 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf08153c70 0x7fbf0815d950 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0097a0 tx=0x7fbefc02b960 comp rx=0 tx=0).stop 2023-12-16T20:21:10.108 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.106+0000 7fbf0d8d3640 1 -- 172.21.15.195:0/3048948063 shutdown_connections 2023-12-16T20:21:10.108 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.106+0000 7fbf0d8d3640 1 --2- 172.21.15.195:0/3048948063 >> v2:172.21.15.195:3300/0 conn(0x7fbf080ceef0 0x7fbf080cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.108 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.106+0000 7fbf0d8d3640 1 --2- 172.21.15.195:0/3048948063 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf08153c70 0x7fbf0815d950 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.108 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.106+0000 7fbf0d8d3640 1 -- 172.21.15.195:0/3048948063 >> 172.21.15.195:0/3048948063 conn(0x7fbf0806ba00 msgr2=0x7fbf0806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:10.108 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.106+0000 7fbf0d8d3640 1 -- 172.21.15.195:0/3048948063 shutdown_connections 2023-12-16T20:21:10.108 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.106+0000 7fbf0d8d3640 1 -- 172.21.15.195:0/3048948063 wait complete. 2023-12-16T20:21:10.109 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.107+0000 7fbf0d8d3640 1 Processor -- start 2023-12-16T20:21:10.109 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.107+0000 7fbf0d8d3640 1 -- start start 2023-12-16T20:21:10.110 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.108+0000 7fbf0d8d3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf080ceef0 0x7fbf08147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:10.110 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.108+0000 7fbf0d8d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf08153890 0x7fbf08146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:10.110 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.108+0000 7fbf0d8d3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf08153c70 0x7fbf08154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:10.110 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.108+0000 7fbf0d8d3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf08154880 con 0x7fbf08153890 2023-12-16T20:21:10.111 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.108+0000 7fbf0d8d3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf081489d0 con 0x7fbf080ceef0 2023-12-16T20:21:10.111 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.108+0000 7fbf0d8d3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf08147560 con 0x7fbf08153c70 2023-12-16T20:21:10.111 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.108+0000 7fbf077fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf08153c70 0x7fbf08154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:10.111 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.108+0000 7fbf06ffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf080ceef0 0x7fbf08147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:10.111 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.109+0000 7fbf067fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf08153890 0x7fbf08146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:10.111 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.109+0000 7fbf077fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf08153c70 0x7fbf08154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:40778/0 (socket says 172.21.15.195:40778) 2023-12-16T20:21:10.111 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.109+0000 7fbf077fe640 1 -- 172.21.15.195:0/2549876832 learned_addr learned my addr 172.21.15.195:0/2549876832 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-12-16T20:21:10.114 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.112+0000 7fbf077fe640 1 -- 172.21.15.195:0/2549876832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf080ceef0 msgr2=0x7fbf08147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:10.114 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.112+0000 7fbf077fe640 1 --2- 172.21.15.195:0/2549876832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf080ceef0 0x7fbf08147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.114 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.112+0000 7fbf077fe640 1 -- 172.21.15.195:0/2549876832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf08153890 msgr2=0x7fbf08146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:10.114 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.112+0000 7fbf077fe640 1 --2- 172.21.15.195:0/2549876832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf08153890 0x7fbf08146930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.114 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.112+0000 7fbf077fe640 1 -- 172.21.15.195:0/2549876832 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc009400 con 0x7fbf08153c70 2023-12-16T20:21:10.114 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.112+0000 7fbf067fc640 1 --2- 172.21.15.195:0/2549876832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf08153890 0x7fbf08146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:21:10.115 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.114+0000 7fbf077fe640 1 --2- 172.21.15.195:0/2549876832 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf08153c70 0x7fbf08154ca0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009dd0 tx=0x7fbf0000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:10.121 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.118+0000 7fbeeffff640 1 -- 172.21.15.195:0/2549876832 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf00014480 con 0x7fbf08153c70 2023-12-16T20:21:10.122 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.118+0000 7fbeeffff640 1 -- 172.21.15.195:0/2549876832 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0000f040 con 0x7fbf08153c70 2023-12-16T20:21:10.122 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.118+0000 7fbeeffff640 1 -- 172.21.15.195:0/2549876832 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf00014840 con 0x7fbf08153c70 2023-12-16T20:21:10.122 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.118+0000 7fbf0d8d3640 1 -- 172.21.15.195:0/2549876832 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf08146fa0 con 0x7fbf08153c70 2023-12-16T20:21:10.122 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.118+0000 7fbf0d8d3640 1 -- 172.21.15.195:0/2549876832 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf081541c0 con 0x7fbf08153c70 2023-12-16T20:21:10.122 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.119+0000 7fbf0d8d3640 1 -- 172.21.15.195:0/2549876832 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf081549c0 con 0x7fbf08153c70 2023-12-16T20:21:10.122 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.120+0000 7fbeeffff640 1 -- 172.21.15.195:0/2549876832 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbf00014ca0 con 0x7fbf08153c70 2023-12-16T20:21:10.122 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.120+0000 7fbeeffff640 1 -- 172.21.15.195:0/2549876832 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fbf00026e00 con 0x7fbf08153c70 2023-12-16T20:21:10.140 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:10.139+0000 7f320e00f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-16T20:21:10.141 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:10.141+0000 7f857381d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-16T20:21:10.221 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.219+0000 7fbeeffff640 1 -- 172.21.15.195:0/2549876832 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7fbf081549c0 con 0x7fbf08153c70 2023-12-16T20:21:10.234 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:10.233+0000 7f320e00f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-16T20:21:10.242 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:10.241+0000 7f857381d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-16T20:21:10.293 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.292+0000 7fbf0d8d3640 1 -- 172.21.15.195:0/2549876832 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "969d599a-ea7d-4f88-a65c-c3e367c2c27c", "id": 3} v 0) v1 -- 0x7fbf08067500 con 0x7fbf08153c70 2023-12-16T20:21:10.339 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:10.338+0000 7f857381d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-16T20:21:10.368 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.367+0000 7fbeeffff640 1 -- 172.21.15.195:0/2549876832 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "969d599a-ea7d-4f88-a65c-c3e367c2c27c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbf00018020 con 0x7fbf08153c70 2023-12-16T20:21:10.368 INFO:teuthology.orchestra.run.smithi195.stdout:3 2023-12-16T20:21:10.369 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.368+0000 7fbf0d8d3640 1 -- 172.21.15.195:0/2549876832 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf08153c70 msgr2=0x7fbf08154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:10.369 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.368+0000 7fbf0d8d3640 1 --2- 172.21.15.195:0/2549876832 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf08153c70 0x7fbf08154ca0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009dd0 tx=0x7fbf0000c490 comp rx=0 tx=0).stop 2023-12-16T20:21:10.370 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.368+0000 7fbf0d8d3640 1 -- 172.21.15.195:0/2549876832 shutdown_connections 2023-12-16T20:21:10.370 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.368+0000 7fbf0d8d3640 1 --2- 172.21.15.195:0/2549876832 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf08153c70 0x7fbf08154ca0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.370 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.368+0000 7fbf0d8d3640 1 --2- 172.21.15.195:0/2549876832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf08153890 0x7fbf08146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.370 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.368+0000 7fbf0d8d3640 1 --2- 172.21.15.195:0/2549876832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf080ceef0 0x7fbf08147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.370 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.368+0000 7fbf0d8d3640 1 -- 172.21.15.195:0/2549876832 >> 172.21.15.195:0/2549876832 conn(0x7fbf0806ba00 msgr2=0x7fbf0815c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:10.370 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.368+0000 7fbf0d8d3640 1 -- 172.21.15.195:0/2549876832 shutdown_connections 2023-12-16T20:21:10.370 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.368+0000 7fbf0d8d3640 1 -- 172.21.15.195:0/2549876832 wait complete. 2023-12-16T20:21:10.381 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:10.380+0000 7f320e00f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-16T20:21:10.384 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 43e4ad86-7f30-4b7e-b027-37c7dcb16903 4 2023-12-16T20:21:10.428 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:10.426+0000 7f320e00f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-16T20:21:10.486 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.485+0000 7f9a33990640 1 Processor -- start 2023-12-16T20:21:10.486 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.485+0000 7f9a33990640 1 -- start start 2023-12-16T20:21:10.488 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.486+0000 7f9a33990640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a2c1504e0 0x7f9a2c06e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:10.488 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.486+0000 7f9a33990640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9a2c0c7190 0x7f9a2c06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:10.488 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.486+0000 7f9a33990640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9a2c0c7700 0x7f9a2c0c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:10.488 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.486+0000 7f9a33990640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2c0c5f60 con 0x7f9a2c0c7700 2023-12-16T20:21:10.488 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.486+0000 7f9a33990640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2c0c2c60 con 0x7f9a2c0c7190 2023-12-16T20:21:10.488 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.486+0000 7f9a33990640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0c2f20 con 0x7f9a2c1504e0 2023-12-16T20:21:10.488 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.486+0000 7f9a3172c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a2c1504e0 0x7f9a2c06e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:10.488 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.486+0000 7f9a30f2b640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9a2c0c7190 0x7f9a2c06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:10.488 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.487+0000 7f9a31f2d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9a2c0c7700 0x7f9a2c0c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:10.488 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.487+0000 7f9a3172c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a2c1504e0 0x7f9a2c06e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:40784/0 (socket says 172.21.15.195:40784) 2023-12-16T20:21:10.488 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.487+0000 7f9a3172c640 1 -- 172.21.15.195:0/2628836190 learned_addr learned my addr 172.21.15.195:0/2628836190 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-12-16T20:21:10.490 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.489+0000 7f9a3172c640 1 -- 172.21.15.195:0/2628836190 >> v2:172.21.15.195:3300/0 conn(0x7f9a2c0c7190 msgr2=0x7f9a2c06e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:10.490 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.489+0000 7f9a3172c640 1 --2- 172.21.15.195:0/2628836190 >> v2:172.21.15.195:3300/0 conn(0x7f9a2c0c7190 0x7f9a2c06e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.490 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.489+0000 7f9a3172c640 1 -- 172.21.15.195:0/2628836190 >> v2:172.21.15.87:3300/0 conn(0x7f9a2c0c7700 msgr2=0x7f9a2c0c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:10.490 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.489+0000 7f9a3172c640 1 --2- 172.21.15.195:0/2628836190 >> v2:172.21.15.87:3300/0 conn(0x7f9a2c0c7700 0x7f9a2c0c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.490 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.489+0000 7f9a3172c640 1 -- 172.21.15.195:0/2628836190 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c0c61b0 con 0x7f9a2c1504e0 2023-12-16T20:21:10.492 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.491+0000 7f9a3172c640 1 --2- 172.21.15.195:0/2628836190 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a2c1504e0 0x7f9a2c06e1a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0709c0 tx=0x7f9a2802b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=832d1424fc5913cb server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:10.493 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:10.492+0000 7f857381d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-16T20:21:10.495 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.494+0000 7f9a23fff640 1 -- 172.21.15.195:0/2628836190 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280317e0 con 0x7f9a2c1504e0 2023-12-16T20:21:10.495 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.494+0000 7f9a23fff640 1 -- 172.21.15.195:0/2628836190 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a28031940 con 0x7f9a2c1504e0 2023-12-16T20:21:10.495 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.494+0000 7f9a23fff640 1 -- 172.21.15.195:0/2628836190 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a28031cd0 con 0x7f9a2c1504e0 2023-12-16T20:21:10.497 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.495+0000 7f9a33990640 1 -- 172.21.15.195:0/2628836190 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a2c1504e0 msgr2=0x7f9a2c06e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:10.497 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.495+0000 7f9a33990640 1 --2- 172.21.15.195:0/2628836190 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a2c1504e0 0x7f9a2c06e1a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0709c0 tx=0x7f9a2802b880 comp rx=0 tx=0).stop 2023-12-16T20:21:10.497 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.495+0000 7f9a33990640 1 -- 172.21.15.195:0/2628836190 shutdown_connections 2023-12-16T20:21:10.498 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.495+0000 7f9a33990640 1 --2- 172.21.15.195:0/2628836190 >> v2:172.21.15.87:3300/0 conn(0x7f9a2c0c7700 0x7f9a2c0c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.498 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.495+0000 7f9a33990640 1 --2- 172.21.15.195:0/2628836190 >> v2:172.21.15.195:3300/0 conn(0x7f9a2c0c7190 0x7f9a2c06e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.498 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.495+0000 7f9a33990640 1 --2- 172.21.15.195:0/2628836190 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a2c1504e0 0x7f9a2c06e1a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.498 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.495+0000 7f9a33990640 1 -- 172.21.15.195:0/2628836190 >> 172.21.15.195:0/2628836190 conn(0x7f9a2c0cbef0 msgr2=0x7f9a2c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:10.498 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.495+0000 7f9a33990640 1 -- 172.21.15.195:0/2628836190 shutdown_connections 2023-12-16T20:21:10.498 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.495+0000 7f9a33990640 1 -- 172.21.15.195:0/2628836190 wait complete. 2023-12-16T20:21:10.498 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.497+0000 7f9a33990640 1 Processor -- start 2023-12-16T20:21:10.498 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.497+0000 7f9a33990640 1 -- start start 2023-12-16T20:21:10.500 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.498+0000 7f9a33990640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a2c0c7190 0x7f9a2c1eb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:10.500 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.498+0000 7f9a33990640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2c0c7700 0x7f9a2c0c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:10.500 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.498+0000 7f9a33990640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a2c1504e0 0x7f9a2c1dfb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:10.500 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.498+0000 7f9a33990640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c1df6f0 con 0x7f9a2c0c7700 2023-12-16T20:21:10.500 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.498+0000 7f9a33990640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c1577f0 con 0x7f9a2c0c7190 2023-12-16T20:21:10.501 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.498+0000 7f9a33990640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c157ad0 con 0x7f9a2c1504e0 2023-12-16T20:21:10.501 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.499+0000 7f9a31f2d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a2c1504e0 0x7f9a2c1dfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:10.501 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.499+0000 7f9a3172c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a2c0c7190 0x7f9a2c1eb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:10.501 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.499+0000 7f9a30f2b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2c0c7700 0x7f9a2c0c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:10.501 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.499+0000 7f9a31f2d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a2c1504e0 0x7f9a2c1dfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:40800/0 (socket says 172.21.15.195:40800) 2023-12-16T20:21:10.501 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.499+0000 7f9a31f2d640 1 -- 172.21.15.195:0/3933552129 learned_addr learned my addr 172.21.15.195:0/3933552129 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-12-16T20:21:10.503 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.502+0000 7f9a30f2b640 1 -- 172.21.15.195:0/3933552129 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a2c1504e0 msgr2=0x7f9a2c1dfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:10.503 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.502+0000 7f9a30f2b640 1 --2- 172.21.15.195:0/3933552129 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a2c1504e0 0x7f9a2c1dfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.503 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.502+0000 7f9a30f2b640 1 -- 172.21.15.195:0/3933552129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a2c0c7190 msgr2=0x7f9a2c1eb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:10.504 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.502+0000 7f9a30f2b640 1 --2- 172.21.15.195:0/3933552129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a2c0c7190 0x7f9a2c1eb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.504 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.502+0000 7f9a30f2b640 1 -- 172.21.15.195:0/3933552129 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a280094d0 con 0x7f9a2c0c7700 2023-12-16T20:21:10.505 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.504+0000 7f9a30f2b640 1 --2- 172.21.15.195:0/3933552129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2c0c7700 0x7f9a2c0c4550 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c010df0 tx=0x7f9a1c00e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:10.509 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.508+0000 7f9a21ffb640 1 -- 172.21.15.195:0/3933552129 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c011860 con 0x7f9a2c0c7700 2023-12-16T20:21:10.509 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.508+0000 7f9a21ffb640 1 -- 172.21.15.195:0/3933552129 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c0119c0 con 0x7f9a2c0c7700 2023-12-16T20:21:10.509 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.508+0000 7f9a21ffb640 1 -- 172.21.15.195:0/3933552129 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c011d70 con 0x7f9a2c0c7700 2023-12-16T20:21:10.509 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.508+0000 7f9a33990640 1 -- 172.21.15.195:0/3933552129 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2c157db0 con 0x7f9a2c0c7700 2023-12-16T20:21:10.509 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.508+0000 7f9a33990640 1 -- 172.21.15.195:0/3933552129 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2c158370 con 0x7f9a2c0c7700 2023-12-16T20:21:10.510 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.509+0000 7f9a33990640 1 -- 172.21.15.195:0/3933552129 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2c1df860 con 0x7f9a2c0c7700 2023-12-16T20:21:10.511 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.510+0000 7f9a21ffb640 1 -- 172.21.15.195:0/3933552129 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9a1c005c90 con 0x7f9a2c0c7700 2023-12-16T20:21:10.538 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:10.537+0000 7f857381d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-16T20:21:10.571 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:10.569+0000 7f320e00f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-16T20:21:10.611 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.610+0000 7f9a21ffb640 1 -- 172.21.15.195:0/3933552129 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f9a1c00ee40 con 0x7f9a2c0c7700 2023-12-16T20:21:10.611 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.610+0000 7f9a21ffb640 1 -- 172.21.15.195:0/3933552129 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f9a2c1df860 con 0x7f9a2c0c7700 2023-12-16T20:21:10.679 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:10.678+0000 7f857381d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-16T20:21:10.682 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.681+0000 7f9a33990640 1 -- 172.21.15.195:0/3933552129 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "43e4ad86-7f30-4b7e-b027-37c7dcb16903", "id": 4} v 0) v1 -- 0x7f9a2c14e3c0 con 0x7f9a2c0c7700 2023-12-16T20:21:10.714 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.713+0000 7f9a21ffb640 1 -- 172.21.15.195:0/3933552129 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43e4ad86-7f30-4b7e-b027-37c7dcb16903", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9a1c028060 con 0x7f9a2c0c7700 2023-12-16T20:21:10.714 INFO:teuthology.orchestra.run.smithi195.stdout:4 2023-12-16T20:21:10.716 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.714+0000 7f9a33990640 1 -- 172.21.15.195:0/3933552129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2c0c7700 msgr2=0x7f9a2c0c4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:10.716 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.714+0000 7f9a33990640 1 --2- 172.21.15.195:0/3933552129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2c0c7700 0x7f9a2c0c4550 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c010df0 tx=0x7f9a1c00e730 comp rx=0 tx=0).stop 2023-12-16T20:21:10.716 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.714+0000 7f9a33990640 1 -- 172.21.15.195:0/3933552129 shutdown_connections 2023-12-16T20:21:10.716 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.714+0000 7f9a33990640 1 --2- 172.21.15.195:0/3933552129 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a2c1504e0 0x7f9a2c1dfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.716 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.714+0000 7f9a33990640 1 --2- 172.21.15.195:0/3933552129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2c0c7700 0x7f9a2c0c4550 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.716 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.714+0000 7f9a33990640 1 --2- 172.21.15.195:0/3933552129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a2c0c7190 0x7f9a2c1eb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.716 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.714+0000 7f9a33990640 1 -- 172.21.15.195:0/3933552129 >> 172.21.15.195:0/3933552129 conn(0x7f9a2c0cbef0 msgr2=0x7f9a2c06b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:10.716 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.714+0000 7f9a33990640 1 -- 172.21.15.195:0/3933552129 shutdown_connections 2023-12-16T20:21:10.716 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.714+0000 7f9a33990640 1 -- 172.21.15.195:0/3933552129 wait complete. 2023-12-16T20:21:10.727 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new af2039e7-39f7-496f-9ab3-f32c1bb426f4 5 2023-12-16T20:21:10.828 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.826+0000 7f88f5bc5640 1 Processor -- start 2023-12-16T20:21:10.828 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.827+0000 7f88f5bc5640 1 -- start start 2023-12-16T20:21:10.828 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.827+0000 7f88f5bc5640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f88f0070d80 0x7f88f015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:10.829 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.827+0000 7f88f5bc5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f88f0071160 0x7f88f00c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:10.829 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.827+0000 7f88f5bc5640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f0157850 con 0x7f88f0157ce0 2023-12-16T20:21:10.829 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.827+0000 7f88f5bc5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f015b090 con 0x7f88f0071160 2023-12-16T20:21:10.829 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.827+0000 7f88f5bc5640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f0157520 con 0x7f88f0070d80 2023-12-16T20:21:10.829 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.828+0000 7f88ef7fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f88f0070d80 0x7f88f015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:10.829 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.828+0000 7f88eeffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f88f0071160 0x7f88f00c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:10.829 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.828+0000 7f88effff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f88f0157ce0 0x7f88f0151220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:42054/0 (socket says 172.21.15.195:42054) 2023-12-16T20:21:10.830 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.828+0000 7f88effff640 1 -- 172.21.15.195:0/1718961449 learned_addr learned my addr 172.21.15.195:0/1718961449 (peer_addr_for_me v1:172.21.15.195:0/0) 2023-12-16T20:21:10.831 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.830+0000 7f88eeffd640 1 -- 172.21.15.195:0/1718961449 >> v2:172.21.15.195:3300/0 conn(0x7f88f0070d80 msgr2=0x7f88f015aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:10.832 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.830+0000 7f88eeffd640 1 --2- 172.21.15.195:0/1718961449 >> v2:172.21.15.195:3300/0 conn(0x7f88f0070d80 0x7f88f015aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.832 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.830+0000 7f88eeffd640 1 -- 172.21.15.195:0/1718961449 >> v1:172.21.15.195:6789/0 conn(0x7f88f0157ce0 legacy=0x7f88f0151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:10.832 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.830+0000 7f88eeffd640 1 -- 172.21.15.195:0/1718961449 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f015b330 con 0x7f88f0071160 2023-12-16T20:21:10.833 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.832+0000 7f88eeffd640 1 --2- 172.21.15.195:0/1718961449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88f0071160 0x7f88f00c29b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f88f006afd0 tx=0x7f88e002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee4df88ec8d1020 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:10.837 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.836+0000 7f88ee7fc640 1 -- 172.21.15.195:0/1718961449 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0030610 con 0x7f88f0071160 2023-12-16T20:21:10.837 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.836+0000 7f88ee7fc640 1 -- 172.21.15.195:0/1718961449 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e0030770 con 0x7f88f0071160 2023-12-16T20:21:10.837 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.836+0000 7f88ee7fc640 1 -- 172.21.15.195:0/1718961449 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0030b00 con 0x7f88f0071160 2023-12-16T20:21:10.838 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.836+0000 7f88f5bc5640 1 -- 172.21.15.195:0/1718961449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88f0071160 msgr2=0x7f88f00c29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:10.838 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.836+0000 7f88f5bc5640 1 --2- 172.21.15.195:0/1718961449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88f0071160 0x7f88f00c29b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f88f006afd0 tx=0x7f88e002b960 comp rx=0 tx=0).stop 2023-12-16T20:21:10.838 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.837+0000 7f88f5bc5640 1 -- 172.21.15.195:0/1718961449 shutdown_connections 2023-12-16T20:21:10.838 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.837+0000 7f88f5bc5640 1 --2- 172.21.15.195:0/1718961449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88f0071160 0x7f88f00c29b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.838 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.837+0000 7f88f5bc5640 1 --2- 172.21.15.195:0/1718961449 >> v2:172.21.15.195:3300/0 conn(0x7f88f0070d80 0x7f88f015aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.838 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.837+0000 7f88f5bc5640 1 -- 172.21.15.195:0/1718961449 >> 172.21.15.195:0/1718961449 conn(0x7f88f006a920 msgr2=0x7f88f006eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:10.838 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.837+0000 7f88f5bc5640 1 -- 172.21.15.195:0/1718961449 shutdown_connections 2023-12-16T20:21:10.838 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.837+0000 7f88f5bc5640 1 -- 172.21.15.195:0/1718961449 wait complete. 2023-12-16T20:21:10.839 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.838+0000 7f88f5bc5640 1 Processor -- start 2023-12-16T20:21:10.839 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.838+0000 7f88f5bc5640 1 -- start start 2023-12-16T20:21:10.840 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.839+0000 7f88f5bc5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88f0070d80 0x7f88f00ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:10.840 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.839+0000 7f88f5bc5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88f0071160 0x7f88f00b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:10.840 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.839+0000 7f88f5bc5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88f0157ce0 0x7f88f014fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:10.840 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.839+0000 7f88f5bc5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f014ecb0 con 0x7f88f0070d80 2023-12-16T20:21:10.840 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.839+0000 7f88f5bc5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f014f1e0 con 0x7f88f0071160 2023-12-16T20:21:10.840 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.839+0000 7f88f5bc5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f006c8b0 con 0x7f88f0157ce0 2023-12-16T20:21:10.840 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.839+0000 7f88ef7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88f0070d80 0x7f88f00ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:10.841 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.839+0000 7f88effff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88f0157ce0 0x7f88f014fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:10.841 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.839+0000 7f88effff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88f0157ce0 0x7f88f014fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:40804/0 (socket says 172.21.15.195:40804) 2023-12-16T20:21:10.841 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.839+0000 7f88effff640 1 -- 172.21.15.195:0/4153258434 learned_addr learned my addr 172.21.15.195:0/4153258434 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-12-16T20:21:10.841 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.839+0000 7f88eeffd640 1 --2- 172.21.15.195:0/4153258434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88f0071160 0x7f88f00b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:10.843 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.842+0000 7f88ef7fe640 1 -- 172.21.15.195:0/4153258434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88f0157ce0 msgr2=0x7f88f014fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:10.844 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.842+0000 7f88ef7fe640 1 --2- 172.21.15.195:0/4153258434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88f0157ce0 0x7f88f014fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.844 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.842+0000 7f88ef7fe640 1 -- 172.21.15.195:0/4153258434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88f0071160 msgr2=0x7f88f00b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:10.844 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.842+0000 7f88ef7fe640 1 --2- 172.21.15.195:0/4153258434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88f0071160 0x7f88f00b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:10.844 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.842+0000 7f88ef7fe640 1 -- 172.21.15.195:0/4153258434 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e0009400 con 0x7f88f0070d80 2023-12-16T20:21:10.849 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.844+0000 7f88ef7fe640 1 --2- 172.21.15.195:0/4153258434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88f0070d80 0x7f88f00ad8f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f88e400e850 tx=0x7f88e400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:10.849 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.848+0000 7f88d7fff640 1 -- 172.21.15.195:0/4153258434 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e40095b0 con 0x7f88f0070d80 2023-12-16T20:21:10.849 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.848+0000 7f88d7fff640 1 -- 172.21.15.195:0/4153258434 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e400c940 con 0x7f88f0070d80 2023-12-16T20:21:10.851 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.848+0000 7f88f5bc5640 1 -- 172.21.15.195:0/4153258434 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f00b0a00 con 0x7f88f0070d80 2023-12-16T20:21:10.851 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.848+0000 7f88d7fff640 1 -- 172.21.15.195:0/4153258434 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e400ccd0 con 0x7f88f0070d80 2023-12-16T20:21:10.851 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.848+0000 7f88f5bc5640 1 -- 172.21.15.195:0/4153258434 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f01f2b00 con 0x7f88f0070d80 2023-12-16T20:21:10.852 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.849+0000 7f88f5bc5640 1 -- 172.21.15.195:0/4153258434 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f00740e0 con 0x7f88f0070d80 2023-12-16T20:21:10.945 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.944+0000 7f88d7fff640 1 -- 172.21.15.195:0/4153258434 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f88e4005c90 con 0x7f88f0070d80 2023-12-16T20:21:10.950 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.948+0000 7f88d7fff640 1 -- 172.21.15.195:0/4153258434 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f88e40139f0 con 0x7f88f0070d80 2023-12-16T20:21:10.950 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:10.949+0000 7f88d7fff640 1 -- 172.21.15.195:0/4153258434 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f88e4021060 con 0x7f88f0070d80 2023-12-16T20:21:11.021 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.020+0000 7f88f5bc5640 1 -- 172.21.15.195:0/4153258434 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "af2039e7-39f7-496f-9ab3-f32c1bb426f4", "id": 5} v 0) v1 -- 0x7f88f00c84a0 con 0x7f88f0070d80 2023-12-16T20:21:11.054 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.052+0000 7f88d7fff640 1 -- 172.21.15.195:0/4153258434 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "af2039e7-39f7-496f-9ab3-f32c1bb426f4", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f88e4017070 con 0x7f88f0070d80 2023-12-16T20:21:11.054 INFO:teuthology.orchestra.run.smithi195.stdout:5 2023-12-16T20:21:11.055 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.054+0000 7f88f5bc5640 1 -- 172.21.15.195:0/4153258434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88f0070d80 msgr2=0x7f88f00ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:11.055 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.054+0000 7f88f5bc5640 1 --2- 172.21.15.195:0/4153258434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88f0070d80 0x7f88f00ad8f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f88e400e850 tx=0x7f88e400ed10 comp rx=0 tx=0).stop 2023-12-16T20:21:11.055 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.054+0000 7f88f5bc5640 1 -- 172.21.15.195:0/4153258434 shutdown_connections 2023-12-16T20:21:11.055 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.054+0000 7f88f5bc5640 1 --2- 172.21.15.195:0/4153258434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88f0157ce0 0x7f88f014fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:11.055 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.054+0000 7f88f5bc5640 1 --2- 172.21.15.195:0/4153258434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88f0071160 0x7f88f00b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:11.056 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.054+0000 7f88f5bc5640 1 --2- 172.21.15.195:0/4153258434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88f0070d80 0x7f88f00ad8f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:11.056 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.054+0000 7f88f5bc5640 1 -- 172.21.15.195:0/4153258434 >> 172.21.15.195:0/4153258434 conn(0x7f88f006a920 msgr2=0x7f88f015a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:11.056 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.054+0000 7f88f5bc5640 1 -- 172.21.15.195:0/4153258434 shutdown_connections 2023-12-16T20:21:11.056 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.054+0000 7f88f5bc5640 1 -- 172.21.15.195:0/4153258434 wait complete. 2023-12-16T20:21:11.069 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new c3124a37-4570-4f0e-af2c-cfc0cb49b68d 6 2023-12-16T20:21:11.169 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.168+0000 7f3f57d16640 1 Processor -- start 2023-12-16T20:21:11.170 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.168+0000 7f3f57d16640 1 -- start start 2023-12-16T20:21:11.170 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.169+0000 7f3f57d16640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3f500c2d60 0x7f3f5015d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:11.170 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.169+0000 7f3f57d16640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5015ccd0 con 0x7f3f50153b20 2023-12-16T20:21:11.170 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.169+0000 7f3f57d16640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f500c8680 con 0x7f3f5006a500 2023-12-16T20:21:11.170 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.169+0000 7f3f57d16640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5006f810 con 0x7f3f500c2d60 2023-12-16T20:21:11.171 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.170+0000 7f3f55ab2640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3f50153b20 0x7f3f500c7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.195:37396/0 (socket says 172.21.15.195:37396) 2023-12-16T20:21:11.171 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.170+0000 7f3f55ab2640 1 -- 172.21.15.195:0/190932121 learned_addr learned my addr 172.21.15.195:0/190932121 (peer_addr_for_me v1:172.21.15.195:0/0) 2023-12-16T20:21:11.171 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.170+0000 7f3f552b1640 1 --2- 172.21.15.195:0/190932121 >> v2:172.21.15.195:3300/0 conn(0x7f3f500c2d60 0x7f3f5015d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:11.174 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.173+0000 7f3f54ab0640 1 -- 172.21.15.195:0/190932121 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673365262 0 0) 0x7f3f5015ccd0 con 0x7f3f50153b20 2023-12-16T20:21:11.174 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.173+0000 7f3f54ab0640 1 -- 172.21.15.195:0/190932121 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f3c003520 con 0x7f3f50153b20 2023-12-16T20:21:11.174 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.173+0000 7f3f54ab0640 1 -- 172.21.15.195:0/190932121 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843451933 0 0) 0x7f3f500c8680 con 0x7f3f5006a500 2023-12-16T20:21:11.174 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.173+0000 7f3f54ab0640 1 -- 172.21.15.195:0/190932121 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f5015ccd0 con 0x7f3f5006a500 2023-12-16T20:21:11.176 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.175+0000 7f3f552b1640 1 -- 172.21.15.195:0/190932121 >> v1:172.21.15.195:6789/0 conn(0x7f3f5006a500 legacy=0x7f3f50163fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:11.176 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.175+0000 7f3f552b1640 1 -- 172.21.15.195:0/190932121 >> v1:172.21.15.87:6789/0 conn(0x7f3f50153b20 legacy=0x7f3f500c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:11.176 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.175+0000 7f3f552b1640 1 -- 172.21.15.195:0/190932121 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5006faf0 con 0x7f3f500c2d60 2023-12-16T20:21:11.179 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.178+0000 7f3f552b1640 1 --2- 172.21.15.195:0/190932121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f500c2d60 0x7f3f5015d160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0097a0 tx=0x7f3f4c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ab0fc79c85ccce4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:11.183 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.181+0000 7f3f54ab0640 1 -- 172.21.15.195:0/190932121 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c02e070 con 0x7f3f500c2d60 2023-12-16T20:21:11.183 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.182+0000 7f3f54ab0640 1 -- 172.21.15.195:0/190932121 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c0315a0 con 0x7f3f500c2d60 2023-12-16T20:21:11.183 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.182+0000 7f3f54ab0640 1 -- 172.21.15.195:0/190932121 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c031930 con 0x7f3f500c2d60 2023-12-16T20:21:11.184 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.182+0000 7f3f57d16640 1 -- 172.21.15.195:0/190932121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f500c2d60 msgr2=0x7f3f5015d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:11.184 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.182+0000 7f3f57d16640 1 --2- 172.21.15.195:0/190932121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f500c2d60 0x7f3f5015d160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0097a0 tx=0x7f3f4c02b840 comp rx=0 tx=0).stop 2023-12-16T20:21:11.184 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.182+0000 7f3f57d16640 1 -- 172.21.15.195:0/190932121 shutdown_connections 2023-12-16T20:21:11.184 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.182+0000 7f3f57d16640 1 --2- 172.21.15.195:0/190932121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f500c2d60 0x7f3f5015d160 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:11.184 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.182+0000 7f3f57d16640 1 -- 172.21.15.195:0/190932121 >> 172.21.15.195:0/190932121 conn(0x7f3f50072930 msgr2=0x7f3f500cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:11.184 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.182+0000 7f3f57d16640 1 -- 172.21.15.195:0/190932121 shutdown_connections 2023-12-16T20:21:11.184 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.182+0000 7f3f57d16640 1 -- 172.21.15.195:0/190932121 wait complete. 2023-12-16T20:21:11.185 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.184+0000 7f3f57d16640 1 Processor -- start 2023-12-16T20:21:11.185 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.184+0000 7f3f57d16640 1 -- start start 2023-12-16T20:21:11.185 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.184+0000 7f3f57d16640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f5006a500 0x7f3f501490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:11.186 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.184+0000 7f3f57d16640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f500c2d60 0x7f3f501f2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:11.186 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.184+0000 7f3f57d16640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f50153b20 0x7f3f500c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:11.186 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.184+0000 7f3f57d16640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500cbb80 con 0x7f3f5006a500 2023-12-16T20:21:11.186 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.184+0000 7f3f57d16640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f501f2c00 con 0x7f3f500c2d60 2023-12-16T20:21:11.186 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.184+0000 7f3f57d16640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f501f2ee0 con 0x7f3f50153b20 2023-12-16T20:21:11.187 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.185+0000 7f3f552b1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f500c2d60 0x7f3f501f2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:11.187 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.185+0000 7f3f562b3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f50153b20 0x7f3f500c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:11.187 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.185+0000 7f3f55ab2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f5006a500 0x7f3f501490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:11.187 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.185+0000 7f3f552b1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f500c2d60 0x7f3f501f2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:58980/0 (socket says 172.21.15.195:58980) 2023-12-16T20:21:11.187 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.185+0000 7f3f552b1640 1 -- 172.21.15.195:0/2683351368 learned_addr learned my addr 172.21.15.195:0/2683351368 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-12-16T20:21:11.189 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.188+0000 7f3f552b1640 1 -- 172.21.15.195:0/2683351368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f50153b20 msgr2=0x7f3f500c51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:11.189 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.188+0000 7f3f552b1640 1 --2- 172.21.15.195:0/2683351368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f50153b20 0x7f3f500c51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:11.189 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.188+0000 7f3f552b1640 1 -- 172.21.15.195:0/2683351368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f5006a500 msgr2=0x7f3f501490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:11.189 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.188+0000 7f3f552b1640 1 --2- 172.21.15.195:0/2683351368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f5006a500 0x7f3f501490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:11.189 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.188+0000 7f3f552b1640 1 -- 172.21.15.195:0/2683351368 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c009400 con 0x7f3f500c2d60 2023-12-16T20:21:11.192 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.191+0000 7f3f552b1640 1 --2- 172.21.15.195:0/2683351368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f500c2d60 0x7f3f501f2230 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c034040 tx=0x7f3f4c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:11.195 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.194+0000 7f3f467fc640 1 -- 172.21.15.195:0/2683351368 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c032840 con 0x7f3f500c2d60 2023-12-16T20:21:11.195 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.194+0000 7f3f467fc640 1 -- 172.21.15.195:0/2683351368 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c0329c0 con 0x7f3f500c2d60 2023-12-16T20:21:11.196 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.194+0000 7f3f57d16640 1 -- 172.21.15.195:0/2683351368 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f500c6cb0 con 0x7f3f500c2d60 2023-12-16T20:21:11.196 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.194+0000 7f3f467fc640 1 -- 172.21.15.195:0/2683351368 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c032d70 con 0x7f3f500c2d60 2023-12-16T20:21:11.196 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.194+0000 7f3f57d16640 1 -- 172.21.15.195:0/2683351368 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f500c49c0 con 0x7f3f500c2d60 2023-12-16T20:21:11.196 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.195+0000 7f3f57d16640 1 -- 172.21.15.195:0/2683351368 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f500c4540 con 0x7f3f500c2d60 2023-12-16T20:21:11.391 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.390+0000 7f3f467fc640 1 -- 172.21.15.195:0/2683351368 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3f4c005c90 con 0x7f3f500c2d60 2023-12-16T20:21:11.391 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.390+0000 7f3f467fc640 1 -- 172.21.15.195:0/2683351368 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f3f4c0066b0 con 0x7f3f500c2d60 2023-12-16T20:21:11.392 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.390+0000 7f3f467fc640 1 -- 172.21.15.195:0/2683351368 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f3f500c4540 con 0x7f3f500c2d60 2023-12-16T20:21:11.394 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:11.393+0000 7f320e00f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-16T20:21:11.472 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.470+0000 7f3f57d16640 1 -- 172.21.15.195:0/2683351368 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c3124a37-4570-4f0e-af2c-cfc0cb49b68d", "id": 6} v 0) v1 -- 0x7f3f500740e0 con 0x7f3f500c2d60 2023-12-16T20:21:11.508 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:11.507+0000 7f857381d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-16T20:21:11.576 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.575+0000 7f3f467fc640 1 -- 172.21.15.195:0/2683351368 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c3124a37-4570-4f0e-af2c-cfc0cb49b68d", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3f4c006870 con 0x7f3f500c2d60 2023-12-16T20:21:11.576 INFO:teuthology.orchestra.run.smithi195.stdout:6 2023-12-16T20:21:11.577 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.576+0000 7f3f57d16640 1 -- 172.21.15.195:0/2683351368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f500c2d60 msgr2=0x7f3f501f2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:11.577 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.576+0000 7f3f57d16640 1 --2- 172.21.15.195:0/2683351368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f500c2d60 0x7f3f501f2230 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c034040 tx=0x7f3f4c0046c0 comp rx=0 tx=0).stop 2023-12-16T20:21:11.577 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.576+0000 7f3f57d16640 1 -- 172.21.15.195:0/2683351368 shutdown_connections 2023-12-16T20:21:11.577 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.576+0000 7f3f57d16640 1 --2- 172.21.15.195:0/2683351368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f50153b20 0x7f3f500c51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:11.578 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.576+0000 7f3f57d16640 1 --2- 172.21.15.195:0/2683351368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f500c2d60 0x7f3f501f2230 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:11.578 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.576+0000 7f3f57d16640 1 --2- 172.21.15.195:0/2683351368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f5006a500 0x7f3f501490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:11.578 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.576+0000 7f3f57d16640 1 -- 172.21.15.195:0/2683351368 >> 172.21.15.195:0/2683351368 conn(0x7f3f50072930 msgr2=0x7f3f500c7720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:11.578 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.576+0000 7f3f57d16640 1 -- 172.21.15.195:0/2683351368 shutdown_connections 2023-12-16T20:21:11.578 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.576+0000 7f3f57d16640 1 -- 172.21.15.195:0/2683351368 wait complete. 2023-12-16T20:21:11.588 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 5ee83620-9e5a-412a-ae7e-1602cd92f1bb 7 2023-12-16T20:21:11.679 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:11.678+0000 7f320e00f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-16T20:21:11.688 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.687+0000 7f182530f640 1 Processor -- start 2023-12-16T20:21:11.688 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.687+0000 7f182530f640 1 -- start start 2023-12-16T20:21:11.689 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.687+0000 7f182530f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f18200cb4a0 0x7f18200cb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:11.689 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.687+0000 7f182530f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18200cbe40 con 0x7f1820153900 2023-12-16T20:21:11.689 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.687+0000 7f182530f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18200ca460 con 0x7f18200c9e20 2023-12-16T20:21:11.689 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.687+0000 7f182530f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18200c8960 con 0x7f18200cb4a0 2023-12-16T20:21:11.689 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.688+0000 7f181e7fc640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f18200c9e20 0x7f18200ca960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:42074/0 (socket says 172.21.15.195:42074) 2023-12-16T20:21:11.690 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.688+0000 7f181e7fc640 1 -- 172.21.15.195:0/1750185523 learned_addr learned my addr 172.21.15.195:0/1750185523 (peer_addr_for_me v1:172.21.15.195:0/0) 2023-12-16T20:21:11.690 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.688+0000 7f181f7fe640 1 --2- 172.21.15.195:0/1750185523 >> v2:172.21.15.87:3300/0 conn(0x7f18200cb4a0 0x7f18200cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:11.691 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.690+0000 7f181dffb640 1 -- 172.21.15.195:0/1750185523 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378048248 0 0) 0x7f18200ca460 con 0x7f18200c9e20 2023-12-16T20:21:11.691 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.690+0000 7f181dffb640 1 -- 172.21.15.195:0/1750185523 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1808003520 con 0x7f18200c9e20 2023-12-16T20:21:11.692 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.691+0000 7f181f7fe640 1 -- 172.21.15.195:0/1750185523 >> v1:172.21.15.195:6789/0 conn(0x7f18200c9e20 legacy=0x7f18200ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:11.692 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.691+0000 7f181f7fe640 1 -- 172.21.15.195:0/1750185523 >> v1:172.21.15.87:6789/0 conn(0x7f1820153900 legacy=0x7f18200c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:11.692 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.691+0000 7f181f7fe640 1 -- 172.21.15.195:0/1750185523 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1820159a40 con 0x7f18200cb4a0 2023-12-16T20:21:11.696 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.695+0000 7f181f7fe640 1 --2- 172.21.15.195:0/1750185523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18200cb4a0 0x7f18200cb900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1818009d90 tx=0x7f181802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a878dbf88ba61e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:11.702 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.701+0000 7f181dffb640 1 -- 172.21.15.195:0/1750185523 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181802cbd0 con 0x7f18200cb4a0 2023-12-16T20:21:11.702 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.701+0000 7f181dffb640 1 -- 172.21.15.195:0/1750185523 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181802cd30 con 0x7f18200cb4a0 2023-12-16T20:21:11.702 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.701+0000 7f181dffb640 1 -- 172.21.15.195:0/1750185523 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181802cea0 con 0x7f18200cb4a0 2023-12-16T20:21:11.703 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.701+0000 7f182530f640 1 -- 172.21.15.195:0/1750185523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18200cb4a0 msgr2=0x7f18200cb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:11.703 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.701+0000 7f182530f640 1 --2- 172.21.15.195:0/1750185523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18200cb4a0 0x7f18200cb900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1818009d90 tx=0x7f181802be20 comp rx=0 tx=0).stop 2023-12-16T20:21:11.703 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.701+0000 7f182530f640 1 -- 172.21.15.195:0/1750185523 shutdown_connections 2023-12-16T20:21:11.703 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.701+0000 7f182530f640 1 --2- 172.21.15.195:0/1750185523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18200cb4a0 0x7f18200cb900 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:11.703 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.701+0000 7f182530f640 1 -- 172.21.15.195:0/1750185523 >> 172.21.15.195:0/1750185523 conn(0x7f182008afb0 msgr2=0x7f182008b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:11.703 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.701+0000 7f182530f640 1 -- 172.21.15.195:0/1750185523 shutdown_connections 2023-12-16T20:21:11.703 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.701+0000 7f182530f640 1 -- 172.21.15.195:0/1750185523 wait complete. 2023-12-16T20:21:11.704 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.703+0000 7f182530f640 1 Processor -- start 2023-12-16T20:21:11.704 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.703+0000 7f182530f640 1 -- start start 2023-12-16T20:21:11.705 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.703+0000 7f182530f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18200c9e20 0x7f18200c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:11.705 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.703+0000 7f182530f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18200cb4a0 0x7f18201521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:11.705 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.703+0000 7f182530f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1820153900 0x7f18200c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:11.705 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.703+0000 7f182530f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182014c2a0 con 0x7f18200c9e20 2023-12-16T20:21:11.705 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.703+0000 7f182530f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182014b9e0 con 0x7f1820153900 2023-12-16T20:21:11.705 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.703+0000 7f182530f640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18200c5940 con 0x7f18200cb4a0 2023-12-16T20:21:11.706 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.704+0000 7f181f7fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1820153900 0x7f18200c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:11.706 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.704+0000 7f181e7fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18200cb4a0 0x7f18201521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:11.706 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.704+0000 7f181effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18200c9e20 0x7f18200c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:11.706 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.704+0000 7f181f7fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1820153900 0x7f18200c2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:58992/0 (socket says 172.21.15.195:58992) 2023-12-16T20:21:11.706 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.704+0000 7f181f7fe640 1 -- 172.21.15.195:0/1542452641 learned_addr learned my addr 172.21.15.195:0/1542452641 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-12-16T20:21:11.709 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.707+0000 7f181effd640 1 -- 172.21.15.195:0/1542452641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18200cb4a0 msgr2=0x7f18201521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:11.709 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.707+0000 7f181effd640 1 --2- 172.21.15.195:0/1542452641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18200cb4a0 0x7f18201521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:11.709 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.707+0000 7f181effd640 1 -- 172.21.15.195:0/1542452641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1820153900 msgr2=0x7f18200c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:11.709 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.707+0000 7f181effd640 1 --2- 172.21.15.195:0/1542452641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1820153900 0x7f18200c2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:11.709 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.707+0000 7f181effd640 1 -- 172.21.15.195:0/1542452641 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1818009a70 con 0x7f18200c9e20 2023-12-16T20:21:11.711 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.710+0000 7f181effd640 1 --2- 172.21.15.195:0/1542452641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18200c9e20 0x7f18200c5400 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f181000b3e0 tx=0x7f181000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:11.714 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.713+0000 7f18077fe640 1 -- 172.21.15.195:0/1542452641 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810004020 con 0x7f18200c9e20 2023-12-16T20:21:11.714 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.713+0000 7f18077fe640 1 -- 172.21.15.195:0/1542452641 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1810004180 con 0x7f18200c9e20 2023-12-16T20:21:11.714 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.713+0000 7f182530f640 1 -- 172.21.15.195:0/1542452641 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182014cbe0 con 0x7f18200c9e20 2023-12-16T20:21:11.715 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.713+0000 7f18077fe640 1 -- 172.21.15.195:0/1542452641 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810011630 con 0x7f18200c9e20 2023-12-16T20:21:11.715 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.713+0000 7f182530f640 1 -- 172.21.15.195:0/1542452641 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182014bf30 con 0x7f18200c9e20 2023-12-16T20:21:11.715 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.714+0000 7f182530f640 1 -- 172.21.15.195:0/1542452641 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1820067500 con 0x7f18200c9e20 2023-12-16T20:21:11.718 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.717+0000 7f18077fe640 1 -- 172.21.15.195:0/1542452641 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1810011a90 con 0x7f18200c9e20 2023-12-16T20:21:11.718 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.717+0000 7f18077fe640 1 -- 172.21.15.195:0/1542452641 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f1810003c70 con 0x7f18200c9e20 2023-12-16T20:21:11.734 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:11.732+0000 7f320e00f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-16T20:21:11.796 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:11.795+0000 7f857381d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-16T20:21:11.816 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.814+0000 7f18077fe640 1 -- 172.21.15.195:0/1542452641 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f1810015030 con 0x7f18200c9e20 2023-12-16T20:21:11.837 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:11.836+0000 7f320e00f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-16T20:21:11.848 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:11.847+0000 7f857381d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-16T20:21:11.886 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:11.885+0000 7f182530f640 1 -- 172.21.15.195:0/1542452641 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5ee83620-9e5a-412a-ae7e-1602cd92f1bb", "id": 7} v 0) v1 -- 0x7f18200ca740 con 0x7f18200c9e20 2023-12-16T20:21:11.964 INFO:tasks.ceph.mgr.x.smithi195.stderr:2023-12-16T20:21:11.963+0000 7f857381d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-16T20:21:12.010 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:12.009+0000 7f18077fe640 1 -- 172.21.15.195:0/1542452641 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5ee83620-9e5a-412a-ae7e-1602cd92f1bb", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1810011d40 con 0x7f18200c9e20 2023-12-16T20:21:12.011 INFO:teuthology.orchestra.run.smithi195.stdout:7 2023-12-16T20:21:12.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:12.010+0000 7f182530f640 1 -- 172.21.15.195:0/1542452641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18200c9e20 msgr2=0x7f18200c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:12.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:12.010+0000 7f182530f640 1 --2- 172.21.15.195:0/1542452641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18200c9e20 0x7f18200c5400 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f181000b3e0 tx=0x7f181000b8a0 comp rx=0 tx=0).stop 2023-12-16T20:21:12.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:12.010+0000 7f182530f640 1 -- 172.21.15.195:0/1542452641 shutdown_connections 2023-12-16T20:21:12.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:12.010+0000 7f182530f640 1 --2- 172.21.15.195:0/1542452641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1820153900 0x7f18200c2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:12.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:12.010+0000 7f182530f640 1 --2- 172.21.15.195:0/1542452641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18200cb4a0 0x7f18201521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:12.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:12.010+0000 7f182530f640 1 --2- 172.21.15.195:0/1542452641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18200c9e20 0x7f18200c5400 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:12.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:12.010+0000 7f182530f640 1 -- 172.21.15.195:0/1542452641 >> 172.21.15.195:0/1542452641 conn(0x7f182008afb0 msgr2=0x7f18200c7200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:12.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:12.010+0000 7f182530f640 1 -- 172.21.15.195:0/1542452641 shutdown_connections 2023-12-16T20:21:12.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-12-16T20:21:12.010+0000 7f182530f640 1 -- 172.21.15.195:0/1542452641 wait complete. 2023-12-16T20:21:12.023 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-16T20:21:12.023 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2023-12-16T20:21:12.025 INFO:tasks.ceph.osd.0:Started 2023-12-16T20:21:12.026 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-16T20:21:12.026 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2023-12-16T20:21:12.028 INFO:tasks.ceph.osd.1:Started 2023-12-16T20:21:12.028 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-16T20:21:12.028 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2023-12-16T20:21:12.030 INFO:tasks.ceph.osd.2:Started 2023-12-16T20:21:12.030 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-16T20:21:12.030 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2023-12-16T20:21:12.032 INFO:tasks.ceph.osd.3:Started 2023-12-16T20:21:12.033 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-16T20:21:12.033 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2023-12-16T20:21:12.035 INFO:tasks.ceph.osd.4:Started 2023-12-16T20:21:12.035 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-16T20:21:12.035 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2023-12-16T20:21:12.037 INFO:tasks.ceph.osd.5:Started 2023-12-16T20:21:12.037 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-16T20:21:12.037 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2023-12-16T20:21:12.039 INFO:tasks.ceph.osd.6:Started 2023-12-16T20:21:12.040 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-16T20:21:12.040 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2023-12-16T20:21:12.041 INFO:tasks.ceph.osd.7:Started 2023-12-16T20:21:12.042 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:21:12.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.167+0000 7f0eacf53640 1 Processor -- start 2023-12-16T20:21:12.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.167+0000 7f0eacf53640 1 -- start start 2023-12-16T20:21:12.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.168+0000 7f0eacf53640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ea8151630 0x7f0ea806f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:12.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.168+0000 7f0eacf53640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0ea8157f50 0x7f0ea80c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:12.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.168+0000 7f0eacf53640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea815b9c0 con 0x7f0ea80ca130 2023-12-16T20:21:12.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.168+0000 7f0eacf53640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea815ab60 con 0x7f0ea8157f50 2023-12-16T20:21:12.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.168+0000 7f0eacf53640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea815ae40 con 0x7f0ea8151630 2023-12-16T20:21:12.175 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.174+0000 7f0ea659c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ea8151630 0x7f0ea806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:12.199 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.197+0000 7f0ea5d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0ea8157f50 0x7f0ea80c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:12.199 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.198+0000 7f0ea5d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0ea8157f50 0x7f0ea80c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44314/0 (socket says 172.21.15.87:44314) 2023-12-16T20:21:12.199 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.198+0000 7f0ea5d9b640 1 -- 172.21.15.87:0/300564947 learned_addr learned my addr 172.21.15.87:0/300564947 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:12.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.202+0000 7f0ea5d9b640 1 -- 172.21.15.87:0/300564947 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ea8151630 msgr2=0x7f0ea806f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:12.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.202+0000 7f0ea5d9b640 1 --2- 172.21.15.87:0/300564947 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ea8151630 0x7f0ea806f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:12.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.202+0000 7f0ea5d9b640 1 -- 172.21.15.87:0/300564947 >> v1:172.21.15.87:6789/0 conn(0x7f0ea80ca130 legacy=0x7f0ea80c2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:12.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.202+0000 7f0ea5d9b640 1 -- 172.21.15.87:0/300564947 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea815b120 con 0x7f0ea8157f50 2023-12-16T20:21:12.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.205+0000 7f0ea5d9b640 1 --2- 172.21.15.87:0/300564947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea8157f50 0x7f0ea80c9bf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009870 tx=0x7f0e9802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960199662dfb446 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:12.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.233+0000 7f0ea559a640 1 -- 172.21.15.87:0/300564947 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98030840 con 0x7f0ea8157f50 2023-12-16T20:21:12.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.233+0000 7f0ea559a640 1 -- 172.21.15.87:0/300564947 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e980309a0 con 0x7f0ea8157f50 2023-12-16T20:21:12.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.234+0000 7f0ea559a640 1 -- 172.21.15.87:0/300564947 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98030d30 con 0x7f0ea8157f50 2023-12-16T20:21:12.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.234+0000 7f0eacf53640 1 -- 172.21.15.87:0/300564947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea8157f50 msgr2=0x7f0ea80c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:12.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.234+0000 7f0eacf53640 1 --2- 172.21.15.87:0/300564947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea8157f50 0x7f0ea80c9bf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009870 tx=0x7f0e9802b980 comp rx=0 tx=0).stop 2023-12-16T20:21:12.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.234+0000 7f0eacf53640 1 -- 172.21.15.87:0/300564947 shutdown_connections 2023-12-16T20:21:12.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.234+0000 7f0eacf53640 1 --2- 172.21.15.87:0/300564947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea8157f50 0x7f0ea80c9bf0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:12.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.234+0000 7f0eacf53640 1 --2- 172.21.15.87:0/300564947 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ea8151630 0x7f0ea806f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:12.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.234+0000 7f0eacf53640 1 -- 172.21.15.87:0/300564947 >> 172.21.15.87:0/300564947 conn(0x7f0ea8061100 msgr2=0x7f0ea80614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:12.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.234+0000 7f0eacf53640 1 -- 172.21.15.87:0/300564947 shutdown_connections 2023-12-16T20:21:12.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.234+0000 7f0eacf53640 1 -- 172.21.15.87:0/300564947 wait complete. 2023-12-16T20:21:12.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.236+0000 7f0eacf53640 1 Processor -- start 2023-12-16T20:21:12.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.236+0000 7f0eacf53640 1 -- start start 2023-12-16T20:21:12.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.236+0000 7f0eacf53640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ea80ca130 0x7f0ea8157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:12.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.236+0000 7f0eacf53640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ea8151630 0x7f0ea81599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:12.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.236+0000 7f0eacf53640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea8157f50 0x7f0ea8159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:12.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.236+0000 7f0eacf53640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8159580 con 0x7f0ea8157f50 2023-12-16T20:21:12.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.236+0000 7f0eacf53640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8156960 con 0x7f0ea80ca130 2023-12-16T20:21:12.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.236+0000 7f0eacf53640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea81ee1a0 con 0x7f0ea8151630 2023-12-16T20:21:12.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.245+0000 7f0ea6d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea8157f50 0x7f0ea8159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:12.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.246+0000 7f0ea659c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ea80ca130 0x7f0ea8157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:12.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.247+0000 7f0ea6d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea8157f50 0x7f0ea8159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44316/0 (socket says 172.21.15.87:44316) 2023-12-16T20:21:12.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.247+0000 7f0ea6d9d640 1 -- 172.21.15.87:0/3856019282 learned_addr learned my addr 172.21.15.87:0/3856019282 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:12.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.252+0000 7f0ea6d9d640 1 -- 172.21.15.87:0/3856019282 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ea8151630 msgr2=0x7f0ea81599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:12.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.252+0000 7f0ea6d9d640 1 --2- 172.21.15.87:0/3856019282 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ea8151630 0x7f0ea81599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:12.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.252+0000 7f0ea6d9d640 1 -- 172.21.15.87:0/3856019282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ea80ca130 msgr2=0x7f0ea8157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:12.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.252+0000 7f0ea6d9d640 1 --2- 172.21.15.87:0/3856019282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ea80ca130 0x7f0ea8157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:12.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.252+0000 7f0ea6d9d640 1 -- 172.21.15.87:0/3856019282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e980094d0 con 0x7f0ea8157f50 2023-12-16T20:21:12.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.256+0000 7f0ea6d9d640 1 --2- 172.21.15.87:0/3856019282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea8157f50 0x7f0ea8159ee0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000b990 tx=0x7f0ea000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:12.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.263+0000 7f0e96ffd640 1 -- 172.21.15.87:0/3856019282 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea000cba0 con 0x7f0ea8157f50 2023-12-16T20:21:12.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.264+0000 7f0e96ffd640 1 -- 172.21.15.87:0/3856019282 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea000cd00 con 0x7f0ea8157f50 2023-12-16T20:21:12.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.264+0000 7f0eacf53640 1 -- 172.21.15.87:0/3856019282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea81ed620 con 0x7f0ea8157f50 2023-12-16T20:21:12.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.264+0000 7f0e96ffd640 1 -- 172.21.15.87:0/3856019282 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0014680 con 0x7f0ea8157f50 2023-12-16T20:21:12.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.264+0000 7f0eacf53640 1 -- 172.21.15.87:0/3856019282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea81edbe0 con 0x7f0ea8157f50 2023-12-16T20:21:12.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.265+0000 7f0eacf53640 1 -- 172.21.15.87:0/3856019282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea81596c0 con 0x7f0ea8157f50 2023-12-16T20:21:12.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.366+0000 7f0e96ffd640 1 -- 172.21.15.87:0/3856019282 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 2) v1 ==== 44568+0+0 (secure 0 0 0) 0x7f0ea0007370 con 0x7f0ea8157f50 2023-12-16T20:21:12.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.372+0000 7f0e96ffd640 1 -- 172.21.15.87:0/3856019282 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0ea0012340 con 0x7f0ea8157f50 2023-12-16T20:21:12.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.372+0000 7f0e96ffd640 1 -- 172.21.15.87:0/3856019282 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f0ea001b2c0 con 0x7f0ea8157f50 2023-12-16T20:21:12.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.437+0000 7f0eacf53640 1 -- 172.21.15.87:0/3856019282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ea81596c0 con 0x7f0ea8157f50 2023-12-16T20:21:12.485 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.484+0000 7f0e96ffd640 1 -- 172.21.15.87:0/3856019282 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0ea81596c0 con 0x7f0ea8157f50 2023-12-16T20:21:12.486 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:21:12.486 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":10,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:21:11.891757+0000","last_up_change":"0.000000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:21:12.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.485+0000 7f0eacf53640 1 -- 172.21.15.87:0/3856019282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea8157f50 msgr2=0x7f0ea8159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:12.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.485+0000 7f0eacf53640 1 --2- 172.21.15.87:0/3856019282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea8157f50 0x7f0ea8159ee0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000b990 tx=0x7f0ea000be50 comp rx=0 tx=0).stop 2023-12-16T20:21:12.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.485+0000 7f0eacf53640 1 -- 172.21.15.87:0/3856019282 shutdown_connections 2023-12-16T20:21:12.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.485+0000 7f0eacf53640 1 --2- 172.21.15.87:0/3856019282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea8157f50 0x7f0ea8159ee0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:12.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.485+0000 7f0eacf53640 1 --2- 172.21.15.87:0/3856019282 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ea8151630 0x7f0ea81599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:12.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.485+0000 7f0eacf53640 1 --2- 172.21.15.87:0/3856019282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ea80ca130 0x7f0ea8157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:12.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.485+0000 7f0eacf53640 1 -- 172.21.15.87:0/3856019282 >> 172.21.15.87:0/3856019282 conn(0x7f0ea8061100 msgr2=0x7f0ea8070ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:12.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.485+0000 7f0eacf53640 1 -- 172.21.15.87:0/3856019282 shutdown_connections 2023-12-16T20:21:12.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:12.485+0000 7f0eacf53640 1 -- 172.21.15.87:0/3856019282 wait complete. 2023-12-16T20:21:12.497 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-16T20:21:12.497 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-16T20:21:12.654 INFO:tasks.ceph.osd.5.smithi195.stderr:2023-12-16T20:21:12.653+0000 7fc8c3021500 -1 Falling back to public interface 2023-12-16T20:21:12.660 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-12-16T20:21:12.659+0000 7f271a61a500 -1 Falling back to public interface 2023-12-16T20:21:12.663 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-12-16T20:21:12.662+0000 7fad58469500 -1 Falling back to public interface 2023-12-16T20:21:12.689 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-12-16T20:21:12.688+0000 7fbc3ac1e500 -1 Falling back to public interface 2023-12-16T20:21:12.756 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-12-16T20:21:12.755+0000 7f3d4f8cf500 -1 Falling back to public interface 2023-12-16T20:21:12.766 INFO:tasks.ceph.osd.7.smithi195.stderr:2023-12-16T20:21:12.765+0000 7f965f107500 -1 Falling back to public interface 2023-12-16T20:21:12.771 INFO:tasks.ceph.osd.6.smithi195.stderr:2023-12-16T20:21:12.770+0000 7f776314a500 -1 Falling back to public interface 2023-12-16T20:21:12.800 INFO:tasks.ceph.osd.4.smithi195.stderr:2023-12-16T20:21:12.798+0000 7f7c16bad500 -1 Falling back to public interface 2023-12-16T20:21:13.303 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-16T20:21:13.398 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.394+0000 7fd045782640 1 Processor -- start 2023-12-16T20:21:13.398 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.394+0000 7fd045782640 1 -- start start 2023-12-16T20:21:13.398 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.395+0000 7fd045782640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd0400cb440 0x7fd04015d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:13.398 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.395+0000 7fd045782640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0401596a0 0x7fd0400ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:13.398 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.395+0000 7fd045782640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0400ca5f0 con 0x7fd0401538b0 2023-12-16T20:21:13.398 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.395+0000 7fd045782640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0400c6230 con 0x7fd0400cb440 2023-12-16T20:21:13.398 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.395+0000 7fd045782640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04015a6b0 con 0x7fd0401596a0 2023-12-16T20:21:13.398 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.395+0000 7fd03e7fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd0400cb440 0x7fd04015d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:13.399 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.395+0000 7fd03e7fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd0400cb440 0x7fd04015d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44382/0 (socket says 172.21.15.87:44382) 2023-12-16T20:21:13.399 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.395+0000 7fd03e7fc640 1 -- 172.21.15.87:0/4066879016 learned_addr learned my addr 172.21.15.87:0/4066879016 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:13.399 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.397+0000 7fd03e7fc640 1 -- 172.21.15.87:0/4066879016 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0401596a0 msgr2=0x7fd0400ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:13.399 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.397+0000 7fd03e7fc640 1 --2- 172.21.15.87:0/4066879016 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0401596a0 0x7fd0400ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:13.399 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.398+0000 7fd03e7fc640 1 -- 172.21.15.87:0/4066879016 >> v1:172.21.15.195:6789/0 conn(0x7fd0401538b0 legacy=0x7fd0400c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:13.399 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.398+0000 7fd03e7fc640 1 -- 172.21.15.87:0/4066879016 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd040159b30 con 0x7fd0400cb440 2023-12-16T20:21:13.400 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.399+0000 7fd03e7fc640 1 --2- 172.21.15.87:0/4066879016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0400cb440 0x7fd04015d2d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd034009870 tx=0x7fd03402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45767624b2b421e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:13.404 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.403+0000 7fd03dffb640 1 -- 172.21.15.87:0/4066879016 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034030860 con 0x7fd0400cb440 2023-12-16T20:21:13.404 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.403+0000 7fd03dffb640 1 -- 172.21.15.87:0/4066879016 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0340309c0 con 0x7fd0400cb440 2023-12-16T20:21:13.404 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.403+0000 7fd03dffb640 1 -- 172.21.15.87:0/4066879016 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034030d50 con 0x7fd0400cb440 2023-12-16T20:21:13.405 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.403+0000 7fd045782640 1 -- 172.21.15.87:0/4066879016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0400cb440 msgr2=0x7fd04015d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:13.405 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.403+0000 7fd045782640 1 --2- 172.21.15.87:0/4066879016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0400cb440 0x7fd04015d2d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd034009870 tx=0x7fd03402b9a0 comp rx=0 tx=0).stop 2023-12-16T20:21:13.405 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.404+0000 7fd045782640 1 -- 172.21.15.87:0/4066879016 shutdown_connections 2023-12-16T20:21:13.405 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.404+0000 7fd045782640 1 --2- 172.21.15.87:0/4066879016 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0401596a0 0x7fd0400ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:13.405 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.404+0000 7fd045782640 1 --2- 172.21.15.87:0/4066879016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0400cb440 0x7fd04015d2d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:13.405 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.404+0000 7fd045782640 1 -- 172.21.15.87:0/4066879016 >> 172.21.15.87:0/4066879016 conn(0x7fd04006b970 msgr2=0x7fd04006bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:13.405 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.404+0000 7fd045782640 1 -- 172.21.15.87:0/4066879016 shutdown_connections 2023-12-16T20:21:13.405 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.404+0000 7fd045782640 1 -- 172.21.15.87:0/4066879016 wait complete. 2023-12-16T20:21:13.406 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.405+0000 7fd045782640 1 Processor -- start 2023-12-16T20:21:13.406 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.405+0000 7fd045782640 1 -- start start 2023-12-16T20:21:13.407 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.406+0000 7fd045782640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0400cb440 0x7fd0401f0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:13.407 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.406+0000 7fd045782640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0401538b0 0x7fd040151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:13.407 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.406+0000 7fd045782640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0400c3060 0x7fd0400c3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:13.407 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.406+0000 7fd045782640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0401f0640 con 0x7fd0400cb440 2023-12-16T20:21:13.407 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.406+0000 7fd045782640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0401530e0 con 0x7fd0401538b0 2023-12-16T20:21:13.407 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.406+0000 7fd045782640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0400c3a50 con 0x7fd0400c3060 2023-12-16T20:21:13.408 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.406+0000 7fd03effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0400cb440 0x7fd0401f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:13.408 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.406+0000 7fd03effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0400cb440 0x7fd0401f0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44384/0 (socket says 172.21.15.87:44384) 2023-12-16T20:21:13.408 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.406+0000 7fd03effd640 1 -- 172.21.15.87:0/2970832188 learned_addr learned my addr 172.21.15.87:0/2970832188 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:13.410 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.409+0000 7fd03effd640 1 -- 172.21.15.87:0/2970832188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0400c3060 msgr2=0x7fd0400c3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:13.410 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.409+0000 7fd03effd640 1 --2- 172.21.15.87:0/2970832188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0400c3060 0x7fd0400c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:13.410 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.409+0000 7fd03effd640 1 -- 172.21.15.87:0/2970832188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0401538b0 msgr2=0x7fd040151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:13.410 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.409+0000 7fd03effd640 1 --2- 172.21.15.87:0/2970832188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0401538b0 0x7fd040151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:13.411 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.409+0000 7fd03effd640 1 -- 172.21.15.87:0/2970832188 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0340094d0 con 0x7fd0400cb440 2023-12-16T20:21:13.412 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.411+0000 7fd03effd640 1 --2- 172.21.15.87:0/2970832188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0400cb440 0x7fd0401f0100 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd03000c440 tx=0x7fd03000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:13.416 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.414+0000 7fd0277fe640 1 -- 172.21.15.87:0/2970832188 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0300035f0 con 0x7fd0400cb440 2023-12-16T20:21:13.416 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.415+0000 7fd0277fe640 1 -- 172.21.15.87:0/2970832188 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd030003770 con 0x7fd0400cb440 2023-12-16T20:21:13.416 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.415+0000 7fd0277fe640 1 -- 172.21.15.87:0/2970832188 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030003b20 con 0x7fd0400cb440 2023-12-16T20:21:13.416 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.415+0000 7fd045782640 1 -- 172.21.15.87:0/2970832188 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd040152850 con 0x7fd0400cb440 2023-12-16T20:21:13.416 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.415+0000 7fd045782640 1 -- 172.21.15.87:0/2970832188 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd040152e00 con 0x7fd0400cb440 2023-12-16T20:21:13.416 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.415+0000 7fd045782640 1 -- 172.21.15.87:0/2970832188 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd040067210 con 0x7fd0400cb440 2023-12-16T20:21:13.434 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.432+0000 7fd0277fe640 1 -- 172.21.15.87:0/2970832188 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 3) v1 ==== 89071+0+0 (secure 0 0 0) 0x7fd030003c80 con 0x7fd0400cb440 2023-12-16T20:21:13.434 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.433+0000 7fd0277fe640 1 --2- 172.21.15.87:0/2970832188 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd02c06ac90 0x7fd02c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:13.434 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.433+0000 7fd03e7fc640 1 --2- 172.21.15.87:0/2970832188 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd02c06ac90 0x7fd02c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:13.434 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.433+0000 7fd03e7fc640 1 --2- 172.21.15.87:0/2970832188 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd02c06ac90 0x7fd02c06d150 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd034036000 tx=0x7fd03403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:13.436 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:13.435+0000 7f31aef5c640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-16T20:21:13.437 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.436+0000 7fd0277fe640 1 -- 172.21.15.87:0/2970832188 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd030057ed0 con 0x7fd0400cb440 2023-12-16T20:21:13.608 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:21:13.607+0000 7f31aef5c640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-16T20:21:13.681 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.680+0000 7fd0277fe640 1 -- 172.21.15.87:0/2970832188 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fd030053b10 con 0x7fd0400cb440 2023-12-16T20:21:13.869 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.867+0000 7fd045782640 1 -- 172.21.15.87:0/2970832188 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd040153460 con 0x7fd0400cb440 2023-12-16T20:21:13.905 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.903+0000 7fd0277fe640 1 -- 172.21.15.87:0/2970832188 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd030017070 con 0x7fd0400cb440 2023-12-16T20:21:13.905 INFO:teuthology.misc.health.smithi087.stdout: 2023-12-16T20:21:13.905 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":10,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:21:11.891757+0000","last_up_change":"0.000000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:21:13.907 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.905+0000 7fd045782640 1 -- 172.21.15.87:0/2970832188 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd02c06ac90 msgr2=0x7fd02c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:13.907 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.905+0000 7fd045782640 1 --2- 172.21.15.87:0/2970832188 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd02c06ac90 0x7fd02c06d150 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd034036000 tx=0x7fd03403b040 comp rx=0 tx=0).stop 2023-12-16T20:21:13.907 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.905+0000 7fd045782640 1 -- 172.21.15.87:0/2970832188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0400cb440 msgr2=0x7fd0401f0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:13.907 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.905+0000 7fd045782640 1 --2- 172.21.15.87:0/2970832188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0400cb440 0x7fd0401f0100 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd03000c440 tx=0x7fd03000c900 comp rx=0 tx=0).stop 2023-12-16T20:21:13.907 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.905+0000 7fd045782640 1 -- 172.21.15.87:0/2970832188 shutdown_connections 2023-12-16T20:21:13.907 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.905+0000 7fd045782640 1 --2- 172.21.15.87:0/2970832188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0400c3060 0x7fd0400c3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:13.907 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.905+0000 7fd045782640 1 --2- 172.21.15.87:0/2970832188 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd02c06ac90 0x7fd02c06d150 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:13.907 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.905+0000 7fd045782640 1 --2- 172.21.15.87:0/2970832188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0401538b0 0x7fd040151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:13.907 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.905+0000 7fd045782640 1 --2- 172.21.15.87:0/2970832188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0400cb440 0x7fd0401f0100 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:13.907 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.905+0000 7fd045782640 1 -- 172.21.15.87:0/2970832188 >> 172.21.15.87:0/2970832188 conn(0x7fd04006b970 msgr2=0x7fd04014d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:13.908 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.905+0000 7fd045782640 1 -- 172.21.15.87:0/2970832188 shutdown_connections 2023-12-16T20:21:13.908 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:13.905+0000 7fd045782640 1 -- 172.21.15.87:0/2970832188 wait complete. 2023-12-16T20:21:13.916 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-16T20:21:16.104 INFO:tasks.ceph.osd.5.smithi195.stderr:2023-12-16T20:21:16.103+0000 7fc8c3021500 -1 osd.5 0 log_to_monitors true 2023-12-16T20:21:16.124 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-12-16T20:21:16.123+0000 7f271a61a500 -1 osd.2 0 log_to_monitors true 2023-12-16T20:21:16.129 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-12-16T20:21:16.128+0000 7fad58469500 -1 osd.0 0 log_to_monitors true 2023-12-16T20:21:16.190 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-12-16T20:21:16.189+0000 7fbc3ac1e500 -1 osd.3 0 log_to_monitors true 2023-12-16T20:21:16.211 INFO:tasks.ceph.osd.7.smithi195.stderr:2023-12-16T20:21:16.210+0000 7f965f107500 -1 osd.7 0 log_to_monitors true 2023-12-16T20:21:16.225 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-12-16T20:21:16.224+0000 7f3d4f8cf500 -1 osd.1 0 log_to_monitors true 2023-12-16T20:21:16.245 INFO:tasks.ceph.osd.6.smithi195.stderr:2023-12-16T20:21:16.244+0000 7f776314a500 -1 osd.6 0 log_to_monitors true 2023-12-16T20:21:16.278 INFO:tasks.ceph.osd.4.smithi195.stderr:2023-12-16T20:21:16.277+0000 7f7c16bad500 -1 osd.4 0 log_to_monitors true 2023-12-16T20:21:19.290 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-12-16T20:21:19.289+0000 7f2716076640 -1 osd.2 0 waiting for initial osdmap 2023-12-16T20:21:19.341 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-12-16T20:21:19.340+0000 7fbc365ec640 -1 osd.3 0 waiting for initial osdmap 2023-12-16T20:21:19.378 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-12-16T20:21:19.376+0000 7f3d4c071640 -1 osd.1 0 waiting for initial osdmap 2023-12-16T20:21:19.382 INFO:tasks.ceph.osd.5.smithi195.stderr:2023-12-16T20:21:19.381+0000 7fc8bea10640 -1 osd.5 0 waiting for initial osdmap 2023-12-16T20:21:19.390 INFO:tasks.ceph.osd.4.smithi195.stderr:2023-12-16T20:21:19.389+0000 7f7c12b3b640 -1 osd.4 0 waiting for initial osdmap 2023-12-16T20:21:19.391 INFO:tasks.ceph.osd.7.smithi195.stderr:2023-12-16T20:21:19.390+0000 7f965b097640 -1 osd.7 0 waiting for initial osdmap 2023-12-16T20:21:19.394 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-12-16T20:21:19.393+0000 7fad543f9640 -1 osd.0 0 waiting for initial osdmap 2023-12-16T20:21:19.419 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-12-16T20:21:19.418+0000 7f3d43684640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:21:19.424 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-12-16T20:21:19.423+0000 7fbc2e413640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:21:19.425 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-12-16T20:21:19.424+0000 7fad4c220640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:21:19.436 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-12-16T20:21:19.435+0000 7f270de9d640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:21:19.441 INFO:tasks.ceph.osd.6.smithi195.stderr:2023-12-16T20:21:19.440+0000 7f775f8ec640 -1 osd.6 0 waiting for initial osdmap 2023-12-16T20:21:19.448 INFO:tasks.ceph.osd.7.smithi195.stderr:2023-12-16T20:21:19.447+0000 7f9652ebe640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:21:19.448 INFO:tasks.ceph.osd.5.smithi195.stderr:2023-12-16T20:21:19.447+0000 7fc8b6837640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:21:19.470 INFO:tasks.ceph.osd.4.smithi195.stderr:2023-12-16T20:21:19.469+0000 7f7c0a962640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:21:19.493 INFO:tasks.ceph.osd.6.smithi195.stderr:2023-12-16T20:21:19.492+0000 7f7756eff640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T20:21:20.723 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-16T20:21:20.734 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:21:20.768 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:21:20.816 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.814+0000 7f11fac77640 1 Processor -- start 2023-12-16T20:21:20.816 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.814+0000 7f11fac77640 1 -- start start 2023-12-16T20:21:20.816 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.814+0000 7f11fac77640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f11f40c8bf0 0x7f11f40708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:20.817 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.814+0000 7f11fac77640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f11f40c86c0 0x7f11f4070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:20.817 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.814+0000 7f11fac77640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f4157df0 con 0x7f11f41514f0 2023-12-16T20:21:20.817 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.814+0000 7f11fac77640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f40cdae0 con 0x7f11f40c8bf0 2023-12-16T20:21:20.817 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.814+0000 7f11fac77640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f4158280 con 0x7f11f40c86c0 2023-12-16T20:21:20.817 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.815+0000 7f11f3fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f11f40c8bf0 0x7f11f40708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:20.818 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.816+0000 7f11f3fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f11f40c8bf0 0x7f11f40708c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47132/0 (socket says 172.21.15.87:47132) 2023-12-16T20:21:20.818 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.816+0000 7f11f3fff640 1 -- 172.21.15.87:0/1562328160 learned_addr learned my addr 172.21.15.87:0/1562328160 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:20.819 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.818+0000 7f11f3fff640 1 -- 172.21.15.87:0/1562328160 >> v2:172.21.15.195:3300/0 conn(0x7f11f40c86c0 msgr2=0x7f11f4070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:20.820 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.818+0000 7f11f3fff640 1 --2- 172.21.15.87:0/1562328160 >> v2:172.21.15.195:3300/0 conn(0x7f11f40c86c0 0x7f11f4070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:20.820 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.818+0000 7f11f3fff640 1 -- 172.21.15.87:0/1562328160 >> v1:172.21.15.87:6789/0 conn(0x7f11f41514f0 legacy=0x7f11f40c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:20.820 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.818+0000 7f11f3fff640 1 -- 172.21.15.87:0/1562328160 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f40cd800 con 0x7f11f40c8bf0 2023-12-16T20:21:20.823 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.822+0000 7f11f3fff640 1 --2- 172.21.15.87:0/1562328160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11f40c8bf0 0x7f11f40708c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f11f40c3710 tx=0x7f11e002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36e1b7d35e8f69d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:20.827 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.825+0000 7f11f37fe640 1 -- 172.21.15.87:0/1562328160 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e0031870 con 0x7f11f40c8bf0 2023-12-16T20:21:20.828 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.825+0000 7f11f37fe640 1 -- 172.21.15.87:0/1562328160 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e00319d0 con 0x7f11f40c8bf0 2023-12-16T20:21:20.828 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.825+0000 7f11f37fe640 1 -- 172.21.15.87:0/1562328160 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e0031d60 con 0x7f11f40c8bf0 2023-12-16T20:21:20.828 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.826+0000 7f11fac77640 1 -- 172.21.15.87:0/1562328160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11f40c8bf0 msgr2=0x7f11f40708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:20.828 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.826+0000 7f11fac77640 1 --2- 172.21.15.87:0/1562328160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11f40c8bf0 0x7f11f40708c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f11f40c3710 tx=0x7f11e002b910 comp rx=0 tx=0).stop 2023-12-16T20:21:20.828 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.826+0000 7f11fac77640 1 -- 172.21.15.87:0/1562328160 shutdown_connections 2023-12-16T20:21:20.828 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.826+0000 7f11fac77640 1 --2- 172.21.15.87:0/1562328160 >> v2:172.21.15.195:3300/0 conn(0x7f11f40c86c0 0x7f11f4070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:20.829 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.826+0000 7f11fac77640 1 --2- 172.21.15.87:0/1562328160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11f40c8bf0 0x7f11f40708c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:20.829 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.826+0000 7f11fac77640 1 -- 172.21.15.87:0/1562328160 >> 172.21.15.87:0/1562328160 conn(0x7f11f40669c0 msgr2=0x7f11f406ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:20.829 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.826+0000 7f11fac77640 1 -- 172.21.15.87:0/1562328160 shutdown_connections 2023-12-16T20:21:20.829 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.826+0000 7f11fac77640 1 -- 172.21.15.87:0/1562328160 wait complete. 2023-12-16T20:21:20.831 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.827+0000 7f11fac77640 1 Processor -- start 2023-12-16T20:21:20.831 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.827+0000 7f11fac77640 1 -- start start 2023-12-16T20:21:20.831 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.828+0000 7f11fac77640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11f40c86c0 0x7f11f41f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:20.832 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.828+0000 7f11fac77640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11f40c8bf0 0x7f11f406b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:20.832 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.828+0000 7f11fac77640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11f41514f0 0x7f11f41e3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:20.832 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.828+0000 7f11fac77640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f4155160 con 0x7f11f40c86c0 2023-12-16T20:21:20.832 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.828+0000 7f11fac77640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f41f3170 con 0x7f11f40c8bf0 2023-12-16T20:21:20.832 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.828+0000 7f11fac77640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f41e1080 con 0x7f11f41514f0 2023-12-16T20:21:20.832 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.829+0000 7f11f9214640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11f41514f0 0x7f11f41e3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:20.832 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.829+0000 7f11f8a13640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11f40c86c0 0x7f11f41f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:20.833 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.829+0000 7f11f8a13640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11f40c86c0 0x7f11f41f2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47138/0 (socket says 172.21.15.87:47138) 2023-12-16T20:21:20.833 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.829+0000 7f11f8a13640 1 -- 172.21.15.87:0/2432452405 learned_addr learned my addr 172.21.15.87:0/2432452405 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:20.833 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.832+0000 7f11f8a13640 1 -- 172.21.15.87:0/2432452405 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11f41514f0 msgr2=0x7f11f41e3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:20.834 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.832+0000 7f11f8a13640 1 --2- 172.21.15.87:0/2432452405 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11f41514f0 0x7f11f41e3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:20.834 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.832+0000 7f11f8a13640 1 -- 172.21.15.87:0/2432452405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11f40c8bf0 msgr2=0x7f11f406b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:20.834 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.832+0000 7f11f8a13640 1 --2- 172.21.15.87:0/2432452405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11f40c8bf0 0x7f11f406b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:20.834 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.832+0000 7f11f8a13640 1 -- 172.21.15.87:0/2432452405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e00094d0 con 0x7f11f40c86c0 2023-12-16T20:21:20.835 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.834+0000 7f11f8a13640 1 --2- 172.21.15.87:0/2432452405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11f40c86c0 0x7f11f41f2c30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f11e800c430 tx=0x7f11e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:20.840 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.839+0000 7f11f17fa640 1 -- 172.21.15.87:0/2432452405 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e80052d0 con 0x7f11f40c86c0 2023-12-16T20:21:20.841 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.839+0000 7f11f17fa640 1 -- 172.21.15.87:0/2432452405 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e8005450 con 0x7f11f40c86c0 2023-12-16T20:21:20.841 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.839+0000 7f11f17fa640 1 -- 172.21.15.87:0/2432452405 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8007260 con 0x7f11f40c86c0 2023-12-16T20:21:20.841 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.839+0000 7f11fac77640 1 -- 172.21.15.87:0/2432452405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f41e2a80 con 0x7f11f40c86c0 2023-12-16T20:21:20.841 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.839+0000 7f11fac77640 1 -- 172.21.15.87:0/2432452405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f4155390 con 0x7f11f40c86c0 2023-12-16T20:21:20.842 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.840+0000 7f11fac77640 1 -- 172.21.15.87:0/2432452405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f4074140 con 0x7f11f40c86c0 2023-12-16T20:21:20.858 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.857+0000 7f11f17fa640 1 -- 172.21.15.87:0/2432452405 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 4) v1 ==== 89177+0+0 (secure 0 0 0) 0x7f11e80073c0 con 0x7f11f40c86c0 2023-12-16T20:21:20.859 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.858+0000 7f11f17fa640 1 --2- 172.21.15.87:0/2432452405 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f11d806ae30 0x7f11d806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:20.859 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.858+0000 7f11f3fff640 1 --2- 172.21.15.87:0/2432452405 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f11d806ae30 0x7f11d806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:20.859 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:20.858+0000 7f11f3fff640 1 --2- 172.21.15.87:0/2432452405 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f11d806ae30 0x7f11d806d2f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f11e0036000 tx=0x7f11e0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:21.092 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:21.090+0000 7f11f17fa640 1 -- 172.21.15.87:0/2432452405 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f11e8057c70 con 0x7f11f40c86c0 2023-12-16T20:21:21.092 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:21.090+0000 7f11f17fa640 1 -- 172.21.15.87:0/2432452405 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f11e8057a40 con 0x7f11f40c86c0 2023-12-16T20:21:21.270 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:21.268+0000 7f11fac77640 1 -- 172.21.15.87:0/2432452405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11f4067920 con 0x7f11f40c86c0 2023-12-16T20:21:21.291 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:21.290+0000 7f11f17fa640 1 -- 172.21.15.87:0/2432452405 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10884 (secure 0 0 0) 0x7f11e8020070 con 0x7f11f40c86c0 2023-12-16T20:21:21.291 INFO:teuthology.misc.health.smithi087.stdout: 2023-12-16T20:21:21.292 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":13,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:21:20.245627+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:21:21.293 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:21.292+0000 7f11fac77640 1 -- 172.21.15.87:0/2432452405 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f11d806ae30 msgr2=0x7f11d806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:21.294 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:21.292+0000 7f11fac77640 1 --2- 172.21.15.87:0/2432452405 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f11d806ae30 0x7f11d806d2f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f11e0036000 tx=0x7f11e0030000 comp rx=0 tx=0).stop 2023-12-16T20:21:21.294 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:21.292+0000 7f11fac77640 1 -- 172.21.15.87:0/2432452405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11f40c86c0 msgr2=0x7f11f41f2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:21.294 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:21.292+0000 7f11fac77640 1 --2- 172.21.15.87:0/2432452405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11f40c86c0 0x7f11f41f2c30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f11e800c430 tx=0x7f11e800c8f0 comp rx=0 tx=0).stop 2023-12-16T20:21:21.294 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:21.292+0000 7f11fac77640 1 -- 172.21.15.87:0/2432452405 shutdown_connections 2023-12-16T20:21:21.294 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:21.292+0000 7f11fac77640 1 --2- 172.21.15.87:0/2432452405 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11f41514f0 0x7f11f41e3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:21.294 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:21.292+0000 7f11fac77640 1 --2- 172.21.15.87:0/2432452405 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f11d806ae30 0x7f11d806d2f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:21.294 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:21.292+0000 7f11fac77640 1 --2- 172.21.15.87:0/2432452405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11f40c8bf0 0x7f11f406b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:21.294 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:21.292+0000 7f11fac77640 1 --2- 172.21.15.87:0/2432452405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11f40c86c0 0x7f11f41f2c30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:21.294 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:21.292+0000 7f11fac77640 1 -- 172.21.15.87:0/2432452405 >> 172.21.15.87:0/2432452405 conn(0x7f11f40669c0 msgr2=0x7f11f40738b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:21.294 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:21.292+0000 7f11fac77640 1 -- 172.21.15.87:0/2432452405 shutdown_connections 2023-12-16T20:21:21.294 INFO:teuthology.misc.health.smithi087.stderr:2023-12-16T20:21:21.292+0000 7f11fac77640 1 -- 172.21.15.87:0/2432452405 wait complete. 2023-12-16T20:21:21.303 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-16T20:21:21.303 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-16T20:21:21.303 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-16T20:21:21.303 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-16T20:21:21.303 DEBUG:teuthology.orchestra.run.smithi087:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2023-12-16T20:21:21.305 INFO:tasks.ceph.mds.a:Started 2023-12-16T20:21:21.306 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-16T20:21:21.306 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-16T20:21:21.306 DEBUG:teuthology.orchestra.run.smithi087:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2023-12-16T20:21:21.308 INFO:tasks.ceph.mds.c:Started 2023-12-16T20:21:21.308 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-16T20:21:21.308 INFO:tasks.ceph.mds.e:Restarting daemon 2023-12-16T20:21:21.308 DEBUG:teuthology.orchestra.run.smithi087:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2023-12-16T20:21:21.310 INFO:tasks.ceph.mds.e:Started 2023-12-16T20:21:21.310 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-16T20:21:21.310 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-16T20:21:21.310 DEBUG:teuthology.orchestra.run.smithi195:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2023-12-16T20:21:21.313 INFO:tasks.ceph.mds.b:Started 2023-12-16T20:21:21.313 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-16T20:21:21.313 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-16T20:21:21.313 DEBUG:teuthology.orchestra.run.smithi195:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2023-12-16T20:21:21.315 INFO:tasks.ceph.mds.d:Started 2023-12-16T20:21:21.315 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-16T20:21:21.315 INFO:tasks.ceph.mds.f:Restarting daemon 2023-12-16T20:21:21.316 DEBUG:teuthology.orchestra.run.smithi195:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2023-12-16T20:21:21.317 INFO:tasks.ceph.mds.f:Started 2023-12-16T20:21:21.318 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-16T20:21:21.318 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:21:21.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.421+0000 7f60b4989640 1 Processor -- start 2023-12-16T20:21:21.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.421+0000 7f60b4989640 1 -- start start 2023-12-16T20:21:21.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.422+0000 7f60b4989640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f60b0153890 0x7f60b015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:21.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.422+0000 7f60b4989640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60b0153c70 0x7f60b00c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:21.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.422+0000 7f60b4989640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f60b00ceef0 0x7f60b00cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:21.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.422+0000 7f60b4989640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b015a700 con 0x7f60b0153890 2023-12-16T20:21:21.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.422+0000 7f60b4989640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b00ca870 con 0x7f60b00ceef0 2023-12-16T20:21:21.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.422+0000 7f60b4989640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b0159af0 con 0x7f60b0153c70 2023-12-16T20:21:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.423+0000 7f60aed9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f60b00ceef0 0x7f60b00cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.423+0000 7f60add9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60b0153c70 0x7f60b00c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.423+0000 7f60ae59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f60b0153890 0x7f60b015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.424+0000 7f60aed9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f60b00ceef0 0x7f60b00cf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:60214/0 (socket says 172.21.15.87:60214) 2023-12-16T20:21:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.424+0000 7f60aed9d640 1 -- 172.21.15.87:0/1722388819 learned_addr learned my addr 172.21.15.87:0/1722388819 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.427+0000 7f60aed9d640 1 -- 172.21.15.87:0/1722388819 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60b0153c70 msgr2=0x7f60b00c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.427+0000 7f60aed9d640 1 --2- 172.21.15.87:0/1722388819 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60b0153c70 0x7f60b00c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.427+0000 7f60aed9d640 1 -- 172.21.15.87:0/1722388819 >> v2:172.21.15.87:3300/0 conn(0x7f60b0153890 msgr2=0x7f60b015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.427+0000 7f60aed9d640 1 --2- 172.21.15.87:0/1722388819 >> v2:172.21.15.87:3300/0 conn(0x7f60b0153890 0x7f60b015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.427+0000 7f60aed9d640 1 -- 172.21.15.87:0/1722388819 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b0159dd0 con 0x7f60b00ceef0 2023-12-16T20:21:21.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.429+0000 7f60aed9d640 1 --2- 172.21.15.87:0/1722388819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b00ceef0 0x7f60b00cf340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f60b006d6d0 tx=0x7f60a802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a62d1fcf206efea server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.433+0000 7f60ad59a640 1 -- 172.21.15.87:0/1722388819 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a802cb00 con 0x7f60b00ceef0 2023-12-16T20:21:21.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.433+0000 7f60ad59a640 1 -- 172.21.15.87:0/1722388819 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a802cc60 con 0x7f60b00ceef0 2023-12-16T20:21:21.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.433+0000 7f60ad59a640 1 -- 172.21.15.87:0/1722388819 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a80343f0 con 0x7f60b00ceef0 2023-12-16T20:21:21.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.434+0000 7f60b4989640 1 -- 172.21.15.87:0/1722388819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b00ceef0 msgr2=0x7f60b00cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:21.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.434+0000 7f60b4989640 1 --2- 172.21.15.87:0/1722388819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b00ceef0 0x7f60b00cf340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f60b006d6d0 tx=0x7f60a802bf60 comp rx=0 tx=0).stop 2023-12-16T20:21:21.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.434+0000 7f60b4989640 1 -- 172.21.15.87:0/1722388819 shutdown_connections 2023-12-16T20:21:21.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.434+0000 7f60b4989640 1 --2- 172.21.15.87:0/1722388819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b00ceef0 0x7f60b00cf340 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:21.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.434+0000 7f60b4989640 1 --2- 172.21.15.87:0/1722388819 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60b0153c70 0x7f60b00c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:21.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.434+0000 7f60b4989640 1 --2- 172.21.15.87:0/1722388819 >> v2:172.21.15.87:3300/0 conn(0x7f60b0153890 0x7f60b015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:21.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.434+0000 7f60b4989640 1 -- 172.21.15.87:0/1722388819 >> 172.21.15.87:0/1722388819 conn(0x7f60b006ba00 msgr2=0x7f60b006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:21.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.434+0000 7f60b4989640 1 -- 172.21.15.87:0/1722388819 shutdown_connections 2023-12-16T20:21:21.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.434+0000 7f60b4989640 1 -- 172.21.15.87:0/1722388819 wait complete. 2023-12-16T20:21:21.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.435+0000 7f60b4989640 1 Processor -- start 2023-12-16T20:21:21.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.435+0000 7f60b4989640 1 -- start start 2023-12-16T20:21:21.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.436+0000 7f60b4989640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60b00ceef0 0x7f60b00c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:21.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.436+0000 7f60b4989640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b0153890 0x7f60b0146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:21.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.436+0000 7f60b4989640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60b0153c70 0x7f60b0146d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:21.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.436+0000 7f60b4989640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00c4af0 con 0x7f60b00ceef0 2023-12-16T20:21:21.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.436+0000 7f60b4989640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00cd800 con 0x7f60b0153890 2023-12-16T20:21:21.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.436+0000 7f60b4989640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00b2ed0 con 0x7f60b0153c70 2023-12-16T20:21:21.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.437+0000 7f60add9b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b0153890 0x7f60b0146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:21.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.437+0000 7f60ae59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60b00ceef0 0x7f60b00c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:21.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.437+0000 7f60aed9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60b0153c70 0x7f60b0146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:21.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.437+0000 7f60add9b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b0153890 0x7f60b0146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:60220/0 (socket says 172.21.15.87:60220) 2023-12-16T20:21:21.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.437+0000 7f60add9b640 1 -- 172.21.15.87:0/2703256293 learned_addr learned my addr 172.21.15.87:0/2703256293 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:21.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.442+0000 7f60add9b640 1 -- 172.21.15.87:0/2703256293 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60b0153c70 msgr2=0x7f60b0146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:21.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.442+0000 7f60add9b640 1 --2- 172.21.15.87:0/2703256293 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60b0153c70 0x7f60b0146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:21.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.442+0000 7f60add9b640 1 -- 172.21.15.87:0/2703256293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60b00ceef0 msgr2=0x7f60b00c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:21.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.442+0000 7f60add9b640 1 --2- 172.21.15.87:0/2703256293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60b00ceef0 0x7f60b00c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:21.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.442+0000 7f60add9b640 1 -- 172.21.15.87:0/2703256293 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a8009b30 con 0x7f60b0153890 2023-12-16T20:21:21.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.445+0000 7f60add9b640 1 --2- 172.21.15.87:0/2703256293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b0153890 0x7f60b0146820 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f60a400e870 tx=0x7f60a400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:21.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.447+0000 7f609effd640 1 -- 172.21.15.87:0/2703256293 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a40094f0 con 0x7f60b0153890 2023-12-16T20:21:21.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.448+0000 7f60b4989640 1 -- 172.21.15.87:0/2703256293 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b00ce900 con 0x7f60b0153890 2023-12-16T20:21:21.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.448+0000 7f60b4989640 1 -- 172.21.15.87:0/2703256293 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b00c3ee0 con 0x7f60b0153890 2023-12-16T20:21:21.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.449+0000 7f60b4989640 1 -- 172.21.15.87:0/2703256293 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b0067500 con 0x7f60b0153890 2023-12-16T20:21:21.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.451+0000 7f609effd640 1 -- 172.21.15.87:0/2703256293 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a4005990 con 0x7f60b0153890 2023-12-16T20:21:21.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.451+0000 7f609effd640 1 -- 172.21.15.87:0/2703256293 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a4005d00 con 0x7f60b0153890 2023-12-16T20:21:21.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.725+0000 7f609effd640 1 -- 172.21.15.87:0/2703256293 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 4) v1 ==== 89177+0+0 (secure 0 0 0) 0x7f60a400c940 con 0x7f60b0153890 2023-12-16T20:21:21.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.726+0000 7f609effd640 1 --2- 172.21.15.87:0/2703256293 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f609006ade0 0x7f609006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:21.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.726+0000 7f60ae59c640 1 --2- 172.21.15.87:0/2703256293 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f609006ade0 0x7f609006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:21.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.726+0000 7f60ae59c640 1 --2- 172.21.15.87:0/2703256293 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f609006ade0 0x7f609006d2a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009ac0 tx=0x7f60a0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:21.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.733+0000 7f609effd640 1 -- 172.21.15.87:0/2703256293 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f60a4058c10 con 0x7f60b0153890 2023-12-16T20:21:21.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.751+0000 7f609effd640 1 -- 172.21.15.87:0/2703256293 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f60a4054f50 con 0x7f60b0153890 2023-12-16T20:21:21.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:21.991+0000 7f60b4989640 1 -- 172.21.15.87:0/2703256293 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60b014d910 con 0x7f60b0153890 2023-12-16T20:21:22.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.157+0000 7f609effd640 1 -- 172.21.15.87:0/2703256293 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+11068 (secure 0 0 0) 0x7f60a4021020 con 0x7f60b0153890 2023-12-16T20:21:22.159 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:21:22.159 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":14,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:21:21.711353+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:21:22.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.160+0000 7f60b4989640 1 -- 172.21.15.87:0/2703256293 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f609006ade0 msgr2=0x7f609006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:22.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.160+0000 7f60b4989640 1 --2- 172.21.15.87:0/2703256293 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f609006ade0 0x7f609006d2a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009ac0 tx=0x7f60a0009190 comp rx=0 tx=0).stop 2023-12-16T20:21:22.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.160+0000 7f60b4989640 1 -- 172.21.15.87:0/2703256293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b0153890 msgr2=0x7f60b0146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:22.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.160+0000 7f60b4989640 1 --2- 172.21.15.87:0/2703256293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b0153890 0x7f60b0146820 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f60a400e870 tx=0x7f60a400ed30 comp rx=0 tx=0).stop 2023-12-16T20:21:22.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.160+0000 7f60b4989640 1 -- 172.21.15.87:0/2703256293 shutdown_connections 2023-12-16T20:21:22.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.160+0000 7f60b4989640 1 --2- 172.21.15.87:0/2703256293 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60b0153c70 0x7f60b0146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:22.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.160+0000 7f60b4989640 1 --2- 172.21.15.87:0/2703256293 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f609006ade0 0x7f609006d2a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:22.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.160+0000 7f60b4989640 1 --2- 172.21.15.87:0/2703256293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b0153890 0x7f60b0146820 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:22.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.160+0000 7f60b4989640 1 --2- 172.21.15.87:0/2703256293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60b00ceef0 0x7f60b00c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:22.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.160+0000 7f60b4989640 1 -- 172.21.15.87:0/2703256293 >> 172.21.15.87:0/2703256293 conn(0x7f60b006ba00 msgr2=0x7f60b0158370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:22.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.160+0000 7f60b4989640 1 -- 172.21.15.87:0/2703256293 shutdown_connections 2023-12-16T20:21:22.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.160+0000 7f60b4989640 1 -- 172.21.15.87:0/2703256293 wait complete. 2023-12-16T20:21:22.177 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-12-16T20:21:22.177 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T20:21:22.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.278+0000 7f4758e51640 1 Processor -- start 2023-12-16T20:21:22.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.279+0000 7f4758e51640 1 -- start start 2023-12-16T20:21:22.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.279+0000 7f4758e51640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f47540cced0 0x7f4754070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:22.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.280+0000 7f4758e51640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47540cc650 0x7f47541510f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:22.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.280+0000 7f4758e51640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4754070540 con 0x7f47540cd2b0 2023-12-16T20:21:22.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.280+0000 7f4758e51640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4754158400 con 0x7f47540cced0 2023-12-16T20:21:22.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.280+0000 7f4758e51640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475415ad60 con 0x7f47540cc650 2023-12-16T20:21:22.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.280+0000 7f4751d9b640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f47540cd2b0 0x7f47540cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:41684/0 (socket says 172.21.15.87:41684) 2023-12-16T20:21:22.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.280+0000 7f4751d9b640 1 -- 172.21.15.87:0/1905212662 learned_addr learned my addr 172.21.15.87:0/1905212662 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:22.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.280+0000 7f4752d9d640 1 --2- 172.21.15.87:0/1905212662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47540cc650 0x7f47541510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:22.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.284+0000 7f475159a640 1 -- 172.21.15.87:0/1905212662 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064252534 0 0) 0x7f4748001160 con 0x7f47540cd2b0 2023-12-16T20:21:22.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.284+0000 7f475159a640 1 -- 172.21.15.87:0/1905212662 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f473c003520 con 0x7f47540cd2b0 2023-12-16T20:21:22.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.284+0000 7f4752d9d640 1 -- 172.21.15.87:0/1905212662 >> v2:172.21.15.87:3300/0 conn(0x7f47540cced0 msgr2=0x7f4754070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:22.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.284+0000 7f4752d9d640 1 --2- 172.21.15.87:0/1905212662 >> v2:172.21.15.87:3300/0 conn(0x7f47540cced0 0x7f4754070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:22.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.284+0000 7f4752d9d640 1 -- 172.21.15.87:0/1905212662 >> v1:172.21.15.195:6789/0 conn(0x7f47540cd2b0 legacy=0x7f47540cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:22.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.284+0000 7f4752d9d640 1 -- 172.21.15.87:0/1905212662 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475415b040 con 0x7f47540cc650 2023-12-16T20:21:22.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.287+0000 7f4752d9d640 1 --2- 172.21.15.87:0/1905212662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47540cc650 0x7f47541510f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f474c009d90 tx=0x7f474c02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42a85934ea50f1a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.291+0000 7f475159a640 1 -- 172.21.15.87:0/1905212662 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c02cce0 con 0x7f47540cc650 2023-12-16T20:21:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.291+0000 7f475159a640 1 -- 172.21.15.87:0/1905212662 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c02ce40 con 0x7f47540cc650 2023-12-16T20:21:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.291+0000 7f475159a640 1 -- 172.21.15.87:0/1905212662 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c034660 con 0x7f47540cc650 2023-12-16T20:21:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.292+0000 7f4758e51640 1 -- 172.21.15.87:0/1905212662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47540cc650 msgr2=0x7f47541510f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.292+0000 7f4758e51640 1 --2- 172.21.15.87:0/1905212662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47540cc650 0x7f47541510f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f474c009d90 tx=0x7f474c02bf30 comp rx=0 tx=0).stop 2023-12-16T20:21:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.292+0000 7f4758e51640 1 -- 172.21.15.87:0/1905212662 shutdown_connections 2023-12-16T20:21:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.292+0000 7f4758e51640 1 --2- 172.21.15.87:0/1905212662 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47540cc650 0x7f47541510f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.292+0000 7f4758e51640 1 --2- 172.21.15.87:0/1905212662 >> v2:172.21.15.87:3300/0 conn(0x7f47540cced0 0x7f4754070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.292+0000 7f4758e51640 1 -- 172.21.15.87:0/1905212662 >> 172.21.15.87:0/1905212662 conn(0x7f4754061660 msgr2=0x7f4754070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.292+0000 7f4758e51640 1 -- 172.21.15.87:0/1905212662 shutdown_connections 2023-12-16T20:21:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.292+0000 7f4758e51640 1 -- 172.21.15.87:0/1905212662 wait complete. 2023-12-16T20:21:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.293+0000 7f4758e51640 1 Processor -- start 2023-12-16T20:21:22.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.294+0000 7f4758e51640 1 -- start start 2023-12-16T20:21:22.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.294+0000 7f4758e51640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47540cc650 0x7f4754155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:22.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.294+0000 7f4758e51640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47540cced0 0x7f47541ed940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:22.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.294+0000 7f4758e51640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47540cd2b0 0x7f4754159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:22.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.294+0000 7f4758e51640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47541e3710 con 0x7f47540cced0 2023-12-16T20:21:22.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.294+0000 7f4758e51640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47541e31c0 con 0x7f47540cd2b0 2023-12-16T20:21:22.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.294+0000 7f4758e51640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4754155620 con 0x7f47540cc650 2023-12-16T20:21:22.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.295+0000 7f4752d9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47540cd2b0 0x7f4754159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.295+0000 7f475259c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47540cc650 0x7f4754155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.295+0000 7f4751d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47540cced0 0x7f47541ed940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.295+0000 7f4752d9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47540cd2b0 0x7f4754159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:60228/0 (socket says 172.21.15.87:60228) 2023-12-16T20:21:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.295+0000 7f4752d9d640 1 -- 172.21.15.87:0/2262912994 learned_addr learned my addr 172.21.15.87:0/2262912994 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.300+0000 7f4752d9d640 1 -- 172.21.15.87:0/2262912994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47540cc650 msgr2=0x7f4754155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.300+0000 7f4752d9d640 1 --2- 172.21.15.87:0/2262912994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47540cc650 0x7f4754155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.300+0000 7f4752d9d640 1 -- 172.21.15.87:0/2262912994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47540cced0 msgr2=0x7f47541ed940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.300+0000 7f4752d9d640 1 --2- 172.21.15.87:0/2262912994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47540cced0 0x7f47541ed940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.300+0000 7f4752d9d640 1 -- 172.21.15.87:0/2262912994 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c009a70 con 0x7f47540cd2b0 2023-12-16T20:21:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.303+0000 7f4752d9d640 1 --2- 172.21.15.87:0/2262912994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47540cd2b0 0x7f4754159bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f474c037040 tx=0x7f474c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:22.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.307+0000 7f4742ffd640 1 -- 172.21.15.87:0/2262912994 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c03e670 con 0x7f47540cd2b0 2023-12-16T20:21:22.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.307+0000 7f4742ffd640 1 -- 172.21.15.87:0/2262912994 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c03e7d0 con 0x7f47540cd2b0 2023-12-16T20:21:22.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.307+0000 7f4758e51640 1 -- 172.21.15.87:0/2262912994 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4754155ff0 con 0x7f47540cd2b0 2023-12-16T20:21:22.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.307+0000 7f4742ffd640 1 -- 172.21.15.87:0/2262912994 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c03eb80 con 0x7f47540cd2b0 2023-12-16T20:21:22.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.307+0000 7f4758e51640 1 -- 172.21.15.87:0/2262912994 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47541ede80 con 0x7f47540cd2b0 2023-12-16T20:21:22.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.308+0000 7f4758e51640 1 -- 172.21.15.87:0/2262912994 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47541557b0 con 0x7f47540cd2b0 2023-12-16T20:21:22.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.520+0000 7f4742ffd640 1 -- 172.21.15.87:0/2262912994 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 4) v1 ==== 89177+0+0 (secure 0 0 0) 0x7f474c03b040 con 0x7f47540cd2b0 2023-12-16T20:21:22.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.521+0000 7f4742ffd640 1 --2- 172.21.15.87:0/2262912994 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f473406ae00 0x7f473406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:22.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.521+0000 7f475259c640 1 --2- 172.21.15.87:0/2262912994 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f473406ae00 0x7f473406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:22.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.521+0000 7f475259c640 1 --2- 172.21.15.87:0/2262912994 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f473406ae00 0x7f473406d2c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4744009990 tx=0x7f4744009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:22.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.572+0000 7f4742ffd640 1 -- 172.21.15.87:0/2262912994 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f474c07aa70 con 0x7f47540cd2b0 2023-12-16T20:21:22.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.596+0000 7f4742ffd640 1 -- 172.21.15.87:0/2262912994 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f474c076db0 con 0x7f47540cd2b0 2023-12-16T20:21:22.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.848+0000 7f4758e51640 1 -- 172.21.15.87:0/2262912994 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4754067500 con 0x7f47540cd2b0 2023-12-16T20:21:22.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.858+0000 7f4742ffd640 1 -- 172.21.15.87:0/2262912994 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f474c04e020 con 0x7f47540cd2b0 2023-12-16T20:21:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:21:22.860 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-12-16T20:21:22.860 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 1 2023-12-16T20:21:22.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.860+0000 7f4758e51640 1 -- 172.21.15.87:0/2262912994 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f473406ae00 msgr2=0x7f473406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:22.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.860+0000 7f4758e51640 1 --2- 172.21.15.87:0/2262912994 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f473406ae00 0x7f473406d2c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4744009990 tx=0x7f4744009110 comp rx=0 tx=0).stop 2023-12-16T20:21:22.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.860+0000 7f4758e51640 1 -- 172.21.15.87:0/2262912994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47540cd2b0 msgr2=0x7f4754159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:22.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.860+0000 7f4758e51640 1 --2- 172.21.15.87:0/2262912994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47540cd2b0 0x7f4754159bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f474c037040 tx=0x7f474c004a40 comp rx=0 tx=0).stop 2023-12-16T20:21:22.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.860+0000 7f4758e51640 1 -- 172.21.15.87:0/2262912994 shutdown_connections 2023-12-16T20:21:22.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.860+0000 7f4758e51640 1 --2- 172.21.15.87:0/2262912994 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f473406ae00 0x7f473406d2c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:22.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.860+0000 7f4758e51640 1 --2- 172.21.15.87:0/2262912994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47540cd2b0 0x7f4754159bd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:22.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.860+0000 7f4758e51640 1 --2- 172.21.15.87:0/2262912994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47540cced0 0x7f47541ed940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:22.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.860+0000 7f4758e51640 1 --2- 172.21.15.87:0/2262912994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47540cc650 0x7f4754155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:22.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.860+0000 7f4758e51640 1 -- 172.21.15.87:0/2262912994 >> 172.21.15.87:0/2262912994 conn(0x7f4754061660 msgr2=0x7f475414f290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:22.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.860+0000 7f4758e51640 1 -- 172.21.15.87:0/2262912994 shutdown_connections 2023-12-16T20:21:22.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:22.860+0000 7f4758e51640 1 -- 172.21.15.87:0/2262912994 wait complete. 2023-12-16T20:21:24.875 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T20:21:24.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.975+0000 7ff8e665c640 1 Processor -- start 2023-12-16T20:21:24.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.975+0000 7ff8e665c640 1 -- start start 2023-12-16T20:21:24.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.976+0000 7ff8e665c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff8e0153c70 0x7ff8e015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:24.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.976+0000 7ff8e665c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e00ceef0 0x7ff8e00cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:24.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.976+0000 7ff8e665c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e015a700 con 0x7ff8e0153890 2023-12-16T20:21:24.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.976+0000 7ff8e665c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e00ca870 con 0x7ff8e0153c70 2023-12-16T20:21:24.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.976+0000 7ff8e665c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e0159af0 con 0x7ff8e00ceef0 2023-12-16T20:21:24.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.976+0000 7ff8df7fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff8e0153c70 0x7ff8e015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:24.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.976+0000 7ff8dffff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff8e0153890 0x7ff8e00c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54544/0 (socket says 172.21.15.87:54544) 2023-12-16T20:21:24.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.976+0000 7ff8dffff640 1 -- 172.21.15.87:0/1685620723 learned_addr learned my addr 172.21.15.87:0/1685620723 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:24.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.977+0000 7ff8e4bf9640 1 --2- 172.21.15.87:0/1685620723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e00ceef0 0x7ff8e00cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:24.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.980+0000 7ff8deffd640 1 -- 172.21.15.87:0/1685620723 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706821814 0 0) 0x7ff8e015a700 con 0x7ff8e0153890 2023-12-16T20:21:24.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.980+0000 7ff8deffd640 1 -- 172.21.15.87:0/1685620723 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8c8003520 con 0x7ff8e0153890 2023-12-16T20:21:24.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.980+0000 7ff8df7fe640 1 -- 172.21.15.87:0/1685620723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e00ceef0 msgr2=0x7ff8e00cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:24.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.980+0000 7ff8df7fe640 1 --2- 172.21.15.87:0/1685620723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e00ceef0 0x7ff8e00cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:24.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.980+0000 7ff8df7fe640 1 -- 172.21.15.87:0/1685620723 >> v1:172.21.15.87:6789/0 conn(0x7ff8e0153890 legacy=0x7ff8e00c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:24.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.980+0000 7ff8df7fe640 1 -- 172.21.15.87:0/1685620723 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e0159dd0 con 0x7ff8e0153c70 2023-12-16T20:21:24.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.983+0000 7ff8df7fe640 1 --2- 172.21.15.87:0/1685620723 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e0153c70 0x7ff8e015d950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40097a0 tx=0x7ff8d402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d92f34ccefad9986 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:24.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.989+0000 7ff8deffd640 1 -- 172.21.15.87:0/1685620723 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4030610 con 0x7ff8e0153c70 2023-12-16T20:21:24.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.989+0000 7ff8deffd640 1 -- 172.21.15.87:0/1685620723 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d4030770 con 0x7ff8e0153c70 2023-12-16T20:21:24.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.989+0000 7ff8deffd640 1 -- 172.21.15.87:0/1685620723 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4030b00 con 0x7ff8e0153c70 2023-12-16T20:21:24.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.989+0000 7ff8e665c640 1 -- 172.21.15.87:0/1685620723 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e0153c70 msgr2=0x7ff8e015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:24.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.989+0000 7ff8e665c640 1 --2- 172.21.15.87:0/1685620723 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e0153c70 0x7ff8e015d950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40097a0 tx=0x7ff8d402b960 comp rx=0 tx=0).stop 2023-12-16T20:21:24.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.989+0000 7ff8e665c640 1 -- 172.21.15.87:0/1685620723 shutdown_connections 2023-12-16T20:21:24.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.989+0000 7ff8e665c640 1 --2- 172.21.15.87:0/1685620723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e00ceef0 0x7ff8e00cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:24.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.989+0000 7ff8e665c640 1 --2- 172.21.15.87:0/1685620723 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e0153c70 0x7ff8e015d950 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:24.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.989+0000 7ff8e665c640 1 -- 172.21.15.87:0/1685620723 >> 172.21.15.87:0/1685620723 conn(0x7ff8e006ba00 msgr2=0x7ff8e006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:24.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.989+0000 7ff8e665c640 1 -- 172.21.15.87:0/1685620723 shutdown_connections 2023-12-16T20:21:24.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.989+0000 7ff8e665c640 1 -- 172.21.15.87:0/1685620723 wait complete. 2023-12-16T20:21:24.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.991+0000 7ff8e665c640 1 Processor -- start 2023-12-16T20:21:24.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.991+0000 7ff8e665c640 1 -- start start 2023-12-16T20:21:24.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.993+0000 7ff8e665c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8e00ceef0 0x7ff8e00ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:24.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.993+0000 7ff8e665c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e0153890 0x7ff8e015b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:24.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.993+0000 7ff8e665c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e0153c70 0x7ff8e013f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:24.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.993+0000 7ff8e665c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e00cd4e0 con 0x7ff8e00ceef0 2023-12-16T20:21:24.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.993+0000 7ff8e665c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e00cec70 con 0x7ff8e0153c70 2023-12-16T20:21:24.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.993+0000 7ff8e665c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e00cd6d0 con 0x7ff8e0153890 2023-12-16T20:21:24.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.993+0000 7ff8df7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e0153890 0x7ff8e015b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:24.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.993+0000 7ff8dffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8e00ceef0 0x7ff8e00ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:24.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.993+0000 7ff8e4bf9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e0153c70 0x7ff8e013f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:24.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.994+0000 7ff8dffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8e00ceef0 0x7ff8e00ccfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47182/0 (socket says 172.21.15.87:47182) 2023-12-16T20:21:24.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.994+0000 7ff8dffff640 1 -- 172.21.15.87:0/4273125698 learned_addr learned my addr 172.21.15.87:0/4273125698 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:25.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.999+0000 7ff8e4bf9640 1 -- 172.21.15.87:0/4273125698 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e0153890 msgr2=0x7ff8e015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:25.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.999+0000 7ff8e4bf9640 1 --2- 172.21.15.87:0/4273125698 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e0153890 0x7ff8e015b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:25.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.999+0000 7ff8e4bf9640 1 -- 172.21.15.87:0/4273125698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8e00ceef0 msgr2=0x7ff8e00ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:25.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.999+0000 7ff8e4bf9640 1 --2- 172.21.15.87:0/4273125698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8e00ceef0 0x7ff8e00ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:25.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.999+0000 7ff8e4bf9640 1 -- 172.21.15.87:0/4273125698 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d4009400 con 0x7ff8e0153c70 2023-12-16T20:21:25.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:24.999+0000 7ff8dffff640 1 --2- 172.21.15.87:0/4273125698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8e00ceef0 0x7ff8e00ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:21:25.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.001+0000 7ff8e4bf9640 1 --2- 172.21.15.87:0/4273125698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e0153c70 0x7ff8e013f9e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009d90 tx=0x7ff8d800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:25.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.004+0000 7ff8dcff9640 1 -- 172.21.15.87:0/4273125698 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8014480 con 0x7ff8e0153c70 2023-12-16T20:21:25.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.005+0000 7ff8e665c640 1 -- 172.21.15.87:0/4273125698 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e00ce640 con 0x7ff8e0153c70 2023-12-16T20:21:25.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.005+0000 7ff8e665c640 1 -- 172.21.15.87:0/4273125698 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e01efbd0 con 0x7ff8e0153c70 2023-12-16T20:21:25.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.006+0000 7ff8e665c640 1 -- 172.21.15.87:0/4273125698 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e0067500 con 0x7ff8e0153c70 2023-12-16T20:21:25.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.289+0000 7ff8dcff9640 1 -- 172.21.15.87:0/4273125698 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d800f040 con 0x7ff8e0153c70 2023-12-16T20:21:25.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.289+0000 7ff8dcff9640 1 -- 172.21.15.87:0/4273125698 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d80147e0 con 0x7ff8e0153c70 2023-12-16T20:21:25.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.291+0000 7ff8dcff9640 1 -- 172.21.15.87:0/4273125698 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 4) v1 ==== 89177+0+0 (secure 0 0 0) 0x7ff8d8014980 con 0x7ff8e0153c70 2023-12-16T20:21:25.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.291+0000 7ff8dcff9640 1 --2- 172.21.15.87:0/4273125698 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff8cc06adb0 0x7ff8cc06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:25.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.291+0000 7ff8dffff640 1 --2- 172.21.15.87:0/4273125698 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff8cc06adb0 0x7ff8cc06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:25.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.292+0000 7ff8dffff640 1 --2- 172.21.15.87:0/4273125698 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff8cc06adb0 0x7ff8cc06d270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0005880 tx=0x7ff8d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:25.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.296+0000 7ff8dcff9640 1 -- 172.21.15.87:0/4273125698 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff8d8059730 con 0x7ff8e0153c70 2023-12-16T20:21:25.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.315+0000 7ff8dcff9640 1 -- 172.21.15.87:0/4273125698 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ff8d8055a70 con 0x7ff8e0153c70 2023-12-16T20:21:25.751 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.750+0000 7ff8e665c640 1 -- 172.21.15.87:0/4273125698 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8e00cb6d0 con 0x7ff8e0153c70 2023-12-16T20:21:25.771 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.770+0000 7ff8dcff9640 1 -- 172.21.15.87:0/4273125698 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7ff8d8059090 con 0x7ff8e0153c70 2023-12-16T20:21:25.771 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:21:25.771 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-12-16T20:21:25.771 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 1 2023-12-16T20:21:25.773 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.772+0000 7ff8e665c640 1 -- 172.21.15.87:0/4273125698 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff8cc06adb0 msgr2=0x7ff8cc06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:25.773 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.772+0000 7ff8e665c640 1 --2- 172.21.15.87:0/4273125698 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff8cc06adb0 0x7ff8cc06d270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0005880 tx=0x7ff8d0009040 comp rx=0 tx=0).stop 2023-12-16T20:21:25.773 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.772+0000 7ff8e665c640 1 -- 172.21.15.87:0/4273125698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e0153c70 msgr2=0x7ff8e013f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:25.773 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.772+0000 7ff8e665c640 1 --2- 172.21.15.87:0/4273125698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e0153c70 0x7ff8e013f9e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009d90 tx=0x7ff8d800c490 comp rx=0 tx=0).stop 2023-12-16T20:21:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.772+0000 7ff8e665c640 1 -- 172.21.15.87:0/4273125698 shutdown_connections 2023-12-16T20:21:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.772+0000 7ff8e665c640 1 --2- 172.21.15.87:0/4273125698 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff8cc06adb0 0x7ff8cc06d270 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.772+0000 7ff8e665c640 1 --2- 172.21.15.87:0/4273125698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e0153c70 0x7ff8e013f9e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.772+0000 7ff8e665c640 1 --2- 172.21.15.87:0/4273125698 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e0153890 0x7ff8e015b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.772+0000 7ff8e665c640 1 --2- 172.21.15.87:0/4273125698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8e00ceef0 0x7ff8e00ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.772+0000 7ff8e665c640 1 -- 172.21.15.87:0/4273125698 >> 172.21.15.87:0/4273125698 conn(0x7ff8e006ba00 msgr2=0x7ff8e015c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.772+0000 7ff8e665c640 1 -- 172.21.15.87:0/4273125698 shutdown_connections 2023-12-16T20:21:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:25.772+0000 7ff8e665c640 1 -- 172.21.15.87:0/4273125698 wait complete. 2023-12-16T20:21:27.786 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T20:21:27.843 INFO:tasks.ceph.mds.e.smithi087.stdout:starting mds.e at 2023-12-16T20:21:27.908 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.905+0000 7f0e3225c640 1 Processor -- start 2023-12-16T20:21:27.908 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.905+0000 7f0e3225c640 1 -- start start 2023-12-16T20:21:27.908 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.906+0000 7f0e3225c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0e2c153640 0x7f0e2c153a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:27.908 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.906+0000 7f0e3225c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e2c0c4810 0x7f0e2c0c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:27.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.906+0000 7f0e3225c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e2c06bba0 con 0x7f0e2c0c4210 2023-12-16T20:21:27.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.906+0000 7f0e3225c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e2c06be60 con 0x7f0e2c153640 2023-12-16T20:21:27.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.906+0000 7f0e3225c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c06c140 con 0x7f0e2c0c4810 2023-12-16T20:21:27.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.907+0000 7f0e2affd640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f0e2c0c4210 0x7f0e2c15a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:41718/0 (socket says 172.21.15.87:41718) 2023-12-16T20:21:27.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.907+0000 7f0e2affd640 1 -- 172.21.15.87:0/2251356615 learned_addr learned my addr 172.21.15.87:0/2251356615 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:27.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.907+0000 7f0e2b7fe640 1 --2- 172.21.15.87:0/2251356615 >> v2:172.21.15.87:3300/0 conn(0x7f0e2c153640 0x7f0e2c153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:27.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.909+0000 7f0e2a7fc640 1 -- 172.21.15.87:0/2251356615 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555797422 0 0) 0x7f0e2c06bba0 con 0x7f0e2c0c4210 2023-12-16T20:21:27.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.909+0000 7f0e2a7fc640 1 -- 172.21.15.87:0/2251356615 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e14003520 con 0x7f0e2c0c4210 2023-12-16T20:21:27.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.911+0000 7f0e2b7fe640 1 -- 172.21.15.87:0/2251356615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e2c0c4810 msgr2=0x7f0e2c0c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:27.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.911+0000 7f0e2b7fe640 1 --2- 172.21.15.87:0/2251356615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e2c0c4810 0x7f0e2c0c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:27.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.911+0000 7f0e2b7fe640 1 -- 172.21.15.87:0/2251356615 >> v1:172.21.15.195:6789/0 conn(0x7f0e2c0c4210 legacy=0x7f0e2c15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:27.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.911+0000 7f0e2b7fe640 1 -- 172.21.15.87:0/2251356615 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c06c420 con 0x7f0e2c153640 2023-12-16T20:21:27.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.914+0000 7f0e2b7fe640 1 --2- 172.21.15.87:0/2251356615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e2c153640 0x7f0e2c153a20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0097a0 tx=0x7f0e1c02b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ded46dc31d9c200 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:27.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.918+0000 7f0e2a7fc640 1 -- 172.21.15.87:0/2251356615 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c030800 con 0x7f0e2c153640 2023-12-16T20:21:27.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.918+0000 7f0e2a7fc640 1 -- 172.21.15.87:0/2251356615 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1c030960 con 0x7f0e2c153640 2023-12-16T20:21:27.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.918+0000 7f0e2a7fc640 1 -- 172.21.15.87:0/2251356615 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c030cf0 con 0x7f0e2c153640 2023-12-16T20:21:27.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.919+0000 7f0e3225c640 1 -- 172.21.15.87:0/2251356615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e2c153640 msgr2=0x7f0e2c153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:27.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.919+0000 7f0e3225c640 1 --2- 172.21.15.87:0/2251356615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e2c153640 0x7f0e2c153a20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0097a0 tx=0x7f0e1c02b940 comp rx=0 tx=0).stop 2023-12-16T20:21:27.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.919+0000 7f0e3225c640 1 -- 172.21.15.87:0/2251356615 shutdown_connections 2023-12-16T20:21:27.921 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.919+0000 7f0e3225c640 1 --2- 172.21.15.87:0/2251356615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e2c0c4810 0x7f0e2c0c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:27.921 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.919+0000 7f0e3225c640 1 --2- 172.21.15.87:0/2251356615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e2c153640 0x7f0e2c153a20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:27.921 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.919+0000 7f0e3225c640 1 -- 172.21.15.87:0/2251356615 >> 172.21.15.87:0/2251356615 conn(0x7f0e2c08b610 msgr2=0x7f0e2c060f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:27.921 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.919+0000 7f0e3225c640 1 -- 172.21.15.87:0/2251356615 shutdown_connections 2023-12-16T20:21:27.921 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.919+0000 7f0e3225c640 1 -- 172.21.15.87:0/2251356615 wait complete. 2023-12-16T20:21:27.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.921+0000 7f0e3225c640 1 Processor -- start 2023-12-16T20:21:27.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.921+0000 7f0e3225c640 1 -- start start 2023-12-16T20:21:27.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.922+0000 7f0e3225c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e2c0c4210 0x7f0e2c0c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:27.925 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.922+0000 7f0e3225c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e2c0c4810 0x7f0e2c157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:27.925 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.922+0000 7f0e3225c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e2c153640 0x7f0e2c1ef990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:27.925 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.923+0000 7f0e3225c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c1ef500 con 0x7f0e2c0c4810 2023-12-16T20:21:27.925 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.923+0000 7f0e3225c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c1eeed0 con 0x7f0e2c0c4210 2023-12-16T20:21:27.925 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.923+0000 7f0e2b7fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e2c0c4210 0x7f0e2c0c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:27.925 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.923+0000 7f0e3225c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c159da0 con 0x7f0e2c153640 2023-12-16T20:21:27.925 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.923+0000 7f0e2affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e2c0c4810 0x7f0e2c157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:27.925 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.923+0000 7f0e2b7fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e2c0c4210 0x7f0e2c0c7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:60270/0 (socket says 172.21.15.87:60270) 2023-12-16T20:21:27.925 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.923+0000 7f0e2b7fe640 1 -- 172.21.15.87:0/351665744 learned_addr learned my addr 172.21.15.87:0/351665744 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:27.928 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.927+0000 7f0e2b7fe640 1 -- 172.21.15.87:0/351665744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e2c153640 msgr2=0x7f0e2c1ef990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:27.928 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.927+0000 7f0e2b7fe640 1 --2- 172.21.15.87:0/351665744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e2c153640 0x7f0e2c1ef990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:27.928 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.927+0000 7f0e2b7fe640 1 -- 172.21.15.87:0/351665744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e2c0c4810 msgr2=0x7f0e2c157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:27.928 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.927+0000 7f0e2b7fe640 1 --2- 172.21.15.87:0/351665744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e2c0c4810 0x7f0e2c157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:27.928 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.927+0000 7f0e2b7fe640 1 -- 172.21.15.87:0/351665744 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1c009400 con 0x7f0e2c0c4210 2023-12-16T20:21:27.930 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.929+0000 7f0e2b7fe640 1 --2- 172.21.15.87:0/351665744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e2c0c4210 0x7f0e2c0c7ff0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0098c0 tx=0x7f0e1c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:27.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.932+0000 7f0e13fff640 1 -- 172.21.15.87:0/351665744 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c03e040 con 0x7f0e2c0c4210 2023-12-16T20:21:27.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.933+0000 7f0e13fff640 1 -- 172.21.15.87:0/351665744 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1c039cb0 con 0x7f0e2c0c4210 2023-12-16T20:21:27.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.933+0000 7f0e3225c640 1 -- 172.21.15.87:0/351665744 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e2c15a080 con 0x7f0e2c0c4210 2023-12-16T20:21:27.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.933+0000 7f0e3225c640 1 -- 172.21.15.87:0/351665744 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e2c1ef190 con 0x7f0e2c0c4210 2023-12-16T20:21:27.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.933+0000 7f0e13fff640 1 -- 172.21.15.87:0/351665744 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c044630 con 0x7f0e2c0c4210 2023-12-16T20:21:27.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.934+0000 7f0e3225c640 1 -- 172.21.15.87:0/351665744 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e2c0740e0 con 0x7f0e2c0c4210 2023-12-16T20:21:27.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.964+0000 7f0e13fff640 1 -- 172.21.15.87:0/351665744 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f0e1c04d3b0 con 0x7f0e2c0c4210 2023-12-16T20:21:27.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.964+0000 7f0e13fff640 1 --2- 172.21.15.87:0/351665744 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0e1806ae90 0x7f0e1806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:27.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.965+0000 7f0e2affd640 1 --2- 172.21.15.87:0/351665744 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0e1806ae90 0x7f0e1806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:27.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.965+0000 7f0e2affd640 1 --2- 172.21.15.87:0/351665744 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0e1806ae90 0x7f0e1806d350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0c6330 tx=0x7f0e20007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:27.971 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:27.970+0000 7f0e13fff640 1 -- 172.21.15.87:0/351665744 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0e1c039e20 con 0x7f0e2c0c4210 2023-12-16T20:21:28.032 INFO:tasks.ceph.mds.c.smithi087.stdout:starting mds.c at 2023-12-16T20:21:28.040 INFO:tasks.ceph.mds.a.smithi087.stdout:starting mds.a at 2023-12-16T20:21:28.073 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2023-12-16T20:21:28.185 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2023-12-16T20:21:28.196 INFO:tasks.ceph.mds.f.smithi195.stdout:starting mds.f at 2023-12-16T20:21:28.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:28.314+0000 7f0e13fff640 1 -- 172.21.15.87:0/351665744 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f0e1c077360 con 0x7f0e2c0c4210 2023-12-16T20:21:28.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:28.573+0000 7f0e3225c640 1 -- 172.21.15.87:0/351665744 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e2c06d260 con 0x7f0e2c0c4210 2023-12-16T20:21:28.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:28.674+0000 7f0e13fff640 1 -- 172.21.15.87:0/351665744 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f0e1c07a980 con 0x7f0e2c0c4210 2023-12-16T20:21:28.676 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:21:28.676 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2198156124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2198156124},{"type":"v1","addr":"172.21.15.87:6835","nonce":2198156124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-16T20:21:28.677 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 2 2023-12-16T20:21:28.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:28.677+0000 7f0e3225c640 1 -- 172.21.15.87:0/351665744 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0e1806ae90 msgr2=0x7f0e1806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:28.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:28.677+0000 7f0e3225c640 1 --2- 172.21.15.87:0/351665744 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0e1806ae90 0x7f0e1806d350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0c6330 tx=0x7f0e20007d60 comp rx=0 tx=0).stop 2023-12-16T20:21:28.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:28.677+0000 7f0e3225c640 1 -- 172.21.15.87:0/351665744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e2c0c4210 msgr2=0x7f0e2c0c7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:28.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:28.677+0000 7f0e3225c640 1 --2- 172.21.15.87:0/351665744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e2c0c4210 0x7f0e2c0c7ff0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0098c0 tx=0x7f0e1c004730 comp rx=0 tx=0).stop 2023-12-16T20:21:28.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:28.677+0000 7f0e3225c640 1 -- 172.21.15.87:0/351665744 shutdown_connections 2023-12-16T20:21:28.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:28.677+0000 7f0e3225c640 1 --2- 172.21.15.87:0/351665744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e2c153640 0x7f0e2c1ef990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:28.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:28.677+0000 7f0e3225c640 1 --2- 172.21.15.87:0/351665744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e2c0c4810 0x7f0e2c157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:28.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:28.677+0000 7f0e3225c640 1 --2- 172.21.15.87:0/351665744 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0e1806ae90 0x7f0e1806d350 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:28.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:28.677+0000 7f0e3225c640 1 --2- 172.21.15.87:0/351665744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e2c0c4210 0x7f0e2c0c7ff0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:28.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:28.677+0000 7f0e3225c640 1 -- 172.21.15.87:0/351665744 >> 172.21.15.87:0/351665744 conn(0x7f0e2c08b610 msgr2=0x7f0e2c0c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:28.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:28.677+0000 7f0e3225c640 1 -- 172.21.15.87:0/351665744 shutdown_connections 2023-12-16T20:21:28.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:28.677+0000 7f0e3225c640 1 -- 172.21.15.87:0/351665744 wait complete. 2023-12-16T20:21:30.690 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T20:21:30.794 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.791+0000 7f8e70d43640 1 Processor -- start 2023-12-16T20:21:30.794 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.791+0000 7f8e70d43640 1 -- start start 2023-12-16T20:21:30.794 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.792+0000 7f8e70d43640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8e6c153900 0x7f8e6c0c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:30.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.792+0000 7f8e70d43640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8e6c0c9360 0x7f8e6c0ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:30.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.792+0000 7f8e70d43640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e6c15a650 con 0x7f8e6c159660 2023-12-16T20:21:30.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.792+0000 7f8e70d43640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e6c15ce10 con 0x7f8e6c0c9360 2023-12-16T20:21:30.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.792+0000 7f8e70d43640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e6c06d190 con 0x7f8e6c153900 2023-12-16T20:21:30.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.807+0000 7f8e6ad9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8e6c0c9360 0x7f8e6c0ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:30.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.807+0000 7f8e69d9b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8e6c159660 0x7f8e6c15d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51132/0 (socket says 172.21.15.87:51132) 2023-12-16T20:21:30.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.807+0000 7f8e69d9b640 1 -- 172.21.15.87:0/630249236 learned_addr learned my addr 172.21.15.87:0/630249236 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:30.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.811+0000 7f8e6a59c640 1 --2- 172.21.15.87:0/630249236 >> v2:172.21.15.195:3300/0 conn(0x7f8e6c153900 0x7f8e6c0c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:30.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.812+0000 7f8e6ad9d640 1 -- 172.21.15.87:0/630249236 >> v2:172.21.15.195:3300/0 conn(0x7f8e6c153900 msgr2=0x7f8e6c0c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:30.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.812+0000 7f8e6ad9d640 1 --2- 172.21.15.87:0/630249236 >> v2:172.21.15.195:3300/0 conn(0x7f8e6c153900 0x7f8e6c0c9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:30.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.812+0000 7f8e6ad9d640 1 -- 172.21.15.87:0/630249236 >> v1:172.21.15.87:6789/0 conn(0x7f8e6c159660 legacy=0x7f8e6c15d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:30.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.812+0000 7f8e6ad9d640 1 -- 172.21.15.87:0/630249236 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c159af0 con 0x7f8e6c0c9360 2023-12-16T20:21:30.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.816+0000 7f8e6ad9d640 1 --2- 172.21.15.87:0/630249236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e6c0c9360 0x7f8e6c0ca080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c06ed60 tx=0x7f8e6402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5dc29f61b4a0a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:30.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.823+0000 7f8e6959a640 1 -- 172.21.15.87:0/630249236 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6402cc80 con 0x7f8e6c0c9360 2023-12-16T20:21:30.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.824+0000 7f8e6959a640 1 -- 172.21.15.87:0/630249236 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6402cde0 con 0x7f8e6c0c9360 2023-12-16T20:21:30.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.824+0000 7f8e6959a640 1 -- 172.21.15.87:0/630249236 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64034660 con 0x7f8e6c0c9360 2023-12-16T20:21:30.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.824+0000 7f8e70d43640 1 -- 172.21.15.87:0/630249236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e6c0c9360 msgr2=0x7f8e6c0ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:30.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.824+0000 7f8e70d43640 1 --2- 172.21.15.87:0/630249236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e6c0c9360 0x7f8e6c0ca080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c06ed60 tx=0x7f8e6402bed0 comp rx=0 tx=0).stop 2023-12-16T20:21:30.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.824+0000 7f8e70d43640 1 -- 172.21.15.87:0/630249236 shutdown_connections 2023-12-16T20:21:30.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.824+0000 7f8e70d43640 1 --2- 172.21.15.87:0/630249236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e6c0c9360 0x7f8e6c0ca080 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:30.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.824+0000 7f8e70d43640 1 --2- 172.21.15.87:0/630249236 >> v2:172.21.15.195:3300/0 conn(0x7f8e6c153900 0x7f8e6c0c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:30.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.824+0000 7f8e70d43640 1 -- 172.21.15.87:0/630249236 >> 172.21.15.87:0/630249236 conn(0x7f8e6c061100 msgr2=0x7f8e6c0614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:30.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.824+0000 7f8e70d43640 1 -- 172.21.15.87:0/630249236 shutdown_connections 2023-12-16T20:21:30.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.824+0000 7f8e70d43640 1 -- 172.21.15.87:0/630249236 wait complete. 2023-12-16T20:21:30.828 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.826+0000 7f8e70d43640 1 Processor -- start 2023-12-16T20:21:30.828 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.826+0000 7f8e70d43640 1 -- start start 2023-12-16T20:21:30.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.827+0000 7f8e70d43640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e6c0c9360 0x7f8e6c1e36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:30.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.827+0000 7f8e70d43640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e6c153900 0x7f8e6c15c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:30.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.827+0000 7f8e70d43640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e6c0b1d50 0x7f8e6c14e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:30.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.827+0000 7f8e70d43640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c15b310 con 0x7f8e6c153900 2023-12-16T20:21:30.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.827+0000 7f8e70d43640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c15bb30 con 0x7f8e6c0b1d50 2023-12-16T20:21:30.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.827+0000 7f8e70d43640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c1f2af0 con 0x7f8e6c0c9360 2023-12-16T20:21:30.830 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.827+0000 7f8e69d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e6c153900 0x7f8e6c15c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:30.830 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.827+0000 7f8e6ad9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e6c0b1d50 0x7f8e6c14e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:30.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.827+0000 7f8e6a59c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e6c0c9360 0x7f8e6c1e36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:30.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.828+0000 7f8e69d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e6c153900 0x7f8e6c15c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44686/0 (socket says 172.21.15.87:44686) 2023-12-16T20:21:30.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.828+0000 7f8e69d9b640 1 -- 172.21.15.87:0/591305797 learned_addr learned my addr 172.21.15.87:0/591305797 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:30.833 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.831+0000 7f8e6ad9d640 1 -- 172.21.15.87:0/591305797 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e6c0c9360 msgr2=0x7f8e6c1e36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:30.833 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.831+0000 7f8e6ad9d640 1 --2- 172.21.15.87:0/591305797 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e6c0c9360 0x7f8e6c1e36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:30.833 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.831+0000 7f8e6ad9d640 1 -- 172.21.15.87:0/591305797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e6c153900 msgr2=0x7f8e6c15c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:30.833 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.831+0000 7f8e6ad9d640 1 --2- 172.21.15.87:0/591305797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e6c153900 0x7f8e6c15c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:30.833 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.831+0000 7f8e6ad9d640 1 -- 172.21.15.87:0/591305797 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e64009a70 con 0x7f8e6c0b1d50 2023-12-16T20:21:30.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.833+0000 7f8e6ad9d640 1 --2- 172.21.15.87:0/591305797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e6c0b1d50 0x7f8e6c14e8e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c06e820 tx=0x7f8e64004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:30.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.837+0000 7f8e5affd640 1 -- 172.21.15.87:0/591305797 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6403e610 con 0x7f8e6c0b1d50 2023-12-16T20:21:30.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.837+0000 7f8e5affd640 1 -- 172.21.15.87:0/591305797 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6403e770 con 0x7f8e6c0b1d50 2023-12-16T20:21:30.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.837+0000 7f8e70d43640 1 -- 172.21.15.87:0/591305797 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6c15a820 con 0x7f8e6c0b1d50 2023-12-16T20:21:30.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.837+0000 7f8e5affd640 1 -- 172.21.15.87:0/591305797 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6403eb20 con 0x7f8e6c0b1d50 2023-12-16T20:21:30.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.837+0000 7f8e70d43640 1 -- 172.21.15.87:0/591305797 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6c15ad50 con 0x7f8e6c0b1d50 2023-12-16T20:21:30.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:30.838+0000 7f8e70d43640 1 -- 172.21.15.87:0/591305797 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e6c151d70 con 0x7f8e6c0b1d50 2023-12-16T20:21:31.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.078+0000 7f8e5affd640 1 -- 172.21.15.87:0/591305797 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f8e6403b050 con 0x7f8e6c0b1d50 2023-12-16T20:21:31.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.078+0000 7f8e5affd640 1 --2- 172.21.15.87:0/591305797 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8e4c06ae90 0x7f8e4c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:31.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.078+0000 7f8e6a59c640 1 --2- 172.21.15.87:0/591305797 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8e4c06ae90 0x7f8e4c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:31.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.079+0000 7f8e6a59c640 1 --2- 172.21.15.87:0/591305797 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8e4c06ae90 0x7f8e4c06d350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c00aa20 tx=0x7f8e5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:31.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.081+0000 7f8e5affd640 1 -- 172.21.15.87:0/591305797 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8e6407b110 con 0x7f8e6c0b1d50 2023-12-16T20:21:31.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.091+0000 7f8e5affd640 1 -- 172.21.15.87:0/591305797 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f8e64077450 con 0x7f8e6c0b1d50 2023-12-16T20:21:31.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.293+0000 7f8e70d43640 1 -- 172.21.15.87:0/591305797 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e6c06ca60 con 0x7f8e6c0b1d50 2023-12-16T20:21:31.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.305+0000 7f8e5affd640 1 -- 172.21.15.87:0/591305797 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5283 (secure 0 0 0) 0x7f8e6404e070 con 0x7f8e6c0b1d50 2023-12-16T20:21:31.307 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:21:31.308 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2198156124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2198156124},{"type":"v1","addr":"172.21.15.87:6835","nonce":2198156124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3187160209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3187160209},{"type":"v1","addr":"172.21.15.195:6833","nonce":3187160209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3703236183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":3703236183},{"type":"v1","addr":"172.21.15.87:6837","nonce":3703236183}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1942743723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1942743723},{"type":"v1","addr":"172.21.15.87:6839","nonce":1942743723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/3327792325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3327792325},{"type":"v1","addr":"172.21.15.195:6836","nonce":3327792325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3093855583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3093855583},{"type":"v1","addr":"172.21.15.195:6837","nonce":3093855583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-16T20:21:31.310 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 3 2023-12-16T20:21:31.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.306+0000 7f8e70d43640 1 -- 172.21.15.87:0/591305797 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8e4c06ae90 msgr2=0x7f8e4c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:31.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.306+0000 7f8e70d43640 1 --2- 172.21.15.87:0/591305797 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8e4c06ae90 0x7f8e4c06d350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c00aa20 tx=0x7f8e5c008040 comp rx=0 tx=0).stop 2023-12-16T20:21:31.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.306+0000 7f8e70d43640 1 -- 172.21.15.87:0/591305797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e6c0b1d50 msgr2=0x7f8e6c14e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:31.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.306+0000 7f8e70d43640 1 --2- 172.21.15.87:0/591305797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e6c0b1d50 0x7f8e6c14e8e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c06e820 tx=0x7f8e64004a40 comp rx=0 tx=0).stop 2023-12-16T20:21:31.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.306+0000 7f8e70d43640 1 -- 172.21.15.87:0/591305797 shutdown_connections 2023-12-16T20:21:31.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.306+0000 7f8e70d43640 1 --2- 172.21.15.87:0/591305797 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8e4c06ae90 0x7f8e4c06d350 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:31.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.306+0000 7f8e70d43640 1 --2- 172.21.15.87:0/591305797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e6c0b1d50 0x7f8e6c14e8e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:31.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.306+0000 7f8e70d43640 1 --2- 172.21.15.87:0/591305797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e6c153900 0x7f8e6c15c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:31.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.306+0000 7f8e70d43640 1 --2- 172.21.15.87:0/591305797 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e6c0c9360 0x7f8e6c1e36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:31.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.306+0000 7f8e70d43640 1 -- 172.21.15.87:0/591305797 >> 172.21.15.87:0/591305797 conn(0x7f8e6c061100 msgr2=0x7f8e6c06f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:31.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.306+0000 7f8e70d43640 1 -- 172.21.15.87:0/591305797 shutdown_connections 2023-12-16T20:21:31.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.306+0000 7f8e70d43640 1 -- 172.21.15.87:0/591305797 wait complete. 2023-12-16T20:21:31.320 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:21:31.421 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.419+0000 7f95bb47c640 1 Processor -- start 2023-12-16T20:21:31.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.419+0000 7f95bb47c640 1 -- start start 2023-12-16T20:21:31.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.420+0000 7f95bb47c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f95b40728b0 0x7f95b40c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:31.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.420+0000 7f95bb47c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95b40c5fd0 0x7f95b4161c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:31.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.420+0000 7f95bb47c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b415b6e0 con 0x7f95b4151510 2023-12-16T20:21:31.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.420+0000 7f95bb47c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b415a880 con 0x7f95b40728b0 2023-12-16T20:21:31.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.420+0000 7f95bb47c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40c6480 con 0x7f95b40c5fd0 2023-12-16T20:21:31.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.421+0000 7f95b8a17640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f95b40728b0 0x7f95b40c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:31.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.421+0000 7f95b9a19640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95b40c5fd0 0x7f95b4161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:31.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.421+0000 7f95b9218640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f95b4151510 0x7f95b40cae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51136/0 (socket says 172.21.15.87:51136) 2023-12-16T20:21:31.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.421+0000 7f95b9218640 1 -- 172.21.15.87:0/2795244966 learned_addr learned my addr 172.21.15.87:0/2795244966 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:31.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.423+0000 7f95b9a19640 1 -- 172.21.15.87:0/2795244966 >> v2:172.21.15.87:3300/0 conn(0x7f95b40728b0 msgr2=0x7f95b40c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:31.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.423+0000 7f95b9a19640 1 --2- 172.21.15.87:0/2795244966 >> v2:172.21.15.87:3300/0 conn(0x7f95b40728b0 0x7f95b40c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:31.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.423+0000 7f95b9a19640 1 -- 172.21.15.87:0/2795244966 >> v1:172.21.15.87:6789/0 conn(0x7f95b4151510 legacy=0x7f95b40cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:31.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.423+0000 7f95b9a19640 1 -- 172.21.15.87:0/2795244966 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b406f7e0 con 0x7f95b40c5fd0 2023-12-16T20:21:31.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.425+0000 7f95b9a19640 1 --2- 172.21.15.87:0/2795244966 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95b40c5fd0 0x7f95b4161c10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0097a0 tx=0x7f95ac02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a22d403508f261dd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:31.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.428+0000 7f95abfff640 1 -- 172.21.15.87:0/2795244966 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac031830 con 0x7f95b40c5fd0 2023-12-16T20:21:31.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.428+0000 7f95abfff640 1 -- 172.21.15.87:0/2795244966 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac031990 con 0x7f95b40c5fd0 2023-12-16T20:21:31.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.428+0000 7f95abfff640 1 -- 172.21.15.87:0/2795244966 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac031d20 con 0x7f95b40c5fd0 2023-12-16T20:21:31.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.429+0000 7f95bb47c640 1 -- 172.21.15.87:0/2795244966 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95b40c5fd0 msgr2=0x7f95b4161c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:31.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.429+0000 7f95bb47c640 1 --2- 172.21.15.87:0/2795244966 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95b40c5fd0 0x7f95b4161c10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0097a0 tx=0x7f95ac02b8d0 comp rx=0 tx=0).stop 2023-12-16T20:21:31.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.429+0000 7f95bb47c640 1 -- 172.21.15.87:0/2795244966 shutdown_connections 2023-12-16T20:21:31.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.429+0000 7f95bb47c640 1 --2- 172.21.15.87:0/2795244966 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95b40c5fd0 0x7f95b4161c10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:31.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.429+0000 7f95bb47c640 1 --2- 172.21.15.87:0/2795244966 >> v2:172.21.15.87:3300/0 conn(0x7f95b40728b0 0x7f95b40c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:31.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.429+0000 7f95bb47c640 1 -- 172.21.15.87:0/2795244966 >> 172.21.15.87:0/2795244966 conn(0x7f95b406cd60 msgr2=0x7f95b406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:31.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.429+0000 7f95bb47c640 1 -- 172.21.15.87:0/2795244966 shutdown_connections 2023-12-16T20:21:31.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.429+0000 7f95bb47c640 1 -- 172.21.15.87:0/2795244966 wait complete. 2023-12-16T20:21:31.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.430+0000 7f95bb47c640 1 Processor -- start 2023-12-16T20:21:31.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.431+0000 7f95bb47c640 1 -- start start 2023-12-16T20:21:31.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.431+0000 7f95bb47c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95b40728b0 0x7f95b41f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:31.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.431+0000 7f95bb47c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95b40c5fd0 0x7f95b4159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:31.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.431+0000 7f95bb47c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95b4151510 0x7f95b41ed4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:31.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.431+0000 7f95bb47c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b41ed020 con 0x7f95b40c5fd0 2023-12-16T20:21:31.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.431+0000 7f95bb47c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b41f10d0 con 0x7f95b4151510 2023-12-16T20:21:31.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.431+0000 7f95bb47c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b4158090 con 0x7f95b40728b0 2023-12-16T20:21:31.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.432+0000 7f95b8a17640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95b40c5fd0 0x7f95b4159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:31.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.432+0000 7f95b9218640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95b40728b0 0x7f95b41f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:31.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.432+0000 7f95b8a17640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95b40c5fd0 0x7f95b4159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44712/0 (socket says 172.21.15.87:44712) 2023-12-16T20:21:31.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.432+0000 7f95b8a17640 1 -- 172.21.15.87:0/1748899670 learned_addr learned my addr 172.21.15.87:0/1748899670 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:31.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.432+0000 7f95b9a19640 1 --2- 172.21.15.87:0/1748899670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95b4151510 0x7f95b41ed4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:31.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.435+0000 7f95b9218640 1 -- 172.21.15.87:0/1748899670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95b4151510 msgr2=0x7f95b41ed4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:31.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.435+0000 7f95b9218640 1 --2- 172.21.15.87:0/1748899670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95b4151510 0x7f95b41ed4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:31.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.435+0000 7f95b9218640 1 -- 172.21.15.87:0/1748899670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95b40c5fd0 msgr2=0x7f95b4159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:31.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.435+0000 7f95b9218640 1 --2- 172.21.15.87:0/1748899670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95b40c5fd0 0x7f95b4159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:31.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.435+0000 7f95b9218640 1 -- 172.21.15.87:0/1748899670 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac009400 con 0x7f95b40728b0 2023-12-16T20:21:31.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.437+0000 7f95b9218640 1 --2- 172.21.15.87:0/1748899670 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95b40728b0 0x7f95b41f0b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f95b000caa0 tx=0x7f95b000cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:31.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.441+0000 7f95a9ffb640 1 -- 172.21.15.87:0/1748899670 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b000ab40 con 0x7f95b40728b0 2023-12-16T20:21:31.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.441+0000 7f95a9ffb640 1 -- 172.21.15.87:0/1748899670 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b000aca0 con 0x7f95b40728b0 2023-12-16T20:21:31.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.441+0000 7f95a9ffb640 1 -- 172.21.15.87:0/1748899670 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b0012620 con 0x7f95b40728b0 2023-12-16T20:21:31.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.441+0000 7f95bb47c640 1 -- 172.21.15.87:0/1748899670 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b40cab70 con 0x7f95b40728b0 2023-12-16T20:21:31.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.441+0000 7f95bb47c640 1 -- 172.21.15.87:0/1748899670 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b40ca820 con 0x7f95b40728b0 2023-12-16T20:21:31.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.442+0000 7f95bb47c640 1 -- 172.21.15.87:0/1748899670 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b40cb6d0 con 0x7f95b40728b0 2023-12-16T20:21:31.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.460+0000 7f95a9ffb640 1 -- 172.21.15.87:0/1748899670 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f95b0007070 con 0x7f95b40728b0 2023-12-16T20:21:31.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.460+0000 7f95a9ffb640 1 --2- 172.21.15.87:0/1748899670 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f959806ae90 0x7f959806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:31.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.460+0000 7f95b8a17640 1 --2- 172.21.15.87:0/1748899670 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f959806ae90 0x7f959806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:31.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.461+0000 7f95b8a17640 1 --2- 172.21.15.87:0/1748899670 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f959806ae90 0x7f959806d350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f95b4154ef0 tx=0x7f95a4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:31.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.463+0000 7f95a9ffb640 1 -- 172.21.15.87:0/1748899670 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f95b00586a0 con 0x7f95b40728b0 2023-12-16T20:21:31.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.696+0000 7f95a9ffb640 1 -- 172.21.15.87:0/1748899670 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f95b00549e0 con 0x7f95b40728b0 2023-12-16T20:21:31.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.867+0000 7f95bb47c640 1 -- 172.21.15.87:0/1748899670 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95b4067500 con 0x7f95b40728b0 2023-12-16T20:21:31.986 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.983+0000 7f95a9ffb640 1 -- 172.21.15.87:0/1748899670 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f95b0017070 con 0x7f95b40728b0 2023-12-16T20:21:31.986 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:21:31.986 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":17,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:21:26.326841+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:21:22.654341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:21:31.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.985+0000 7f95bb47c640 1 -- 172.21.15.87:0/1748899670 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f959806ae90 msgr2=0x7f959806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:31.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.985+0000 7f95bb47c640 1 --2- 172.21.15.87:0/1748899670 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f959806ae90 0x7f959806d350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f95b4154ef0 tx=0x7f95a4009190 comp rx=0 tx=0).stop 2023-12-16T20:21:31.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.985+0000 7f95bb47c640 1 -- 172.21.15.87:0/1748899670 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95b40728b0 msgr2=0x7f95b41f0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:31.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.985+0000 7f95bb47c640 1 --2- 172.21.15.87:0/1748899670 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95b40728b0 0x7f95b41f0b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f95b000caa0 tx=0x7f95b000cea0 comp rx=0 tx=0).stop 2023-12-16T20:21:31.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.985+0000 7f95bb47c640 1 -- 172.21.15.87:0/1748899670 shutdown_connections 2023-12-16T20:21:31.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.985+0000 7f95bb47c640 1 --2- 172.21.15.87:0/1748899670 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f959806ae90 0x7f959806d350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:31.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.985+0000 7f95bb47c640 1 --2- 172.21.15.87:0/1748899670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95b4151510 0x7f95b41ed4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:31.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.985+0000 7f95bb47c640 1 --2- 172.21.15.87:0/1748899670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95b40c5fd0 0x7f95b4159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:31.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.985+0000 7f95bb47c640 1 --2- 172.21.15.87:0/1748899670 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95b40728b0 0x7f95b41f0b90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:31.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.985+0000 7f95bb47c640 1 -- 172.21.15.87:0/1748899670 >> 172.21.15.87:0/1748899670 conn(0x7f95b406cd60 msgr2=0x7f95b414e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:31.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.985+0000 7f95bb47c640 1 -- 172.21.15.87:0/1748899670 shutdown_connections 2023-12-16T20:21:31.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:31.985+0000 7f95bb47c640 1 -- 172.21.15.87:0/1748899670 wait complete. 2023-12-16T20:21:31.998 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T20:21:22.654341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T20:21:31.999 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T20:21:32.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.101+0000 7fb39554c640 1 Processor -- start 2023-12-16T20:21:32.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.101+0000 7fb39554c640 1 -- start start 2023-12-16T20:21:32.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.101+0000 7fb39554c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb390153890 0x7fb39015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:32.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.101+0000 7fb39554c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb390153c70 0x7fb3900c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:32.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.101+0000 7fb39554c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb39015a700 con 0x7fb3900ceef0 2023-12-16T20:21:32.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.101+0000 7fb39554c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3900ca870 con 0x7fb390153c70 2023-12-16T20:21:32.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.101+0000 7fb39554c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb390159af0 con 0x7fb390153890 2023-12-16T20:21:32.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.102+0000 7fb38effd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb390153890 0x7fb39015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:32.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.102+0000 7fb38effd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb390153890 0x7fb39015d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:41710/0 (socket says 172.21.15.87:41710) 2023-12-16T20:21:32.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.102+0000 7fb38effd640 1 -- 172.21.15.87:0/170688298 learned_addr learned my addr 172.21.15.87:0/170688298 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:32.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.105+0000 7fb38effd640 1 -- 172.21.15.87:0/170688298 >> v2:172.21.15.87:3300/0 conn(0x7fb390153c70 msgr2=0x7fb3900c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:32.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.105+0000 7fb38effd640 1 --2- 172.21.15.87:0/170688298 >> v2:172.21.15.87:3300/0 conn(0x7fb390153c70 0x7fb3900c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:32.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.105+0000 7fb38effd640 1 -- 172.21.15.87:0/170688298 >> v1:172.21.15.195:6789/0 conn(0x7fb3900ceef0 legacy=0x7fb39015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:32.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.105+0000 7fb38effd640 1 -- 172.21.15.87:0/170688298 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb390159dd0 con 0x7fb390153890 2023-12-16T20:21:32.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.108+0000 7fb38effd640 1 --2- 172.21.15.87:0/170688298 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb390153890 0x7fb39015d950 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb3900ccaa0 tx=0x7fb38002ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=403905b83e6a17a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:32.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.112+0000 7fb38dffb640 1 -- 172.21.15.87:0/170688298 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38002f850 con 0x7fb390153890 2023-12-16T20:21:32.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.112+0000 7fb38dffb640 1 -- 172.21.15.87:0/170688298 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38002f9b0 con 0x7fb390153890 2023-12-16T20:21:32.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.112+0000 7fb38dffb640 1 -- 172.21.15.87:0/170688298 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38002fd40 con 0x7fb390153890 2023-12-16T20:21:32.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.112+0000 7fb39554c640 1 -- 172.21.15.87:0/170688298 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb390153890 msgr2=0x7fb39015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:32.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.112+0000 7fb39554c640 1 --2- 172.21.15.87:0/170688298 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb390153890 0x7fb39015d950 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb3900ccaa0 tx=0x7fb38002ba30 comp rx=0 tx=0).stop 2023-12-16T20:21:32.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.112+0000 7fb39554c640 1 -- 172.21.15.87:0/170688298 shutdown_connections 2023-12-16T20:21:32.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.112+0000 7fb39554c640 1 --2- 172.21.15.87:0/170688298 >> v2:172.21.15.87:3300/0 conn(0x7fb390153c70 0x7fb3900c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:32.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.112+0000 7fb39554c640 1 --2- 172.21.15.87:0/170688298 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb390153890 0x7fb39015d950 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:32.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.112+0000 7fb39554c640 1 -- 172.21.15.87:0/170688298 >> 172.21.15.87:0/170688298 conn(0x7fb39006ba00 msgr2=0x7fb39006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:32.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.112+0000 7fb39554c640 1 -- 172.21.15.87:0/170688298 shutdown_connections 2023-12-16T20:21:32.116 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.112+0000 7fb39554c640 1 -- 172.21.15.87:0/170688298 wait complete. 2023-12-16T20:21:32.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.114+0000 7fb39554c640 1 Processor -- start 2023-12-16T20:21:32.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.114+0000 7fb39554c640 1 -- start start 2023-12-16T20:21:32.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.114+0000 7fb39554c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3900ceef0 0x7fb3900c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:32.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.114+0000 7fb39554c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb390153890 0x7fb3900b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:32.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.114+0000 7fb39554c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb390153c70 0x7fb3901556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:32.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.114+0000 7fb39554c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3901f33a0 con 0x7fb3900ceef0 2023-12-16T20:21:32.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.114+0000 7fb39554c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb390152bd0 con 0x7fb390153c70 2023-12-16T20:21:32.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.114+0000 7fb39554c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3901f2e40 con 0x7fb390153890 2023-12-16T20:21:32.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.115+0000 7fb38f7fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb390153c70 0x7fb3901556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:32.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.115+0000 7fb38e7fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb390153890 0x7fb3900b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:32.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.115+0000 7fb38f7fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb390153c70 0x7fb3901556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:41714/0 (socket says 172.21.15.87:41714) 2023-12-16T20:21:32.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.115+0000 7fb38f7fe640 1 -- 172.21.15.87:0/4019187263 learned_addr learned my addr 172.21.15.87:0/4019187263 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:32.121 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.118+0000 7fb38effd640 1 --2- 172.21.15.87:0/4019187263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3900ceef0 0x7fb3900c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:32.121 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.118+0000 7fb38f7fe640 1 -- 172.21.15.87:0/4019187263 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb390153890 msgr2=0x7fb3900b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:32.121 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.118+0000 7fb38f7fe640 1 --2- 172.21.15.87:0/4019187263 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb390153890 0x7fb3900b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:32.121 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.118+0000 7fb38f7fe640 1 -- 172.21.15.87:0/4019187263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3900ceef0 msgr2=0x7fb3900c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:32.121 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.118+0000 7fb38f7fe640 1 --2- 172.21.15.87:0/4019187263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3900ceef0 0x7fb3900c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:32.121 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.118+0000 7fb38f7fe640 1 -- 172.21.15.87:0/4019187263 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3800094d0 con 0x7fb390153c70 2023-12-16T20:21:32.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.121+0000 7fb38f7fe640 1 --2- 172.21.15.87:0/4019187263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb390153c70 0x7fb3901556b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb38800c6e0 tx=0x7fb38800cae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:32.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.124+0000 7fb3777fe640 1 -- 172.21.15.87:0/4019187263 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388003b70 con 0x7fb390153c70 2023-12-16T20:21:32.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.124+0000 7fb3777fe640 1 -- 172.21.15.87:0/4019187263 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb388003cd0 con 0x7fb390153c70 2023-12-16T20:21:32.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.124+0000 7fb3777fe640 1 -- 172.21.15.87:0/4019187263 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3880052f0 con 0x7fb390153c70 2023-12-16T20:21:32.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.124+0000 7fb39554c640 1 -- 172.21.15.87:0/4019187263 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3901522e0 con 0x7fb390153c70 2023-12-16T20:21:32.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.125+0000 7fb39554c640 1 -- 172.21.15.87:0/4019187263 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb390152580 con 0x7fb390153c70 2023-12-16T20:21:32.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.125+0000 7fb39554c640 1 -- 172.21.15.87:0/4019187263 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb390152d60 con 0x7fb390153c70 2023-12-16T20:21:32.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.143+0000 7fb3777fe640 1 -- 172.21.15.87:0/4019187263 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fb388005450 con 0x7fb390153c70 2023-12-16T20:21:32.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.143+0000 7fb3777fe640 1 --2- 172.21.15.87:0/4019187263 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb37c06aec0 0x7fb37c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:32.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.143+0000 7fb38effd640 1 --2- 172.21.15.87:0/4019187263 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb37c06aec0 0x7fb37c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:32.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.144+0000 7fb38effd640 1 --2- 172.21.15.87:0/4019187263 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb37c06aec0 0x7fb37c06d380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb380036000 tx=0x7fb380008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:32.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.144+0000 7fb3777fe640 1 -- 172.21.15.87:0/4019187263 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb3880591c0 con 0x7fb390153c70 2023-12-16T20:21:32.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.381+0000 7fb3777fe640 1 -- 172.21.15.87:0/4019187263 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fb388054e00 con 0x7fb390153c70 2023-12-16T20:21:32.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.550+0000 7fb39554c640 1 -- 172.21.15.87:0/4019187263 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb390067500 con 0x7fb390153c70 2023-12-16T20:21:32.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.571+0000 7fb3777fe640 1 -- 172.21.15.87:0/4019187263 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb388058420 con 0x7fb390153c70 2023-12-16T20:21:32.572 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-12-16T20:21:32.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.572+0000 7fb39554c640 1 -- 172.21.15.87:0/4019187263 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb37c06aec0 msgr2=0x7fb37c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:32.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.572+0000 7fb39554c640 1 --2- 172.21.15.87:0/4019187263 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb37c06aec0 0x7fb37c06d380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb380036000 tx=0x7fb380008030 comp rx=0 tx=0).stop 2023-12-16T20:21:32.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.572+0000 7fb39554c640 1 -- 172.21.15.87:0/4019187263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb390153c70 msgr2=0x7fb3901556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:32.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.572+0000 7fb39554c640 1 --2- 172.21.15.87:0/4019187263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb390153c70 0x7fb3901556b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb38800c6e0 tx=0x7fb38800cae0 comp rx=0 tx=0).stop 2023-12-16T20:21:32.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.572+0000 7fb39554c640 1 -- 172.21.15.87:0/4019187263 shutdown_connections 2023-12-16T20:21:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.572+0000 7fb39554c640 1 --2- 172.21.15.87:0/4019187263 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb37c06aec0 0x7fb37c06d380 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.572+0000 7fb39554c640 1 --2- 172.21.15.87:0/4019187263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb390153c70 0x7fb3901556b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.572+0000 7fb39554c640 1 --2- 172.21.15.87:0/4019187263 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb390153890 0x7fb3900b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.572+0000 7fb39554c640 1 --2- 172.21.15.87:0/4019187263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3900ceef0 0x7fb3900c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.572+0000 7fb39554c640 1 -- 172.21.15.87:0/4019187263 >> 172.21.15.87:0/4019187263 conn(0x7fb39006ba00 msgr2=0x7fb3901576a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.572+0000 7fb39554c640 1 -- 172.21.15.87:0/4019187263 shutdown_connections 2023-12-16T20:21:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.572+0000 7fb39554c640 1 -- 172.21.15.87:0/4019187263 wait complete. 2023-12-16T20:21:32.585 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-16T20:21:32.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.682+0000 7fc124a56640 1 Processor -- start 2023-12-16T20:21:32.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.682+0000 7fc124a56640 1 -- start start 2023-12-16T20:21:32.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.683+0000 7fc124a56640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc1201537d0 0x7fc12006a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:32.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.683+0000 7fc124a56640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc1200c2e40 0x7fc12006aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:32.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.683+0000 7fc124a56640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc12006e0f0 con 0x7fc12006f160 2023-12-16T20:21:32.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.683+0000 7fc124a56640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc120159710 con 0x7fc1201537d0 2023-12-16T20:21:32.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.683+0000 7fc124a56640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1200c72d0 con 0x7fc1200c2e40 2023-12-16T20:21:32.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.683+0000 7fc11ed9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc1200c2e40 0x7fc12006aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:32.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.683+0000 7fc11e59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc1201537d0 0x7fc12006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:32.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.684+0000 7fc117fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc12006f160 0x7fc120159bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51146/0 (socket says 172.21.15.87:51146) 2023-12-16T20:21:32.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.684+0000 7fc117fff640 1 -- 172.21.15.87:0/3049188182 learned_addr learned my addr 172.21.15.87:0/3049188182 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:32.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.686+0000 7fc11ed9d640 1 -- 172.21.15.87:0/3049188182 >> v2:172.21.15.87:3300/0 conn(0x7fc1201537d0 msgr2=0x7fc12006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:32.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.686+0000 7fc11ed9d640 1 --2- 172.21.15.87:0/3049188182 >> v2:172.21.15.87:3300/0 conn(0x7fc1201537d0 0x7fc12006a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:32.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.686+0000 7fc11ed9d640 1 -- 172.21.15.87:0/3049188182 >> v1:172.21.15.87:6789/0 conn(0x7fc12006f160 legacy=0x7fc120159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:32.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.686+0000 7fc11ed9d640 1 -- 172.21.15.87:0/3049188182 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1200c7590 con 0x7fc1200c2e40 2023-12-16T20:21:32.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.688+0000 7fc11ed9d640 1 --2- 172.21.15.87:0/3049188182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1200c2e40 0x7fc12006aa40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc12006ee70 tx=0x7fc11802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c67bc0c3b36d1f18 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:32.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.692+0000 7fc11dd9b640 1 -- 172.21.15.87:0/3049188182 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11802cd00 con 0x7fc1200c2e40 2023-12-16T20:21:32.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.692+0000 7fc11dd9b640 1 -- 172.21.15.87:0/3049188182 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11802ce60 con 0x7fc1200c2e40 2023-12-16T20:21:32.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.692+0000 7fc11dd9b640 1 -- 172.21.15.87:0/3049188182 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc118034660 con 0x7fc1200c2e40 2023-12-16T20:21:32.695 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.692+0000 7fc124a56640 1 -- 172.21.15.87:0/3049188182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1200c2e40 msgr2=0x7fc12006aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:32.695 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.692+0000 7fc124a56640 1 --2- 172.21.15.87:0/3049188182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1200c2e40 0x7fc12006aa40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc12006ee70 tx=0x7fc11802bf50 comp rx=0 tx=0).stop 2023-12-16T20:21:32.695 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.692+0000 7fc124a56640 1 -- 172.21.15.87:0/3049188182 shutdown_connections 2023-12-16T20:21:32.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.692+0000 7fc124a56640 1 --2- 172.21.15.87:0/3049188182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1200c2e40 0x7fc12006aa40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:32.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.692+0000 7fc124a56640 1 --2- 172.21.15.87:0/3049188182 >> v2:172.21.15.87:3300/0 conn(0x7fc1201537d0 0x7fc12006a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:32.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.692+0000 7fc124a56640 1 -- 172.21.15.87:0/3049188182 >> 172.21.15.87:0/3049188182 conn(0x7fc1200cbf60 msgr2=0x7fc1200cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:32.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.692+0000 7fc124a56640 1 -- 172.21.15.87:0/3049188182 shutdown_connections 2023-12-16T20:21:32.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.692+0000 7fc124a56640 1 -- 172.21.15.87:0/3049188182 wait complete. 2023-12-16T20:21:32.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.693+0000 7fc124a56640 1 Processor -- start 2023-12-16T20:21:32.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.693+0000 7fc124a56640 1 -- start start 2023-12-16T20:21:32.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.694+0000 7fc124a56640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc12006f160 0x7fc1201569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:32.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.694+0000 7fc124a56640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1200c2e40 0x7fc1201f3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:32.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.694+0000 7fc124a56640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1201537d0 0x7fc120157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:32.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.694+0000 7fc124a56640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1201f4500 con 0x7fc1201537d0 2023-12-16T20:21:32.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.694+0000 7fc124a56640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1201f74c0 con 0x7fc1200c2e40 2023-12-16T20:21:32.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.694+0000 7fc124a56640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1201577d0 con 0x7fc12006f160 2023-12-16T20:21:32.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.694+0000 7fc11ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1201537d0 0x7fc120157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:32.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.695+0000 7fc11ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1201537d0 0x7fc120157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44754/0 (socket says 172.21.15.87:44754) 2023-12-16T20:21:32.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.695+0000 7fc11ed9d640 1 -- 172.21.15.87:0/1344612000 learned_addr learned my addr 172.21.15.87:0/1344612000 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:32.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.695+0000 7fc11e59c640 1 --2- 172.21.15.87:0/1344612000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc12006f160 0x7fc1201569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:32.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.695+0000 7fc117fff640 1 --2- 172.21.15.87:0/1344612000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1200c2e40 0x7fc1201f3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:32.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.698+0000 7fc11ed9d640 1 -- 172.21.15.87:0/1344612000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc12006f160 msgr2=0x7fc1201569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:32.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.698+0000 7fc11ed9d640 1 --2- 172.21.15.87:0/1344612000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc12006f160 0x7fc1201569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:32.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.698+0000 7fc11ed9d640 1 -- 172.21.15.87:0/1344612000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1200c2e40 msgr2=0x7fc1201f3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:32.701 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.698+0000 7fc11ed9d640 1 --2- 172.21.15.87:0/1344612000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1200c2e40 0x7fc1201f3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:32.701 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.698+0000 7fc11ed9d640 1 -- 172.21.15.87:0/1344612000 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc118009a70 con 0x7fc1201537d0 2023-12-16T20:21:32.702 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.700+0000 7fc11ed9d640 1 --2- 172.21.15.87:0/1344612000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1201537d0 0x7fc120157ff0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc11802c560 tx=0x7fc118004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:32.706 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.704+0000 7fc116ffd640 1 -- 172.21.15.87:0/1344612000 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11803e610 con 0x7fc1201537d0 2023-12-16T20:21:32.706 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.704+0000 7fc116ffd640 1 -- 172.21.15.87:0/1344612000 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11803e770 con 0x7fc1201537d0 2023-12-16T20:21:32.706 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.704+0000 7fc116ffd640 1 -- 172.21.15.87:0/1344612000 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11803eb20 con 0x7fc1201537d0 2023-12-16T20:21:32.706 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.704+0000 7fc124a56640 1 -- 172.21.15.87:0/1344612000 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc120157ab0 con 0x7fc1201537d0 2023-12-16T20:21:32.706 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.704+0000 7fc124a56640 1 -- 172.21.15.87:0/1344612000 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1201f6e70 con 0x7fc1201537d0 2023-12-16T20:21:32.707 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.705+0000 7fc124a56640 1 -- 172.21.15.87:0/1344612000 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1201f7600 con 0x7fc1201537d0 2023-12-16T20:21:32.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.722+0000 7fc116ffd640 1 -- 172.21.15.87:0/1344612000 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fc11803b050 con 0x7fc1201537d0 2023-12-16T20:21:32.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.722+0000 7fc116ffd640 1 --2- 172.21.15.87:0/1344612000 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc10006ae90 0x7fc10006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:32.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.723+0000 7fc11e59c640 1 --2- 172.21.15.87:0/1344612000 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc10006ae90 0x7fc10006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:32.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.723+0000 7fc11e59c640 1 --2- 172.21.15.87:0/1344612000 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc10006ae90 0x7fc10006d350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc110009aa0 tx=0x7fc110009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:32.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.725+0000 7fc116ffd640 1 -- 172.21.15.87:0/1344612000 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc11807b080 con 0x7fc1201537d0 2023-12-16T20:21:32.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:32.960+0000 7fc116ffd640 1 -- 172.21.15.87:0/1344612000 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fc1180773c0 con 0x7fc1201537d0 2023-12-16T20:21:33.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.138+0000 7fc124a56640 1 -- 172.21.15.87:0/1344612000 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc1200c6640 con 0x7fc1201537d0 2023-12-16T20:21:33.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.148+0000 7fc116ffd640 1 -- 172.21.15.87:0/1344612000 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc11804e070 con 0x7fc1201537d0 2023-12-16T20:21:33.151 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:21:33.151 INFO:teuthology.orchestra.run.smithi087.stdout:[ 2023-12-16T20:21:33.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-12-16T20:21:33.151 INFO:teuthology.orchestra.run.smithi087.stdout: "poolnum": 1, 2023-12-16T20:21:33.151 INFO:teuthology.orchestra.run.smithi087.stdout: "poolname": ".mgr" 2023-12-16T20:21:33.151 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-12-16T20:21:33.151 INFO:teuthology.orchestra.run.smithi087.stdout:] 2023-12-16T20:21:33.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.150+0000 7fc124a56640 1 -- 172.21.15.87:0/1344612000 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc10006ae90 msgr2=0x7fc10006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:33.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.150+0000 7fc124a56640 1 --2- 172.21.15.87:0/1344612000 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc10006ae90 0x7fc10006d350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc110009aa0 tx=0x7fc110009190 comp rx=0 tx=0).stop 2023-12-16T20:21:33.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.150+0000 7fc124a56640 1 -- 172.21.15.87:0/1344612000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1201537d0 msgr2=0x7fc120157ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:33.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.150+0000 7fc124a56640 1 --2- 172.21.15.87:0/1344612000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1201537d0 0x7fc120157ff0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc11802c560 tx=0x7fc118004a40 comp rx=0 tx=0).stop 2023-12-16T20:21:33.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.150+0000 7fc124a56640 1 -- 172.21.15.87:0/1344612000 shutdown_connections 2023-12-16T20:21:33.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.150+0000 7fc124a56640 1 --2- 172.21.15.87:0/1344612000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1201537d0 0x7fc120157ff0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:33.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.150+0000 7fc124a56640 1 --2- 172.21.15.87:0/1344612000 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc10006ae90 0x7fc10006d350 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:33.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.150+0000 7fc124a56640 1 --2- 172.21.15.87:0/1344612000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1200c2e40 0x7fc1201f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:33.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.150+0000 7fc124a56640 1 --2- 172.21.15.87:0/1344612000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc12006f160 0x7fc1201569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:33.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.150+0000 7fc124a56640 1 -- 172.21.15.87:0/1344612000 >> 172.21.15.87:0/1344612000 conn(0x7fc1200cbf60 msgr2=0x7fc1201490f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:33.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.150+0000 7fc124a56640 1 -- 172.21.15.87:0/1344612000 shutdown_connections 2023-12-16T20:21:33.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.150+0000 7fc124a56640 1 -- 172.21.15.87:0/1344612000 wait complete. 2023-12-16T20:21:33.163 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-16T20:21:33.163 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-16T20:21:33.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.264+0000 7f5fbba51640 1 Processor -- start 2023-12-16T20:21:33.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.264+0000 7f5fbba51640 1 -- start start 2023-12-16T20:21:33.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.265+0000 7f5fbba51640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5fb414fab0 0x7f5fb406f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:33.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.265+0000 7f5fbba51640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb406f690 con 0x7f5fb4156810 2023-12-16T20:21:33.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.265+0000 7f5fbba51640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb40c8230 con 0x7f5fb4070f50 2023-12-16T20:21:33.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.265+0000 7f5fbba51640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb40c0a50 con 0x7f5fb414fab0 2023-12-16T20:21:33.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.265+0000 7f5fb97ed640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5fb414fab0 0x7f5fb406f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:33.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.265+0000 7f5fb8fec640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f5fb4070f50 0x7f5fb4156100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:32906/0 (socket says 172.21.15.87:32906) 2023-12-16T20:21:33.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.265+0000 7f5fb8fec640 1 -- 172.21.15.87:0/3881475667 learned_addr learned my addr 172.21.15.87:0/3881475667 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:33.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.267+0000 7f5fabfff640 1 -- 172.21.15.87:0/3881475667 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029327613 0 0) 0x7f5fb40c8230 con 0x7f5fb4070f50 2023-12-16T20:21:33.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.268+0000 7f5fabfff640 1 -- 172.21.15.87:0/3881475667 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fa0003520 con 0x7f5fb4070f50 2023-12-16T20:21:33.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.268+0000 7f5fb97ed640 1 -- 172.21.15.87:0/3881475667 >> v1:172.21.15.195:6789/0 conn(0x7f5fb4070f50 legacy=0x7f5fb4156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:33.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.268+0000 7f5fb97ed640 1 -- 172.21.15.87:0/3881475667 >> v1:172.21.15.87:6789/0 conn(0x7f5fb4156810 legacy=0x7f5fb40c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:33.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.268+0000 7f5fb97ed640 1 -- 172.21.15.87:0/3881475667 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb40c1380 con 0x7f5fb414fab0 2023-12-16T20:21:33.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.273+0000 7f5fb97ed640 1 --2- 172.21.15.87:0/3881475667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5fb414fab0 0x7f5fb406f150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000a940 tx=0x7f5fb002ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9df42f439df8cc server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:33.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.277+0000 7f5fabfff640 1 -- 172.21.15.87:0/3881475667 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb002dbe0 con 0x7f5fb414fab0 2023-12-16T20:21:33.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.277+0000 7f5fabfff640 1 -- 172.21.15.87:0/3881475667 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb002dd40 con 0x7f5fb414fab0 2023-12-16T20:21:33.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.277+0000 7f5fabfff640 1 -- 172.21.15.87:0/3881475667 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0035660 con 0x7f5fb414fab0 2023-12-16T20:21:33.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.277+0000 7f5fbba51640 1 -- 172.21.15.87:0/3881475667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5fb414fab0 msgr2=0x7f5fb406f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:33.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.277+0000 7f5fbba51640 1 --2- 172.21.15.87:0/3881475667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5fb414fab0 0x7f5fb406f150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000a940 tx=0x7f5fb002ce30 comp rx=0 tx=0).stop 2023-12-16T20:21:33.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.278+0000 7f5fbba51640 1 -- 172.21.15.87:0/3881475667 shutdown_connections 2023-12-16T20:21:33.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.278+0000 7f5fbba51640 1 --2- 172.21.15.87:0/3881475667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5fb414fab0 0x7f5fb406f150 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:33.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.278+0000 7f5fbba51640 1 -- 172.21.15.87:0/3881475667 >> 172.21.15.87:0/3881475667 conn(0x7f5fb406cd60 msgr2=0x7f5fb406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:33.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.278+0000 7f5fbba51640 1 -- 172.21.15.87:0/3881475667 shutdown_connections 2023-12-16T20:21:33.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.278+0000 7f5fbba51640 1 -- 172.21.15.87:0/3881475667 wait complete. 2023-12-16T20:21:33.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.279+0000 7f5fbba51640 1 Processor -- start 2023-12-16T20:21:33.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.279+0000 7f5fbba51640 1 -- start start 2023-12-16T20:21:33.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.279+0000 7f5fbba51640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fb4070f50 0x7f5fb41dd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:33.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.279+0000 7f5fbba51640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5fb414fab0 0x7f5fb41deec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:33.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.279+0000 7f5fbba51640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fb4156810 0x7f5fb41eff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:33.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.279+0000 7f5fbba51640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb4155ce0 con 0x7f5fb414fab0 2023-12-16T20:21:33.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.279+0000 7f5fbba51640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb41e0cf0 con 0x7f5fb4070f50 2023-12-16T20:21:33.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.280+0000 7f5fbba51640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb41e06b0 con 0x7f5fb4156810 2023-12-16T20:21:33.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.280+0000 7f5fb8fec640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5fb414fab0 0x7f5fb41deec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:33.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.280+0000 7f5fb8fec640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5fb414fab0 0x7f5fb41deec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44778/0 (socket says 172.21.15.87:44778) 2023-12-16T20:21:33.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.280+0000 7f5fb8fec640 1 -- 172.21.15.87:0/3578736935 learned_addr learned my addr 172.21.15.87:0/3578736935 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:33.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.280+0000 7f5fb97ed640 1 --2- 172.21.15.87:0/3578736935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fb4070f50 0x7f5fb41dd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:33.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.280+0000 7f5fb9fee640 1 --2- 172.21.15.87:0/3578736935 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fb4156810 0x7f5fb41eff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:33.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.283+0000 7f5fb8fec640 1 -- 172.21.15.87:0/3578736935 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fb4156810 msgr2=0x7f5fb41eff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:33.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.283+0000 7f5fb8fec640 1 --2- 172.21.15.87:0/3578736935 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fb4156810 0x7f5fb41eff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:33.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.283+0000 7f5fb8fec640 1 -- 172.21.15.87:0/3578736935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fb4070f50 msgr2=0x7f5fb41dd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:33.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.283+0000 7f5fb8fec640 1 --2- 172.21.15.87:0/3578736935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fb4070f50 0x7f5fb41dd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:33.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.283+0000 7f5fb8fec640 1 -- 172.21.15.87:0/3578736935 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb000a5a0 con 0x7f5fb414fab0 2023-12-16T20:21:33.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.286+0000 7f5fb8fec640 1 --2- 172.21.15.87:0/3578736935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5fb414fab0 0x7f5fb41deec0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400c500 tx=0x7f5fa400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:33.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.289+0000 7f5fa9ffb640 1 -- 172.21.15.87:0/3578736935 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4005ce0 con 0x7f5fb414fab0 2023-12-16T20:21:33.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.289+0000 7f5fa9ffb640 1 -- 172.21.15.87:0/3578736935 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa4005e40 con 0x7f5fb414fab0 2023-12-16T20:21:33.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.289+0000 7f5fbba51640 1 -- 172.21.15.87:0/3578736935 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb41e0390 con 0x7f5fb414fab0 2023-12-16T20:21:33.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.289+0000 7f5fa9ffb640 1 -- 172.21.15.87:0/3578736935 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4007330 con 0x7f5fb414fab0 2023-12-16T20:21:33.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.289+0000 7f5fbba51640 1 -- 172.21.15.87:0/3578736935 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb41e15c0 con 0x7f5fb414fab0 2023-12-16T20:21:33.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.290+0000 7f5fbba51640 1 -- 172.21.15.87:0/3578736935 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb41ddba0 con 0x7f5fb414fab0 2023-12-16T20:21:33.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.308+0000 7f5fa9ffb640 1 -- 172.21.15.87:0/3578736935 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f5fa4007550 con 0x7f5fb414fab0 2023-12-16T20:21:33.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.308+0000 7f5fa9ffb640 1 --2- 172.21.15.87:0/3578736935 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f5f9806ae90 0x7f5f9806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:33.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.309+0000 7f5fb97ed640 1 --2- 172.21.15.87:0/3578736935 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f5f9806ae90 0x7f5f9806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:33.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.309+0000 7f5fb97ed640 1 --2- 172.21.15.87:0/3578736935 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f5f9806ae90 0x7f5f9806d350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0037000 tx=0x7f5fb0031000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:33.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.311+0000 7f5fa9ffb640 1 -- 172.21.15.87:0/3578736935 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5fa4057e00 con 0x7f5fb414fab0 2023-12-16T20:21:33.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.549+0000 7f5fa9ffb640 1 -- 172.21.15.87:0/3578736935 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f5fa4054140 con 0x7f5fb414fab0 2023-12-16T20:21:33.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:33.719+0000 7f5fbba51640 1 -- 172.21.15.87:0/3578736935 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5fb41e15c0 con 0x7f5fb414fab0 2023-12-16T20:21:34.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.253+0000 7f5fa9ffb640 1 -- 172.21.15.87:0/3578736935 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5fb41e15c0 con 0x7f5fb414fab0 2023-12-16T20:21:34.255 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_metadata' created 2023-12-16T20:21:34.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.255+0000 7f5fbba51640 1 -- 172.21.15.87:0/3578736935 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f5f9806ae90 msgr2=0x7f5f9806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:34.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.255+0000 7f5fbba51640 1 --2- 172.21.15.87:0/3578736935 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f5f9806ae90 0x7f5f9806d350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0037000 tx=0x7f5fb0031000 comp rx=0 tx=0).stop 2023-12-16T20:21:34.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.255+0000 7f5fbba51640 1 -- 172.21.15.87:0/3578736935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5fb414fab0 msgr2=0x7f5fb41deec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:34.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.255+0000 7f5fbba51640 1 --2- 172.21.15.87:0/3578736935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5fb414fab0 0x7f5fb41deec0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400c500 tx=0x7f5fa400c9c0 comp rx=0 tx=0).stop 2023-12-16T20:21:34.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.255+0000 7f5fbba51640 1 -- 172.21.15.87:0/3578736935 shutdown_connections 2023-12-16T20:21:34.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.255+0000 7f5fbba51640 1 --2- 172.21.15.87:0/3578736935 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5fb4156810 0x7f5fb41eff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:34.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.255+0000 7f5fbba51640 1 --2- 172.21.15.87:0/3578736935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5fb414fab0 0x7f5fb41deec0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:34.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.255+0000 7f5fbba51640 1 --2- 172.21.15.87:0/3578736935 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f5f9806ae90 0x7f5f9806d350 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:34.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.255+0000 7f5fbba51640 1 --2- 172.21.15.87:0/3578736935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fb4070f50 0x7f5fb41dd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:34.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.255+0000 7f5fbba51640 1 -- 172.21.15.87:0/3578736935 >> 172.21.15.87:0/3578736935 conn(0x7f5fb406cd60 msgr2=0x7f5fb4154640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:34.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.255+0000 7f5fbba51640 1 -- 172.21.15.87:0/3578736935 shutdown_connections 2023-12-16T20:21:34.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.255+0000 7f5fbba51640 1 -- 172.21.15.87:0/3578736935 wait complete. 2023-12-16T20:21:34.269 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-16T20:21:34.381 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.379+0000 7fcea48bb640 1 Processor -- start 2023-12-16T20:21:34.381 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.379+0000 7fcea48bb640 1 -- start start 2023-12-16T20:21:34.381 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.379+0000 7fcea48bb640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcea0153640 0x7fcea0153a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:34.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.379+0000 7fcea48bb640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcea00c4810 0x7fcea00c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:34.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.379+0000 7fcea48bb640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea006bba0 con 0x7fcea00c4210 2023-12-16T20:21:34.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.379+0000 7fcea48bb640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea006be60 con 0x7fcea0153640 2023-12-16T20:21:34.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.379+0000 7fcea48bb640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea006c140 con 0x7fcea00c4810 2023-12-16T20:21:34.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.380+0000 7fce9ed9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcea00c4810 0x7fcea00c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:34.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.380+0000 7fce9e59c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcea0153640 0x7fcea0153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:34.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.380+0000 7fce9ed9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcea00c4810 0x7fcea00c4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:47754/0 (socket says 172.21.15.87:47754) 2023-12-16T20:21:34.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.380+0000 7fce9ed9d640 1 -- 172.21.15.87:0/2338061093 learned_addr learned my addr 172.21.15.87:0/2338061093 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:34.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.382+0000 7fce9ed9d640 1 -- 172.21.15.87:0/2338061093 >> v2:172.21.15.195:3300/0 conn(0x7fcea0153640 msgr2=0x7fcea0153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:34.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.382+0000 7fce9ed9d640 1 --2- 172.21.15.87:0/2338061093 >> v2:172.21.15.195:3300/0 conn(0x7fcea0153640 0x7fcea0153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:34.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.382+0000 7fce9ed9d640 1 -- 172.21.15.87:0/2338061093 >> v1:172.21.15.195:6789/0 conn(0x7fcea00c4210 legacy=0x7fcea015a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:34.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.383+0000 7fce9ed9d640 1 -- 172.21.15.87:0/2338061093 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea006c420 con 0x7fcea00c4810 2023-12-16T20:21:34.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.385+0000 7fce9ed9d640 1 --2- 172.21.15.87:0/2338061093 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcea00c4810 0x7fcea00c4c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fce98009e50 tx=0x7fce9802bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f750077b7104f14 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:34.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.389+0000 7fce9dd9b640 1 -- 172.21.15.87:0/2338061093 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9802cb90 con 0x7fcea00c4810 2023-12-16T20:21:34.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.389+0000 7fce9dd9b640 1 -- 172.21.15.87:0/2338061093 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9802ccf0 con 0x7fcea00c4810 2023-12-16T20:21:34.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.389+0000 7fce9dd9b640 1 -- 172.21.15.87:0/2338061093 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce98034610 con 0x7fcea00c4810 2023-12-16T20:21:34.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.389+0000 7fcea48bb640 1 -- 172.21.15.87:0/2338061093 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcea00c4810 msgr2=0x7fcea00c4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:34.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.389+0000 7fcea48bb640 1 --2- 172.21.15.87:0/2338061093 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcea00c4810 0x7fcea00c4c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fce98009e50 tx=0x7fce9802bff0 comp rx=0 tx=0).stop 2023-12-16T20:21:34.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.389+0000 7fcea48bb640 1 -- 172.21.15.87:0/2338061093 shutdown_connections 2023-12-16T20:21:34.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.389+0000 7fcea48bb640 1 --2- 172.21.15.87:0/2338061093 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcea00c4810 0x7fcea00c4c60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:34.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.389+0000 7fcea48bb640 1 --2- 172.21.15.87:0/2338061093 >> v2:172.21.15.195:3300/0 conn(0x7fcea0153640 0x7fcea0153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:34.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.389+0000 7fcea48bb640 1 -- 172.21.15.87:0/2338061093 >> 172.21.15.87:0/2338061093 conn(0x7fcea008b610 msgr2=0x7fcea0060f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:34.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.389+0000 7fcea48bb640 1 -- 172.21.15.87:0/2338061093 shutdown_connections 2023-12-16T20:21:34.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.389+0000 7fcea48bb640 1 -- 172.21.15.87:0/2338061093 wait complete. 2023-12-16T20:21:34.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.390+0000 7fcea48bb640 1 Processor -- start 2023-12-16T20:21:34.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.391+0000 7fcea48bb640 1 -- start start 2023-12-16T20:21:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.391+0000 7fcea48bb640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcea00c4210 0x7fcea014b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.391+0000 7fcea48bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcea00c4810 0x7fcea014f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.391+0000 7fcea48bb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcea0153640 0x7fcea00c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.391+0000 7fcea48bb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea01523e0 con 0x7fcea00c4810 2023-12-16T20:21:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.391+0000 7fcea48bb640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea01ef1e0 con 0x7fcea0153640 2023-12-16T20:21:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.391+0000 7fcea48bb640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea00c8570 con 0x7fcea00c4210 2023-12-16T20:21:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.392+0000 7fce9e59c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcea00c4210 0x7fcea014b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.392+0000 7fce95d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcea00c4810 0x7fcea014f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.392+0000 7fce9e59c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcea00c4210 0x7fcea014b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:47760/0 (socket says 172.21.15.87:47760) 2023-12-16T20:21:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.392+0000 7fce9e59c640 1 -- 172.21.15.87:0/215903104 learned_addr learned my addr 172.21.15.87:0/215903104 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.392+0000 7fce9ed9d640 1 --2- 172.21.15.87:0/215903104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcea0153640 0x7fcea00c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:34.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.395+0000 7fce9e59c640 1 -- 172.21.15.87:0/215903104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcea0153640 msgr2=0x7fcea00c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:34.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.395+0000 7fce9e59c640 1 --2- 172.21.15.87:0/215903104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcea0153640 0x7fcea00c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:34.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.395+0000 7fce9e59c640 1 -- 172.21.15.87:0/215903104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcea00c4810 msgr2=0x7fcea014f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:34.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.395+0000 7fce9e59c640 1 --2- 172.21.15.87:0/215903104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcea00c4810 0x7fcea014f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:34.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.395+0000 7fce9e59c640 1 -- 172.21.15.87:0/215903104 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce98009b30 con 0x7fcea00c4210 2023-12-16T20:21:34.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.398+0000 7fce9e59c640 1 --2- 172.21.15.87:0/215903104 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcea00c4210 0x7fcea014b750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fce9000e9b0 tx=0x7fce9000ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:34.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.402+0000 7fce977fe640 1 -- 172.21.15.87:0/215903104 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce90009670 con 0x7fcea00c4210 2023-12-16T20:21:34.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.402+0000 7fce977fe640 1 -- 172.21.15.87:0/215903104 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9000c9a0 con 0x7fcea00c4210 2023-12-16T20:21:34.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.402+0000 7fce977fe640 1 -- 172.21.15.87:0/215903104 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9000cd50 con 0x7fcea00c4210 2023-12-16T20:21:34.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.402+0000 7fcea48bb640 1 -- 172.21.15.87:0/215903104 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea01ef4a0 con 0x7fcea00c4210 2023-12-16T20:21:34.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.402+0000 7fcea48bb640 1 -- 172.21.15.87:0/215903104 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea01efa60 con 0x7fcea00c4210 2023-12-16T20:21:34.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.402+0000 7fcea48bb640 1 -- 172.21.15.87:0/215903104 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea00740e0 con 0x7fcea00c4210 2023-12-16T20:21:34.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.645+0000 7fce977fe640 1 -- 172.21.15.87:0/215903104 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fce90013470 con 0x7fcea00c4210 2023-12-16T20:21:34.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.645+0000 7fce977fe640 1 --2- 172.21.15.87:0/215903104 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fce8406aec0 0x7fce8406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:34.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.645+0000 7fce95d9b640 1 --2- 172.21.15.87:0/215903104 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fce8406aec0 0x7fce8406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:34.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.646+0000 7fce95d9b640 1 --2- 172.21.15.87:0/215903104 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fce8406aec0 0x7fce8406d380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcea015aac0 tx=0x7fce88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:34.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.647+0000 7fce977fe640 1 -- 172.21.15.87:0/215903104 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fce90058dc0 con 0x7fcea00c4210 2023-12-16T20:21:34.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.661+0000 7fce977fe640 1 -- 172.21.15.87:0/215903104 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fce90055100 con 0x7fcea00c4210 2023-12-16T20:21:34.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:34.830+0000 7fcea48bb640 1 -- 172.21.15.87:0/215903104 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fcea006d260 con 0x7fcea00c4210 2023-12-16T20:21:35.504 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.503+0000 7fce977fe640 1 -- 172.21.15.87:0/215903104 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7fce90021020 con 0x7fcea00c4210 2023-12-16T20:21:35.505 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data' created 2023-12-16T20:21:35.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.505+0000 7fcea48bb640 1 -- 172.21.15.87:0/215903104 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fce8406aec0 msgr2=0x7fce8406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:35.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.505+0000 7fcea48bb640 1 --2- 172.21.15.87:0/215903104 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fce8406aec0 0x7fce8406d380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcea015aac0 tx=0x7fce88009040 comp rx=0 tx=0).stop 2023-12-16T20:21:35.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.505+0000 7fcea48bb640 1 -- 172.21.15.87:0/215903104 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcea00c4210 msgr2=0x7fcea014b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:35.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.505+0000 7fcea48bb640 1 --2- 172.21.15.87:0/215903104 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcea00c4210 0x7fcea014b750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fce9000e9b0 tx=0x7fce9000ee70 comp rx=0 tx=0).stop 2023-12-16T20:21:35.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.505+0000 7fcea48bb640 1 -- 172.21.15.87:0/215903104 shutdown_connections 2023-12-16T20:21:35.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.505+0000 7fcea48bb640 1 --2- 172.21.15.87:0/215903104 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fce8406aec0 0x7fce8406d380 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:35.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.505+0000 7fcea48bb640 1 --2- 172.21.15.87:0/215903104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcea0153640 0x7fcea00c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:35.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.505+0000 7fcea48bb640 1 --2- 172.21.15.87:0/215903104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcea00c4810 0x7fcea014f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:35.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.505+0000 7fcea48bb640 1 --2- 172.21.15.87:0/215903104 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcea00c4210 0x7fcea014b750 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:35.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.505+0000 7fcea48bb640 1 -- 172.21.15.87:0/215903104 >> 172.21.15.87:0/215903104 conn(0x7fcea008b610 msgr2=0x7fcea00cadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:35.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.505+0000 7fcea48bb640 1 -- 172.21.15.87:0/215903104 shutdown_connections 2023-12-16T20:21:35.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.505+0000 7fcea48bb640 1 -- 172.21.15.87:0/215903104 wait complete. 2023-12-16T20:21:35.517 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-16T20:21:35.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.623+0000 7fb227133640 1 Processor -- start 2023-12-16T20:21:35.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.623+0000 7fb227133640 1 -- start start 2023-12-16T20:21:35.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.623+0000 7fb227133640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb2200c9e20 0x7fb2200ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:35.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.623+0000 7fb227133640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2200ca460 con 0x7fb220153900 2023-12-16T20:21:35.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.623+0000 7fb227133640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb220159a40 con 0x7fb2200caea0 2023-12-16T20:21:35.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.623+0000 7fb227133640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2200c8960 con 0x7fb2200c9e20 2023-12-16T20:21:35.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.624+0000 7fb224ecf640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb220153900 0x7fb2200c6280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51162/0 (socket says 172.21.15.87:51162) 2023-12-16T20:21:35.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.624+0000 7fb224ecf640 1 -- 172.21.15.87:0/3721438769 learned_addr learned my addr 172.21.15.87:0/3721438769 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:35.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.626+0000 7fb21f7fe640 1 -- 172.21.15.87:0/3721438769 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043769048 0 0) 0x7fb2200ca460 con 0x7fb220153900 2023-12-16T20:21:35.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.626+0000 7fb21f7fe640 1 -- 172.21.15.87:0/3721438769 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb208003520 con 0x7fb220153900 2023-12-16T20:21:35.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.630+0000 7fb21f7fe640 1 -- 172.21.15.87:0/3721438769 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3104819713 0 0) 0x7fb208003520 con 0x7fb220153900 2023-12-16T20:21:35.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.630+0000 7fb21f7fe640 1 -- 172.21.15.87:0/3721438769 >> v2:172.21.15.195:3300/0 conn(0x7fb2200c9e20 msgr2=0x7fb2200ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:35.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.630+0000 7fb21f7fe640 1 --2- 172.21.15.87:0/3721438769 >> v2:172.21.15.195:3300/0 conn(0x7fb2200c9e20 0x7fb2200ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:35.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.630+0000 7fb21f7fe640 1 -- 172.21.15.87:0/3721438769 >> v1:172.21.15.195:6789/0 conn(0x7fb2200caea0 legacy=0x7fb2200cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:35.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.630+0000 7fb21f7fe640 1 -- 172.21.15.87:0/3721438769 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb220159d20 con 0x7fb220153900 2023-12-16T20:21:35.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.630+0000 7fb21f7fe640 1 -- 172.21.15.87:0/3721438769 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1165302485 0 0) 0x7fb210001670 con 0x7fb220153900 2023-12-16T20:21:35.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.630+0000 7fb21f7fe640 1 -- 172.21.15.87:0/3721438769 >> v1:172.21.15.87:6789/0 conn(0x7fb220153900 legacy=0x7fb2200c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:35.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.630+0000 7fb21f7fe640 1 --2- 172.21.15.87:0/3721438769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2080039c0 0x7fb208003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:35.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.630+0000 7fb21f7fe640 1 --2- 172.21.15.87:0/3721438769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2080047c0 0x7fb208004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:35.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.630+0000 7fb21f7fe640 1 --2- 172.21.15.87:0/3721438769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb208005330 0x7fb20800b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:35.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.630+0000 7fb21f7fe640 1 -- 172.21.15.87:0/3721438769 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2200c8960 con 0x7fb2080047c0 2023-12-16T20:21:35.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.630+0000 7fb21f7fe640 1 -- 172.21.15.87:0/3721438769 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20800c280 con 0x7fb208005330 2023-12-16T20:21:35.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.630+0000 7fb21f7fe640 1 -- 172.21.15.87:0/3721438769 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20800c440 con 0x7fb2080039c0 2023-12-16T20:21:35.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.630+0000 7fb224ecf640 1 --2- 172.21.15.87:0/3721438769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2080039c0 0x7fb208003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:35.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.632+0000 7fb2256d0640 1 --2- 172.21.15.87:0/3721438769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb208005330 0x7fb20800b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:35.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.633+0000 7fb224ecf640 1 -- 172.21.15.87:0/3721438769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb208005330 msgr2=0x7fb20800b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:35.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.633+0000 7fb224ecf640 1 --2- 172.21.15.87:0/3721438769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb208005330 0x7fb20800b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:35.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.633+0000 7fb224ecf640 1 -- 172.21.15.87:0/3721438769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2080047c0 msgr2=0x7fb208004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:35.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.633+0000 7fb224ecf640 1 --2- 172.21.15.87:0/3721438769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2080047c0 0x7fb208004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:35.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.633+0000 7fb2256d0640 1 -- 172.21.15.87:0/3721438769 reap_dead start 2023-12-16T20:21:35.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.633+0000 7fb224ecf640 1 -- 172.21.15.87:0/3721438769 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb208003520 con 0x7fb2080039c0 2023-12-16T20:21:35.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.635+0000 7fb224ecf640 1 --2- 172.21.15.87:0/3721438769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2080039c0 0x7fb208003dc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb21000c0e0 tx=0x7fb2080057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c268305782e60ad server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:35.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.639+0000 7fb21f7fe640 1 -- 172.21.15.87:0/3721438769 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210005ad0 con 0x7fb2080039c0 2023-12-16T20:21:35.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.639+0000 7fb21f7fe640 1 -- 172.21.15.87:0/3721438769 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb210005c30 con 0x7fb2080039c0 2023-12-16T20:21:35.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.639+0000 7fb21f7fe640 1 -- 172.21.15.87:0/3721438769 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21002ca50 con 0x7fb2080039c0 2023-12-16T20:21:35.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.640+0000 7fb227133640 1 -- 172.21.15.87:0/3721438769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2080039c0 msgr2=0x7fb208003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:35.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.640+0000 7fb227133640 1 --2- 172.21.15.87:0/3721438769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2080039c0 0x7fb208003dc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb21000c0e0 tx=0x7fb2080057f0 comp rx=0 tx=0).stop 2023-12-16T20:21:35.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.640+0000 7fb227133640 1 -- 172.21.15.87:0/3721438769 shutdown_connections 2023-12-16T20:21:35.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.640+0000 7fb227133640 1 --2- 172.21.15.87:0/3721438769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2080039c0 0x7fb208003dc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:35.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.640+0000 7fb227133640 1 -- 172.21.15.87:0/3721438769 >> 172.21.15.87:0/3721438769 conn(0x7fb22008afb0 msgr2=0x7fb22008b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:35.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.640+0000 7fb227133640 1 -- 172.21.15.87:0/3721438769 shutdown_connections 2023-12-16T20:21:35.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.640+0000 7fb227133640 1 -- 172.21.15.87:0/3721438769 wait complete. 2023-12-16T20:21:35.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.641+0000 7fb227133640 1 Processor -- start 2023-12-16T20:21:35.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.641+0000 7fb227133640 1 -- start start 2023-12-16T20:21:35.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.642+0000 7fb227133640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2080039c0 0x7fb2200c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:35.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.642+0000 7fb227133640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb220149e60 0x7fb220151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:35.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.642+0000 7fb227133640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2201521e0 0x7fb2200cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:35.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.642+0000 7fb227133640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2201f1f50 con 0x7fb2201521e0 2023-12-16T20:21:35.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.642+0000 7fb227133640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2201f0050 con 0x7fb2080039c0 2023-12-16T20:21:35.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.642+0000 7fb227133640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2200c5940 con 0x7fb220149e60 2023-12-16T20:21:35.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.643+0000 7fb21ffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb220149e60 0x7fb220151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:35.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.643+0000 7fb2256d0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2201521e0 0x7fb2200cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:35.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.643+0000 7fb224ecf640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2080039c0 0x7fb2200c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:35.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.643+0000 7fb2256d0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2201521e0 0x7fb2200cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44802/0 (socket says 172.21.15.87:44802) 2023-12-16T20:21:35.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.643+0000 7fb2256d0640 1 -- 172.21.15.87:0/2269700263 learned_addr learned my addr 172.21.15.87:0/2269700263 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:35.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.646+0000 7fb2256d0640 1 -- 172.21.15.87:0/2269700263 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb220149e60 msgr2=0x7fb220151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:35.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.646+0000 7fb2256d0640 1 --2- 172.21.15.87:0/2269700263 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb220149e60 0x7fb220151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:35.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.646+0000 7fb2256d0640 1 -- 172.21.15.87:0/2269700263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2080039c0 msgr2=0x7fb2200c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:35.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.646+0000 7fb2256d0640 1 --2- 172.21.15.87:0/2269700263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2080039c0 0x7fb2200c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:35.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.646+0000 7fb2256d0640 1 -- 172.21.15.87:0/2269700263 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2200cd590 con 0x7fb2201521e0 2023-12-16T20:21:35.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.648+0000 7fb2256d0640 1 --2- 172.21.15.87:0/2269700263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2201521e0 0x7fb2200cda20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb22006a750 tx=0x7fb21800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:35.654 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.652+0000 7fb21d7fa640 1 -- 172.21.15.87:0/2269700263 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218003b70 con 0x7fb2201521e0 2023-12-16T20:21:35.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.652+0000 7fb21d7fa640 1 -- 172.21.15.87:0/2269700263 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb218003cd0 con 0x7fb2201521e0 2023-12-16T20:21:35.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.652+0000 7fb227133640 1 -- 172.21.15.87:0/2269700263 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2201ef770 con 0x7fb2201521e0 2023-12-16T20:21:35.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.652+0000 7fb21d7fa640 1 -- 172.21.15.87:0/2269700263 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2180052b0 con 0x7fb2201521e0 2023-12-16T20:21:35.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.652+0000 7fb227133640 1 -- 172.21.15.87:0/2269700263 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2200ccc60 con 0x7fb2201521e0 2023-12-16T20:21:35.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.653+0000 7fb227133640 1 -- 172.21.15.87:0/2269700263 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2200cd720 con 0x7fb2201521e0 2023-12-16T20:21:35.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.895+0000 7fb21d7fa640 1 -- 172.21.15.87:0/2269700263 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fb218005410 con 0x7fb2201521e0 2023-12-16T20:21:35.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.896+0000 7fb21d7fa640 1 --2- 172.21.15.87:0/2269700263 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb20c06ae70 0x7fb20c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:35.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.896+0000 7fb224ecf640 1 --2- 172.21.15.87:0/2269700263 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb20c06ae70 0x7fb20c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:35.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.896+0000 7fb224ecf640 1 --2- 172.21.15.87:0/2269700263 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb20c06ae70 0x7fb20c06d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb210034000 tx=0x7fb210009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:35.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.908+0000 7fb21d7fa640 1 -- 172.21.15.87:0/2269700263 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb218058c90 con 0x7fb2201521e0 2023-12-16T20:21:35.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:35.908+0000 7fb21d7fa640 1 -- 172.21.15.87:0/2269700263 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fb218054fd0 con 0x7fb2201521e0 2023-12-16T20:21:36.116 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.115+0000 7fb227133640 1 -- 172.21.15.87:0/2269700263 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb2200c94d0 con 0x7fb2201521e0 2023-12-16T20:21:36.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.594+0000 7fb21d7fa640 1 -- 172.21.15.87:0/2269700263 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb2180585f0 con 0x7fb2201521e0 2023-12-16T20:21:36.595 INFO:teuthology.orchestra.run.smithi087.stderr:new fs with metadata pool 2 and data pool 3 2023-12-16T20:21:36.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.596+0000 7fb227133640 1 -- 172.21.15.87:0/2269700263 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb20c06ae70 msgr2=0x7fb20c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:36.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.596+0000 7fb227133640 1 --2- 172.21.15.87:0/2269700263 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb20c06ae70 0x7fb20c06d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb210034000 tx=0x7fb210009030 comp rx=0 tx=0).stop 2023-12-16T20:21:36.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.596+0000 7fb227133640 1 -- 172.21.15.87:0/2269700263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2201521e0 msgr2=0x7fb2200cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:36.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.596+0000 7fb227133640 1 --2- 172.21.15.87:0/2269700263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2201521e0 0x7fb2200cda20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb22006a750 tx=0x7fb21800dc00 comp rx=0 tx=0).stop 2023-12-16T20:21:36.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.596+0000 7fb227133640 1 -- 172.21.15.87:0/2269700263 shutdown_connections 2023-12-16T20:21:36.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.596+0000 7fb227133640 1 --2- 172.21.15.87:0/2269700263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2201521e0 0x7fb2200cda20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:36.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.596+0000 7fb227133640 1 --2- 172.21.15.87:0/2269700263 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb220149e60 0x7fb220151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:36.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.596+0000 7fb227133640 1 --2- 172.21.15.87:0/2269700263 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb20c06ae70 0x7fb20c06d330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:36.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.596+0000 7fb227133640 1 --2- 172.21.15.87:0/2269700263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2080039c0 0x7fb2200c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:36.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.596+0000 7fb227133640 1 -- 172.21.15.87:0/2269700263 >> 172.21.15.87:0/2269700263 conn(0x7fb22008afb0 msgr2=0x7fb22008b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:36.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.596+0000 7fb227133640 1 -- 172.21.15.87:0/2269700263 shutdown_connections 2023-12-16T20:21:36.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.596+0000 7fb227133640 1 -- 172.21.15.87:0/2269700263 wait complete. 2023-12-16T20:21:36.608 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-16T20:21:36.608 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-16T20:21:36.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.713+0000 7f5b4bd1d640 1 Processor -- start 2023-12-16T20:21:36.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.713+0000 7f5b4bd1d640 1 -- start start 2023-12-16T20:21:36.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.714+0000 7f5b4bd1d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5b44151730 0x7f5b44071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:36.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.714+0000 7f5b4bd1d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b44071680 0x7f5b4406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:36.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.714+0000 7f5b4bd1d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4415b7e0 con 0x7f5b4406aa40 2023-12-16T20:21:36.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.714+0000 7f5b4bd1d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b4413d4d0 con 0x7f5b44151730 2023-12-16T20:21:36.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.714+0000 7f5b4bd1d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4415ac60 con 0x7f5b44071680 2023-12-16T20:21:36.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.715+0000 7f5b4a2ba640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f5b4406aa40 0x7f5b44157960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51172/0 (socket says 172.21.15.87:51172) 2023-12-16T20:21:36.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.715+0000 7f5b4a2ba640 1 -- 172.21.15.87:0/1765438602 learned_addr learned my addr 172.21.15.87:0/1765438602 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:36.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.717+0000 7f5b48ab7640 1 -- 172.21.15.87:0/1765438602 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516069001 0 0) 0x7f5b4415b7e0 con 0x7f5b4406aa40 2023-12-16T20:21:36.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.717+0000 7f5b48ab7640 1 -- 172.21.15.87:0/1765438602 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b30003520 con 0x7f5b4406aa40 2023-12-16T20:21:36.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.725+0000 7f5b492b8640 1 --2- 172.21.15.87:0/1765438602 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b44071680 0x7f5b4406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:36.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.726+0000 7f5b49ab9640 1 --2- 172.21.15.87:0/1765438602 >> v2:172.21.15.195:3300/0 conn(0x7f5b44151730 0x7f5b44071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:36.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.728+0000 7f5b492b8640 1 -- 172.21.15.87:0/1765438602 >> v2:172.21.15.195:3300/0 conn(0x7f5b44151730 msgr2=0x7f5b44071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:36.730 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.728+0000 7f5b492b8640 1 --2- 172.21.15.87:0/1765438602 >> v2:172.21.15.195:3300/0 conn(0x7f5b44151730 0x7f5b44071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:36.730 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.728+0000 7f5b492b8640 1 -- 172.21.15.87:0/1765438602 >> v1:172.21.15.87:6789/0 conn(0x7f5b4406aa40 legacy=0x7f5b44157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:36.730 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.728+0000 7f5b492b8640 1 -- 172.21.15.87:0/1765438602 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4415af40 con 0x7f5b44071680 2023-12-16T20:21:36.732 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.731+0000 7f5b492b8640 1 --2- 172.21.15.87:0/1765438602 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b44071680 0x7f5b4406a500 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5b400097a0 tx=0x7f5b4002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd61242fb39c7972 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:36.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.735+0000 7f5b48ab7640 1 -- 172.21.15.87:0/1765438602 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40030610 con 0x7f5b44071680 2023-12-16T20:21:36.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.735+0000 7f5b48ab7640 1 -- 172.21.15.87:0/1765438602 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b40030770 con 0x7f5b44071680 2023-12-16T20:21:36.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.735+0000 7f5b48ab7640 1 -- 172.21.15.87:0/1765438602 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40030b00 con 0x7f5b44071680 2023-12-16T20:21:36.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.736+0000 7f5b4bd1d640 1 -- 172.21.15.87:0/1765438602 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b44071680 msgr2=0x7f5b4406a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:36.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.736+0000 7f5b4bd1d640 1 --2- 172.21.15.87:0/1765438602 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b44071680 0x7f5b4406a500 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5b400097a0 tx=0x7f5b4002b960 comp rx=0 tx=0).stop 2023-12-16T20:21:36.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.736+0000 7f5b4bd1d640 1 -- 172.21.15.87:0/1765438602 shutdown_connections 2023-12-16T20:21:36.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.736+0000 7f5b4bd1d640 1 --2- 172.21.15.87:0/1765438602 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b44071680 0x7f5b4406a500 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:36.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.736+0000 7f5b4bd1d640 1 --2- 172.21.15.87:0/1765438602 >> v2:172.21.15.195:3300/0 conn(0x7f5b44151730 0x7f5b44071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:36.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.736+0000 7f5b4bd1d640 1 -- 172.21.15.87:0/1765438602 >> 172.21.15.87:0/1765438602 conn(0x7f5b4406f310 msgr2=0x7f5b440cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:36.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.736+0000 7f5b4bd1d640 1 -- 172.21.15.87:0/1765438602 shutdown_connections 2023-12-16T20:21:36.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.736+0000 7f5b4bd1d640 1 -- 172.21.15.87:0/1765438602 wait complete. 2023-12-16T20:21:36.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.737+0000 7f5b4bd1d640 1 Processor -- start 2023-12-16T20:21:36.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.737+0000 7f5b4bd1d640 1 -- start start 2023-12-16T20:21:36.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.738+0000 7f5b4bd1d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b4406aa40 0x7f5b441f08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:36.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.738+0000 7f5b4bd1d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b44071680 0x7f5b44159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:36.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.738+0000 7f5b4bd1d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b44151730 0x7f5b44139870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:36.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.738+0000 7f5b4bd1d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4413f550 con 0x7f5b44151730 2023-12-16T20:21:36.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.738+0000 7f5b4bd1d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b441e71a0 con 0x7f5b44071680 2023-12-16T20:21:36.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.738+0000 7f5b4bd1d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4413da40 con 0x7f5b4406aa40 2023-12-16T20:21:36.741 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.740+0000 7f5b492b8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b44071680 0x7f5b44159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:36.741 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.740+0000 7f5b492b8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b44071680 0x7f5b44159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:41808/0 (socket says 172.21.15.87:41808) 2023-12-16T20:21:36.741 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.740+0000 7f5b492b8640 1 -- 172.21.15.87:0/265656214 learned_addr learned my addr 172.21.15.87:0/265656214 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:36.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.741+0000 7f5b49ab9640 1 --2- 172.21.15.87:0/265656214 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b4406aa40 0x7f5b441f08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:36.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.743+0000 7f5b492b8640 1 -- 172.21.15.87:0/265656214 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b4406aa40 msgr2=0x7f5b441f08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:36.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.743+0000 7f5b492b8640 1 --2- 172.21.15.87:0/265656214 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b4406aa40 0x7f5b441f08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:36.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.743+0000 7f5b492b8640 1 -- 172.21.15.87:0/265656214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b44151730 msgr2=0x7f5b44139870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:36.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.743+0000 7f5b492b8640 1 --2- 172.21.15.87:0/265656214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b44151730 0x7f5b44139870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:36.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.743+0000 7f5b492b8640 1 -- 172.21.15.87:0/265656214 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b40009400 con 0x7f5b44071680 2023-12-16T20:21:36.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.747+0000 7f5b492b8640 1 --2- 172.21.15.87:0/265656214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b44071680 0x7f5b44159a60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009890 tx=0x7f5b40004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:36.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.749+0000 7f5b3a7fc640 1 -- 172.21.15.87:0/265656214 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4003e040 con 0x7f5b44071680 2023-12-16T20:21:36.751 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.749+0000 7f5b4bd1d640 1 -- 172.21.15.87:0/265656214 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4413dd20 con 0x7f5b44071680 2023-12-16T20:21:36.751 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.749+0000 7f5b4bd1d640 1 -- 172.21.15.87:0/265656214 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b441eced0 con 0x7f5b44071680 2023-12-16T20:21:36.751 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.750+0000 7f5b4bd1d640 1 -- 172.21.15.87:0/265656214 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b4413deb0 con 0x7f5b44071680 2023-12-16T20:21:36.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:36.962+0000 7f5b3a7fc640 1 -- 172.21.15.87:0/265656214 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b400399a0 con 0x7f5b44071680 2023-12-16T20:21:37.004 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.003+0000 7f5b3a7fc640 1 -- 172.21.15.87:0/265656214 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40039d30 con 0x7f5b44071680 2023-12-16T20:21:37.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.010+0000 7f5b3a7fc640 1 -- 172.21.15.87:0/265656214 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f5b400423e0 con 0x7f5b44071680 2023-12-16T20:21:37.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.011+0000 7f5b3a7fc640 1 --2- 172.21.15.87:0/265656214 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f5b2806ae70 0x7f5b2806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:37.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.011+0000 7f5b49ab9640 1 --2- 172.21.15.87:0/265656214 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f5b2806ae70 0x7f5b2806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:37.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.011+0000 7f5b49ab9640 1 --2- 172.21.15.87:0/265656214 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f5b2806ae70 0x7f5b2806d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009aa0 tx=0x7f5b34009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:37.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.035+0000 7f5b3a7fc640 1 -- 172.21.15.87:0/265656214 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b4007aa60 con 0x7f5b44071680 2023-12-16T20:21:37.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.048+0000 7f5b3a7fc640 1 -- 172.21.15.87:0/265656214 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f5b40076da0 con 0x7f5b44071680 2023-12-16T20:21:37.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.223+0000 7f5b4bd1d640 1 -- 172.21.15.87:0/265656214 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f5b4406b6c0 con 0x7f5b44071680 2023-12-16T20:21:37.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.492+0000 7f5b3a7fc640 1 -- 172.21.15.87:0/265656214 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f5b4007a3c0 con 0x7f5b44071680 2023-12-16T20:21:37.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.494+0000 7f5b4bd1d640 1 -- 172.21.15.87:0/265656214 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f5b2806ae70 msgr2=0x7f5b2806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:37.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.494+0000 7f5b4bd1d640 1 --2- 172.21.15.87:0/265656214 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f5b2806ae70 0x7f5b2806d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009aa0 tx=0x7f5b34009190 comp rx=0 tx=0).stop 2023-12-16T20:21:37.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.494+0000 7f5b4bd1d640 1 -- 172.21.15.87:0/265656214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b44071680 msgr2=0x7f5b44159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:37.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.494+0000 7f5b4bd1d640 1 --2- 172.21.15.87:0/265656214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b44071680 0x7f5b44159a60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009890 tx=0x7f5b40004730 comp rx=0 tx=0).stop 2023-12-16T20:21:37.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.494+0000 7f5b4bd1d640 1 -- 172.21.15.87:0/265656214 shutdown_connections 2023-12-16T20:21:37.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.494+0000 7f5b4bd1d640 1 --2- 172.21.15.87:0/265656214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b44151730 0x7f5b44139870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:37.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.494+0000 7f5b4bd1d640 1 --2- 172.21.15.87:0/265656214 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f5b2806ae70 0x7f5b2806d330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:37.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.494+0000 7f5b4bd1d640 1 --2- 172.21.15.87:0/265656214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b44071680 0x7f5b44159a60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:37.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.494+0000 7f5b4bd1d640 1 --2- 172.21.15.87:0/265656214 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b4406aa40 0x7f5b441f08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:37.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.494+0000 7f5b4bd1d640 1 -- 172.21.15.87:0/265656214 >> 172.21.15.87:0/265656214 conn(0x7f5b4406f310 msgr2=0x7f5b44073850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:37.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.494+0000 7f5b4bd1d640 1 -- 172.21.15.87:0/265656214 shutdown_connections 2023-12-16T20:21:37.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.494+0000 7f5b4bd1d640 1 -- 172.21.15.87:0/265656214 wait complete. 2023-12-16T20:21:37.506 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-16T20:21:37.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.618+0000 7f7d12ff8640 1 Processor -- start 2023-12-16T20:21:37.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.618+0000 7f7d12ff8640 1 -- start start 2023-12-16T20:21:37.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.619+0000 7f7d12ff8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d0c153780 0x7f7d0c06f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:37.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.619+0000 7f7d12ff8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7d0c15d5e0 0x7f7d0c0c8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:37.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.619+0000 7f7d12ff8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c153b60 con 0x7f7d0c06fd70 2023-12-16T20:21:37.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.619+0000 7f7d12ff8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c06d0d0 con 0x7f7d0c15d5e0 2023-12-16T20:21:37.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.619+0000 7f7d12ff8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c070520 con 0x7f7d0c153780 2023-12-16T20:21:37.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.630+0000 7f7d11595640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7d0c06fd70 0x7f7d0c15ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51180/0 (socket says 172.21.15.87:51180) 2023-12-16T20:21:37.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.630+0000 7f7d11595640 1 -- 172.21.15.87:0/1676876730 learned_addr learned my addr 172.21.15.87:0/1676876730 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:37.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.631+0000 7f7d0bfff640 1 --2- 172.21.15.87:0/1676876730 >> v2:172.21.15.87:3300/0 conn(0x7f7d0c15d5e0 0x7f7d0c0c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:37.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.634+0000 7f7d0bfff640 1 -- 172.21.15.87:0/1676876730 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d0c153780 msgr2=0x7f7d0c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:37.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.634+0000 7f7d0bfff640 1 --2- 172.21.15.87:0/1676876730 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d0c153780 0x7f7d0c06f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:37.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.634+0000 7f7d0bfff640 1 -- 172.21.15.87:0/1676876730 >> v1:172.21.15.87:6789/0 conn(0x7f7d0c06fd70 legacy=0x7f7d0c15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:37.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.634+0000 7f7d0bfff640 1 -- 172.21.15.87:0/1676876730 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c070240 con 0x7f7d0c15d5e0 2023-12-16T20:21:37.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.639+0000 7f7d0bfff640 1 --2- 172.21.15.87:0/1676876730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0c15d5e0 0x7f7d0c0c8600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80097a0 tx=0x7f7cf802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f718b35b10f4184 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:37.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.643+0000 7f7d0b7fe640 1 -- 172.21.15.87:0/1676876730 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8030610 con 0x7f7d0c15d5e0 2023-12-16T20:21:37.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.643+0000 7f7d0b7fe640 1 -- 172.21.15.87:0/1676876730 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf8030770 con 0x7f7d0c15d5e0 2023-12-16T20:21:37.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.643+0000 7f7d0b7fe640 1 -- 172.21.15.87:0/1676876730 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8030b00 con 0x7f7d0c15d5e0 2023-12-16T20:21:37.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.644+0000 7f7d12ff8640 1 -- 172.21.15.87:0/1676876730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0c15d5e0 msgr2=0x7f7d0c0c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:37.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.644+0000 7f7d12ff8640 1 --2- 172.21.15.87:0/1676876730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0c15d5e0 0x7f7d0c0c8600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80097a0 tx=0x7f7cf802b960 comp rx=0 tx=0).stop 2023-12-16T20:21:37.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.644+0000 7f7d12ff8640 1 -- 172.21.15.87:0/1676876730 shutdown_connections 2023-12-16T20:21:37.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.644+0000 7f7d12ff8640 1 --2- 172.21.15.87:0/1676876730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0c15d5e0 0x7f7d0c0c8600 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:37.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.644+0000 7f7d12ff8640 1 --2- 172.21.15.87:0/1676876730 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d0c153780 0x7f7d0c06f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:37.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.644+0000 7f7d12ff8640 1 -- 172.21.15.87:0/1676876730 >> 172.21.15.87:0/1676876730 conn(0x7f7d0c070b90 msgr2=0x7f7d0c070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:37.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.644+0000 7f7d12ff8640 1 -- 172.21.15.87:0/1676876730 shutdown_connections 2023-12-16T20:21:37.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.644+0000 7f7d12ff8640 1 -- 172.21.15.87:0/1676876730 wait complete. 2023-12-16T20:21:37.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.645+0000 7f7d12ff8640 1 Processor -- start 2023-12-16T20:21:37.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.645+0000 7f7d12ff8640 1 -- start start 2023-12-16T20:21:37.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.646+0000 7f7d12ff8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d0c06fd70 0x7f7d0c0cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:37.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.646+0000 7f7d12ff8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d0c153780 0x7f7d0c1e3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:37.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.646+0000 7f7d12ff8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0c15d5e0 0x7f7d0c1f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:37.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.646+0000 7f7d12ff8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c1513a0 con 0x7f7d0c15d5e0 2023-12-16T20:21:37.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.646+0000 7f7d12ff8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c155070 con 0x7f7d0c153780 2023-12-16T20:21:37.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.646+0000 7f7d12ff8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c155350 con 0x7f7d0c06fd70 2023-12-16T20:21:37.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.646+0000 7f7d11595640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0c15d5e0 0x7f7d0c1f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:37.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.647+0000 7f7d11595640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0c15d5e0 0x7f7d0c1f2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44826/0 (socket says 172.21.15.87:44826) 2023-12-16T20:21:37.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.647+0000 7f7d11595640 1 -- 172.21.15.87:0/1559606912 learned_addr learned my addr 172.21.15.87:0/1559606912 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:37.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.647+0000 7f7d0bfff640 1 --2- 172.21.15.87:0/1559606912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d0c153780 0x7f7d0c1e3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:37.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.650+0000 7f7d11595640 1 -- 172.21.15.87:0/1559606912 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d0c06fd70 msgr2=0x7f7d0c0cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:37.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.650+0000 7f7d11595640 1 --2- 172.21.15.87:0/1559606912 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d0c06fd70 0x7f7d0c0cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:37.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.650+0000 7f7d11595640 1 -- 172.21.15.87:0/1559606912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d0c153780 msgr2=0x7f7d0c1e3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:37.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.650+0000 7f7d11595640 1 --2- 172.21.15.87:0/1559606912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d0c153780 0x7f7d0c1e3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:37.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.650+0000 7f7d11595640 1 -- 172.21.15.87:0/1559606912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf8009400 con 0x7f7d0c15d5e0 2023-12-16T20:21:37.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.652+0000 7f7d11595640 1 --2- 172.21.15.87:0/1559606912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0c15d5e0 0x7f7d0c1f2a50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400ca20 tx=0x7f7d0400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:37.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.655+0000 7f7d097fa640 1 -- 172.21.15.87:0/1559606912 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0400abd0 con 0x7f7d0c15d5e0 2023-12-16T20:21:37.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.656+0000 7f7d097fa640 1 -- 172.21.15.87:0/1559606912 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0400ad30 con 0x7f7d0c15d5e0 2023-12-16T20:21:37.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.656+0000 7f7d097fa640 1 -- 172.21.15.87:0/1559606912 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d04012600 con 0x7f7d0c15d5e0 2023-12-16T20:21:37.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.656+0000 7f7d12ff8640 1 -- 172.21.15.87:0/1559606912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c155630 con 0x7f7d0c15d5e0 2023-12-16T20:21:37.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.656+0000 7f7d12ff8640 1 -- 172.21.15.87:0/1559606912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c14f080 con 0x7f7d0c15d5e0 2023-12-16T20:21:37.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.656+0000 7f7d12ff8640 1 -- 172.21.15.87:0/1559606912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0c155b50 con 0x7f7d0c15d5e0 2023-12-16T20:21:37.905 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.903+0000 7f7d097fa640 1 -- 172.21.15.87:0/1559606912 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f7d04007070 con 0x7f7d0c15d5e0 2023-12-16T20:21:37.905 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.903+0000 7f7d097fa640 1 --2- 172.21.15.87:0/1559606912 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7cf006ae40 0x7f7cf006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:37.905 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.904+0000 7f7d10d94640 1 --2- 172.21.15.87:0/1559606912 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7cf006ae40 0x7f7cf006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:37.905 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.904+0000 7f7d10d94640 1 --2- 172.21.15.87:0/1559606912 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7cf006ae40 0x7f7cf006d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009710 tx=0x7f7d00006c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:37.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.918+0000 7f7d097fa640 1 -- 172.21.15.87:0/1559606912 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f7d040584f0 con 0x7f7d0c15d5e0 2023-12-16T20:21:37.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:37.918+0000 7f7d097fa640 1 -- 172.21.15.87:0/1559606912 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f7d04054830 con 0x7f7d0c15d5e0 2023-12-16T20:21:38.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:38.099+0000 7f7d12ff8640 1 -- 172.21.15.87:0/1559606912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7d0c155b50 con 0x7f7d0c15d5e0 2023-12-16T20:21:39.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.686+0000 7f7d097fa640 1 -- 172.21.15.87:0/1559606912 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f7d0c155b50 con 0x7f7d0c15d5e0 2023-12-16T20:21:39.688 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data_ec' created 2023-12-16T20:21:39.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.689+0000 7f7d12ff8640 1 -- 172.21.15.87:0/1559606912 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7cf006ae40 msgr2=0x7f7cf006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:39.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.689+0000 7f7d12ff8640 1 --2- 172.21.15.87:0/1559606912 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7cf006ae40 0x7f7cf006d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009710 tx=0x7f7d00006c90 comp rx=0 tx=0).stop 2023-12-16T20:21:39.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.689+0000 7f7d12ff8640 1 -- 172.21.15.87:0/1559606912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0c15d5e0 msgr2=0x7f7d0c1f2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:39.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.689+0000 7f7d12ff8640 1 --2- 172.21.15.87:0/1559606912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0c15d5e0 0x7f7d0c1f2a50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400ca20 tx=0x7f7d0400cee0 comp rx=0 tx=0).stop 2023-12-16T20:21:39.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.689+0000 7f7d12ff8640 1 -- 172.21.15.87:0/1559606912 shutdown_connections 2023-12-16T20:21:39.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.689+0000 7f7d12ff8640 1 --2- 172.21.15.87:0/1559606912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0c15d5e0 0x7f7d0c1f2a50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:39.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.689+0000 7f7d12ff8640 1 --2- 172.21.15.87:0/1559606912 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7cf006ae40 0x7f7cf006d300 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:39.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.689+0000 7f7d12ff8640 1 --2- 172.21.15.87:0/1559606912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d0c153780 0x7f7d0c1e3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:39.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.689+0000 7f7d12ff8640 1 --2- 172.21.15.87:0/1559606912 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d0c06fd70 0x7f7d0c0cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:39.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.689+0000 7f7d12ff8640 1 -- 172.21.15.87:0/1559606912 >> 172.21.15.87:0/1559606912 conn(0x7f7d0c070b90 msgr2=0x7f7d0c0cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:39.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.689+0000 7f7d12ff8640 1 -- 172.21.15.87:0/1559606912 shutdown_connections 2023-12-16T20:21:39.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.689+0000 7f7d12ff8640 1 -- 172.21.15.87:0/1559606912 wait complete. 2023-12-16T20:21:39.705 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-16T20:21:39.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.818+0000 7f3b8a7b0640 1 Processor -- start 2023-12-16T20:21:39.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.818+0000 7f3b8a7b0640 1 -- start start 2023-12-16T20:21:39.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.819+0000 7f3b8a7b0640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3b8406c7f0 0x7f3b8406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:39.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.819+0000 7f3b8a7b0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8415cdb0 con 0x7f3b8406bef0 2023-12-16T20:21:39.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.819+0000 7f3b8a7b0640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8415d090 con 0x7f3b84153ba0 2023-12-16T20:21:39.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.819+0000 7f3b8a7b0640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b840b2a60 con 0x7f3b8406c7f0 2023-12-16T20:21:39.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.840+0000 7f3b88d4d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3b8406bef0 0x7f3b840c4010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51192/0 (socket says 172.21.15.87:51192) 2023-12-16T20:21:39.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.840+0000 7f3b88d4d640 1 -- 172.21.15.87:0/4275004950 learned_addr learned my addr 172.21.15.87:0/4275004950 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:39.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.843+0000 7f3b837fe640 1 --2- 172.21.15.87:0/4275004950 >> v2:172.21.15.195:3300/0 conn(0x7f3b8406c7f0 0x7f3b8406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:39.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.843+0000 7f3b82ffd640 1 -- 172.21.15.87:0/4275004950 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766075326 0 0) 0x7f3b8415cdb0 con 0x7f3b8406bef0 2023-12-16T20:21:39.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.843+0000 7f3b82ffd640 1 -- 172.21.15.87:0/4275004950 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b6c003520 con 0x7f3b8406bef0 2023-12-16T20:21:39.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.848+0000 7f3b837fe640 1 -- 172.21.15.87:0/4275004950 >> v1:172.21.15.195:6789/0 conn(0x7f3b84153ba0 legacy=0x7f3b8415a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:39.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.848+0000 7f3b837fe640 1 -- 172.21.15.87:0/4275004950 >> v1:172.21.15.87:6789/0 conn(0x7f3b8406bef0 legacy=0x7f3b840c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:39.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.848+0000 7f3b837fe640 1 -- 172.21.15.87:0/4275004950 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8415d370 con 0x7f3b8406c7f0 2023-12-16T20:21:39.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.851+0000 7f3b837fe640 1 --2- 172.21.15.87:0/4275004950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b8406c7f0 0x7f3b8406b9b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3b780097a0 tx=0x7f3b7802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f66e7b83c54d3e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:39.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.854+0000 7f3b82ffd640 1 -- 172.21.15.87:0/4275004950 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7802e070 con 0x7f3b8406c7f0 2023-12-16T20:21:39.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.854+0000 7f3b82ffd640 1 -- 172.21.15.87:0/4275004950 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b780315a0 con 0x7f3b8406c7f0 2023-12-16T20:21:39.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.854+0000 7f3b82ffd640 1 -- 172.21.15.87:0/4275004950 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b78031930 con 0x7f3b8406c7f0 2023-12-16T20:21:39.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.855+0000 7f3b8a7b0640 1 -- 172.21.15.87:0/4275004950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b8406c7f0 msgr2=0x7f3b8406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:39.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.855+0000 7f3b8a7b0640 1 --2- 172.21.15.87:0/4275004950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b8406c7f0 0x7f3b8406b9b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3b780097a0 tx=0x7f3b7802b840 comp rx=0 tx=0).stop 2023-12-16T20:21:39.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.855+0000 7f3b8a7b0640 1 -- 172.21.15.87:0/4275004950 shutdown_connections 2023-12-16T20:21:39.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.855+0000 7f3b8a7b0640 1 --2- 172.21.15.87:0/4275004950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b8406c7f0 0x7f3b8406b9b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:39.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.855+0000 7f3b8a7b0640 1 -- 172.21.15.87:0/4275004950 >> 172.21.15.87:0/4275004950 conn(0x7f3b840cee20 msgr2=0x7f3b840cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:39.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.855+0000 7f3b8a7b0640 1 -- 172.21.15.87:0/4275004950 shutdown_connections 2023-12-16T20:21:39.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.855+0000 7f3b8a7b0640 1 -- 172.21.15.87:0/4275004950 wait complete. 2023-12-16T20:21:39.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.857+0000 7f3b8a7b0640 1 Processor -- start 2023-12-16T20:21:39.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.857+0000 7f3b8a7b0640 1 -- start start 2023-12-16T20:21:39.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.858+0000 7f3b8a7b0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b8406bef0 0x7f3b8415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:39.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.858+0000 7f3b8a7b0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b8406c7f0 0x7f3b841e6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:39.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.858+0000 7f3b8a7b0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b84153ba0 0x7f3b841ef0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:39.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.858+0000 7f3b8a7b0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b841f3100 con 0x7f3b8406c7f0 2023-12-16T20:21:39.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.858+0000 7f3b8a7b0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b841f33c0 con 0x7f3b8406bef0 2023-12-16T20:21:39.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.858+0000 7f3b8a7b0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8415bcc0 con 0x7f3b84153ba0 2023-12-16T20:21:39.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.859+0000 7f3b88d4d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b84153ba0 0x7f3b841ef0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:39.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.859+0000 7f3b83fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b8406bef0 0x7f3b8415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:39.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.859+0000 7f3b88d4d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b84153ba0 0x7f3b841ef0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:47816/0 (socket says 172.21.15.87:47816) 2023-12-16T20:21:39.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.859+0000 7f3b88d4d640 1 -- 172.21.15.87:0/2455304064 learned_addr learned my addr 172.21.15.87:0/2455304064 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:39.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.863+0000 7f3b83fff640 1 -- 172.21.15.87:0/2455304064 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b84153ba0 msgr2=0x7f3b841ef0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:39.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.863+0000 7f3b83fff640 1 --2- 172.21.15.87:0/2455304064 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b84153ba0 0x7f3b841ef0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:39.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.863+0000 7f3b83fff640 1 -- 172.21.15.87:0/2455304064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b8406c7f0 msgr2=0x7f3b841e6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:39.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.863+0000 7f3b83fff640 1 --2- 172.21.15.87:0/2455304064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b8406c7f0 0x7f3b841e6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:39.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.863+0000 7f3b83fff640 1 -- 172.21.15.87:0/2455304064 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b78009400 con 0x7f3b8406bef0 2023-12-16T20:21:39.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.863+0000 7f3b88d4d640 1 --2- 172.21.15.87:0/2455304064 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b84153ba0 0x7f3b841ef0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:21:39.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.865+0000 7f3b83fff640 1 --2- 172.21.15.87:0/2455304064 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b8406bef0 0x7f3b8415c4c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400b3e0 tx=0x7f3b7400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:39.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.868+0000 7f3b80ff9640 1 -- 172.21.15.87:0/2455304064 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74011830 con 0x7f3b8406bef0 2023-12-16T20:21:39.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.869+0000 7f3b80ff9640 1 -- 172.21.15.87:0/2455304064 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b74011990 con 0x7f3b8406bef0 2023-12-16T20:21:39.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.869+0000 7f3b80ff9640 1 -- 172.21.15.87:0/2455304064 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74011d40 con 0x7f3b8406bef0 2023-12-16T20:21:39.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.869+0000 7f3b8a7b0640 1 -- 172.21.15.87:0/2455304064 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8415bfa0 con 0x7f3b8406bef0 2023-12-16T20:21:39.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.869+0000 7f3b8a7b0640 1 -- 172.21.15.87:0/2455304064 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8415a8e0 con 0x7f3b8406bef0 2023-12-16T20:21:39.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:39.870+0000 7f3b8a7b0640 1 -- 172.21.15.87:0/2455304064 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8415b510 con 0x7f3b8406bef0 2023-12-16T20:21:40.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.112+0000 7f3b80ff9640 1 -- 172.21.15.87:0/2455304064 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f3b7401a400 con 0x7f3b8406bef0 2023-12-16T20:21:40.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.112+0000 7f3b80ff9640 1 --2- 172.21.15.87:0/2455304064 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f3b7006ae70 0x7f3b7006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:40.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.112+0000 7f3b837fe640 1 --2- 172.21.15.87:0/2455304064 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f3b7006ae70 0x7f3b7006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:40.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.113+0000 7f3b837fe640 1 --2- 172.21.15.87:0/2455304064 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f3b7006ae70 0x7f3b7006d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b78036000 tx=0x7f3b78030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:40.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.116+0000 7f3b80ff9640 1 -- 172.21.15.87:0/2455304064 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f3b74058f80 con 0x7f3b8406bef0 2023-12-16T20:21:40.147 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.146+0000 7f3b80ff9640 1 -- 172.21.15.87:0/2455304064 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f3b74054bc0 con 0x7f3b8406bef0 2023-12-16T20:21:40.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.335+0000 7f3b8a7b0640 1 -- 172.21.15.87:0/2455304064 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f3b8415b510 con 0x7f3b8406bef0 2023-12-16T20:21:40.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.799+0000 7f3b80ff9640 1 -- 172.21.15.87:0/2455304064 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3b8415b510 con 0x7f3b8406bef0 2023-12-16T20:21:40.800 INFO:teuthology.orchestra.run.smithi087.stderr:set pool 4 allow_ec_overwrites to true 2023-12-16T20:21:40.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.801+0000 7f3b8a7b0640 1 -- 172.21.15.87:0/2455304064 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f3b7006ae70 msgr2=0x7f3b7006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:40.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.801+0000 7f3b8a7b0640 1 --2- 172.21.15.87:0/2455304064 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f3b7006ae70 0x7f3b7006d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b78036000 tx=0x7f3b78030000 comp rx=0 tx=0).stop 2023-12-16T20:21:40.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.801+0000 7f3b8a7b0640 1 -- 172.21.15.87:0/2455304064 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b8406bef0 msgr2=0x7f3b8415c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:40.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.801+0000 7f3b8a7b0640 1 --2- 172.21.15.87:0/2455304064 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b8406bef0 0x7f3b8415c4c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400b3e0 tx=0x7f3b7400b8a0 comp rx=0 tx=0).stop 2023-12-16T20:21:40.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.801+0000 7f3b8a7b0640 1 -- 172.21.15.87:0/2455304064 shutdown_connections 2023-12-16T20:21:40.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.801+0000 7f3b8a7b0640 1 --2- 172.21.15.87:0/2455304064 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3b84153ba0 0x7f3b841ef0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:40.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.801+0000 7f3b8a7b0640 1 --2- 172.21.15.87:0/2455304064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b8406c7f0 0x7f3b841e6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:40.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.801+0000 7f3b8a7b0640 1 --2- 172.21.15.87:0/2455304064 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f3b7006ae70 0x7f3b7006d330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:40.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.801+0000 7f3b8a7b0640 1 --2- 172.21.15.87:0/2455304064 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b8406bef0 0x7f3b8415c4c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:40.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.801+0000 7f3b8a7b0640 1 -- 172.21.15.87:0/2455304064 >> 172.21.15.87:0/2455304064 conn(0x7f3b840cee20 msgr2=0x7f3b840cd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:40.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.801+0000 7f3b8a7b0640 1 -- 172.21.15.87:0/2455304064 shutdown_connections 2023-12-16T20:21:40.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.801+0000 7f3b8a7b0640 1 -- 172.21.15.87:0/2455304064 wait complete. 2023-12-16T20:21:40.813 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-16T20:21:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.919+0000 7f590e383640 1 Processor -- start 2023-12-16T20:21:40.921 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.919+0000 7f590e383640 1 -- start start 2023-12-16T20:21:40.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.920+0000 7f590e383640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f59081516a0 0x7f590806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:40.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.920+0000 7f590e383640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f590815fcb0 0x7f59081620a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:40.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.920+0000 7f590e383640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5908157da0 con 0x7f59080c8540 2023-12-16T20:21:40.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.920+0000 7f590e383640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59080c71e0 con 0x7f590815fcb0 2023-12-16T20:21:40.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.920+0000 7f590e383640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5908071b40 con 0x7f59081516a0 2023-12-16T20:21:40.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.920+0000 7f5907fff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f59081516a0 0x7f590806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:40.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.921+0000 7f5907fff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f59081516a0 0x7f590806c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:56046/0 (socket says 172.21.15.87:56046) 2023-12-16T20:21:40.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.921+0000 7f5907fff640 1 -- 172.21.15.87:0/927426125 learned_addr learned my addr 172.21.15.87:0/927426125 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:40.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.923+0000 7f5907fff640 1 -- 172.21.15.87:0/927426125 >> v2:172.21.15.87:3300/0 conn(0x7f590815fcb0 msgr2=0x7f59081620a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:40.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.923+0000 7f5907fff640 1 --2- 172.21.15.87:0/927426125 >> v2:172.21.15.87:3300/0 conn(0x7f590815fcb0 0x7f59081620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:40.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.923+0000 7f5907fff640 1 -- 172.21.15.87:0/927426125 >> v1:172.21.15.87:6789/0 conn(0x7f59080c8540 legacy=0x7f5908072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:40.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.923+0000 7f5907fff640 1 -- 172.21.15.87:0/927426125 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5908071e20 con 0x7f59081516a0 2023-12-16T20:21:40.926 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.925+0000 7f5907fff640 1 --2- 172.21.15.87:0/927426125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59081516a0 0x7f590806c5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f590806e1e0 tx=0x7f58fc02b9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d90f41038cc64d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:40.930 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.928+0000 7f5906ffd640 1 -- 172.21.15.87:0/927426125 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc030880 con 0x7f59081516a0 2023-12-16T20:21:40.930 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.928+0000 7f5906ffd640 1 -- 172.21.15.87:0/927426125 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc0309e0 con 0x7f59081516a0 2023-12-16T20:21:40.930 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.928+0000 7f5906ffd640 1 -- 172.21.15.87:0/927426125 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc030d70 con 0x7f59081516a0 2023-12-16T20:21:40.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.929+0000 7f590e383640 1 -- 172.21.15.87:0/927426125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59081516a0 msgr2=0x7f590806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:40.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.929+0000 7f590e383640 1 --2- 172.21.15.87:0/927426125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59081516a0 0x7f590806c5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f590806e1e0 tx=0x7f58fc02b9c0 comp rx=0 tx=0).stop 2023-12-16T20:21:40.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.929+0000 7f590e383640 1 -- 172.21.15.87:0/927426125 shutdown_connections 2023-12-16T20:21:40.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.929+0000 7f590e383640 1 --2- 172.21.15.87:0/927426125 >> v2:172.21.15.87:3300/0 conn(0x7f590815fcb0 0x7f59081620a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:40.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.929+0000 7f590e383640 1 --2- 172.21.15.87:0/927426125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59081516a0 0x7f590806c5a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:40.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.929+0000 7f590e383640 1 -- 172.21.15.87:0/927426125 >> 172.21.15.87:0/927426125 conn(0x7f59080c79e0 msgr2=0x7f59080c7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:40.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.929+0000 7f590e383640 1 -- 172.21.15.87:0/927426125 shutdown_connections 2023-12-16T20:21:40.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.929+0000 7f590e383640 1 -- 172.21.15.87:0/927426125 wait complete. 2023-12-16T20:21:40.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.930+0000 7f590e383640 1 Processor -- start 2023-12-16T20:21:40.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.930+0000 7f590e383640 1 -- start start 2023-12-16T20:21:40.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.931+0000 7f590e383640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59080c8540 0x7f590815dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:40.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.931+0000 7f590e383640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59081516a0 0x7f590815cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:40.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.931+0000 7f590e383640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f590815fcb0 0x7f590814a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:40.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.931+0000 7f590e383640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590814c570 con 0x7f59080c8540 2023-12-16T20:21:40.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.931+0000 7f590e383640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590815ee10 con 0x7f59081516a0 2023-12-16T20:21:40.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.931+0000 7f590e383640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59080c53f0 con 0x7f590815fcb0 2023-12-16T20:21:40.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.932+0000 7f590c920640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f590815fcb0 0x7f590814a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:40.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.932+0000 7f59077fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59081516a0 0x7f590815cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:40.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.932+0000 7f590c920640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f590815fcb0 0x7f590814a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:44748/0 (socket says 172.21.15.87:44748) 2023-12-16T20:21:40.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.932+0000 7f590c920640 1 -- 172.21.15.87:0/509191661 learned_addr learned my addr 172.21.15.87:0/509191661 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:40.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.935+0000 7f59077fe640 1 -- 172.21.15.87:0/509191661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f590815fcb0 msgr2=0x7f590814a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:40.937 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.935+0000 7f59077fe640 1 --2- 172.21.15.87:0/509191661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f590815fcb0 0x7f590814a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:40.937 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.935+0000 7f59077fe640 1 -- 172.21.15.87:0/509191661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59080c8540 msgr2=0x7f590815dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:40.937 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.935+0000 7f59077fe640 1 --2- 172.21.15.87:0/509191661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59080c8540 0x7f590815dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:40.937 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.935+0000 7f59077fe640 1 -- 172.21.15.87:0/509191661 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc0094d0 con 0x7f59081516a0 2023-12-16T20:21:40.939 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.938+0000 7f59077fe640 1 --2- 172.21.15.87:0/509191661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59081516a0 0x7f590815cb20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f58f800c410 tx=0x7f58f800c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:40.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.942+0000 7f5904ff9640 1 -- 172.21.15.87:0/509191661 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f80035f0 con 0x7f59081516a0 2023-12-16T20:21:40.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.942+0000 7f5904ff9640 1 -- 172.21.15.87:0/509191661 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f8003770 con 0x7f59081516a0 2023-12-16T20:21:40.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.942+0000 7f5904ff9640 1 -- 172.21.15.87:0/509191661 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f8003b60 con 0x7f59081516a0 2023-12-16T20:21:40.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.942+0000 7f590e383640 1 -- 172.21.15.87:0/509191661 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590806f740 con 0x7f59081516a0 2023-12-16T20:21:40.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.942+0000 7f590e383640 1 -- 172.21.15.87:0/509191661 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59081f3260 con 0x7f59081516a0 2023-12-16T20:21:40.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.943+0000 7f590e383640 1 -- 172.21.15.87:0/509191661 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590814c6b0 con 0x7f59081516a0 2023-12-16T20:21:40.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.963+0000 7f5904ff9640 1 -- 172.21.15.87:0/509191661 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f58f8003cc0 con 0x7f59081516a0 2023-12-16T20:21:40.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.963+0000 7f5904ff9640 1 --2- 172.21.15.87:0/509191661 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f58f406ae40 0x7f58f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:40.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.963+0000 7f5907fff640 1 --2- 172.21.15.87:0/509191661 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f58f406ae40 0x7f58f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:40.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.964+0000 7f5907fff640 1 --2- 172.21.15.87:0/509191661 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f58f406ae40 0x7f58f406d300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f58fc036000 tx=0x7f58fc03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:40.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:40.965+0000 7f5904ff9640 1 -- 172.21.15.87:0/509191661 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f58f80577e0 con 0x7f59081516a0 2023-12-16T20:21:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:41.202+0000 7f5904ff9640 1 -- 172.21.15.87:0/509191661 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f58f8053b20 con 0x7f59081516a0 2023-12-16T20:21:41.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:41.412+0000 7f590e383640 1 -- 172.21.15.87:0/509191661 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f590806b490 con 0x7f59081516a0 2023-12-16T20:21:42.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.091+0000 7f5904ff9640 1 -- 172.21.15.87:0/509191661 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f58f8017020 con 0x7f59081516a0 2023-12-16T20:21:42.093 INFO:teuthology.orchestra.run.smithi087.stderr:added data pool 4 to fsmap 2023-12-16T20:21:42.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.093+0000 7f590e383640 1 -- 172.21.15.87:0/509191661 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f58f406ae40 msgr2=0x7f58f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:42.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.093+0000 7f590e383640 1 --2- 172.21.15.87:0/509191661 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f58f406ae40 0x7f58f406d300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f58fc036000 tx=0x7f58fc03b040 comp rx=0 tx=0).stop 2023-12-16T20:21:42.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.093+0000 7f590e383640 1 -- 172.21.15.87:0/509191661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59081516a0 msgr2=0x7f590815cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:42.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.093+0000 7f590e383640 1 --2- 172.21.15.87:0/509191661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59081516a0 0x7f590815cb20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f58f800c410 tx=0x7f58f800c810 comp rx=0 tx=0).stop 2023-12-16T20:21:42.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.093+0000 7f590e383640 1 -- 172.21.15.87:0/509191661 shutdown_connections 2023-12-16T20:21:42.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.093+0000 7f590e383640 1 --2- 172.21.15.87:0/509191661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f590815fcb0 0x7f590814a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.093+0000 7f590e383640 1 --2- 172.21.15.87:0/509191661 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f58f406ae40 0x7f58f406d300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.093+0000 7f590e383640 1 --2- 172.21.15.87:0/509191661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59081516a0 0x7f590815cb20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.093+0000 7f590e383640 1 --2- 172.21.15.87:0/509191661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59080c8540 0x7f590815dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.093+0000 7f590e383640 1 -- 172.21.15.87:0/509191661 >> 172.21.15.87:0/509191661 conn(0x7f59080c79e0 msgr2=0x7f5908073850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:42.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.093+0000 7f590e383640 1 -- 172.21.15.87:0/509191661 shutdown_connections 2023-12-16T20:21:42.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.094+0000 7f590e383640 1 -- 172.21.15.87:0/509191661 wait complete. 2023-12-16T20:21:42.105 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T20:21:42.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.204+0000 7f1d9df73640 1 Processor -- start 2023-12-16T20:21:42.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.204+0000 7f1d9df73640 1 -- start start 2023-12-16T20:21:42.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.205+0000 7f1d9df73640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1d980c82b0 0x7f1d980c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:42.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.205+0000 7f1d9df73640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1d9815d600 0x7f1d9806fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:42.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.205+0000 7f1d9df73640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d98159ba0 con 0x7f1d9806f720 2023-12-16T20:21:42.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.205+0000 7f1d9df73640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9815da90 con 0x7f1d9815d600 2023-12-16T20:21:42.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.205+0000 7f1d9df73640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d98070040 con 0x7f1d980c82b0 2023-12-16T20:21:42.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.206+0000 7f1d96ffd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1d980c82b0 0x7f1d980c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:42.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.207+0000 7f1d96ffd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1d980c82b0 0x7f1d980c7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:56060/0 (socket says 172.21.15.87:56060) 2023-12-16T20:21:42.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.207+0000 7f1d96ffd640 1 -- 172.21.15.87:0/3961475275 learned_addr learned my addr 172.21.15.87:0/3961475275 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:42.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.208+0000 7f1d97fff640 1 --2- 172.21.15.87:0/3961475275 >> v2:172.21.15.87:3300/0 conn(0x7f1d9815d600 0x7f1d9806fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:42.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.209+0000 7f1d96ffd640 1 -- 172.21.15.87:0/3961475275 >> v2:172.21.15.87:3300/0 conn(0x7f1d9815d600 msgr2=0x7f1d9806fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:42.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.209+0000 7f1d96ffd640 1 --2- 172.21.15.87:0/3961475275 >> v2:172.21.15.87:3300/0 conn(0x7f1d9815d600 0x7f1d9806fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.209+0000 7f1d96ffd640 1 -- 172.21.15.87:0/3961475275 >> v1:172.21.15.87:6789/0 conn(0x7f1d9806f720 legacy=0x7f1d98159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:42.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.209+0000 7f1d96ffd640 1 -- 172.21.15.87:0/3961475275 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9815a3e0 con 0x7f1d980c82b0 2023-12-16T20:21:42.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.215+0000 7f1d96ffd640 1 --2- 172.21.15.87:0/3961475275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d980c82b0 0x7f1d980c7040 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1d980c65b0 tx=0x7f1d8c02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ddcf707944a9bba server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:42.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.218+0000 7f1d967fc640 1 -- 172.21.15.87:0/3961475275 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c031870 con 0x7f1d980c82b0 2023-12-16T20:21:42.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.219+0000 7f1d967fc640 1 -- 172.21.15.87:0/3961475275 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c0319d0 con 0x7f1d980c82b0 2023-12-16T20:21:42.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.219+0000 7f1d967fc640 1 -- 172.21.15.87:0/3961475275 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c031d60 con 0x7f1d980c82b0 2023-12-16T20:21:42.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.219+0000 7f1d9df73640 1 -- 172.21.15.87:0/3961475275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d980c82b0 msgr2=0x7f1d980c7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:42.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.219+0000 7f1d9df73640 1 --2- 172.21.15.87:0/3961475275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d980c82b0 0x7f1d980c7040 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1d980c65b0 tx=0x7f1d8c02b910 comp rx=0 tx=0).stop 2023-12-16T20:21:42.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.219+0000 7f1d9df73640 1 -- 172.21.15.87:0/3961475275 shutdown_connections 2023-12-16T20:21:42.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.219+0000 7f1d9df73640 1 --2- 172.21.15.87:0/3961475275 >> v2:172.21.15.87:3300/0 conn(0x7f1d9815d600 0x7f1d9806fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.219+0000 7f1d9df73640 1 --2- 172.21.15.87:0/3961475275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d980c82b0 0x7f1d980c7040 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.219+0000 7f1d9df73640 1 -- 172.21.15.87:0/3961475275 >> 172.21.15.87:0/3961475275 conn(0x7f1d980cbef0 msgr2=0x7f1d980cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:42.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.219+0000 7f1d9df73640 1 -- 172.21.15.87:0/3961475275 shutdown_connections 2023-12-16T20:21:42.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.219+0000 7f1d9df73640 1 -- 172.21.15.87:0/3961475275 wait complete. 2023-12-16T20:21:42.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.220+0000 7f1d9df73640 1 Processor -- start 2023-12-16T20:21:42.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.221+0000 7f1d9df73640 1 -- start start 2023-12-16T20:21:42.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.221+0000 7f1d9df73640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d9806f720 0x7f1d98157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:42.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.221+0000 7f1d9df73640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d980c82b0 0x7f1d98157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:42.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.221+0000 7f1d9df73640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d9815d600 0x7f1d981f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:42.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.221+0000 7f1d9df73640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d981efae0 con 0x7f1d9815d600 2023-12-16T20:21:42.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.221+0000 7f1d9df73640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d981e57c0 con 0x7f1d9806f720 2023-12-16T20:21:42.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.221+0000 7f1d9df73640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d981eff70 con 0x7f1d980c82b0 2023-12-16T20:21:42.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.222+0000 7f1d97fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d9815d600 0x7f1d981f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:42.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.222+0000 7f1d977fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d9806f720 0x7f1d98157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:42.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.222+0000 7f1d96ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d980c82b0 0x7f1d98157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:42.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.222+0000 7f1d97fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d9815d600 0x7f1d981f2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42112/0 (socket says 172.21.15.87:42112) 2023-12-16T20:21:42.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.222+0000 7f1d97fff640 1 -- 172.21.15.87:0/2625028863 learned_addr learned my addr 172.21.15.87:0/2625028863 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:42.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.225+0000 7f1d97fff640 1 -- 172.21.15.87:0/2625028863 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d980c82b0 msgr2=0x7f1d98157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:42.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.225+0000 7f1d97fff640 1 --2- 172.21.15.87:0/2625028863 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d980c82b0 0x7f1d98157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.225+0000 7f1d97fff640 1 -- 172.21.15.87:0/2625028863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d9806f720 msgr2=0x7f1d98157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:42.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.225+0000 7f1d97fff640 1 --2- 172.21.15.87:0/2625028863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d9806f720 0x7f1d98157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.225+0000 7f1d97fff640 1 -- 172.21.15.87:0/2625028863 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c0094d0 con 0x7f1d9815d600 2023-12-16T20:21:42.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.227+0000 7f1d97fff640 1 --2- 172.21.15.87:0/2625028863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d9815d600 0x7f1d981f2580 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d90007e40 tx=0x7f1d9000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:42.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.231+0000 7f1d7ffff640 1 -- 172.21.15.87:0/2625028863 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90014620 con 0x7f1d9815d600 2023-12-16T20:21:42.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.231+0000 7f1d7ffff640 1 -- 172.21.15.87:0/2625028863 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9000ee90 con 0x7f1d9815d600 2023-12-16T20:21:42.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.231+0000 7f1d7ffff640 1 -- 172.21.15.87:0/2625028863 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900149e0 con 0x7f1d9815d600 2023-12-16T20:21:42.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.231+0000 7f1d9df73640 1 -- 172.21.15.87:0/2625028863 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d981e5220 con 0x7f1d9815d600 2023-12-16T20:21:42.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.231+0000 7f1d9df73640 1 -- 172.21.15.87:0/2625028863 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d981ef1b0 con 0x7f1d9815d600 2023-12-16T20:21:42.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.232+0000 7f1d9df73640 1 -- 172.21.15.87:0/2625028863 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d981efc50 con 0x7f1d9815d600 2023-12-16T20:21:42.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.473+0000 7f1d7ffff640 1 -- 172.21.15.87:0/2625028863 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f1d90014b40 con 0x7f1d9815d600 2023-12-16T20:21:42.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.473+0000 7f1d7ffff640 1 --2- 172.21.15.87:0/2625028863 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1d8406ae40 0x7f1d8406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:42.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.473+0000 7f1d977fe640 1 --2- 172.21.15.87:0/2625028863 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1d8406ae40 0x7f1d8406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:42.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.473+0000 7f1d977fe640 1 --2- 172.21.15.87:0/2625028863 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1d8406ae40 0x7f1d8406d300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1d88006fd0 tx=0x7f1d88009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:42.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.487+0000 7f1d7ffff640 1 -- 172.21.15.87:0/2625028863 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1d90059810 con 0x7f1d9815d600 2023-12-16T20:21:42.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.487+0000 7f1d7ffff640 1 -- 172.21.15.87:0/2625028863 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f1d90055b50 con 0x7f1d9815d600 2023-12-16T20:21:42.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.690+0000 7f1d9df73640 1 -- 172.21.15.87:0/2625028863 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d980740e0 con 0x7f1d9815d600 2023-12-16T20:21:42.720 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.719+0000 7f1d7ffff640 1 -- 172.21.15.87:0/2625028863 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6523 (secure 0 0 0) 0x7f1d90059170 con 0x7f1d9815d600 2023-12-16T20:21:42.720 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:21:42.720 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2198156124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2198156124},{"type":"v1","addr":"172.21.15.87:6835","nonce":2198156124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3187160209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3187160209},{"type":"v1","addr":"172.21.15.195:6833","nonce":3187160209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3703236183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":3703236183},{"type":"v1","addr":"172.21.15.87:6837","nonce":3703236183}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1942743723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1942743723},{"type":"v1","addr":"172.21.15.87:6839","nonce":1942743723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/3327792325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3327792325},{"type":"v1","addr":"172.21.15.195:6836","nonce":3327792325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T20:21:36.158936+0000","modified":"2023-12-16T20:21:41.436051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6837/3093855583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3093855583},{"type":"v1","addr":"172.21.15.195:6837","nonce":3093855583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-16T20:21:42.721 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 7 2023-12-16T20:21:42.722 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.721+0000 7f1d9df73640 1 -- 172.21.15.87:0/2625028863 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1d8406ae40 msgr2=0x7f1d8406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:42.722 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.721+0000 7f1d9df73640 1 --2- 172.21.15.87:0/2625028863 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1d8406ae40 0x7f1d8406d300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1d88006fd0 tx=0x7f1d88009060 comp rx=0 tx=0).stop 2023-12-16T20:21:42.722 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.721+0000 7f1d9df73640 1 -- 172.21.15.87:0/2625028863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d9815d600 msgr2=0x7f1d981f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:42.722 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.721+0000 7f1d9df73640 1 --2- 172.21.15.87:0/2625028863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d9815d600 0x7f1d981f2580 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d90007e40 tx=0x7f1d9000e4b0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.721+0000 7f1d9df73640 1 -- 172.21.15.87:0/2625028863 shutdown_connections 2023-12-16T20:21:42.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.721+0000 7f1d9df73640 1 --2- 172.21.15.87:0/2625028863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d9815d600 0x7f1d981f2580 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.721+0000 7f1d9df73640 1 --2- 172.21.15.87:0/2625028863 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1d980c82b0 0x7f1d98157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.721+0000 7f1d9df73640 1 --2- 172.21.15.87:0/2625028863 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1d8406ae40 0x7f1d8406d300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.721+0000 7f1d9df73640 1 --2- 172.21.15.87:0/2625028863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d9806f720 0x7f1d98157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.721+0000 7f1d9df73640 1 -- 172.21.15.87:0/2625028863 >> 172.21.15.87:0/2625028863 conn(0x7f1d980cbef0 msgr2=0x7f1d98149910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:42.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.721+0000 7f1d9df73640 1 -- 172.21.15.87:0/2625028863 shutdown_connections 2023-12-16T20:21:42.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.721+0000 7f1d9df73640 1 -- 172.21.15.87:0/2625028863 wait complete. 2023-12-16T20:21:42.733 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:21:42.833 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.831+0000 7f2a48089640 1 Processor -- start 2023-12-16T20:21:42.833 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.831+0000 7f2a48089640 1 -- start start 2023-12-16T20:21:42.833 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.832+0000 7f2a48089640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2a4006f590 0x7f2a40157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:42.833 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.832+0000 7f2a48089640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a400c2000 0x7f2a400c2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:42.833 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.832+0000 7f2a48089640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4006fa00 con 0x7f2a40151630 2023-12-16T20:21:42.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.832+0000 7f2a48089640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a40158490 con 0x7f2a4006f590 2023-12-16T20:21:42.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.832+0000 7f2a48089640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400c29b0 con 0x7f2a400c2000 2023-12-16T20:21:42.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.833+0000 7f2a45624640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2a4006f590 0x7f2a40157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:42.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.833+0000 7f2a45e25640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f2a40151630 0x7f2a400c9bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:36014/0 (socket says 172.21.15.87:36014) 2023-12-16T20:21:42.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.833+0000 7f2a45e25640 1 -- 172.21.15.87:0/1767179073 learned_addr learned my addr 172.21.15.87:0/1767179073 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:42.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.833+0000 7f2a46626640 1 --2- 172.21.15.87:0/1767179073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a400c2000 0x7f2a400c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:42.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.835+0000 7f2a45624640 1 -- 172.21.15.87:0/1767179073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a400c2000 msgr2=0x7f2a400c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:42.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.835+0000 7f2a45624640 1 --2- 172.21.15.87:0/1767179073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a400c2000 0x7f2a400c2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.835+0000 7f2a45624640 1 -- 172.21.15.87:0/1767179073 >> v1:172.21.15.195:6789/0 conn(0x7f2a40151630 legacy=0x7f2a400c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:42.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.835+0000 7f2a45624640 1 -- 172.21.15.87:0/1767179073 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4015b9c0 con 0x7f2a4006f590 2023-12-16T20:21:42.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.837+0000 7f2a45624640 1 --2- 172.21.15.87:0/1767179073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a4006f590 0x7f2a40157f50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2a300097a0 tx=0x7f2a3002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500c2168589b7a6a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:42.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.841+0000 7f2a44e23640 1 -- 172.21.15.87:0/1767179073 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30030610 con 0x7f2a4006f590 2023-12-16T20:21:42.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.841+0000 7f2a44e23640 1 -- 172.21.15.87:0/1767179073 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a30030770 con 0x7f2a4006f590 2023-12-16T20:21:42.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.841+0000 7f2a44e23640 1 -- 172.21.15.87:0/1767179073 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30030b00 con 0x7f2a4006f590 2023-12-16T20:21:42.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.841+0000 7f2a48089640 1 -- 172.21.15.87:0/1767179073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a4006f590 msgr2=0x7f2a40157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:42.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.841+0000 7f2a48089640 1 --2- 172.21.15.87:0/1767179073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a4006f590 0x7f2a40157f50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2a300097a0 tx=0x7f2a3002b960 comp rx=0 tx=0).stop 2023-12-16T20:21:42.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.841+0000 7f2a48089640 1 -- 172.21.15.87:0/1767179073 shutdown_connections 2023-12-16T20:21:42.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.841+0000 7f2a48089640 1 --2- 172.21.15.87:0/1767179073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a400c2000 0x7f2a400c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.841+0000 7f2a48089640 1 --2- 172.21.15.87:0/1767179073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a4006f590 0x7f2a40157f50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.841+0000 7f2a48089640 1 -- 172.21.15.87:0/1767179073 >> 172.21.15.87:0/1767179073 conn(0x7f2a40061100 msgr2=0x7f2a400614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:42.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.842+0000 7f2a48089640 1 -- 172.21.15.87:0/1767179073 shutdown_connections 2023-12-16T20:21:42.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.842+0000 7f2a48089640 1 -- 172.21.15.87:0/1767179073 wait complete. 2023-12-16T20:21:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.843+0000 7f2a48089640 1 Processor -- start 2023-12-16T20:21:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.843+0000 7f2a48089640 1 -- start start 2023-12-16T20:21:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.843+0000 7f2a48089640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a4006f590 0x7f2a400cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.843+0000 7f2a48089640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a400c2000 0x7f2a401ed210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.843+0000 7f2a48089640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a40151630 0x7f2a40146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.843+0000 7f2a48089640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4015a5d0 con 0x7f2a400c2000 2023-12-16T20:21:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.843+0000 7f2a48089640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a401ecae0 con 0x7f2a4006f590 2023-12-16T20:21:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.843+0000 7f2a48089640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400cab00 con 0x7f2a40151630 2023-12-16T20:21:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.844+0000 7f2a45624640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a400c2000 0x7f2a401ed210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.844+0000 7f2a45624640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a400c2000 0x7f2a401ed210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42122/0 (socket says 172.21.15.87:42122) 2023-12-16T20:21:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.844+0000 7f2a45624640 1 -- 172.21.15.87:0/1210470342 learned_addr learned my addr 172.21.15.87:0/1210470342 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.844+0000 7f2a46626640 1 --2- 172.21.15.87:0/1210470342 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a40151630 0x7f2a40146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.844+0000 7f2a45e25640 1 --2- 172.21.15.87:0/1210470342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a4006f590 0x7f2a400cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:42.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.847+0000 7f2a45624640 1 -- 172.21.15.87:0/1210470342 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a40151630 msgr2=0x7f2a40146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:42.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.847+0000 7f2a45624640 1 --2- 172.21.15.87:0/1210470342 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a40151630 0x7f2a40146530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.847+0000 7f2a45624640 1 -- 172.21.15.87:0/1210470342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a4006f590 msgr2=0x7f2a400cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:42.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.847+0000 7f2a45624640 1 --2- 172.21.15.87:0/1210470342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a4006f590 0x7f2a400cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:42.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.847+0000 7f2a45624640 1 -- 172.21.15.87:0/1210470342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a30009400 con 0x7f2a400c2000 2023-12-16T20:21:42.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.850+0000 7f2a45624640 1 --2- 172.21.15.87:0/1210470342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a400c2000 0x7f2a401ed210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2a3002bf70 tx=0x7f2a300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:42.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.852+0000 7f2a367fc640 1 -- 172.21.15.87:0/1210470342 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3003e070 con 0x7f2a400c2000 2023-12-16T20:21:42.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.852+0000 7f2a48089640 1 -- 172.21.15.87:0/1210470342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a40159a50 con 0x7f2a400c2000 2023-12-16T20:21:42.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.852+0000 7f2a48089640 1 -- 172.21.15.87:0/1210470342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4015a010 con 0x7f2a400c2000 2023-12-16T20:21:42.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.853+0000 7f2a48089640 1 -- 172.21.15.87:0/1210470342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a400740e0 con 0x7f2a400c2000 2023-12-16T20:21:42.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.853+0000 7f2a367fc640 1 -- 172.21.15.87:0/1210470342 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a30030e10 con 0x7f2a400c2000 2023-12-16T20:21:42.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:42.853+0000 7f2a367fc640 1 -- 172.21.15.87:0/1210470342 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30039c30 con 0x7f2a400c2000 2023-12-16T20:21:43.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.097+0000 7f2a367fc640 1 -- 172.21.15.87:0/1210470342 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f2a300423f0 con 0x7f2a400c2000 2023-12-16T20:21:43.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.098+0000 7f2a367fc640 1 --2- 172.21.15.87:0/1210470342 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2a2406ae40 0x7f2a2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:43.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.098+0000 7f2a45e25640 1 --2- 172.21.15.87:0/1210470342 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2a2406ae40 0x7f2a2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:43.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.098+0000 7f2a45e25640 1 --2- 172.21.15.87:0/1210470342 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2a2406ae40 0x7f2a2406d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c005c00 tx=0x7f2a3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:43.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.113+0000 7f2a367fc640 1 -- 172.21.15.87:0/1210470342 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2a3007a910 con 0x7f2a400c2000 2023-12-16T20:21:43.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.113+0000 7f2a367fc640 1 -- 172.21.15.87:0/1210470342 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f2a30076c50 con 0x7f2a400c2000 2023-12-16T20:21:43.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.297+0000 7f2a48089640 1 -- 172.21.15.87:0/1210470342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a400cd950 con 0x7f2a400c2000 2023-12-16T20:21:43.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.398+0000 7f2a367fc640 1 -- 172.21.15.87:0/1210470342 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f2a30034020 con 0x7f2a400c2000 2023-12-16T20:21:43.400 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:21:43.400 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:21:41.431615+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:21:22.654341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T20:21:33.728787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T20:21:34.846119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T20:21:38.657738+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:21:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.400+0000 7f2a48089640 1 -- 172.21.15.87:0/1210470342 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2a2406ae40 msgr2=0x7f2a2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.400+0000 7f2a48089640 1 --2- 172.21.15.87:0/1210470342 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2a2406ae40 0x7f2a2406d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c005c00 tx=0x7f2a3c009040 comp rx=0 tx=0).stop 2023-12-16T20:21:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.400+0000 7f2a48089640 1 -- 172.21.15.87:0/1210470342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a400c2000 msgr2=0x7f2a401ed210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.400+0000 7f2a48089640 1 --2- 172.21.15.87:0/1210470342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a400c2000 0x7f2a401ed210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2a3002bf70 tx=0x7f2a300046c0 comp rx=0 tx=0).stop 2023-12-16T20:21:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.400+0000 7f2a48089640 1 -- 172.21.15.87:0/1210470342 shutdown_connections 2023-12-16T20:21:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.400+0000 7f2a48089640 1 --2- 172.21.15.87:0/1210470342 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a40151630 0x7f2a40146530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.400+0000 7f2a48089640 1 --2- 172.21.15.87:0/1210470342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a400c2000 0x7f2a401ed210 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.400+0000 7f2a48089640 1 --2- 172.21.15.87:0/1210470342 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2a2406ae40 0x7f2a2406d300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.400+0000 7f2a48089640 1 --2- 172.21.15.87:0/1210470342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a4006f590 0x7f2a400cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.400+0000 7f2a48089640 1 -- 172.21.15.87:0/1210470342 >> 172.21.15.87:0/1210470342 conn(0x7f2a40061100 msgr2=0x7f2a400614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.400+0000 7f2a48089640 1 -- 172.21.15.87:0/1210470342 shutdown_connections 2023-12-16T20:21:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.400+0000 7f2a48089640 1 -- 172.21.15.87:0/1210470342 wait complete. 2023-12-16T20:21:43.413 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:21:43.514 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.512+0000 7fe5f2e9b640 1 Processor -- start 2023-12-16T20:21:43.514 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.512+0000 7fe5f2e9b640 1 -- start start 2023-12-16T20:21:43.514 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.513+0000 7fe5f2e9b640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe5ec0c4de0 0x7fe5ec06f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:43.515 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.513+0000 7fe5f2e9b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ec0c7dd0 con 0x7fe5ec06f940 2023-12-16T20:21:43.515 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.513+0000 7fe5f2e9b640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ec158640 con 0x7fe5ec0c51c0 2023-12-16T20:21:43.515 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.513+0000 7fe5f2e9b640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5ec06ec40 con 0x7fe5ec0c4de0 2023-12-16T20:21:43.515 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.514+0000 7fe5ebfff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe5ec06f940 0x7fe5ec1514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60438/0 (socket says 172.21.15.87:60438) 2023-12-16T20:21:43.515 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.514+0000 7fe5ebfff640 1 -- 172.21.15.87:0/441808698 learned_addr learned my addr 172.21.15.87:0/441808698 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:43.515 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.514+0000 7fe5f0c37640 1 --2- 172.21.15.87:0/441808698 >> v2:172.21.15.195:3300/0 conn(0x7fe5ec0c4de0 0x7fe5ec06f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:43.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.516+0000 7fe5eb7fe640 1 -- 172.21.15.87:0/441808698 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778855931 0 0) 0x7fe5ec0c7dd0 con 0x7fe5ec06f940 2023-12-16T20:21:43.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.516+0000 7fe5eb7fe640 1 -- 172.21.15.87:0/441808698 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5d4003520 con 0x7fe5ec06f940 2023-12-16T20:21:43.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.517+0000 7fe5f0c37640 1 -- 172.21.15.87:0/441808698 >> v1:172.21.15.195:6789/0 conn(0x7fe5ec0c51c0 legacy=0x7fe5ec161fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:43.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.517+0000 7fe5f0c37640 1 -- 172.21.15.87:0/441808698 >> v1:172.21.15.87:6789/0 conn(0x7fe5ec06f940 legacy=0x7fe5ec1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:43.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.517+0000 7fe5f0c37640 1 -- 172.21.15.87:0/441808698 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec06a8b0 con 0x7fe5ec0c4de0 2023-12-16T20:21:43.520 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.519+0000 7fe5f0c37640 1 --2- 172.21.15.87:0/441808698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5ec0c4de0 0x7fe5ec06f400 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc0097a0 tx=0x7fe5dc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6950d610cf2501b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:43.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.525+0000 7fe5eb7fe640 1 -- 172.21.15.87:0/441808698 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc030610 con 0x7fe5ec0c4de0 2023-12-16T20:21:43.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.525+0000 7fe5eb7fe640 1 -- 172.21.15.87:0/441808698 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5dc030770 con 0x7fe5ec0c4de0 2023-12-16T20:21:43.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.525+0000 7fe5eb7fe640 1 -- 172.21.15.87:0/441808698 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc030b00 con 0x7fe5ec0c4de0 2023-12-16T20:21:43.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.526+0000 7fe5f2e9b640 1 -- 172.21.15.87:0/441808698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5ec0c4de0 msgr2=0x7fe5ec06f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:43.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.526+0000 7fe5f2e9b640 1 --2- 172.21.15.87:0/441808698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5ec0c4de0 0x7fe5ec06f400 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc0097a0 tx=0x7fe5dc02b960 comp rx=0 tx=0).stop 2023-12-16T20:21:43.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.526+0000 7fe5f2e9b640 1 -- 172.21.15.87:0/441808698 shutdown_connections 2023-12-16T20:21:43.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.526+0000 7fe5f2e9b640 1 --2- 172.21.15.87:0/441808698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5ec0c4de0 0x7fe5ec06f400 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:43.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.526+0000 7fe5f2e9b640 1 -- 172.21.15.87:0/441808698 >> 172.21.15.87:0/441808698 conn(0x7fe5ec0c7f60 msgr2=0x7fe5ec0c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:43.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.526+0000 7fe5f2e9b640 1 -- 172.21.15.87:0/441808698 shutdown_connections 2023-12-16T20:21:43.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.526+0000 7fe5f2e9b640 1 -- 172.21.15.87:0/441808698 wait complete. 2023-12-16T20:21:43.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.527+0000 7fe5f2e9b640 1 Processor -- start 2023-12-16T20:21:43.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.527+0000 7fe5f2e9b640 1 -- start start 2023-12-16T20:21:43.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.528+0000 7fe5f2e9b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5ec06f940 0x7fe5ec155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:43.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.528+0000 7fe5f2e9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5ec0c4de0 0x7fe5ec1452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:43.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.528+0000 7fe5f2e9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5ec0c51c0 0x7fe5ec0c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:43.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.528+0000 7fe5f2e9b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec1550e0 con 0x7fe5ec0c51c0 2023-12-16T20:21:43.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.528+0000 7fe5f2e9b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec1574b0 con 0x7fe5ec06f940 2023-12-16T20:21:43.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.528+0000 7fe5f2e9b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec156bc0 con 0x7fe5ec0c4de0 2023-12-16T20:21:43.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.529+0000 7fe5f1438640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5ec0c51c0 0x7fe5ec0c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:43.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.529+0000 7fe5f0c37640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5ec06f940 0x7fe5ec155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:43.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.529+0000 7fe5ebfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5ec0c4de0 0x7fe5ec1452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:43.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.529+0000 7fe5f1438640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5ec0c51c0 0x7fe5ec0c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42136/0 (socket says 172.21.15.87:42136) 2023-12-16T20:21:43.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.529+0000 7fe5f1438640 1 -- 172.21.15.87:0/3962650249 learned_addr learned my addr 172.21.15.87:0/3962650249 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:43.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.532+0000 7fe5f1438640 1 -- 172.21.15.87:0/3962650249 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5ec0c4de0 msgr2=0x7fe5ec1452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:43.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.532+0000 7fe5f1438640 1 --2- 172.21.15.87:0/3962650249 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5ec0c4de0 0x7fe5ec1452f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:43.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.532+0000 7fe5f1438640 1 -- 172.21.15.87:0/3962650249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5ec06f940 msgr2=0x7fe5ec155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:43.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.532+0000 7fe5f1438640 1 --2- 172.21.15.87:0/3962650249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5ec06f940 0x7fe5ec155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:43.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.532+0000 7fe5f1438640 1 -- 172.21.15.87:0/3962650249 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5dc009400 con 0x7fe5ec0c51c0 2023-12-16T20:21:43.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.534+0000 7fe5f1438640 1 --2- 172.21.15.87:0/3962650249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5ec0c51c0 0x7fe5ec0c9fa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400c730 tx=0x7fe5e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:43.539 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.538+0000 7fe5e97fa640 1 -- 172.21.15.87:0/3962650249 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4003b70 con 0x7fe5ec0c51c0 2023-12-16T20:21:43.539 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.538+0000 7fe5e97fa640 1 -- 172.21.15.87:0/3962650249 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e4003cd0 con 0x7fe5ec0c51c0 2023-12-16T20:21:43.539 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.538+0000 7fe5e97fa640 1 -- 172.21.15.87:0/3962650249 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4005310 con 0x7fe5ec0c51c0 2023-12-16T20:21:43.540 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.538+0000 7fe5f2e9b640 1 -- 172.21.15.87:0/3962650249 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ec156f60 con 0x7fe5ec0c51c0 2023-12-16T20:21:43.540 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.538+0000 7fe5f2e9b640 1 -- 172.21.15.87:0/3962650249 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ec1571d0 con 0x7fe5ec0c51c0 2023-12-16T20:21:43.540 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.539+0000 7fe5f2e9b640 1 -- 172.21.15.87:0/3962650249 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ec155220 con 0x7fe5ec0c51c0 2023-12-16T20:21:43.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.557+0000 7fe5e97fa640 1 -- 172.21.15.87:0/3962650249 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fe5e4005470 con 0x7fe5ec0c51c0 2023-12-16T20:21:43.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.557+0000 7fe5e97fa640 1 --2- 172.21.15.87:0/3962650249 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe5d806ae90 0x7fe5d806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:43.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.557+0000 7fe5f0c37640 1 --2- 172.21.15.87:0/3962650249 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe5d806ae90 0x7fe5d806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:43.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.558+0000 7fe5f0c37640 1 --2- 172.21.15.87:0/3962650249 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe5d806ae90 0x7fe5d806d350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc036000 tx=0x7fe5dc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:43.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.796+0000 7fe5e97fa640 1 -- 172.21.15.87:0/3962650249 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe5e4058890 con 0x7fe5ec0c51c0 2023-12-16T20:21:43.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.797+0000 7fe5e97fa640 1 -- 172.21.15.87:0/3962650249 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fe5e4054bd0 con 0x7fe5ec0c51c0 2023-12-16T20:21:43.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:43.968+0000 7fe5f2e9b640 1 -- 172.21.15.87:0/3962650249 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5ec155220 con 0x7fe5ec0c51c0 2023-12-16T20:21:44.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.009+0000 7fe5e97fa640 1 -- 172.21.15.87:0/3962650249 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fe5ec155220 con 0x7fe5ec0c51c0 2023-12-16T20:21:44.011 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:21:44.011 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:21:41.431615+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:21:22.654341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T20:21:33.728787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T20:21:34.846119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T20:21:38.657738+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:21:44.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.012+0000 7fe5f2e9b640 1 -- 172.21.15.87:0/3962650249 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe5d806ae90 msgr2=0x7fe5d806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:44.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.012+0000 7fe5f2e9b640 1 --2- 172.21.15.87:0/3962650249 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe5d806ae90 0x7fe5d806d350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc036000 tx=0x7fe5dc008030 comp rx=0 tx=0).stop 2023-12-16T20:21:44.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.012+0000 7fe5f2e9b640 1 -- 172.21.15.87:0/3962650249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5ec0c51c0 msgr2=0x7fe5ec0c9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:44.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.012+0000 7fe5f2e9b640 1 --2- 172.21.15.87:0/3962650249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5ec0c51c0 0x7fe5ec0c9fa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400c730 tx=0x7fe5e400cbf0 comp rx=0 tx=0).stop 2023-12-16T20:21:44.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.012+0000 7fe5f2e9b640 1 -- 172.21.15.87:0/3962650249 shutdown_connections 2023-12-16T20:21:44.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.012+0000 7fe5f2e9b640 1 --2- 172.21.15.87:0/3962650249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5ec0c51c0 0x7fe5ec0c9fa0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:44.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.012+0000 7fe5f2e9b640 1 --2- 172.21.15.87:0/3962650249 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5ec0c4de0 0x7fe5ec1452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:44.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.012+0000 7fe5f2e9b640 1 --2- 172.21.15.87:0/3962650249 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe5d806ae90 0x7fe5d806d350 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:44.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.012+0000 7fe5f2e9b640 1 --2- 172.21.15.87:0/3962650249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5ec06f940 0x7fe5ec155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:44.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.012+0000 7fe5f2e9b640 1 -- 172.21.15.87:0/3962650249 >> 172.21.15.87:0/3962650249 conn(0x7fe5ec0c7f60 msgr2=0x7fe5ec0c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:44.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.012+0000 7fe5f2e9b640 1 -- 172.21.15.87:0/3962650249 shutdown_connections 2023-12-16T20:21:44.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.012+0000 7fe5f2e9b640 1 -- 172.21.15.87:0/3962650249 wait complete. 2023-12-16T20:21:44.037 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T20:21:44.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.137+0000 7f20902d3640 1 Processor -- start 2023-12-16T20:21:44.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.137+0000 7f20902d3640 1 -- start start 2023-12-16T20:21:44.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.138+0000 7f20902d3640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2088153890 0x7f208815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:44.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.138+0000 7f20902d3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f208815a700 con 0x7f20880ceef0 2023-12-16T20:21:44.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.138+0000 7f20902d3640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20880ca870 con 0x7f2088153c70 2023-12-16T20:21:44.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.138+0000 7f20902d3640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2088159af0 con 0x7f2088153890 2023-12-16T20:21:44.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.139+0000 7f208e06f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2088153890 0x7f208815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:44.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.139+0000 7f208e06f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2088153890 0x7f208815d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:56088/0 (socket says 172.21.15.87:56088) 2023-12-16T20:21:44.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.139+0000 7f208e06f640 1 -- 172.21.15.87:0/1683371628 learned_addr learned my addr 172.21.15.87:0/1683371628 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:44.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.142+0000 7f208e06f640 1 -- 172.21.15.87:0/1683371628 >> v1:172.21.15.195:6789/0 conn(0x7f2088153c70 legacy=0x7f20880c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:44.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.142+0000 7f208e06f640 1 -- 172.21.15.87:0/1683371628 >> v1:172.21.15.87:6789/0 conn(0x7f20880ceef0 legacy=0x7f208815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:44.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.142+0000 7f208e06f640 1 -- 172.21.15.87:0/1683371628 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2088159dd0 con 0x7f2088153890 2023-12-16T20:21:44.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.145+0000 7f208e06f640 1 --2- 172.21.15.87:0/1683371628 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2088153890 0x7f208815d950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2080009e50 tx=0x7f208002c090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dc086471e5ecdef server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:44.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.149+0000 7f208d06d640 1 -- 172.21.15.87:0/1683371628 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208002cc30 con 0x7f2088153890 2023-12-16T20:21:44.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.149+0000 7f208d06d640 1 -- 172.21.15.87:0/1683371628 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208002cd90 con 0x7f2088153890 2023-12-16T20:21:44.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.149+0000 7f208d06d640 1 -- 172.21.15.87:0/1683371628 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080034610 con 0x7f2088153890 2023-12-16T20:21:44.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.150+0000 7f20902d3640 1 -- 172.21.15.87:0/1683371628 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2088153890 msgr2=0x7f208815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:44.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.150+0000 7f20902d3640 1 --2- 172.21.15.87:0/1683371628 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2088153890 0x7f208815d950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2080009e50 tx=0x7f208002c090 comp rx=0 tx=0).stop 2023-12-16T20:21:44.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.150+0000 7f20902d3640 1 -- 172.21.15.87:0/1683371628 shutdown_connections 2023-12-16T20:21:44.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.150+0000 7f20902d3640 1 --2- 172.21.15.87:0/1683371628 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2088153890 0x7f208815d950 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:44.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.150+0000 7f20902d3640 1 -- 172.21.15.87:0/1683371628 >> 172.21.15.87:0/1683371628 conn(0x7f208806ba00 msgr2=0x7f208806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:44.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.150+0000 7f20902d3640 1 -- 172.21.15.87:0/1683371628 shutdown_connections 2023-12-16T20:21:44.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.150+0000 7f20902d3640 1 -- 172.21.15.87:0/1683371628 wait complete. 2023-12-16T20:21:44.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.151+0000 7f20902d3640 1 Processor -- start 2023-12-16T20:21:44.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.151+0000 7f20902d3640 1 -- start start 2023-12-16T20:21:44.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.152+0000 7f20902d3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20880ceef0 0x7f208814dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:44.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.152+0000 7f20902d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2088153890 0x7f20881f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:44.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.152+0000 7f20902d3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2088153c70 0x7f20881efde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:44.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.152+0000 7f20902d3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20881529e0 con 0x7f2088153890 2023-12-16T20:21:44.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.152+0000 7f20902d3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2088152cc0 con 0x7f20880ceef0 2023-12-16T20:21:44.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.152+0000 7f20902d3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2088152fa0 con 0x7f2088153c70 2023-12-16T20:21:44.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.153+0000 7f208d86e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2088153890 0x7f20881f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:44.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.153+0000 7f208d86e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2088153890 0x7f20881f2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42150/0 (socket says 172.21.15.87:42150) 2023-12-16T20:21:44.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.153+0000 7f208d86e640 1 -- 172.21.15.87:0/128162606 learned_addr learned my addr 172.21.15.87:0/128162606 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:44.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.157+0000 7f208e870640 1 --2- 172.21.15.87:0/128162606 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2088153c70 0x7f20881efde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:44.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.158+0000 7f208e06f640 1 --2- 172.21.15.87:0/128162606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20880ceef0 0x7f208814dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:44.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.163+0000 7f208e06f640 1 -- 172.21.15.87:0/128162606 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2088153c70 msgr2=0x7f20881efde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:44.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.163+0000 7f208e06f640 1 --2- 172.21.15.87:0/128162606 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2088153c70 0x7f20881efde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:44.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.163+0000 7f208e06f640 1 -- 172.21.15.87:0/128162606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2088153890 msgr2=0x7f20881f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:44.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.163+0000 7f208e06f640 1 --2- 172.21.15.87:0/128162606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2088153890 0x7f20881f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:44.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.163+0000 7f208e06f640 1 -- 172.21.15.87:0/128162606 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2080009b30 con 0x7f20880ceef0 2023-12-16T20:21:44.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.212+0000 7f208e06f640 1 --2- 172.21.15.87:0/128162606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20880ceef0 0x7f208814dcf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2080032000 tx=0x7f2080004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:44.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.221+0000 7f207effd640 1 -- 172.21.15.87:0/128162606 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208003e450 con 0x7f20880ceef0 2023-12-16T20:21:44.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.221+0000 7f207effd640 1 -- 172.21.15.87:0/128162606 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208003e5d0 con 0x7f20880ceef0 2023-12-16T20:21:44.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.221+0000 7f207effd640 1 -- 172.21.15.87:0/128162606 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208003e980 con 0x7f20880ceef0 2023-12-16T20:21:44.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.221+0000 7f20902d3640 1 -- 172.21.15.87:0/128162606 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20881ef5e0 con 0x7f20880ceef0 2023-12-16T20:21:44.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.221+0000 7f20902d3640 1 -- 172.21.15.87:0/128162606 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2088152430 con 0x7f20880ceef0 2023-12-16T20:21:44.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.222+0000 7f20902d3640 1 -- 172.21.15.87:0/128162606 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2088067500 con 0x7f20880ceef0 2023-12-16T20:21:44.465 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.464+0000 7f207effd640 1 -- 172.21.15.87:0/128162606 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f208003eae0 con 0x7f20880ceef0 2023-12-16T20:21:44.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.464+0000 7f207effd640 1 --2- 172.21.15.87:0/128162606 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f206c06ae90 0x7f206c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:44.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.465+0000 7f208d86e640 1 --2- 172.21.15.87:0/128162606 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f206c06ae90 0x7f206c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:44.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.465+0000 7f208d86e640 1 --2- 172.21.15.87:0/128162606 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f206c06ae90 0x7f206c06d350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2088074490 tx=0x7f2078009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:44.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.467+0000 7f207effd640 1 -- 172.21.15.87:0/128162606 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f208007ba50 con 0x7f20880ceef0 2023-12-16T20:21:44.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.477+0000 7f207effd640 1 -- 172.21.15.87:0/128162606 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f2080077d90 con 0x7f20880ceef0 2023-12-16T20:21:44.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.699+0000 7f20902d3640 1 -- 172.21.15.87:0/128162606 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20881530e0 con 0x7f20880ceef0 2023-12-16T20:21:44.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.720+0000 7f207effd640 1 -- 172.21.15.87:0/128162606 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6523 (secure 0 0 0) 0x7f20881530e0 con 0x7f20880ceef0 2023-12-16T20:21:44.721 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:21:44.721 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2198156124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2198156124},{"type":"v1","addr":"172.21.15.87:6835","nonce":2198156124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3187160209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3187160209},{"type":"v1","addr":"172.21.15.195:6833","nonce":3187160209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3703236183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":3703236183},{"type":"v1","addr":"172.21.15.87:6837","nonce":3703236183}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1942743723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1942743723},{"type":"v1","addr":"172.21.15.87:6839","nonce":1942743723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/3327792325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3327792325},{"type":"v1","addr":"172.21.15.195:6836","nonce":3327792325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T20:21:36.158936+0000","modified":"2023-12-16T20:21:41.436051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6837/3093855583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3093855583},{"type":"v1","addr":"172.21.15.195:6837","nonce":3093855583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-16T20:21:44.722 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 7 2023-12-16T20:21:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.721+0000 7f20902d3640 1 -- 172.21.15.87:0/128162606 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f206c06ae90 msgr2=0x7f206c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.721+0000 7f20902d3640 1 --2- 172.21.15.87:0/128162606 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f206c06ae90 0x7f206c06d350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2088074490 tx=0x7f2078009040 comp rx=0 tx=0).stop 2023-12-16T20:21:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.721+0000 7f20902d3640 1 -- 172.21.15.87:0/128162606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20880ceef0 msgr2=0x7f208814dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.721+0000 7f20902d3640 1 --2- 172.21.15.87:0/128162606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20880ceef0 0x7f208814dcf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2080032000 tx=0x7f2080004a40 comp rx=0 tx=0).stop 2023-12-16T20:21:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.721+0000 7f20902d3640 1 -- 172.21.15.87:0/128162606 shutdown_connections 2023-12-16T20:21:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.721+0000 7f20902d3640 1 --2- 172.21.15.87:0/128162606 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2088153c70 0x7f20881efde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:44.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.721+0000 7f20902d3640 1 --2- 172.21.15.87:0/128162606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2088153890 0x7f20881f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:44.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.721+0000 7f20902d3640 1 --2- 172.21.15.87:0/128162606 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f206c06ae90 0x7f206c06d350 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:44.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.721+0000 7f20902d3640 1 --2- 172.21.15.87:0/128162606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20880ceef0 0x7f208814dcf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:44.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.722+0000 7f20902d3640 1 -- 172.21.15.87:0/128162606 >> 172.21.15.87:0/128162606 conn(0x7f208806ba00 msgr2=0x7f2088073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:44.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.722+0000 7f20902d3640 1 -- 172.21.15.87:0/128162606 shutdown_connections 2023-12-16T20:21:44.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.722+0000 7f20902d3640 1 -- 172.21.15.87:0/128162606 wait complete. 2023-12-16T20:21:44.734 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:21:44.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.833+0000 7f2b0589b640 1 Processor -- start 2023-12-16T20:21:44.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.833+0000 7f2b0589b640 1 -- start start 2023-12-16T20:21:44.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.834+0000 7f2b0589b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2b0006f110 0x7f2b000c7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:44.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.834+0000 7f2b0589b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b000c0ff0 0x7f2b000c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:44.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.834+0000 7f2b0589b640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b000c15c0 con 0x7f2b00150450 2023-12-16T20:21:44.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.834+0000 7f2b0589b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b00150830 con 0x7f2b0006f110 2023-12-16T20:21:44.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.834+0000 7f2b0589b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b001572d0 con 0x7f2b000c0ff0 2023-12-16T20:21:44.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.834+0000 7f2af7fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2b0006f110 0x7f2b000c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:44.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.835+0000 7f2aff7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b000c0ff0 0x7f2b000c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:44.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.835+0000 7f2af7fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2b0006f110 0x7f2b000c7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42154/0 (socket says 172.21.15.87:42154) 2023-12-16T20:21:44.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.835+0000 7f2af7fff640 1 -- 172.21.15.87:0/281558928 learned_addr learned my addr 172.21.15.87:0/281558928 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:44.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.837+0000 7f2af7fff640 1 -- 172.21.15.87:0/281558928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b000c0ff0 msgr2=0x7f2b000c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:44.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.837+0000 7f2af7fff640 1 --2- 172.21.15.87:0/281558928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b000c0ff0 0x7f2b000c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:44.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.837+0000 7f2af7fff640 1 -- 172.21.15.87:0/281558928 >> v1:172.21.15.195:6789/0 conn(0x7f2b00150450 legacy=0x7f2b00156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:44.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.837+0000 7f2af7fff640 1 -- 172.21.15.87:0/281558928 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b000c18a0 con 0x7f2b0006f110 2023-12-16T20:21:44.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.839+0000 7f2af7fff640 1 --2- 172.21.15.87:0/281558928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b0006f110 0x7f2b000c7950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009870 tx=0x7f2ae802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea40a7054c2b98dd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:44.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.842+0000 7f2afe7fc640 1 -- 172.21.15.87:0/281558928 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae802f840 con 0x7f2b0006f110 2023-12-16T20:21:44.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.843+0000 7f2afe7fc640 1 -- 172.21.15.87:0/281558928 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae802f9a0 con 0x7f2b0006f110 2023-12-16T20:21:44.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.843+0000 7f2afe7fc640 1 -- 172.21.15.87:0/281558928 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae802fd30 con 0x7f2b0006f110 2023-12-16T20:21:44.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.843+0000 7f2b0589b640 1 -- 172.21.15.87:0/281558928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b0006f110 msgr2=0x7f2b000c7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:44.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.843+0000 7f2b0589b640 1 --2- 172.21.15.87:0/281558928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b0006f110 0x7f2b000c7950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009870 tx=0x7f2ae802ba20 comp rx=0 tx=0).stop 2023-12-16T20:21:44.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.843+0000 7f2b0589b640 1 -- 172.21.15.87:0/281558928 shutdown_connections 2023-12-16T20:21:44.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.843+0000 7f2b0589b640 1 --2- 172.21.15.87:0/281558928 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b000c0ff0 0x7f2b000c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:44.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.843+0000 7f2b0589b640 1 --2- 172.21.15.87:0/281558928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b0006f110 0x7f2b000c7950 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:44.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.843+0000 7f2b0589b640 1 -- 172.21.15.87:0/281558928 >> 172.21.15.87:0/281558928 conn(0x7f2b0006fa70 msgr2=0x7f2b0006fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:44.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.843+0000 7f2b0589b640 1 -- 172.21.15.87:0/281558928 shutdown_connections 2023-12-16T20:21:44.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.843+0000 7f2b0589b640 1 -- 172.21.15.87:0/281558928 wait complete. 2023-12-16T20:21:44.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.845+0000 7f2b0589b640 1 Processor -- start 2023-12-16T20:21:44.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.845+0000 7f2b0589b640 1 -- start start 2023-12-16T20:21:44.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.845+0000 7f2b0589b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b0006f110 0x7f2b0014f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:44.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.845+0000 7f2b0589b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b000c0ff0 0x7f2b00154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:44.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.845+0000 7f2b0589b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b00150450 0x7f2b0014b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:44.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.845+0000 7f2b0589b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0014fd30 con 0x7f2b00150450 2023-12-16T20:21:44.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.845+0000 7f2b0589b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0014afe0 con 0x7f2b000c0ff0 2023-12-16T20:21:44.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.845+0000 7f2b0589b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00158770 con 0x7f2b0006f110 2023-12-16T20:21:44.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.846+0000 7f2aff7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b00150450 0x7f2b0014b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:44.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.846+0000 7f2afeffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b0006f110 0x7f2b0014f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:44.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.846+0000 7f2af7fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b000c0ff0 0x7f2b00154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:44.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.846+0000 7f2aff7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b00150450 0x7f2b0014b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42156/0 (socket says 172.21.15.87:42156) 2023-12-16T20:21:44.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.846+0000 7f2aff7fe640 1 -- 172.21.15.87:0/2239156375 learned_addr learned my addr 172.21.15.87:0/2239156375 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:44.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.849+0000 7f2afeffd640 1 -- 172.21.15.87:0/2239156375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b000c0ff0 msgr2=0x7f2b00154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:44.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.849+0000 7f2afeffd640 1 --2- 172.21.15.87:0/2239156375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b000c0ff0 0x7f2b00154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:44.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.849+0000 7f2afeffd640 1 -- 172.21.15.87:0/2239156375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b00150450 msgr2=0x7f2b0014b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:44.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.849+0000 7f2afeffd640 1 --2- 172.21.15.87:0/2239156375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b00150450 0x7f2b0014b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:44.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.849+0000 7f2afeffd640 1 -- 172.21.15.87:0/2239156375 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae80094d0 con 0x7f2b0006f110 2023-12-16T20:21:44.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.852+0000 7f2afeffd640 1 --2- 172.21.15.87:0/2239156375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b0006f110 0x7f2b0014f7f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2af000c3c0 tx=0x7f2af000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:44.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.855+0000 7f2afcff9640 1 -- 172.21.15.87:0/2239156375 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af00052d0 con 0x7f2b0006f110 2023-12-16T20:21:44.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.855+0000 7f2afcff9640 1 -- 172.21.15.87:0/2239156375 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af0005450 con 0x7f2b0006f110 2023-12-16T20:21:44.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.855+0000 7f2afcff9640 1 -- 172.21.15.87:0/2239156375 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0007260 con 0x7f2b0006f110 2023-12-16T20:21:44.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.855+0000 7f2b0589b640 1 -- 172.21.15.87:0/2239156375 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b00158a50 con 0x7f2b0006f110 2023-12-16T20:21:44.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.856+0000 7f2b0589b640 1 -- 172.21.15.87:0/2239156375 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0014ac70 con 0x7f2b0006f110 2023-12-16T20:21:44.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.856+0000 7f2b0589b640 1 -- 172.21.15.87:0/2239156375 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b000740e0 con 0x7f2b0006f110 2023-12-16T20:21:44.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.877+0000 7f2afcff9640 1 -- 172.21.15.87:0/2239156375 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f2af00073c0 con 0x7f2b0006f110 2023-12-16T20:21:44.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.877+0000 7f2afcff9640 1 --2- 172.21.15.87:0/2239156375 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2ae006ae90 0x7f2ae006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:44.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.877+0000 7f2af7fff640 1 --2- 172.21.15.87:0/2239156375 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2ae006ae90 0x7f2ae006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:44.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:44.878+0000 7f2af7fff640 1 --2- 172.21.15.87:0/2239156375 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2ae006ae90 0x7f2ae006d350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8036000 tx=0x7f2ae8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:45.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:45.102+0000 7f2afcff9640 1 -- 172.21.15.87:0/2239156375 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2af0057e70 con 0x7f2b0006f110 2023-12-16T20:21:45.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:45.112+0000 7f2afcff9640 1 -- 172.21.15.87:0/2239156375 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f2af00541b0 con 0x7f2b0006f110 2023-12-16T20:21:45.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:45.289+0000 7f2b0589b640 1 -- 172.21.15.87:0/2239156375 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b000c73b0 con 0x7f2b0006f110 2023-12-16T20:21:45.368 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:45.366+0000 7f2afcff9640 1 -- 172.21.15.87:0/2239156375 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f2af0020090 con 0x7f2b0006f110 2023-12-16T20:21:45.368 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:21:45.368 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:21:41.431615+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:21:22.654341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T20:21:33.728787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T20:21:34.846119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T20:21:38.657738+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:21:45.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:45.368+0000 7f2b0589b640 1 -- 172.21.15.87:0/2239156375 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2ae006ae90 msgr2=0x7f2ae006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:45.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:45.368+0000 7f2b0589b640 1 --2- 172.21.15.87:0/2239156375 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2ae006ae90 0x7f2ae006d350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8036000 tx=0x7f2ae8008030 comp rx=0 tx=0).stop 2023-12-16T20:21:45.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:45.368+0000 7f2b0589b640 1 -- 172.21.15.87:0/2239156375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b0006f110 msgr2=0x7f2b0014f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:45.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:45.368+0000 7f2b0589b640 1 --2- 172.21.15.87:0/2239156375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b0006f110 0x7f2b0014f7f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2af000c3c0 tx=0x7f2af000c880 comp rx=0 tx=0).stop 2023-12-16T20:21:45.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:45.368+0000 7f2b0589b640 1 -- 172.21.15.87:0/2239156375 shutdown_connections 2023-12-16T20:21:45.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:45.368+0000 7f2b0589b640 1 --2- 172.21.15.87:0/2239156375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b00150450 0x7f2b0014b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:45.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:45.368+0000 7f2b0589b640 1 --2- 172.21.15.87:0/2239156375 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2ae006ae90 0x7f2ae006d350 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:45.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:45.368+0000 7f2b0589b640 1 --2- 172.21.15.87:0/2239156375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b000c0ff0 0x7f2b00154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:45.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:45.368+0000 7f2b0589b640 1 --2- 172.21.15.87:0/2239156375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b0006f110 0x7f2b0014f7f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:45.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:45.368+0000 7f2b0589b640 1 -- 172.21.15.87:0/2239156375 >> 172.21.15.87:0/2239156375 conn(0x7f2b0006fa70 msgr2=0x7f2b001555a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:45.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:45.368+0000 7f2b0589b640 1 -- 172.21.15.87:0/2239156375 shutdown_connections 2023-12-16T20:21:45.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:45.368+0000 7f2b0589b640 1 -- 172.21.15.87:0/2239156375 wait complete. 2023-12-16T20:21:45.984 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-16T20:21:36.158936+0000', 'modified': '2023-12-16T20:21:41.436051+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4251': {'gid': 4251, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.195:6837/3093855583', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6835', 'nonce': 3093855583}, {'type': 'v1', 'addr': '172.21.15.195:6837', 'nonce': 3093855583}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-12-16T20:21:45.985 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-16T20:21:45.985 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-12-16T20:21:46.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.088+0000 7fd440ccf640 1 Processor -- start 2023-12-16T20:21:46.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.088+0000 7fd440ccf640 1 -- start start 2023-12-16T20:21:46.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.088+0000 7fd440ccf640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd43c153be0 0x7fd43c159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.088+0000 7fd440ccf640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd43c06fa00 0x7fd43c0c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.089+0000 7fd440ccf640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd43c0c5e60 0x7fd43c0c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.089+0000 7fd440ccf640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c0c3340 con 0x7fd43c06fa00 2023-12-16T20:21:46.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.089+0000 7fd440ccf640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c153fc0 con 0x7fd43c153be0 2023-12-16T20:21:46.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.089+0000 7fd440ccf640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c06b7b0 con 0x7fd43c0c5e60 2023-12-16T20:21:46.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.089+0000 7fd439d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd43c06fa00 0x7fd43c0c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.089+0000 7fd43a59c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd43c153be0 0x7fd43c159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.089+0000 7fd43ad9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd43c0c5e60 0x7fd43c0c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.089+0000 7fd439d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd43c06fa00 0x7fd43c0c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42166/0 (socket says 172.21.15.87:42166) 2023-12-16T20:21:46.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.089+0000 7fd439d9b640 1 -- 172.21.15.87:0/2767732661 learned_addr learned my addr 172.21.15.87:0/2767732661 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:46.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.092+0000 7fd439d9b640 1 -- 172.21.15.87:0/2767732661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd43c0c5e60 msgr2=0x7fd43c0c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:46.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.092+0000 7fd439d9b640 1 --2- 172.21.15.87:0/2767732661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd43c0c5e60 0x7fd43c0c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.092+0000 7fd439d9b640 1 -- 172.21.15.87:0/2767732661 >> v2:172.21.15.195:3300/0 conn(0x7fd43c153be0 msgr2=0x7fd43c159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:46.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.092+0000 7fd439d9b640 1 --2- 172.21.15.87:0/2767732661 >> v2:172.21.15.195:3300/0 conn(0x7fd43c153be0 0x7fd43c159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.092+0000 7fd439d9b640 1 -- 172.21.15.87:0/2767732661 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c06ba90 con 0x7fd43c06fa00 2023-12-16T20:21:46.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.093+0000 7fd439d9b640 1 --2- 172.21.15.87:0/2767732661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd43c06fa00 0x7fd43c0c41b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0610b0 tx=0x7fd43002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e26c632aea2db54 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:46.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.097+0000 7fd43959a640 1 -- 172.21.15.87:0/2767732661 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd430031870 con 0x7fd43c06fa00 2023-12-16T20:21:46.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.097+0000 7fd43959a640 1 -- 172.21.15.87:0/2767732661 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4300319d0 con 0x7fd43c06fa00 2023-12-16T20:21:46.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.097+0000 7fd43959a640 1 -- 172.21.15.87:0/2767732661 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd430031d60 con 0x7fd43c06fa00 2023-12-16T20:21:46.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.097+0000 7fd440ccf640 1 -- 172.21.15.87:0/2767732661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd43c06fa00 msgr2=0x7fd43c0c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:46.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.097+0000 7fd440ccf640 1 --2- 172.21.15.87:0/2767732661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd43c06fa00 0x7fd43c0c41b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0610b0 tx=0x7fd43002b910 comp rx=0 tx=0).stop 2023-12-16T20:21:46.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.098+0000 7fd440ccf640 1 -- 172.21.15.87:0/2767732661 shutdown_connections 2023-12-16T20:21:46.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.098+0000 7fd440ccf640 1 --2- 172.21.15.87:0/2767732661 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd43c0c5e60 0x7fd43c0c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.098+0000 7fd440ccf640 1 --2- 172.21.15.87:0/2767732661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd43c06fa00 0x7fd43c0c41b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.098+0000 7fd440ccf640 1 --2- 172.21.15.87:0/2767732661 >> v2:172.21.15.195:3300/0 conn(0x7fd43c153be0 0x7fd43c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.098+0000 7fd440ccf640 1 -- 172.21.15.87:0/2767732661 >> 172.21.15.87:0/2767732661 conn(0x7fd43c0c7f60 msgr2=0x7fd43c0c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:46.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.098+0000 7fd440ccf640 1 -- 172.21.15.87:0/2767732661 shutdown_connections 2023-12-16T20:21:46.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.098+0000 7fd440ccf640 1 -- 172.21.15.87:0/2767732661 wait complete. 2023-12-16T20:21:46.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.099+0000 7fd440ccf640 1 Processor -- start 2023-12-16T20:21:46.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.099+0000 7fd440ccf640 1 -- start start 2023-12-16T20:21:46.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.100+0000 7fd440ccf640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd43c06fa00 0x7fd43c1550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.100+0000 7fd440ccf640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd43c0c5e60 0x7fd43c145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.100+0000 7fd440ccf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd43c153be0 0x7fd43c146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.100+0000 7fd440ccf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c14fdc0 con 0x7fd43c153be0 2023-12-16T20:21:46.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.100+0000 7fd440ccf640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c146850 con 0x7fd43c0c5e60 2023-12-16T20:21:46.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.100+0000 7fd440ccf640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c14fae0 con 0x7fd43c06fa00 2023-12-16T20:21:46.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.100+0000 7fd43ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd43c153be0 0x7fd43c146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.100+0000 7fd43a59c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd43c06fa00 0x7fd43c1550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.100+0000 7fd43ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd43c153be0 0x7fd43c146d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42176/0 (socket says 172.21.15.87:42176) 2023-12-16T20:21:46.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.100+0000 7fd439d9b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd43c0c5e60 0x7fd43c145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.100+0000 7fd43ad9d640 1 -- 172.21.15.87:0/3502261079 learned_addr learned my addr 172.21.15.87:0/3502261079 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:46.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.104+0000 7fd43ad9d640 1 -- 172.21.15.87:0/3502261079 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd43c06fa00 msgr2=0x7fd43c1550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:46.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.104+0000 7fd43ad9d640 1 --2- 172.21.15.87:0/3502261079 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd43c06fa00 0x7fd43c1550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.104+0000 7fd43ad9d640 1 -- 172.21.15.87:0/3502261079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd43c0c5e60 msgr2=0x7fd43c145c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:46.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.104+0000 7fd43ad9d640 1 --2- 172.21.15.87:0/3502261079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd43c0c5e60 0x7fd43c145c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.104+0000 7fd43ad9d640 1 -- 172.21.15.87:0/3502261079 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4300094d0 con 0x7fd43c153be0 2023-12-16T20:21:46.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.107+0000 7fd43ad9d640 1 --2- 172.21.15.87:0/3502261079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd43c153be0 0x7fd43c146d30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd43400e7c0 tx=0x7fd43400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:46.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.110+0000 7fd42affd640 1 -- 172.21.15.87:0/3502261079 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400ee70 con 0x7fd43c153be0 2023-12-16T20:21:46.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.110+0000 7fd42affd640 1 -- 172.21.15.87:0/3502261079 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43400c940 con 0x7fd43c153be0 2023-12-16T20:21:46.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.110+0000 7fd42affd640 1 -- 172.21.15.87:0/3502261079 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400ccf0 con 0x7fd43c153be0 2023-12-16T20:21:46.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.110+0000 7fd440ccf640 1 -- 172.21.15.87:0/3502261079 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43c156b40 con 0x7fd43c153be0 2023-12-16T20:21:46.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.110+0000 7fd440ccf640 1 -- 172.21.15.87:0/3502261079 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c1565f0 con 0x7fd43c153be0 2023-12-16T20:21:46.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.114+0000 7fd443863740 1 Processor -- start 2023-12-16T20:21:46.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.114+0000 7fd443863740 1 -- start start 2023-12-16T20:21:46.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.115+0000 7fd443863740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b1d40 0x55cc6a606870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.115+0000 7fd443863740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a5ddb00 0x55cc6a5b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.115+0000 7fd443863740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a5b2120 0x55cc6a5b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.115+0000 7fd443863740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc6a522090 con 0x55cc6a5ddb00 2023-12-16T20:21:46.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.115+0000 7fd443863740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc6a51f780 con 0x55cc6a5b2120 2023-12-16T20:21:46.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.115+0000 7fd443863740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc6a51b070 con 0x55cc6a5b1d40 2023-12-16T20:21:46.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.116+0000 7fd439d9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b1d40 0x55cc6a606870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.116+0000 7fd439d9b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a5b2120 0x55cc6a5b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.116+0000 7fd439d9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b1d40 0x55cc6a606870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:44826/0 (socket says 172.21.15.87:44826) 2023-12-16T20:21:46.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.116+0000 7fd439d9b640 1 -- 172.21.15.87:0/3566392395 learned_addr learned my addr 172.21.15.87:0/3566392395 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:46.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.118+0000 7fd439d9b640 1 -- 172.21.15.87:0/3566392395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a5b2120 msgr2=0x55cc6a5b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:46.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.118+0000 7fd439d9b640 1 --2- 172.21.15.87:0/3566392395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a5b2120 0x55cc6a5b46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.120 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.118+0000 7fd439d9b640 1 -- 172.21.15.87:0/3566392395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a5ddb00 msgr2=0x55cc6a5b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:46.120 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.118+0000 7fd439d9b640 1 --2- 172.21.15.87:0/3566392395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a5ddb00 0x55cc6a5b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.120 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.118+0000 7fd439d9b640 1 -- 172.21.15.87:0/3566392395 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc6a4ddd00 con 0x55cc6a5b1d40 2023-12-16T20:21:46.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.122+0000 7fd439d9b640 1 --2- 172.21.15.87:0/3566392395 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b1d40 0x55cc6a606870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd43002b950 tx=0x7fd430030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e37234752fe1967 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:46.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.126+0000 7fd41bfff640 1 -- 172.21.15.87:0/3566392395 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd430004030 con 0x55cc6a5b1d40 2023-12-16T20:21:46.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.126+0000 7fd41bfff640 1 -- 172.21.15.87:0/3566392395 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd430040070 con 0x55cc6a5b1d40 2023-12-16T20:21:46.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.126+0000 7fd41bfff640 1 -- 172.21.15.87:0/3566392395 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd430004390 con 0x55cc6a5b1d40 2023-12-16T20:21:46.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.127+0000 7fd443863740 1 -- 172.21.15.87:0/3566392395 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b1d40 msgr2=0x55cc6a606870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:46.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.127+0000 7fd443863740 1 --2- 172.21.15.87:0/3566392395 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b1d40 0x55cc6a606870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd43002b950 tx=0x7fd430030000 comp rx=0 tx=0).stop 2023-12-16T20:21:46.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.127+0000 7fd443863740 1 -- 172.21.15.87:0/3566392395 shutdown_connections 2023-12-16T20:21:46.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.127+0000 7fd443863740 1 --2- 172.21.15.87:0/3566392395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a5b2120 0x55cc6a5b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.127+0000 7fd443863740 1 --2- 172.21.15.87:0/3566392395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a5ddb00 0x55cc6a5b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.127+0000 7fd443863740 1 --2- 172.21.15.87:0/3566392395 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b1d40 0x55cc6a606870 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.127+0000 7fd443863740 1 -- 172.21.15.87:0/3566392395 >> 172.21.15.87:0/3566392395 conn(0x55cc6a5b0d60 msgr2=0x55cc6a5b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:46.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.127+0000 7fd443863740 1 -- 172.21.15.87:0/3566392395 shutdown_connections 2023-12-16T20:21:46.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.127+0000 7fd443863740 1 -- 172.21.15.87:0/3566392395 wait complete. 2023-12-16T20:21:46.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.128+0000 7fd443863740 1 -- start start 2023-12-16T20:21:46.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.128+0000 7fd443863740 1 Processor -- start 2023-12-16T20:21:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.128+0000 7fd443863740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b2120 0x55cc6a5f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.128+0000 7fd443863740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a5ddb00 0x55cc6a60d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.128+0000 7fd443863740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a604e40 0x55cc6a5dc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.129+0000 7fd443863740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc6a4d4e70 con 0x55cc6a604e40 2023-12-16T20:21:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.129+0000 7fd443863740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc6a4d4b10 con 0x55cc6a5ddb00 2023-12-16T20:21:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.129+0000 7fd443863740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc6a49a2e0 con 0x55cc6a5b2120 2023-12-16T20:21:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.129+0000 7fd443863740 10 client.0 _ll_register_callbacks cb 0x55cc6a22cac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-16T20:21:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.129+0000 7fd439d9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b2120 0x55cc6a5f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.129+0000 7fd43a59c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a5ddb00 0x55cc6a60d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.129+0000 7fd439d9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b2120 0x55cc6a5f8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:44830/0 (socket says 172.21.15.87:44830) 2023-12-16T20:21:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.129+0000 7fd439d9b640 1 -- 172.21.15.87:0/400893471 learned_addr learned my addr 172.21.15.87:0/400893471 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:46.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.132+0000 7fd439d9b640 1 -- 172.21.15.87:0/400893471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a5ddb00 msgr2=0x55cc6a60d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:46.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.132+0000 7fd439d9b640 1 --2- 172.21.15.87:0/400893471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a5ddb00 0x55cc6a60d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.132+0000 7fd439d9b640 1 -- 172.21.15.87:0/400893471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a604e40 msgr2=0x55cc6a5dc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:46.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.132+0000 7fd439d9b640 1 --2- 172.21.15.87:0/400893471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a604e40 0x55cc6a5dc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.132+0000 7fd439d9b640 1 -- 172.21.15.87:0/400893471 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd430042040 con 0x55cc6a5b2120 2023-12-16T20:21:46.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.133+0000 7fd42affd640 1 -- 172.21.15.87:0/3502261079 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fd434013470 con 0x7fd43c153be0 2023-12-16T20:21:46.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.133+0000 7fd42affd640 1 --2- 172.21.15.87:0/3502261079 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd41c06adb0 0x7fd41c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.133+0000 7fd43a59c640 1 --2- 172.21.15.87:0/3502261079 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd41c06adb0 0x7fd41c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.133+0000 7fd43a59c640 1 --2- 172.21.15.87:0/3502261079 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd41c06adb0 0x7fd41c06d270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd42c004a80 tx=0x7fd42c009750 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:46.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.135+0000 7fd439d9b640 1 --2- 172.21.15.87:0/400893471 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b2120 0x55cc6a5f8c40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd430009930 tx=0x7fd4300046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ebb2d952a70573 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:46.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.135+0000 7fd4197fa640 10 client.0 ms_handle_connect on v2:172.21.15.195:3301/0 2023-12-16T20:21:46.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.135+0000 7fd42affd640 1 -- 172.21.15.87:0/3502261079 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd434058380 con 0x7fd43c153be0 2023-12-16T20:21:46.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.139+0000 7fd4197fa640 1 -- 172.21.15.87:0/400893471 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd430004440 con 0x55cc6a5b2120 2023-12-16T20:21:46.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.139+0000 7fd4197fa640 1 -- 172.21.15.87:0/400893471 <== mon.2 v2:172.21.15.195:3301/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd43002d040 con 0x55cc6a5b2120 2023-12-16T20:21:46.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.139+0000 7fd443863740 1 -- 172.21.15.87:0/400893471 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc6a513f00 con 0x55cc6a5b2120 2023-12-16T20:21:46.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.140+0000 7fd4197fa640 1 -- 172.21.15.87:0/400893471 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd430003610 con 0x55cc6a5b2120 2023-12-16T20:21:46.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.140+0000 7fd443863740 10 client.4316 fetch_fsmap learned FSMap version 7 2023-12-16T20:21:46.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.140+0000 7fd443863740 1 -- 172.21.15.87:0/400893471 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55cc6a5196f0 con 0x55cc6a5b2120 2023-12-16T20:21:46.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.155+0000 7fd4197fa640 1 -- 172.21.15.87:0/400893471 <== mon.2 v2:172.21.15.195:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cc6a513f00 con 0x55cc6a5b2120 2023-12-16T20:21:46.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.155+0000 7fd4197fa640 1 -- 172.21.15.87:0/400893471 <== mon.2 v2:172.21.15.195:3301/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fd430003770 con 0x55cc6a5b2120 2023-12-16T20:21:46.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.155+0000 7fd443863740 10 client.4316 fetch_fsmap finished waiting for FSMap version 7 2023-12-16T20:21:46.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.155+0000 7fd443863740 10 client.4316 resolve_mds: resolved name 'f' to daemon mds.f 2023-12-16T20:21:46.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.155+0000 7fd443863740 20 client.4316 populate_metadata read hostname 'smithi087' 2023-12-16T20:21:46.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.155+0000 7fd443863740 1 --2- 172.21.15.87:0/400893471 >> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] conn(0x55cc6a6022e0 0x55cc6a610bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.155+0000 7fd443863740 4 client.4316 mds_command: new command op to 4251 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-16T20:21:46.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.155+0000 7fd443863740 1 -- 172.21.15.87:0/400893471 --> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc6a513c20 con 0x55cc6a6022e0 2023-12-16T20:21:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.164+0000 7fd439d9b640 1 --2- 172.21.15.87:0/400893471 >> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] conn(0x55cc6a6022e0 0x55cc6a610bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.249+0000 7fd439d9b640 1 --2- 172.21.15.87:0/400893471 >> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] conn(0x55cc6a6022e0 0x55cc6a610bd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ee881764976674b server_cookie=6474317f7eec3ca4 in_seq=0 out_seq=0 2023-12-16T20:21:46.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.249+0000 7fd4197fa640 10 client.4316 ms_handle_connect on v2:172.21.15.195:6835/3093855583 2023-12-16T20:21:46.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.373+0000 7fd4197fa640 1 -- 172.21.15.87:0/400893471 <== mds.0 v2:172.21.15.195:6835/3093855583 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cc6a513c20 con 0x55cc6a6022e0 2023-12-16T20:21:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.373+0000 7fd4197fa640 10 client.4316 handle_command_reply: tid=0 2023-12-16T20:21:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.373+0000 7fd443863740 1 client.4316 shutdown 2023-12-16T20:21:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.373+0000 7fd443863740 1 -- 172.21.15.87:0/400893471 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b2120 msgr2=0x55cc6a5f8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.373+0000 7fd443863740 1 --2- 172.21.15.87:0/400893471 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b2120 0x55cc6a5f8c40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd430009930 tx=0x7fd4300046c0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.373+0000 7fd443863740 1 -- 172.21.15.87:0/400893471 shutdown_connections 2023-12-16T20:21:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.373+0000 7fd443863740 1 --2- 172.21.15.87:0/400893471 >> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] conn(0x55cc6a6022e0 0x55cc6a610bd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.373+0000 7fd443863740 1 --2- 172.21.15.87:0/400893471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a604e40 0x55cc6a5dc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.373+0000 7fd443863740 1 --2- 172.21.15.87:0/400893471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a5ddb00 0x55cc6a60d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.373+0000 7fd443863740 1 --2- 172.21.15.87:0/400893471 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b2120 0x55cc6a5f8c40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.373+0000 7fd4197fa640 0 client.4316 ms_handle_reset on v2:172.21.15.195:6835/3093855583 2023-12-16T20:21:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.373+0000 7fd443863740 1 -- 172.21.15.87:0/400893471 >> 172.21.15.87:0/400893471 conn(0x55cc6a5b1d40 msgr2=0x55cc6a5adab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.373+0000 7fd443863740 1 -- 172.21.15.87:0/400893471 shutdown_connections 2023-12-16T20:21:46.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.373+0000 7fd443863740 1 -- 172.21.15.87:0/400893471 wait complete. 2023-12-16T20:21:46.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.373+0000 7fd443863740 20 client.4316 trim_cache size 0 max 16384 2023-12-16T20:21:46.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.388+0000 7fd443863740 1 Processor -- start 2023-12-16T20:21:46.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.389+0000 7fd443863740 1 -- start start 2023-12-16T20:21:46.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.389+0000 7fd443863740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b2120 0x55cc6a603210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.389+0000 7fd443863740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a5ddb00 0x55cc6a5f7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.389+0000 7fd443863740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a604e40 0x55cc6a5f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.389+0000 7fd443863740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc6a606d50 con 0x55cc6a5ddb00 2023-12-16T20:21:46.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.389+0000 7fd443863740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc6a602df0 con 0x55cc6a604e40 2023-12-16T20:21:46.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.389+0000 7fd443863740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc6a5b2b50 con 0x55cc6a5b2120 2023-12-16T20:21:46.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.390+0000 7fd439d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a5ddb00 0x55cc6a5f7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.390+0000 7fd43a59c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b2120 0x55cc6a603210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.390+0000 7fd43ad9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a604e40 0x55cc6a5f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.390+0000 7fd439d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a5ddb00 0x55cc6a5f7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42194/0 (socket says 172.21.15.87:42194) 2023-12-16T20:21:46.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.390+0000 7fd439d9b640 1 -- 172.21.15.87:0/3216868275 learned_addr learned my addr 172.21.15.87:0/3216868275 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:46.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.392+0000 7fd439d9b640 1 -- 172.21.15.87:0/3216868275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b2120 msgr2=0x55cc6a603210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:46.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.392+0000 7fd439d9b640 1 --2- 172.21.15.87:0/3216868275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b2120 0x55cc6a603210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.392+0000 7fd439d9b640 1 -- 172.21.15.87:0/3216868275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a604e40 msgr2=0x55cc6a5f77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:46.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.392+0000 7fd439d9b640 1 --2- 172.21.15.87:0/3216868275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a604e40 0x55cc6a5f77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.392+0000 7fd439d9b640 1 -- 172.21.15.87:0/3216868275 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc6a4b6d70 con 0x55cc6a5ddb00 2023-12-16T20:21:46.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.394+0000 7fd439d9b640 1 --2- 172.21.15.87:0/3216868275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a5ddb00 0x55cc6a5f7290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd43002be30 tx=0x7fd43003b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8999b2576ceda7a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:46.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.397+0000 7fd428ff9640 1 -- 172.21.15.87:0/3216868275 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd430003be0 con 0x55cc6a5ddb00 2023-12-16T20:21:46.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.397+0000 7fd428ff9640 1 -- 172.21.15.87:0/3216868275 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43004e040 con 0x55cc6a5ddb00 2023-12-16T20:21:46.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.397+0000 7fd428ff9640 1 -- 172.21.15.87:0/3216868275 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd430003e80 con 0x55cc6a5ddb00 2023-12-16T20:21:46.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.398+0000 7fd443863740 1 -- 172.21.15.87:0/3216868275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a5ddb00 msgr2=0x55cc6a5f7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:46.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.398+0000 7fd443863740 1 --2- 172.21.15.87:0/3216868275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a5ddb00 0x55cc6a5f7290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd43002be30 tx=0x7fd43003b000 comp rx=0 tx=0).stop 2023-12-16T20:21:46.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.398+0000 7fd443863740 1 -- 172.21.15.87:0/3216868275 shutdown_connections 2023-12-16T20:21:46.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.398+0000 7fd443863740 1 --2- 172.21.15.87:0/3216868275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a604e40 0x55cc6a5f77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.398+0000 7fd443863740 1 --2- 172.21.15.87:0/3216868275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a5ddb00 0x55cc6a5f7290 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.398+0000 7fd443863740 1 --2- 172.21.15.87:0/3216868275 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5b2120 0x55cc6a603210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.398+0000 7fd443863740 1 -- 172.21.15.87:0/3216868275 >> 172.21.15.87:0/3216868275 conn(0x55cc6a5b1d40 msgr2=0x55cc6a5adab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:46.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.398+0000 7fd443863740 1 -- 172.21.15.87:0/3216868275 shutdown_connections 2023-12-16T20:21:46.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.398+0000 7fd443863740 1 -- 172.21.15.87:0/3216868275 wait complete. 2023-12-16T20:21:46.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.399+0000 7fd443863740 1 -- start start 2023-12-16T20:21:46.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.399+0000 7fd443863740 1 Processor -- start 2023-12-16T20:21:46.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.400+0000 7fd443863740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a5b2120 0x55cc6a661c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.400+0000 7fd443863740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5ddb00 0x55cc6a60a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.400+0000 7fd443863740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a604e40 0x55cc6a668620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.400+0000 7fd443863740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc6a66b4b0 con 0x55cc6a5b2120 2023-12-16T20:21:46.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.400+0000 7fd443863740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc6a5f79b0 con 0x55cc6a604e40 2023-12-16T20:21:46.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.400+0000 7fd443863740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc6a5f8aa0 con 0x55cc6a5ddb00 2023-12-16T20:21:46.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.400+0000 7fd443863740 10 client.0 _ll_register_callbacks cb 0x7fd434009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-16T20:21:46.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.400+0000 7fd43a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a5b2120 0x55cc6a661c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.400+0000 7fd439d9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5ddb00 0x55cc6a60a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.401+0000 7fd439d9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5ddb00 0x55cc6a60a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:44834/0 (socket says 172.21.15.87:44834) 2023-12-16T20:21:46.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.401+0000 7fd439d9b640 1 -- 172.21.15.87:0/790133243 learned_addr learned my addr 172.21.15.87:0/790133243 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:46.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.401+0000 7fd43ad9d640 1 --2- 172.21.15.87:0/790133243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a604e40 0x55cc6a668620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.404+0000 7fd439d9b640 1 -- 172.21.15.87:0/790133243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a604e40 msgr2=0x55cc6a668620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:46.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.404+0000 7fd439d9b640 1 --2- 172.21.15.87:0/790133243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a604e40 0x55cc6a668620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.404+0000 7fd439d9b640 1 -- 172.21.15.87:0/790133243 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a5b2120 msgr2=0x55cc6a661c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:46.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.404+0000 7fd439d9b640 1 --2- 172.21.15.87:0/790133243 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a5b2120 0x55cc6a661c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.404+0000 7fd439d9b640 1 -- 172.21.15.87:0/790133243 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc6a5196f0 con 0x55cc6a5ddb00 2023-12-16T20:21:46.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.406+0000 7fd439d9b640 1 --2- 172.21.15.87:0/790133243 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5ddb00 0x55cc6a60a620 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd43002bf20 tx=0x7fd430031000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d394c1a04818836a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:46.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.406+0000 7fd4197fa640 10 client.0 ms_handle_connect on v2:172.21.15.195:3301/0 2023-12-16T20:21:46.409 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.408+0000 7fd4197fa640 1 -- 172.21.15.87:0/790133243 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd430003e80 con 0x55cc6a5ddb00 2023-12-16T20:21:46.409 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.408+0000 7fd443863740 1 -- 172.21.15.87:0/790133243 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd430040070 con 0x55cc6a5ddb00 2023-12-16T20:21:46.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.409+0000 7fd4197fa640 1 -- 172.21.15.87:0/790133243 <== mon.2 v2:172.21.15.195:3301/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd430003be0 con 0x55cc6a5ddb00 2023-12-16T20:21:46.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.411+0000 7fd4197fa640 1 -- 172.21.15.87:0/790133243 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd430004350 con 0x55cc6a5ddb00 2023-12-16T20:21:46.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.411+0000 7fd443863740 10 client.4322 fetch_fsmap learned FSMap version 7 2023-12-16T20:21:46.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.411+0000 7fd443863740 1 -- 172.21.15.87:0/790133243 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55cc6a4dc560 con 0x55cc6a5ddb00 2023-12-16T20:21:46.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.415+0000 7fd4197fa640 1 -- 172.21.15.87:0/790133243 <== mon.2 v2:172.21.15.195:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd430040070 con 0x55cc6a5ddb00 2023-12-16T20:21:46.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.415+0000 7fd4197fa640 1 -- 172.21.15.87:0/790133243 <== mon.2 v2:172.21.15.195:3301/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fd430069be0 con 0x55cc6a5ddb00 2023-12-16T20:21:46.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.415+0000 7fd443863740 10 client.4322 fetch_fsmap finished waiting for FSMap version 7 2023-12-16T20:21:46.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.415+0000 7fd443863740 10 client.4322 resolve_mds: resolved name 'f' to daemon mds.f 2023-12-16T20:21:46.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.415+0000 7fd443863740 20 client.4322 populate_metadata read hostname 'smithi087' 2023-12-16T20:21:46.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.415+0000 7fd443863740 1 --2- 172.21.15.87:0/790133243 >> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] conn(0x55cc6a5b4dc0 0x55cc6a5da600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.415+0000 7fd443863740 4 client.4322 mds_command: new command op to 4251 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-16T20:21:46.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.415+0000 7fd443863740 1 -- 172.21.15.87:0/790133243 --> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cc6a21b6c0 con 0x55cc6a5b4dc0 2023-12-16T20:21:46.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.416+0000 7fd43a59c640 1 --2- 172.21.15.87:0/790133243 >> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] conn(0x55cc6a5b4dc0 0x55cc6a5da600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.420 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.419+0000 7fd43a59c640 1 --2- 172.21.15.87:0/790133243 >> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] conn(0x55cc6a5b4dc0 0x55cc6a5da600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e613774e77d02d server_cookie=49cbd0ce20c517d7 in_seq=0 out_seq=0 2023-12-16T20:21:46.420 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.419+0000 7fd4197fa640 10 client.4322 ms_handle_connect on v2:172.21.15.195:6835/3093855583 2023-12-16T20:21:46.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.437+0000 7fd4197fa640 1 -- 172.21.15.87:0/790133243 <== mds.0 v2:172.21.15.195:6835/3093855583 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55cc6a21b6c0 con 0x55cc6a5b4dc0 2023-12-16T20:21:46.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.437+0000 7fd4197fa640 10 client.4322 handle_command_reply: tid=0 2023-12-16T20:21:46.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.437+0000 7fd443863740 1 client.4322 shutdown 2023-12-16T20:21:46.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.437+0000 7fd443863740 1 -- 172.21.15.87:0/790133243 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5ddb00 msgr2=0x55cc6a60a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:46.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.437+0000 7fd443863740 1 --2- 172.21.15.87:0/790133243 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5ddb00 0x55cc6a60a620 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd43002bf20 tx=0x7fd430031000 comp rx=0 tx=0).stop 2023-12-16T20:21:46.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.437+0000 7fd443863740 1 -- 172.21.15.87:0/790133243 shutdown_connections 2023-12-16T20:21:46.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.437+0000 7fd443863740 1 --2- 172.21.15.87:0/790133243 >> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] conn(0x55cc6a5b4dc0 0x55cc6a5da600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.437+0000 7fd443863740 1 --2- 172.21.15.87:0/790133243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc6a604e40 0x55cc6a668620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.437+0000 7fd443863740 1 --2- 172.21.15.87:0/790133243 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55cc6a5ddb00 0x55cc6a60a620 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.437+0000 7fd4197fa640 0 client.4322 ms_handle_reset on v2:172.21.15.195:6835/3093855583 2023-12-16T20:21:46.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.437+0000 7fd443863740 1 --2- 172.21.15.87:0/790133243 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc6a5b2120 0x55cc6a661c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.437+0000 7fd443863740 1 -- 172.21.15.87:0/790133243 >> 172.21.15.87:0/790133243 conn(0x55cc6a5b1d40 msgr2=0x55cc6a604160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:46.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.437+0000 7fd443863740 1 -- 172.21.15.87:0/790133243 shutdown_connections 2023-12-16T20:21:46.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.437+0000 7fd443863740 1 -- 172.21.15.87:0/790133243 wait complete. 2023-12-16T20:21:46.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.437+0000 7fd443863740 20 client.4322 trim_cache size 0 max 16384 2023-12-16T20:21:46.440 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-12-16T20:21:46.440 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "281751e9-025f-43bb-9b42-7cc76907fa5a", 2023-12-16T20:21:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 0, 2023-12-16T20:21:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4251, 2023-12-16T20:21:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2023-12-16T20:21:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2023-12-16T20:21:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2023-12-16T20:21:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 9.7621806180000004, 2023-12-16T20:21:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 7, 2023-12-16T20:21:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 25, 2023-12-16T20:21:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 25, 2023-12-16T20:21:46.441 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 18.139407846000001 2023-12-16T20:21:46.441 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-12-16T20:21:46.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.438+0000 7fd440ccf640 1 -- 172.21.15.87:0/3502261079 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd41c06adb0 msgr2=0x7fd41c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:46.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.438+0000 7fd440ccf640 1 --2- 172.21.15.87:0/3502261079 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd41c06adb0 0x7fd41c06d270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd42c004a80 tx=0x7fd42c009750 comp rx=0 tx=0).stop 2023-12-16T20:21:46.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.438+0000 7fd440ccf640 1 -- 172.21.15.87:0/3502261079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd43c153be0 msgr2=0x7fd43c146d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:46.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.438+0000 7fd440ccf640 1 --2- 172.21.15.87:0/3502261079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd43c153be0 0x7fd43c146d30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd43400e7c0 tx=0x7fd43400ec80 comp rx=0 tx=0).stop 2023-12-16T20:21:46.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.438+0000 7fd440ccf640 1 -- 172.21.15.87:0/3502261079 shutdown_connections 2023-12-16T20:21:46.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.438+0000 7fd440ccf640 1 --2- 172.21.15.87:0/3502261079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd43c153be0 0x7fd43c146d30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.438+0000 7fd440ccf640 1 --2- 172.21.15.87:0/3502261079 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd41c06adb0 0x7fd41c06d270 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.438+0000 7fd440ccf640 1 --2- 172.21.15.87:0/3502261079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd43c0c5e60 0x7fd43c145c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.438+0000 7fd440ccf640 1 --2- 172.21.15.87:0/3502261079 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd43c06fa00 0x7fd43c1550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.438+0000 7fd440ccf640 1 -- 172.21.15.87:0/3502261079 >> 172.21.15.87:0/3502261079 conn(0x7fd43c0c7f60 msgr2=0x7fd43c149210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:46.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.438+0000 7fd440ccf640 1 -- 172.21.15.87:0/3502261079 shutdown_connections 2023-12-16T20:21:46.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.438+0000 7fd440ccf640 1 -- 172.21.15.87:0/3502261079 wait complete. 2023-12-16T20:21:46.450 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-16T20:21:46.450 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-16T20:21:46.450 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T20:21:46.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.548+0000 7fcf67f8a640 1 Processor -- start 2023-12-16T20:21:46.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.548+0000 7fcf67f8a640 1 -- start start 2023-12-16T20:21:46.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.549+0000 7fcf67f8a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcf6014cc60 0x7fcf600bff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.549+0000 7fcf67f8a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcf600c58e0 0x7fcf60072490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.549+0000 7fcf67f8a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf600caed0 con 0x7fcf60156b90 2023-12-16T20:21:46.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.549+0000 7fcf67f8a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf60156770 con 0x7fcf600c58e0 2023-12-16T20:21:46.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.549+0000 7fcf67f8a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf600c0ee0 con 0x7fcf6014cc60 2023-12-16T20:21:46.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.549+0000 7fcf65525640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcf600c58e0 0x7fcf60072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.550+0000 7fcf66527640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fcf60156b90 0x7fcf600c17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60452/0 (socket says 172.21.15.87:60452) 2023-12-16T20:21:46.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.550+0000 7fcf66527640 1 -- 172.21.15.87:0/3220837970 learned_addr learned my addr 172.21.15.87:0/3220837970 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:46.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.550+0000 7fcf65d26640 1 --2- 172.21.15.87:0/3220837970 >> v2:172.21.15.195:3300/0 conn(0x7fcf6014cc60 0x7fcf600bff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.552+0000 7fcf65d26640 1 -- 172.21.15.87:0/3220837970 >> v2:172.21.15.87:3300/0 conn(0x7fcf600c58e0 msgr2=0x7fcf60072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:46.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.552+0000 7fcf65d26640 1 --2- 172.21.15.87:0/3220837970 >> v2:172.21.15.87:3300/0 conn(0x7fcf600c58e0 0x7fcf60072490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.552+0000 7fcf65d26640 1 -- 172.21.15.87:0/3220837970 >> v1:172.21.15.87:6789/0 conn(0x7fcf60156b90 legacy=0x7fcf600c17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:46.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.552+0000 7fcf65d26640 1 -- 172.21.15.87:0/3220837970 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf600cb170 con 0x7fcf6014cc60 2023-12-16T20:21:46.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.554+0000 7fcf65d26640 1 --2- 172.21.15.87:0/3220837970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf6014cc60 0x7fcf600bff00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcf6006da50 tx=0x7fcf5c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f64b9372de504704 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:46.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.558+0000 7fcf64d24640 1 -- 172.21.15.87:0/3220837970 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c031830 con 0x7fcf6014cc60 2023-12-16T20:21:46.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.558+0000 7fcf64d24640 1 -- 172.21.15.87:0/3220837970 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c031990 con 0x7fcf6014cc60 2023-12-16T20:21:46.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.558+0000 7fcf64d24640 1 -- 172.21.15.87:0/3220837970 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c031d20 con 0x7fcf6014cc60 2023-12-16T20:21:46.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.558+0000 7fcf67f8a640 1 -- 172.21.15.87:0/3220837970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf6014cc60 msgr2=0x7fcf600bff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:46.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.558+0000 7fcf67f8a640 1 --2- 172.21.15.87:0/3220837970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf6014cc60 0x7fcf600bff00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcf6006da50 tx=0x7fcf5c02b8d0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.558+0000 7fcf67f8a640 1 -- 172.21.15.87:0/3220837970 shutdown_connections 2023-12-16T20:21:46.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.558+0000 7fcf67f8a640 1 --2- 172.21.15.87:0/3220837970 >> v2:172.21.15.87:3300/0 conn(0x7fcf600c58e0 0x7fcf60072490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.558+0000 7fcf67f8a640 1 --2- 172.21.15.87:0/3220837970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf6014cc60 0x7fcf600bff00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.558+0000 7fcf67f8a640 1 -- 172.21.15.87:0/3220837970 >> 172.21.15.87:0/3220837970 conn(0x7fcf6006cd60 msgr2=0x7fcf6006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:46.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.559+0000 7fcf67f8a640 1 -- 172.21.15.87:0/3220837970 shutdown_connections 2023-12-16T20:21:46.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.559+0000 7fcf67f8a640 1 -- 172.21.15.87:0/3220837970 wait complete. 2023-12-16T20:21:46.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.560+0000 7fcf67f8a640 1 Processor -- start 2023-12-16T20:21:46.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.560+0000 7fcf67f8a640 1 -- start start 2023-12-16T20:21:46.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.560+0000 7fcf67f8a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf600c58e0 0x7fcf601435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.560+0000 7fcf67f8a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf6014cc60 0x7fcf60141d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.560+0000 7fcf67f8a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf60156b90 0x7fcf60140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.560+0000 7fcf67f8a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf60157910 con 0x7fcf6014cc60 2023-12-16T20:21:46.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.560+0000 7fcf67f8a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf601555e0 con 0x7fcf600c58e0 2023-12-16T20:21:46.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.560+0000 7fcf67f8a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf60155db0 con 0x7fcf60156b90 2023-12-16T20:21:46.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.561+0000 7fcf65d26640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf600c58e0 0x7fcf601435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.561+0000 7fcf66527640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf60156b90 0x7fcf60140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.561+0000 7fcf65525640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf6014cc60 0x7fcf60141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.561+0000 7fcf65d26640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf600c58e0 0x7fcf601435b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:56154/0 (socket says 172.21.15.87:56154) 2023-12-16T20:21:46.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.561+0000 7fcf65d26640 1 -- 172.21.15.87:0/3325670756 learned_addr learned my addr 172.21.15.87:0/3325670756 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:46.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.564+0000 7fcf65d26640 1 -- 172.21.15.87:0/3325670756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf60156b90 msgr2=0x7fcf60140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:46.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.564+0000 7fcf65d26640 1 --2- 172.21.15.87:0/3325670756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf60156b90 0x7fcf60140730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.564+0000 7fcf65d26640 1 -- 172.21.15.87:0/3325670756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf6014cc60 msgr2=0x7fcf60141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:46.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.564+0000 7fcf65d26640 1 --2- 172.21.15.87:0/3325670756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf6014cc60 0x7fcf60141d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:46.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.564+0000 7fcf65d26640 1 -- 172.21.15.87:0/3325670756 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c009400 con 0x7fcf600c58e0 2023-12-16T20:21:46.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.567+0000 7fcf65d26640 1 --2- 172.21.15.87:0/3325670756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf600c58e0 0x7fcf601435b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009890 tx=0x7fcf5c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:46.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.570+0000 7fcf567fc640 1 -- 172.21.15.87:0/3325670756 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c03a8f0 con 0x7fcf600c58e0 2023-12-16T20:21:46.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.570+0000 7fcf567fc640 1 -- 172.21.15.87:0/3325670756 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c03aa50 con 0x7fcf600c58e0 2023-12-16T20:21:46.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.570+0000 7fcf567fc640 1 -- 172.21.15.87:0/3325670756 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c03ade0 con 0x7fcf600c58e0 2023-12-16T20:21:46.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.570+0000 7fcf67f8a640 1 -- 172.21.15.87:0/3325670756 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf60143120 con 0x7fcf600c58e0 2023-12-16T20:21:46.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.570+0000 7fcf67f8a640 1 -- 172.21.15.87:0/3325670756 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf60155ad0 con 0x7fcf600c58e0 2023-12-16T20:21:46.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.571+0000 7fcf67f8a640 1 -- 172.21.15.87:0/3325670756 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf6015a4b0 con 0x7fcf600c58e0 2023-12-16T20:21:46.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.816+0000 7fcf567fc640 1 -- 172.21.15.87:0/3325670756 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fcf5c0443f0 con 0x7fcf600c58e0 2023-12-16T20:21:46.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.817+0000 7fcf567fc640 1 --2- 172.21.15.87:0/3325670756 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fcf4406aec0 0x7fcf4406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:46.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.817+0000 7fcf65525640 1 --2- 172.21.15.87:0/3325670756 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fcf4406aec0 0x7fcf4406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:46.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.817+0000 7fcf65525640 1 --2- 172.21.15.87:0/3325670756 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fcf4406aec0 0x7fcf4406d380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf60154e20 tx=0x7fcf50009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:46.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.820+0000 7fcf567fc640 1 -- 172.21.15.87:0/3325670756 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcf5c07af60 con 0x7fcf600c58e0 2023-12-16T20:21:46.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:46.831+0000 7fcf567fc640 1 -- 172.21.15.87:0/3325670756 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fcf5c0772a0 con 0x7fcf600c58e0 2023-12-16T20:21:47.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:47.031+0000 7fcf67f8a640 1 -- 172.21.15.87:0/3325670756 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcf60067500 con 0x7fcf600c58e0 2023-12-16T20:21:47.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:47.038+0000 7fcf567fc640 1 -- 172.21.15.87:0/3325670756 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fcf5c052070 con 0x7fcf600c58e0 2023-12-16T20:21:47.039 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-16T20:21:47.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:47.040+0000 7fcf67f8a640 1 -- 172.21.15.87:0/3325670756 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fcf4406aec0 msgr2=0x7fcf4406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:47.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:47.040+0000 7fcf67f8a640 1 --2- 172.21.15.87:0/3325670756 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fcf4406aec0 0x7fcf4406d380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf60154e20 tx=0x7fcf50009190 comp rx=0 tx=0).stop 2023-12-16T20:21:47.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:47.040+0000 7fcf67f8a640 1 -- 172.21.15.87:0/3325670756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf600c58e0 msgr2=0x7fcf601435b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:47.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:47.040+0000 7fcf67f8a640 1 --2- 172.21.15.87:0/3325670756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf600c58e0 0x7fcf601435b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009890 tx=0x7fcf5c0046c0 comp rx=0 tx=0).stop 2023-12-16T20:21:47.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:47.040+0000 7fcf67f8a640 1 -- 172.21.15.87:0/3325670756 shutdown_connections 2023-12-16T20:21:47.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:47.040+0000 7fcf67f8a640 1 --2- 172.21.15.87:0/3325670756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf60156b90 0x7fcf60140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:47.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:47.040+0000 7fcf67f8a640 1 --2- 172.21.15.87:0/3325670756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf6014cc60 0x7fcf60141d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:47.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:47.040+0000 7fcf67f8a640 1 --2- 172.21.15.87:0/3325670756 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fcf4406aec0 0x7fcf4406d380 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:47.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:47.040+0000 7fcf67f8a640 1 --2- 172.21.15.87:0/3325670756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf600c58e0 0x7fcf601435b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:47.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:47.040+0000 7fcf67f8a640 1 -- 172.21.15.87:0/3325670756 >> 172.21.15.87:0/3325670756 conn(0x7fcf6006cd60 msgr2=0x7fcf6006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:47.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:47.040+0000 7fcf67f8a640 1 -- 172.21.15.87:0/3325670756 shutdown_connections 2023-12-16T20:21:47.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:47.040+0000 7fcf67f8a640 1 -- 172.21.15.87:0/3325670756 wait complete. 2023-12-16T20:21:47.051 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-16T20:21:47.052 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T20:21:47.052 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2023-12-16T20:21:47.052 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-16T20:21:47.052 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-16T20:21:47.052 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-16T20:21:47.052 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-16T20:21:47.052 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T20:21:47.052 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-16T20:21:47.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:47.052 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2023-12-16T20:21:47.067 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T20:21:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T20:21:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T20:21:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-12-16T20:21:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2023-12-16T20:21:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-12-16T20:21:47.068 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T20:21:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2023-12-16T20:21:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2023-12-16T20:21:47.068 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T20:21:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2023-12-16T20:21:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2023-12-16T20:21:47.068 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T20:21:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2023-12-16T20:21:47.068 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T20:21:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2023-12-16T20:21:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-16T20:21:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42261sec preferred_lft 42261sec 2023-12-16T20:21:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2023-12-16T20:21:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-12-16T20:21:47.069 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-16T20:21:47.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:47.073 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-12-16T20:21:47.073 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-12-16T20:21:47.073 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add name ceph-brx type bridge 2023-12-16T20:21:47.073 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr flush dev ceph-brx 2023-12-16T20:21:47.073 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set ceph-brx up 2023-12-16T20:21:47.073 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-16T20:21:47.074 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-12-16T20:21:47.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:47.225 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T20:21:47.252 INFO:teuthology.orchestra.run.smithi087.stdout:1 2023-12-16T20:21:47.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:47.253 DEBUG:teuthology.orchestra.run.smithi087:> route 2023-12-16T20:21:47.320 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2023-12-16T20:21:47.320 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T20:21:47.320 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-16T20:21:47.320 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-16T20:21:47.320 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T20:21:47.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:47.321 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-12-16T20:21:47.321 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-12-16T20:21:47.321 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-16T20:21:47.321 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-16T20:21:47.321 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-16T20:21:47.321 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-12-16T20:21:47.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:47.574 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2023-12-16T20:21:47.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:47.589 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2023-12-16T20:21:47.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:47.643 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-12-16T20:21:47.643 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-12-16T20:21:47.643 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-16T20:21:47.643 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-16T20:21:47.643 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-12-16T20:21:47.725 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-16T20:21:47.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:47.725 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-12-16T20:21:47.726 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-12-16T20:21:47.726 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-16T20:21:47.726 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-16T20:21:47.726 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-16T20:21:47.726 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-16T20:21:47.726 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-16T20:21:47.726 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-12-16T20:21:47.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:47.866 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-12-16T20:21:47.866 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-12-16T20:21:47.866 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2023-12-16T20:21:47.866 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.0 master ceph-brx 2023-12-16T20:21:47.866 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-12-16T20:21:47.907 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-16T20:21:47.907 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T20:21:47.908 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-16T20:21:47.963 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-16T20:21:47.963 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T20:21:47.963 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-16T20:21:48.017 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2023-12-16T20:21:48.086 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T20:21:48.142 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2023-12-16T20:21:48.142 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2023-12-16T20:21:48.142 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2023-12-16T20:21:48.142 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2023-12-16T20:21:48.142 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2023-12-16T20:21:48.142 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2023-12-16T20:21:48.142 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2023-12-16T20:21:48.142 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2023-12-16T20:21:48.143 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2023-12-16T20:21:48.143 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2023-12-16T20:21:48.143 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2023-12-16T20:21:48.143 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2023-12-16T20:21:48.143 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T20:21:48.143 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2023-12-16T20:21:48.143 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2023-12-16T20:21:48.143 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2023-12-16T20:21:48.143 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2023-12-16T20:21:48.143 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2023-12-16T20:21:48.143 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2023-12-16T20:21:48.143 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T20:21:48.144 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T20:21:48.144 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T20:21:48.144 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T20:21:48.144 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2023-12-16T20:21:48.144 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2023-12-16T20:21:48.144 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T20:21:48.144 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T20:21:48.144 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T20:21:48.144 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T20:21:48.144 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2023-12-16T20:21:48.144 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-16T20:21:48.144 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-16T20:21:48.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:48.145 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2023-12-16T20:21:48.197 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-16T20:21:48.197 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-16T20:21:48.239 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2023-12-16T20:21:48.266 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T20:21:48.324 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2023-12-16T20:21:48.324 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2023-12-16T20:21:48.324 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2023-12-16T20:21:48.324 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2023-12-16T20:21:48.324 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2023-12-16T20:21:48.324 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2023-12-16T20:21:48.324 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2023-12-16T20:21:48.324 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2023-12-16T20:21:48.325 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2023-12-16T20:21:48.325 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2023-12-16T20:21:48.325 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2023-12-16T20:21:48.325 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2023-12-16T20:21:48.325 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T20:21:48.325 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2023-12-16T20:21:48.325 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2023-12-16T20:21:48.325 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2023-12-16T20:21:48.325 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2023-12-16T20:21:48.325 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2023-12-16T20:21:48.325 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2023-12-16T20:21:48.325 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T20:21:48.326 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T20:21:48.326 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T20:21:48.326 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T20:21:48.326 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2023-12-16T20:21:48.326 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2023-12-16T20:21:48.326 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T20:21:48.326 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T20:21:48.326 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T20:21:48.326 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T20:21:48.326 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2023-12-16T20:21:48.326 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-16T20:21:48.326 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-16T20:21:48.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:48.327 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2023-12-16T20:21:48.336 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi087.stderr:2023-12-16T20:21:48.335+0000 7fc8f6236480 -1 init, newargv = 0x557e247433b0 newargc=15 2023-12-16T20:21:48.337 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi087.stderr:ceph-fuse[94047]: starting ceph client 2023-12-16T20:21:48.588 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi087.stderr:ceph-fuse[94047]: starting fuse 2023-12-16T20:21:49.452 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2023-12-16T20:21:49.480 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T20:21:49.537 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2023-12-16T20:21:49.537 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2023-12-16T20:21:49.537 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2023-12-16T20:21:49.537 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2023-12-16T20:21:49.537 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2023-12-16T20:21:49.537 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2023-12-16T20:21:49.537 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2023-12-16T20:21:49.537 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2023-12-16T20:21:49.537 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2023-12-16T20:21:49.537 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2023-12-16T20:21:49.538 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2023-12-16T20:21:49.538 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2023-12-16T20:21:49.538 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T20:21:49.538 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2023-12-16T20:21:49.538 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2023-12-16T20:21:49.538 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2023-12-16T20:21:49.538 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2023-12-16T20:21:49.538 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2023-12-16T20:21:49.538 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2023-12-16T20:21:49.538 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T20:21:49.538 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T20:21:49.538 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T20:21:49.538 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T20:21:49.539 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2023-12-16T20:21:49.539 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2023-12-16T20:21:49.539 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T20:21:49.539 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T20:21:49.539 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T20:21:49.539 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T20:21:49.539 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2023-12-16T20:21:49.539 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-16T20:21:49.539 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-16T20:21:49.539 INFO:teuthology.orchestra.run.smithi087.stdout:/home/ubuntu/cephtest/mnt.admin 2023-12-16T20:21:49.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:49.539 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2023-12-16T20:21:49.591 INFO:teuthology.orchestra.run.smithi087.stdout:41 2023-12-16T20:21:49.592 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-16T20:21:49.592 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2023-12-16T20:21:49.592 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2023-12-16T20:21:49.592 DEBUG:teuthology.orchestra.run.smithi087:> import re 2023-12-16T20:21:49.592 DEBUG:teuthology.orchestra.run.smithi087:> import os 2023-12-16T20:21:49.592 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2023-12-16T20:21:49.592 DEBUG:teuthology.orchestra.run.smithi087:> 2023-12-16T20:21:49.592 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2023-12-16T20:21:49.592 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-16T20:21:49.592 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2023-12-16T20:21:49.593 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-16T20:21:49.593 DEBUG:teuthology.orchestra.run.smithi087:> 2023-12-16T20:21:49.593 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2023-12-16T20:21:49.593 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2023-12-16T20:21:49.593 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2023-12-16T20:21:49.593 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2023-12-16T20:21:49.593 DEBUG:teuthology.orchestra.run.smithi087:> 2023-12-16T20:21:49.593 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2023-12-16T20:21:49.593 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-16T20:21:49.593 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-16T20:21:49.593 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-16T20:21:49.593 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2023-12-16T20:21:49.593 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2023-12-16T20:21:49.593 DEBUG:teuthology.orchestra.run.smithi087:> return f 2023-12-16T20:21:49.594 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-16T20:21:49.594 DEBUG:teuthology.orchestra.run.smithi087:> 2023-12-16T20:21:49.594 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.admin")) 2023-12-16T20:21:49.594 DEBUG:teuthology.orchestra.run.smithi087:> ' 2023-12-16T20:21:49.711 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.admin.94047.asok 2023-12-16T20:21:49.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-16T20:21:49.721 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.94047.asok 2023-12-16T20:21:49.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:49.722 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.94047.asok status 2023-12-16T20:21:49.857 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-12-16T20:21:49.857 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2023-12-16T20:21:49.857 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "c7586e95519b7be76f3b6e3a4b333888baf46bc9", 2023-12-16T20:21:49.858 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)", 2023-12-16T20:21:49.858 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "admin", 2023-12-16T20:21:49.858 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2023-12-16T20:21:49.858 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-16T20:21:49.858 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "94047", 2023-12-16T20:21:49.858 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2023-12-16T20:21:49.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-12-16T20:21:49.858 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2023-12-16T20:21:49.858 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2023-12-16T20:21:49.858 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4368, 2023-12-16T20:21:49.858 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2023-12-16T20:21:49.858 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2023-12-16T20:21:49.858 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2023-12-16T20:21:49.858 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 4368 2023-12-16T20:21:49.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-12-16T20:21:49.859 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2023-12-16T20:21:49.859 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2023-12-16T20:21:49.859 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2023-12-16T20:21:49.859 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 4243924505 2023-12-16T20:21:49.859 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-12-16T20:21:49.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-12-16T20:21:49.859 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2023-12-16T20:21:49.859 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2023-12-16T20:21:49.859 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2023-12-16T20:21:49.859 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 4243924505 2023-12-16T20:21:49.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-12-16T20:21:49.859 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.4368 192.168.0.1:0/4243924505", 2023-12-16T20:21:49.859 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/4243924505", 2023-12-16T20:21:49.859 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2023-12-16T20:21:49.860 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 7, 2023-12-16T20:21:49.860 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 25, 2023-12-16T20:21:49.860 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2023-12-16T20:21:49.860 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2023-12-16T20:21:49.860 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2023-12-16T20:21:49.860 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-12-16T20:21:49.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:49.866 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2023-12-16T20:21:49.866 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-16T20:21:49.891 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2023-12-16T20:21:49.891 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-16T20:21:49.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:49.891 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-16T20:21:50.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:50.026 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-16T20:21:50.231 INFO:teuthology.orchestra.run.smithi087.stdout:# file: . 2023-12-16T20:21:50.231 INFO:teuthology.orchestra.run.smithi087.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-16T20:21:50.232 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:21:50.232 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:21:50.232 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T20:21:50.247 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:21:50.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.386+0000 7f8ee2cb2640 1 Processor -- start 2023-12-16T20:21:50.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.386+0000 7f8ee2cb2640 1 -- start start 2023-12-16T20:21:50.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.387+0000 7f8ee2cb2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8edc153890 0x7f8edc15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:50.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.387+0000 7f8ee2cb2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8edc15a700 con 0x7f8edc0ceef0 2023-12-16T20:21:50.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.387+0000 7f8ee2cb2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8edc0ca870 con 0x7f8edc153c70 2023-12-16T20:21:50.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.387+0000 7f8ee2cb2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc159af0 con 0x7f8edc153890 2023-12-16T20:21:50.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.388+0000 7f8ee124f640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8edc0ceef0 0x7f8edc15aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60462/0 (socket says 172.21.15.87:60462) 2023-12-16T20:21:50.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.388+0000 7f8ee124f640 1 -- 172.21.15.87:0/1783917274 learned_addr learned my addr 172.21.15.87:0/1783917274 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:50.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.388+0000 7f8ee0a4e640 1 --2- 172.21.15.87:0/1783917274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8edc153890 0x7f8edc15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:50.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.390+0000 7f8edb7fe640 1 -- 172.21.15.87:0/1783917274 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802025763 0 0) 0x7f8edc15a700 con 0x7f8edc0ceef0 2023-12-16T20:21:50.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.390+0000 7f8edb7fe640 1 -- 172.21.15.87:0/1783917274 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ec4003520 con 0x7f8edc0ceef0 2023-12-16T20:21:50.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.391+0000 7f8ee0a4e640 1 -- 172.21.15.87:0/1783917274 >> v1:172.21.15.195:6789/0 conn(0x7f8edc153c70 legacy=0x7f8edc0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:50.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.391+0000 7f8ee0a4e640 1 -- 172.21.15.87:0/1783917274 >> v1:172.21.15.87:6789/0 conn(0x7f8edc0ceef0 legacy=0x7f8edc15aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:50.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.391+0000 7f8ee0a4e640 1 -- 172.21.15.87:0/1783917274 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc159dd0 con 0x7f8edc153890 2023-12-16T20:21:50.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.393+0000 7f8ee0a4e640 1 --2- 172.21.15.87:0/1783917274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8edc153890 0x7f8edc15d950 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc0097d0 tx=0x7f8ecc02b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e678b8a06562fcca server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:50.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.397+0000 7f8edb7fe640 1 -- 172.21.15.87:0/1783917274 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc030880 con 0x7f8edc153890 2023-12-16T20:21:50.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.397+0000 7f8edb7fe640 1 -- 172.21.15.87:0/1783917274 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc0309e0 con 0x7f8edc153890 2023-12-16T20:21:50.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.397+0000 7f8edb7fe640 1 -- 172.21.15.87:0/1783917274 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc030d70 con 0x7f8edc153890 2023-12-16T20:21:50.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.398+0000 7f8ee2cb2640 1 -- 172.21.15.87:0/1783917274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8edc153890 msgr2=0x7f8edc15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:50.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.398+0000 7f8ee2cb2640 1 --2- 172.21.15.87:0/1783917274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8edc153890 0x7f8edc15d950 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc0097d0 tx=0x7f8ecc02b9c0 comp rx=0 tx=0).stop 2023-12-16T20:21:50.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.398+0000 7f8ee2cb2640 1 -- 172.21.15.87:0/1783917274 shutdown_connections 2023-12-16T20:21:50.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.398+0000 7f8ee2cb2640 1 --2- 172.21.15.87:0/1783917274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8edc153890 0x7f8edc15d950 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:50.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.398+0000 7f8ee2cb2640 1 -- 172.21.15.87:0/1783917274 >> 172.21.15.87:0/1783917274 conn(0x7f8edc06ba00 msgr2=0x7f8edc06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:50.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.398+0000 7f8ee2cb2640 1 -- 172.21.15.87:0/1783917274 shutdown_connections 2023-12-16T20:21:50.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.398+0000 7f8ee2cb2640 1 -- 172.21.15.87:0/1783917274 wait complete. 2023-12-16T20:21:50.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.399+0000 7f8ee2cb2640 1 Processor -- start 2023-12-16T20:21:50.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.399+0000 7f8ee2cb2640 1 -- start start 2023-12-16T20:21:50.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.400+0000 7f8ee2cb2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8edc0ceef0 0x7f8edc152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:50.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.400+0000 7f8ee2cb2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8edc153890 0x7f8edc14e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:50.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.400+0000 7f8ee2cb2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8edc153c70 0x7f8edc156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:50.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.400+0000 7f8ee2cb2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc14f950 con 0x7f8edc153890 2023-12-16T20:21:50.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.400+0000 7f8ee2cb2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc1544d0 con 0x7f8edc0ceef0 2023-12-16T20:21:50.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.400+0000 7f8ee2cb2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc1547b0 con 0x7f8edc153c70 2023-12-16T20:21:50.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.400+0000 7f8edbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8edc153890 0x7f8edc14e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:50.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.400+0000 7f8ee124f640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8edc153c70 0x7f8edc156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:50.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.400+0000 7f8ee0a4e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8edc0ceef0 0x7f8edc152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:50.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.400+0000 7f8edbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8edc153890 0x7f8edc14e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42238/0 (socket says 172.21.15.87:42238) 2023-12-16T20:21:50.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.400+0000 7f8edbfff640 1 -- 172.21.15.87:0/239352245 learned_addr learned my addr 172.21.15.87:0/239352245 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:50.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.404+0000 7f8edbfff640 1 -- 172.21.15.87:0/239352245 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8edc153c70 msgr2=0x7f8edc156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:50.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.404+0000 7f8edbfff640 1 --2- 172.21.15.87:0/239352245 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8edc153c70 0x7f8edc156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:50.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.404+0000 7f8edbfff640 1 -- 172.21.15.87:0/239352245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8edc0ceef0 msgr2=0x7f8edc152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:50.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.404+0000 7f8edbfff640 1 --2- 172.21.15.87:0/239352245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8edc0ceef0 0x7f8edc152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:50.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.404+0000 7f8edbfff640 1 -- 172.21.15.87:0/239352245 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc009400 con 0x7f8edc153890 2023-12-16T20:21:50.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.406+0000 7f8edbfff640 1 --2- 172.21.15.87:0/239352245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8edc153890 0x7f8edc14e9b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000c3c0 tx=0x7f8ed000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:50.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.409+0000 7f8ed97fa640 1 -- 172.21.15.87:0/239352245 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed00052d0 con 0x7f8edc153890 2023-12-16T20:21:50.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.409+0000 7f8ed97fa640 1 -- 172.21.15.87:0/239352245 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed0005450 con 0x7f8edc153890 2023-12-16T20:21:50.411 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.409+0000 7f8ed97fa640 1 -- 172.21.15.87:0/239352245 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0007260 con 0x7f8edc153890 2023-12-16T20:21:50.411 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.409+0000 7f8ee2cb2640 1 -- 172.21.15.87:0/239352245 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8edc14f300 con 0x7f8edc153890 2023-12-16T20:21:50.411 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.409+0000 7f8ee2cb2640 1 -- 172.21.15.87:0/239352245 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8edc155a10 con 0x7f8edc153890 2023-12-16T20:21:50.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.410+0000 7f8ee2cb2640 1 -- 172.21.15.87:0/239352245 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8edc0728d0 con 0x7f8edc153890 2023-12-16T20:21:50.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.428+0000 7f8ed97fa640 1 -- 172.21.15.87:0/239352245 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f8ed00073c0 con 0x7f8edc153890 2023-12-16T20:21:50.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.428+0000 7f8ed97fa640 1 --2- 172.21.15.87:0/239352245 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8ec806ae90 0x7f8ec806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:50.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.428+0000 7f8ee0a4e640 1 --2- 172.21.15.87:0/239352245 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8ec806ae90 0x7f8ec806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:50.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.429+0000 7f8ee0a4e640 1 --2- 172.21.15.87:0/239352245 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8ec806ae90 0x7f8ec806d350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc036000 tx=0x7f8ecc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:50.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.431+0000 7f8ed97fa640 1 -- 172.21.15.87:0/239352245 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8ed0057c20 con 0x7f8edc153890 2023-12-16T20:21:50.673 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.671+0000 7f8ed97fa640 1 -- 172.21.15.87:0/239352245 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f8ed0053f60 con 0x7f8edc153890 2023-12-16T20:21:50.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.866+0000 7f8ee2cb2640 1 -- 172.21.15.87:0/239352245 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8edc067500 con 0x7f8edc153890 2023-12-16T20:21:50.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.902+0000 7f8ed97fa640 1 -- 172.21.15.87:0/239352245 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f8ed0020020 con 0x7f8edc153890 2023-12-16T20:21:50.904 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:21:50.904 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:21:41.431615+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:21:22.654341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T20:21:33.728787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T20:21:34.846119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T20:21:38.657738+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:21:50.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.904+0000 7f8ee2cb2640 1 -- 172.21.15.87:0/239352245 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8ec806ae90 msgr2=0x7f8ec806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:50.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.904+0000 7f8ee2cb2640 1 --2- 172.21.15.87:0/239352245 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8ec806ae90 0x7f8ec806d350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc036000 tx=0x7f8ecc008030 comp rx=0 tx=0).stop 2023-12-16T20:21:50.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.904+0000 7f8ee2cb2640 1 -- 172.21.15.87:0/239352245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8edc153890 msgr2=0x7f8edc14e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:50.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.904+0000 7f8ee2cb2640 1 --2- 172.21.15.87:0/239352245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8edc153890 0x7f8edc14e9b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000c3c0 tx=0x7f8ed000c880 comp rx=0 tx=0).stop 2023-12-16T20:21:50.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.904+0000 7f8ee2cb2640 1 -- 172.21.15.87:0/239352245 shutdown_connections 2023-12-16T20:21:50.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.904+0000 7f8ee2cb2640 1 --2- 172.21.15.87:0/239352245 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8edc153c70 0x7f8edc156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:50.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.904+0000 7f8ee2cb2640 1 --2- 172.21.15.87:0/239352245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8edc153890 0x7f8edc14e9b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:50.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.904+0000 7f8ee2cb2640 1 --2- 172.21.15.87:0/239352245 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8ec806ae90 0x7f8ec806d350 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:50.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.904+0000 7f8ee2cb2640 1 --2- 172.21.15.87:0/239352245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8edc0ceef0 0x7f8edc152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:50.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.904+0000 7f8ee2cb2640 1 -- 172.21.15.87:0/239352245 >> 172.21.15.87:0/239352245 conn(0x7f8edc06ba00 msgr2=0x7f8edc0cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:50.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.904+0000 7f8ee2cb2640 1 -- 172.21.15.87:0/239352245 shutdown_connections 2023-12-16T20:21:50.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:50.904+0000 7f8ee2cb2640 1 -- 172.21.15.87:0/239352245 wait complete. 2023-12-16T20:21:50.916 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T20:21:22.654341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T20:21:33.728787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T20:21:34.846119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-16T20:21:38.657738+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-16T20:21:50.917 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T20:21:51.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.018+0000 7f242b2d3640 1 Processor -- start 2023-12-16T20:21:51.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.018+0000 7f242b2d3640 1 -- start start 2023-12-16T20:21:51.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.019+0000 7f242b2d3640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2424153be0 0x7f2424159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:51.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.019+0000 7f242b2d3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f242406fa00 0x7f24240c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:51.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.019+0000 7f242b2d3640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2424153fc0 con 0x7f24240c5e60 2023-12-16T20:21:51.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.019+0000 7f242b2d3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24240c3340 con 0x7f242406fa00 2023-12-16T20:21:51.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.019+0000 7f242b2d3640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f242406b7b0 con 0x7f2424153be0 2023-12-16T20:21:51.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.020+0000 7f242886e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f242406fa00 0x7f24240c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:51.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.020+0000 7f242906f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2424153be0 0x7f2424159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:51.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.020+0000 7f242886e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f242406fa00 0x7f24240c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46628/0 (socket says 172.21.15.87:46628) 2023-12-16T20:21:51.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.020+0000 7f242886e640 1 -- 172.21.15.87:0/4029493129 learned_addr learned my addr 172.21.15.87:0/4029493129 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:51.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.022+0000 7f242886e640 1 -- 172.21.15.87:0/4029493129 >> v2:172.21.15.195:3300/0 conn(0x7f2424153be0 msgr2=0x7f2424159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:51.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.022+0000 7f242886e640 1 --2- 172.21.15.87:0/4029493129 >> v2:172.21.15.195:3300/0 conn(0x7f2424153be0 0x7f2424159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:51.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.022+0000 7f242886e640 1 -- 172.21.15.87:0/4029493129 >> v1:172.21.15.195:6789/0 conn(0x7f24240c5e60 legacy=0x7f242406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:51.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.022+0000 7f242886e640 1 -- 172.21.15.87:0/4029493129 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242406ba90 con 0x7f242406fa00 2023-12-16T20:21:51.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.024+0000 7f242886e640 1 --2- 172.21.15.87:0/4029493129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f242406fa00 0x7f24240c41b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f24240610b0 tx=0x7f241402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ad1a1644646a6f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:51.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.028+0000 7f241bfff640 1 -- 172.21.15.87:0/4029493129 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2414030860 con 0x7f242406fa00 2023-12-16T20:21:51.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.028+0000 7f241bfff640 1 -- 172.21.15.87:0/4029493129 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24140309c0 con 0x7f242406fa00 2023-12-16T20:21:51.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.028+0000 7f241bfff640 1 -- 172.21.15.87:0/4029493129 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2414030d50 con 0x7f242406fa00 2023-12-16T20:21:51.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.029+0000 7f242b2d3640 1 -- 172.21.15.87:0/4029493129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f242406fa00 msgr2=0x7f24240c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:51.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.029+0000 7f242b2d3640 1 --2- 172.21.15.87:0/4029493129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f242406fa00 0x7f24240c41b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f24240610b0 tx=0x7f241402b9a0 comp rx=0 tx=0).stop 2023-12-16T20:21:51.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.029+0000 7f242b2d3640 1 -- 172.21.15.87:0/4029493129 shutdown_connections 2023-12-16T20:21:51.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.029+0000 7f242b2d3640 1 --2- 172.21.15.87:0/4029493129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f242406fa00 0x7f24240c41b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:51.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.029+0000 7f242b2d3640 1 --2- 172.21.15.87:0/4029493129 >> v2:172.21.15.195:3300/0 conn(0x7f2424153be0 0x7f2424159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:51.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.029+0000 7f242b2d3640 1 -- 172.21.15.87:0/4029493129 >> 172.21.15.87:0/4029493129 conn(0x7f24240c7f60 msgr2=0x7f24240c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:51.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.029+0000 7f242b2d3640 1 -- 172.21.15.87:0/4029493129 shutdown_connections 2023-12-16T20:21:51.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.029+0000 7f242b2d3640 1 -- 172.21.15.87:0/4029493129 wait complete. 2023-12-16T20:21:51.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.030+0000 7f242b2d3640 1 Processor -- start 2023-12-16T20:21:51.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.030+0000 7f242b2d3640 1 -- start start 2023-12-16T20:21:51.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.031+0000 7f242b2d3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f242406fa00 0x7f242413dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:51.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.031+0000 7f242b2d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24240c5e60 0x7f24240cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:51.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.031+0000 7f242b2d3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2424153be0 0x7f24241ef980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:51.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.031+0000 7f242b2d3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2424155d50 con 0x7f24240c5e60 2023-12-16T20:21:51.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.031+0000 7f242b2d3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24241572f0 con 0x7f242406fa00 2023-12-16T20:21:51.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.031+0000 7f242b2d3640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24241ef560 con 0x7f2424153be0 2023-12-16T20:21:51.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.031+0000 7f242906f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f242406fa00 0x7f242413dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:51.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.031+0000 7f2429870640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2424153be0 0x7f24241ef980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:51.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.031+0000 7f242886e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24240c5e60 0x7f24240cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:51.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.032+0000 7f242906f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f242406fa00 0x7f242413dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:55762/0 (socket says 172.21.15.87:55762) 2023-12-16T20:21:51.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.032+0000 7f242906f640 1 -- 172.21.15.87:0/4291308630 learned_addr learned my addr 172.21.15.87:0/4291308630 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:51.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.035+0000 7f242906f640 1 -- 172.21.15.87:0/4291308630 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2424153be0 msgr2=0x7f24241ef980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:51.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.035+0000 7f242906f640 1 --2- 172.21.15.87:0/4291308630 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2424153be0 0x7f24241ef980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:51.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.035+0000 7f242906f640 1 -- 172.21.15.87:0/4291308630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24240c5e60 msgr2=0x7f24240cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:51.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.035+0000 7f242906f640 1 --2- 172.21.15.87:0/4291308630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24240c5e60 0x7f24240cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:51.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.035+0000 7f242906f640 1 -- 172.21.15.87:0/4291308630 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24140094d0 con 0x7f242406fa00 2023-12-16T20:21:51.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.037+0000 7f242906f640 1 --2- 172.21.15.87:0/4291308630 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f242406fa00 0x7f242413dc10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2420009d10 tx=0x7f242000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:51.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.040+0000 7f2419ffb640 1 -- 172.21.15.87:0/4291308630 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420009b80 con 0x7f242406fa00 2023-12-16T20:21:51.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.040+0000 7f2419ffb640 1 -- 172.21.15.87:0/4291308630 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242000f040 con 0x7f242406fa00 2023-12-16T20:21:51.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.040+0000 7f2419ffb640 1 -- 172.21.15.87:0/4291308630 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420014680 con 0x7f242406fa00 2023-12-16T20:21:51.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.041+0000 7f242b2d3640 1 -- 172.21.15.87:0/4291308630 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242413e150 con 0x7f242406fa00 2023-12-16T20:21:51.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.041+0000 7f242b2d3640 1 -- 172.21.15.87:0/4291308630 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2424140ef0 con 0x7f242406fa00 2023-12-16T20:21:51.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.042+0000 7f242b2d3640 1 -- 172.21.15.87:0/4291308630 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2424067500 con 0x7f242406fa00 2023-12-16T20:21:51.077 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:21:51.080 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:21:51.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.287+0000 7f2419ffb640 1 -- 172.21.15.87:0/4291308630 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f24200147e0 con 0x7f242406fa00 2023-12-16T20:21:51.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.288+0000 7f2419ffb640 1 --2- 172.21.15.87:0/4291308630 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f240806ae40 0x7f240806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:51.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.288+0000 7f242886e640 1 --2- 172.21.15.87:0/4291308630 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f240806ae40 0x7f240806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:51.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.288+0000 7f242886e640 1 --2- 172.21.15.87:0/4291308630 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f240806ae40 0x7f240806d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2414036000 tx=0x7f2414008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:51.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.290+0000 7f2419ffb640 1 -- 172.21.15.87:0/4291308630 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2420059440 con 0x7f242406fa00 2023-12-16T20:21:51.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.300+0000 7f2419ffb640 1 -- 172.21.15.87:0/4291308630 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f2420055780 con 0x7f242406fa00 2023-12-16T20:21:51.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.467+0000 7f242b2d3640 1 -- 172.21.15.87:0/4291308630 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f242413e150 con 0x7f242406fa00 2023-12-16T20:21:51.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.473+0000 7f2419ffb640 1 -- 172.21.15.87:0/4291308630 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f242413e150 con 0x7f242406fa00 2023-12-16T20:21:51.474 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-12-16T20:21:51.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.475+0000 7f242b2d3640 1 -- 172.21.15.87:0/4291308630 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f240806ae40 msgr2=0x7f240806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:51.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.475+0000 7f242b2d3640 1 --2- 172.21.15.87:0/4291308630 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f240806ae40 0x7f240806d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2414036000 tx=0x7f2414008030 comp rx=0 tx=0).stop 2023-12-16T20:21:51.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.475+0000 7f242b2d3640 1 -- 172.21.15.87:0/4291308630 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f242406fa00 msgr2=0x7f242413dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:51.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.475+0000 7f242b2d3640 1 --2- 172.21.15.87:0/4291308630 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f242406fa00 0x7f242413dc10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2420009d10 tx=0x7f242000c490 comp rx=0 tx=0).stop 2023-12-16T20:21:51.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.475+0000 7f242b2d3640 1 -- 172.21.15.87:0/4291308630 shutdown_connections 2023-12-16T20:21:51.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.475+0000 7f242b2d3640 1 --2- 172.21.15.87:0/4291308630 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2424153be0 0x7f24241ef980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:51.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.475+0000 7f242b2d3640 1 --2- 172.21.15.87:0/4291308630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24240c5e60 0x7f24240cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:51.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.475+0000 7f242b2d3640 1 --2- 172.21.15.87:0/4291308630 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f240806ae40 0x7f240806d300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:51.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.475+0000 7f242b2d3640 1 --2- 172.21.15.87:0/4291308630 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f242406fa00 0x7f242413dc10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:51.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.475+0000 7f242b2d3640 1 -- 172.21.15.87:0/4291308630 >> 172.21.15.87:0/4291308630 conn(0x7f24240c7f60 msgr2=0x7f2424071570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:51.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.475+0000 7f242b2d3640 1 -- 172.21.15.87:0/4291308630 shutdown_connections 2023-12-16T20:21:51.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.475+0000 7f242b2d3640 1 -- 172.21.15.87:0/4291308630 wait complete. 2023-12-16T20:21:51.487 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T20:21:51.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.588+0000 7fa9b9f68640 1 Processor -- start 2023-12-16T20:21:51.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.588+0000 7fa9b9f68640 1 -- start start 2023-12-16T20:21:51.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.588+0000 7fa9b9f68640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa9b4151510 0x7fa9b40cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:51.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.588+0000 7fa9b9f68640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b415b6e0 con 0x7fa9b40728b0 2023-12-16T20:21:51.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.588+0000 7fa9b9f68640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b415a880 con 0x7fa9b40c61a0 2023-12-16T20:21:51.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.588+0000 7fa9b9f68640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b406f7e0 con 0x7fa9b4151510 2023-12-16T20:21:51.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.589+0000 7fa9b37fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa9b4151510 0x7fa9b40cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:51.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.589+0000 7fa9b3fff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fa9b40c61a0 0x7fa9b4161c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:37444/0 (socket says 172.21.15.87:37444) 2023-12-16T20:21:51.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.589+0000 7fa9b3fff640 1 -- 172.21.15.87:0/1362980045 learned_addr learned my addr 172.21.15.87:0/1362980045 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:51.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.591+0000 7fa9b27fc640 1 -- 172.21.15.87:0/1362980045 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396645073 0 0) 0x7fa9b415a880 con 0x7fa9b40c61a0 2023-12-16T20:21:51.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.592+0000 7fa9b27fc640 1 -- 172.21.15.87:0/1362980045 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa99c003520 con 0x7fa9b40c61a0 2023-12-16T20:21:51.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.594+0000 7fa9b37fe640 1 -- 172.21.15.87:0/1362980045 >> v1:172.21.15.195:6789/0 conn(0x7fa9b40c61a0 legacy=0x7fa9b4161c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:51.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.594+0000 7fa9b37fe640 1 -- 172.21.15.87:0/1362980045 >> v1:172.21.15.87:6789/0 conn(0x7fa9b40728b0 legacy=0x7fa9b40c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:51.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.594+0000 7fa9b37fe640 1 -- 172.21.15.87:0/1362980045 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b415aad0 con 0x7fa9b4151510 2023-12-16T20:21:51.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.597+0000 7fa9b37fe640 1 --2- 172.21.15.87:0/1362980045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9b4151510 0x7fa9b40cae30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80097a0 tx=0x7fa9a802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6348d48377ce6699 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:51.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.601+0000 7fa9b27fc640 1 -- 172.21.15.87:0/1362980045 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8030610 con 0x7fa9b4151510 2023-12-16T20:21:51.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.601+0000 7fa9b27fc640 1 -- 172.21.15.87:0/1362980045 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a8030770 con 0x7fa9b4151510 2023-12-16T20:21:51.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.601+0000 7fa9b27fc640 1 -- 172.21.15.87:0/1362980045 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8030b00 con 0x7fa9b4151510 2023-12-16T20:21:51.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.601+0000 7fa9b9f68640 1 -- 172.21.15.87:0/1362980045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9b4151510 msgr2=0x7fa9b40cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:51.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.601+0000 7fa9b9f68640 1 --2- 172.21.15.87:0/1362980045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9b4151510 0x7fa9b40cae30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80097a0 tx=0x7fa9a802b960 comp rx=0 tx=0).stop 2023-12-16T20:21:51.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.601+0000 7fa9b9f68640 1 -- 172.21.15.87:0/1362980045 shutdown_connections 2023-12-16T20:21:51.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.601+0000 7fa9b9f68640 1 --2- 172.21.15.87:0/1362980045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9b4151510 0x7fa9b40cae30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:51.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.601+0000 7fa9b9f68640 1 -- 172.21.15.87:0/1362980045 >> 172.21.15.87:0/1362980045 conn(0x7fa9b406cd60 msgr2=0x7fa9b406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:51.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.602+0000 7fa9b9f68640 1 -- 172.21.15.87:0/1362980045 shutdown_connections 2023-12-16T20:21:51.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.602+0000 7fa9b9f68640 1 -- 172.21.15.87:0/1362980045 wait complete. 2023-12-16T20:21:51.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.603+0000 7fa9b9f68640 1 Processor -- start 2023-12-16T20:21:51.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.603+0000 7fa9b9f68640 1 -- start start 2023-12-16T20:21:51.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.603+0000 7fa9b9f68640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9b40728b0 0x7fa9b40c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:51.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.603+0000 7fa9b9f68640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9b40c61a0 0x7fa9b40ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:51.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.603+0000 7fa9b9f68640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9b4151510 0x7fa9b41438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:51.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.604+0000 7fa9b9f68640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b41f0ce0 con 0x7fa9b40728b0 2023-12-16T20:21:51.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.604+0000 7fa9b9f68640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b40c4fc0 con 0x7fa9b40c61a0 2023-12-16T20:21:51.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.604+0000 7fa9b9f68640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b41f00d0 con 0x7fa9b4151510 2023-12-16T20:21:51.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.604+0000 7fa9b37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9b40728b0 0x7fa9b40c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:51.606 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.604+0000 7fa9b37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9b40728b0 0x7fa9b40c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46654/0 (socket says 172.21.15.87:46654) 2023-12-16T20:21:51.606 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.604+0000 7fa9b37fe640 1 -- 172.21.15.87:0/1007494918 learned_addr learned my addr 172.21.15.87:0/1007494918 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:51.606 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.604+0000 7fa9b3fff640 1 --2- 172.21.15.87:0/1007494918 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9b4151510 0x7fa9b41438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:51.606 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.604+0000 7fa9b2ffd640 1 --2- 172.21.15.87:0/1007494918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9b40c61a0 0x7fa9b40ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:51.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.608+0000 7fa9b37fe640 1 -- 172.21.15.87:0/1007494918 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9b4151510 msgr2=0x7fa9b41438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:51.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.608+0000 7fa9b37fe640 1 --2- 172.21.15.87:0/1007494918 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9b4151510 0x7fa9b41438d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:51.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.608+0000 7fa9b37fe640 1 -- 172.21.15.87:0/1007494918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9b40c61a0 msgr2=0x7fa9b40ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:51.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.608+0000 7fa9b37fe640 1 --2- 172.21.15.87:0/1007494918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9b40c61a0 0x7fa9b40ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:51.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.608+0000 7fa9b37fe640 1 -- 172.21.15.87:0/1007494918 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a8009400 con 0x7fa9b40728b0 2023-12-16T20:21:51.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.610+0000 7fa9b37fe640 1 --2- 172.21.15.87:0/1007494918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9b40728b0 0x7fa9b40c4910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa9a802bf70 tx=0x7fa9a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:51.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.613+0000 7fa99bfff640 1 -- 172.21.15.87:0/1007494918 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a803e040 con 0x7fa9b40728b0 2023-12-16T20:21:51.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.613+0000 7fa99bfff640 1 -- 172.21.15.87:0/1007494918 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a8039cb0 con 0x7fa9b40728b0 2023-12-16T20:21:51.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.613+0000 7fa9b9f68640 1 -- 172.21.15.87:0/1007494918 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b41f03b0 con 0x7fa9b40728b0 2023-12-16T20:21:51.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.613+0000 7fa99bfff640 1 -- 172.21.15.87:0/1007494918 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8044630 con 0x7fa9b40728b0 2023-12-16T20:21:51.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.613+0000 7fa9b9f68640 1 -- 172.21.15.87:0/1007494918 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b41f0970 con 0x7fa9b40728b0 2023-12-16T20:21:51.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.614+0000 7fa9b9f68640 1 -- 172.21.15.87:0/1007494918 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b41f0b00 con 0x7fa9b40728b0 2023-12-16T20:21:51.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.631+0000 7fa99bfff640 1 -- 172.21.15.87:0/1007494918 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fa9a804d3b0 con 0x7fa9b40728b0 2023-12-16T20:21:51.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.632+0000 7fa99bfff640 1 --2- 172.21.15.87:0/1007494918 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa9a006ae90 0x7fa9a006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:51.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.632+0000 7fa9b2ffd640 1 --2- 172.21.15.87:0/1007494918 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa9a006ae90 0x7fa9a006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:51.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.632+0000 7fa9b2ffd640 1 --2- 172.21.15.87:0/1007494918 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa9a006ae90 0x7fa9a006d350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa9b41557e0 tx=0x7fa9a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:51.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.635+0000 7fa99bfff640 1 -- 172.21.15.87:0/1007494918 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa9a8039e20 con 0x7fa9b40728b0 2023-12-16T20:21:51.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:51.870+0000 7fa99bfff640 1 -- 172.21.15.87:0/1007494918 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fa9a80770e0 con 0x7fa9b40728b0 2023-12-16T20:21:52.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.043+0000 7fa9b9f68640 1 -- 172.21.15.87:0/1007494918 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa9b4067500 con 0x7fa9b40728b0 2023-12-16T20:21:52.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.063+0000 7fa99bfff640 1 -- 172.21.15.87:0/1007494918 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa9a807a700 con 0x7fa9b40728b0 2023-12-16T20:21:52.066 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-12-16T20:21:52.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.066+0000 7fa9b9f68640 1 -- 172.21.15.87:0/1007494918 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa9a006ae90 msgr2=0x7fa9a006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:52.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.066+0000 7fa9b9f68640 1 --2- 172.21.15.87:0/1007494918 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa9a006ae90 0x7fa9a006d350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa9b41557e0 tx=0x7fa9a4009040 comp rx=0 tx=0).stop 2023-12-16T20:21:52.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.066+0000 7fa9b9f68640 1 -- 172.21.15.87:0/1007494918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9b40728b0 msgr2=0x7fa9b40c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:52.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.066+0000 7fa9b9f68640 1 --2- 172.21.15.87:0/1007494918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9b40728b0 0x7fa9b40c4910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa9a802bf70 tx=0x7fa9a8004730 comp rx=0 tx=0).stop 2023-12-16T20:21:52.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.066+0000 7fa9b9f68640 1 -- 172.21.15.87:0/1007494918 shutdown_connections 2023-12-16T20:21:52.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.066+0000 7fa9b9f68640 1 --2- 172.21.15.87:0/1007494918 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa9b4151510 0x7fa9b41438d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:52.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.067+0000 7fa9b9f68640 1 --2- 172.21.15.87:0/1007494918 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa9a006ae90 0x7fa9a006d350 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:52.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.067+0000 7fa9b9f68640 1 --2- 172.21.15.87:0/1007494918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9b40c61a0 0x7fa9b40ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:52.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.067+0000 7fa9b9f68640 1 --2- 172.21.15.87:0/1007494918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9b40728b0 0x7fa9b40c4910 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:52.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.067+0000 7fa9b9f68640 1 -- 172.21.15.87:0/1007494918 >> 172.21.15.87:0/1007494918 conn(0x7fa9b406cd60 msgr2=0x7fa9b4073850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:52.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.067+0000 7fa9b9f68640 1 -- 172.21.15.87:0/1007494918 shutdown_connections 2023-12-16T20:21:52.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.067+0000 7fa9b9f68640 1 -- 172.21.15.87:0/1007494918 wait complete. 2023-12-16T20:21:52.079 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T20:21:52.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.182+0000 7fc1e145c640 1 Processor -- start 2023-12-16T20:21:52.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.183+0000 7fc1e145c640 1 -- start start 2023-12-16T20:21:52.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.183+0000 7fc1e145c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc1dc153890 0x7fc1dc15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:52.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.183+0000 7fc1e145c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc1dc0ceef0 0x7fc1dc0cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:52.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.183+0000 7fc1e145c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1dc15a700 con 0x7fc1dc153c70 2023-12-16T20:21:52.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.183+0000 7fc1e145c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1dc0cf840 con 0x7fc1dc153890 2023-12-16T20:21:52.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.183+0000 7fc1e145c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1dc0ca870 con 0x7fc1dc0ceef0 2023-12-16T20:21:52.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.184+0000 7fc1daffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc1dc153890 0x7fc1dc15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:52.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.184+0000 7fc1db7fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc1dc0ceef0 0x7fc1dc0cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:52.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.184+0000 7fc1db7fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc1dc0ceef0 0x7fc1dc0cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:55766/0 (socket says 172.21.15.87:55766) 2023-12-16T20:21:52.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.184+0000 7fc1db7fe640 1 -- 172.21.15.87:0/1693367812 learned_addr learned my addr 172.21.15.87:0/1693367812 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:52.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.186+0000 7fc1db7fe640 1 -- 172.21.15.87:0/1693367812 >> v2:172.21.15.87:3300/0 conn(0x7fc1dc153890 msgr2=0x7fc1dc15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:52.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.186+0000 7fc1db7fe640 1 --2- 172.21.15.87:0/1693367812 >> v2:172.21.15.87:3300/0 conn(0x7fc1dc153890 0x7fc1dc15d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:52.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.186+0000 7fc1db7fe640 1 -- 172.21.15.87:0/1693367812 >> v1:172.21.15.87:6789/0 conn(0x7fc1dc153c70 legacy=0x7fc1dc0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:52.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.187+0000 7fc1db7fe640 1 -- 172.21.15.87:0/1693367812 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc159af0 con 0x7fc1dc0ceef0 2023-12-16T20:21:52.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.189+0000 7fc1db7fe640 1 --2- 172.21.15.87:0/1693367812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1dc0ceef0 0x7fc1dc0cf300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0c9ab0 tx=0x7fc1d402c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e35a1f2a56033b7b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:52.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.192+0000 7fc1d9ffb640 1 -- 172.21.15.87:0/1693367812 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d402cbb0 con 0x7fc1dc0ceef0 2023-12-16T20:21:52.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.192+0000 7fc1d9ffb640 1 -- 172.21.15.87:0/1693367812 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d402cd10 con 0x7fc1dc0ceef0 2023-12-16T20:21:52.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.192+0000 7fc1d9ffb640 1 -- 172.21.15.87:0/1693367812 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4034610 con 0x7fc1dc0ceef0 2023-12-16T20:21:52.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.193+0000 7fc1e145c640 1 -- 172.21.15.87:0/1693367812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1dc0ceef0 msgr2=0x7fc1dc0cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:52.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.193+0000 7fc1e145c640 1 --2- 172.21.15.87:0/1693367812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1dc0ceef0 0x7fc1dc0cf300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0c9ab0 tx=0x7fc1d402c010 comp rx=0 tx=0).stop 2023-12-16T20:21:52.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.193+0000 7fc1e145c640 1 -- 172.21.15.87:0/1693367812 shutdown_connections 2023-12-16T20:21:52.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.193+0000 7fc1e145c640 1 --2- 172.21.15.87:0/1693367812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1dc0ceef0 0x7fc1dc0cf300 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:52.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.193+0000 7fc1e145c640 1 --2- 172.21.15.87:0/1693367812 >> v2:172.21.15.87:3300/0 conn(0x7fc1dc153890 0x7fc1dc15d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:52.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.193+0000 7fc1e145c640 1 -- 172.21.15.87:0/1693367812 >> 172.21.15.87:0/1693367812 conn(0x7fc1dc06ba00 msgr2=0x7fc1dc06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:52.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.193+0000 7fc1e145c640 1 -- 172.21.15.87:0/1693367812 shutdown_connections 2023-12-16T20:21:52.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.193+0000 7fc1e145c640 1 -- 172.21.15.87:0/1693367812 wait complete. 2023-12-16T20:21:52.196 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.194+0000 7fc1e145c640 1 Processor -- start 2023-12-16T20:21:52.196 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.194+0000 7fc1e145c640 1 -- start start 2023-12-16T20:21:52.196 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.195+0000 7fc1e145c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1dc0ceef0 0x7fc1dc0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:52.196 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.195+0000 7fc1e145c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1dc153890 0x7fc1dc0c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:52.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.195+0000 7fc1e145c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1dc153c70 0x7fc1dc0cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:52.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.195+0000 7fc1e145c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc0b4430 con 0x7fc1dc153890 2023-12-16T20:21:52.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.195+0000 7fc1e145c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc0cd200 con 0x7fc1dc0ceef0 2023-12-16T20:21:52.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.195+0000 7fc1e145c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc0b3bd0 con 0x7fc1dc153c70 2023-12-16T20:21:52.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.196+0000 7fc1da7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1dc153890 0x7fc1dc0c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:52.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.196+0000 7fc1daffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1dc0ceef0 0x7fc1dc0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:52.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.196+0000 7fc1db7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1dc153c70 0x7fc1dc0cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:52.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.196+0000 7fc1da7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1dc153890 0x7fc1dc0c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46668/0 (socket says 172.21.15.87:46668) 2023-12-16T20:21:52.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.196+0000 7fc1da7fc640 1 -- 172.21.15.87:0/1438272469 learned_addr learned my addr 172.21.15.87:0/1438272469 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:52.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.199+0000 7fc1da7fc640 1 -- 172.21.15.87:0/1438272469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1dc153c70 msgr2=0x7fc1dc0cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:52.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.199+0000 7fc1da7fc640 1 --2- 172.21.15.87:0/1438272469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1dc153c70 0x7fc1dc0cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:52.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.199+0000 7fc1da7fc640 1 -- 172.21.15.87:0/1438272469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1dc0ceef0 msgr2=0x7fc1dc0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:52.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.199+0000 7fc1da7fc640 1 --2- 172.21.15.87:0/1438272469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1dc0ceef0 0x7fc1dc0ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:52.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.199+0000 7fc1da7fc640 1 -- 172.21.15.87:0/1438272469 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d4009b30 con 0x7fc1dc153890 2023-12-16T20:21:52.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.202+0000 7fc1da7fc640 1 --2- 172.21.15.87:0/1438272469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1dc153890 0x7fc1dc0c52d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400c3f0 tx=0x7fc1c400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:52.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.205+0000 7fc1d37fe640 1 -- 172.21.15.87:0/1438272469 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c40052d0 con 0x7fc1dc153890 2023-12-16T20:21:52.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.205+0000 7fc1d37fe640 1 -- 172.21.15.87:0/1438272469 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c4005450 con 0x7fc1dc153890 2023-12-16T20:21:52.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.205+0000 7fc1d37fe640 1 -- 172.21.15.87:0/1438272469 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4007260 con 0x7fc1dc153890 2023-12-16T20:21:52.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.205+0000 7fc1e145c640 1 -- 172.21.15.87:0/1438272469 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1dc0cece0 con 0x7fc1dc153890 2023-12-16T20:21:52.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.205+0000 7fc1e145c640 1 -- 172.21.15.87:0/1438272469 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1dc0b4150 con 0x7fc1dc153890 2023-12-16T20:21:52.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.206+0000 7fc1e145c640 1 -- 172.21.15.87:0/1438272469 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1dc0cd390 con 0x7fc1dc153890 2023-12-16T20:21:52.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.224+0000 7fc1d37fe640 1 -- 172.21.15.87:0/1438272469 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fc1c40073c0 con 0x7fc1dc153890 2023-12-16T20:21:52.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.225+0000 7fc1d37fe640 1 --2- 172.21.15.87:0/1438272469 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc1bc06aec0 0x7fc1bc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:52.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.225+0000 7fc1daffd640 1 --2- 172.21.15.87:0/1438272469 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc1bc06aec0 0x7fc1bc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:52.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.225+0000 7fc1daffd640 1 --2- 172.21.15.87:0/1438272469 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc1bc06aec0 0x7fc1bc06d380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc009b40 tx=0x7fc1cc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:52.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.228+0000 7fc1d37fe640 1 -- 172.21.15.87:0/1438272469 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc1c4057fa0 con 0x7fc1dc153890 2023-12-16T20:21:52.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.480+0000 7fc1d37fe640 1 -- 172.21.15.87:0/1438272469 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fc1c40542e0 con 0x7fc1dc153890 2023-12-16T20:21:52.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.650+0000 7fc1e145c640 1 -- 172.21.15.87:0/1438272469 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc1dc0b2840 con 0x7fc1dc153890 2023-12-16T20:21:52.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.656+0000 7fc1d37fe640 1 -- 172.21.15.87:0/1438272469 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc1c40200a0 con 0x7fc1dc153890 2023-12-16T20:21:52.657 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-12-16T20:21:52.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.658+0000 7fc1e145c640 1 -- 172.21.15.87:0/1438272469 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc1bc06aec0 msgr2=0x7fc1bc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:52.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.658+0000 7fc1e145c640 1 --2- 172.21.15.87:0/1438272469 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc1bc06aec0 0x7fc1bc06d380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc009b40 tx=0x7fc1cc009190 comp rx=0 tx=0).stop 2023-12-16T20:21:52.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.658+0000 7fc1e145c640 1 -- 172.21.15.87:0/1438272469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1dc153890 msgr2=0x7fc1dc0c52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:52.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.658+0000 7fc1e145c640 1 --2- 172.21.15.87:0/1438272469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1dc153890 0x7fc1dc0c52d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400c3f0 tx=0x7fc1c400c8b0 comp rx=0 tx=0).stop 2023-12-16T20:21:52.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.658+0000 7fc1e145c640 1 -- 172.21.15.87:0/1438272469 shutdown_connections 2023-12-16T20:21:52.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.658+0000 7fc1e145c640 1 --2- 172.21.15.87:0/1438272469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1dc153c70 0x7fc1dc0cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:52.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.658+0000 7fc1e145c640 1 --2- 172.21.15.87:0/1438272469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1dc153890 0x7fc1dc0c52d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:52.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.658+0000 7fc1e145c640 1 --2- 172.21.15.87:0/1438272469 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc1bc06aec0 0x7fc1bc06d380 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:52.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.658+0000 7fc1e145c640 1 --2- 172.21.15.87:0/1438272469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1dc0ceef0 0x7fc1dc0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:52.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.658+0000 7fc1e145c640 1 -- 172.21.15.87:0/1438272469 >> 172.21.15.87:0/1438272469 conn(0x7fc1dc06ba00 msgr2=0x7fc1dc0cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:52.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.658+0000 7fc1e145c640 1 -- 172.21.15.87:0/1438272469 shutdown_connections 2023-12-16T20:21:52.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.658+0000 7fc1e145c640 1 -- 172.21.15.87:0/1438272469 wait complete. 2023-12-16T20:21:52.670 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-16T20:21:52.773 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.771+0000 7f08c2607640 1 Processor -- start 2023-12-16T20:21:52.773 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.772+0000 7f08c2607640 1 -- start start 2023-12-16T20:21:52.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.772+0000 7f08c2607640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f08bc06b840 0x7f08bc06f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:52.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.772+0000 7f08c2607640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08bc151b00 con 0x7f08bc151720 2023-12-16T20:21:52.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.772+0000 7f08c2607640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08bc1582b0 con 0x7f08bc06fc60 2023-12-16T20:21:52.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.772+0000 7f08c2607640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08bc157730 con 0x7f08bc06b840 2023-12-16T20:21:52.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.773+0000 7f08bbfff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f08bc151720 0x7f08bc0c68f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34418/0 (socket says 172.21.15.87:34418) 2023-12-16T20:21:52.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.773+0000 7f08bbfff640 1 -- 172.21.15.87:0/31486759 learned_addr learned my addr 172.21.15.87:0/31486759 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:52.775 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.773+0000 7f08bb7fe640 1 --2- 172.21.15.87:0/31486759 >> v2:172.21.15.195:3300/0 conn(0x7f08bc06b840 0x7f08bc06f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:52.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.775+0000 7f08baffd640 1 -- 172.21.15.87:0/31486759 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050962624 0 0) 0x7f08bc151b00 con 0x7f08bc151720 2023-12-16T20:21:52.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.775+0000 7f08baffd640 1 -- 172.21.15.87:0/31486759 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08a4003520 con 0x7f08bc151720 2023-12-16T20:21:52.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.777+0000 7f08bb7fe640 1 -- 172.21.15.87:0/31486759 >> v1:172.21.15.195:6789/0 conn(0x7f08bc06fc60 legacy=0x7f08bc15af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:52.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.777+0000 7f08bb7fe640 1 -- 172.21.15.87:0/31486759 >> v1:172.21.15.87:6789/0 conn(0x7f08bc151720 legacy=0x7f08bc0c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:52.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.777+0000 7f08bb7fe640 1 -- 172.21.15.87:0/31486759 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc157a10 con 0x7f08bc06b840 2023-12-16T20:21:52.781 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.780+0000 7f08bb7fe640 1 --2- 172.21.15.87:0/31486759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08bc06b840 0x7f08bc06f720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f08b00097d0 tx=0x7f08b002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f948f39c63cc8df server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:52.785 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.784+0000 7f08baffd640 1 -- 172.21.15.87:0/31486759 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b0031830 con 0x7f08bc06b840 2023-12-16T20:21:52.785 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.784+0000 7f08baffd640 1 -- 172.21.15.87:0/31486759 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b0031990 con 0x7f08bc06b840 2023-12-16T20:21:52.786 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.784+0000 7f08baffd640 1 -- 172.21.15.87:0/31486759 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b0031d20 con 0x7f08bc06b840 2023-12-16T20:21:52.786 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.785+0000 7f08c2607640 1 -- 172.21.15.87:0/31486759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08bc06b840 msgr2=0x7f08bc06f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:52.787 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.785+0000 7f08c2607640 1 --2- 172.21.15.87:0/31486759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08bc06b840 0x7f08bc06f720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f08b00097d0 tx=0x7f08b002b8d0 comp rx=0 tx=0).stop 2023-12-16T20:21:52.787 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.785+0000 7f08c2607640 1 -- 172.21.15.87:0/31486759 shutdown_connections 2023-12-16T20:21:52.787 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.785+0000 7f08c2607640 1 --2- 172.21.15.87:0/31486759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08bc06b840 0x7f08bc06f720 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:52.787 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.785+0000 7f08c2607640 1 -- 172.21.15.87:0/31486759 >> 172.21.15.87:0/31486759 conn(0x7f08bc0cbef0 msgr2=0x7f08bc0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:52.787 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.785+0000 7f08c2607640 1 -- 172.21.15.87:0/31486759 shutdown_connections 2023-12-16T20:21:52.787 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.785+0000 7f08c2607640 1 -- 172.21.15.87:0/31486759 wait complete. 2023-12-16T20:21:52.787 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.786+0000 7f08c2607640 1 Processor -- start 2023-12-16T20:21:52.787 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.787+0000 7f08c2607640 1 -- start start 2023-12-16T20:21:52.788 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.787+0000 7f08c2607640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08bc06b840 0x7f08bc0c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:52.788 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.787+0000 7f08c2607640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08bc06fc60 0x7f08bc154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:52.789 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.787+0000 7f08c2607640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08bc151720 0x7f08bc1ed6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:52.789 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.787+0000 7f08c2607640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc153190 con 0x7f08bc06b840 2023-12-16T20:21:52.789 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.787+0000 7f08c2607640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc0c40e0 con 0x7f08bc151720 2023-12-16T20:21:52.789 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.787+0000 7f08c2607640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc1ed1f0 con 0x7f08bc06fc60 2023-12-16T20:21:52.789 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.788+0000 7f08bbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08bc06b840 0x7f08bc0c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:52.789 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.788+0000 7f08c0ba4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08bc151720 0x7f08bc1ed6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:52.790 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.788+0000 7f08bb7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08bc06fc60 0x7f08bc154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:52.790 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.788+0000 7f08bbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08bc06b840 0x7f08bc0c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46672/0 (socket says 172.21.15.87:46672) 2023-12-16T20:21:52.790 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.788+0000 7f08bbfff640 1 -- 172.21.15.87:0/1934981018 learned_addr learned my addr 172.21.15.87:0/1934981018 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:52.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.791+0000 7f08bbfff640 1 -- 172.21.15.87:0/1934981018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08bc06fc60 msgr2=0x7f08bc154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:52.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.792+0000 7f08bbfff640 1 --2- 172.21.15.87:0/1934981018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08bc06fc60 0x7f08bc154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:52.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.792+0000 7f08bbfff640 1 -- 172.21.15.87:0/1934981018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08bc151720 msgr2=0x7f08bc1ed6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:52.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.792+0000 7f08bbfff640 1 --2- 172.21.15.87:0/1934981018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08bc151720 0x7f08bc1ed6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:52.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.792+0000 7f08bbfff640 1 -- 172.21.15.87:0/1934981018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b0009400 con 0x7f08bc06b840 2023-12-16T20:21:52.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.794+0000 7f08bbfff640 1 --2- 172.21.15.87:0/1934981018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08bc06b840 0x7f08bc0c62a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00c410 tx=0x7f08ac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:52.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.797+0000 7f08b8ff9640 1 -- 172.21.15.87:0/1934981018 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac005ce0 con 0x7f08bc06b840 2023-12-16T20:21:52.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.797+0000 7f08b8ff9640 1 -- 172.21.15.87:0/1934981018 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac005e40 con 0x7f08bc06b840 2023-12-16T20:21:52.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.797+0000 7f08c2607640 1 -- 172.21.15.87:0/1934981018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08bc0c4380 con 0x7f08bc06b840 2023-12-16T20:21:52.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.797+0000 7f08b8ff9640 1 -- 172.21.15.87:0/1934981018 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac0072f0 con 0x7f08bc06b840 2023-12-16T20:21:52.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.797+0000 7f08c2607640 1 -- 172.21.15.87:0/1934981018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc0c4940 con 0x7f08bc06b840 2023-12-16T20:21:52.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:52.798+0000 7f08c2607640 1 -- 172.21.15.87:0/1934981018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08bc0cce50 con 0x7f08bc06b840 2023-12-16T20:21:53.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.042+0000 7f08b8ff9640 1 -- 172.21.15.87:0/1934981018 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f08ac007450 con 0x7f08bc06b840 2023-12-16T20:21:53.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.043+0000 7f08b8ff9640 1 --2- 172.21.15.87:0/1934981018 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f08a806aec0 0x7f08a806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:53.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.043+0000 7f08bb7fe640 1 --2- 172.21.15.87:0/1934981018 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f08a806aec0 0x7f08a806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:53.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.043+0000 7f08bb7fe640 1 --2- 172.21.15.87:0/1934981018 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f08a806aec0 0x7f08a806d380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f08b0036000 tx=0x7f08b003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:53.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.058+0000 7f08b8ff9640 1 -- 172.21.15.87:0/1934981018 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f08ac057f00 con 0x7f08bc06b840 2023-12-16T20:21:53.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.058+0000 7f08b8ff9640 1 -- 172.21.15.87:0/1934981018 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f08ac054240 con 0x7f08bc06b840 2023-12-16T20:21:53.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.228+0000 7f08c2607640 1 -- 172.21.15.87:0/1934981018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f08bc14c9d0 con 0x7f08bc06b840 2023-12-16T20:21:53.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.236+0000 7f08b8ff9640 1 -- 172.21.15.87:0/1934981018 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f08ac017020 con 0x7f08bc06b840 2023-12-16T20:21:53.238 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-12-16T20:21:53.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.238+0000 7f08c2607640 1 -- 172.21.15.87:0/1934981018 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f08a806aec0 msgr2=0x7f08a806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:53.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.238+0000 7f08c2607640 1 --2- 172.21.15.87:0/1934981018 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f08a806aec0 0x7f08a806d380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f08b0036000 tx=0x7f08b003c040 comp rx=0 tx=0).stop 2023-12-16T20:21:53.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.238+0000 7f08c2607640 1 -- 172.21.15.87:0/1934981018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08bc06b840 msgr2=0x7f08bc0c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:53.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.238+0000 7f08c2607640 1 --2- 172.21.15.87:0/1934981018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08bc06b840 0x7f08bc0c62a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00c410 tx=0x7f08ac00c8d0 comp rx=0 tx=0).stop 2023-12-16T20:21:53.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.238+0000 7f08c2607640 1 -- 172.21.15.87:0/1934981018 shutdown_connections 2023-12-16T20:21:53.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.238+0000 7f08c2607640 1 --2- 172.21.15.87:0/1934981018 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f08a806aec0 0x7f08a806d380 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:53.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.238+0000 7f08c2607640 1 --2- 172.21.15.87:0/1934981018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08bc151720 0x7f08bc1ed6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:53.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.238+0000 7f08c2607640 1 --2- 172.21.15.87:0/1934981018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08bc06fc60 0x7f08bc154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:53.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.238+0000 7f08c2607640 1 --2- 172.21.15.87:0/1934981018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08bc06b840 0x7f08bc0c62a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:53.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.238+0000 7f08c2607640 1 -- 172.21.15.87:0/1934981018 >> 172.21.15.87:0/1934981018 conn(0x7f08bc0cbef0 msgr2=0x7f08bc156570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:53.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.238+0000 7f08c2607640 1 -- 172.21.15.87:0/1934981018 shutdown_connections 2023-12-16T20:21:53.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.238+0000 7f08c2607640 1 -- 172.21.15.87:0/1934981018 wait complete. 2023-12-16T20:21:53.251 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T20:21:53.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.350+0000 7fdda0d8a640 1 Processor -- start 2023-12-16T20:21:53.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.350+0000 7fdda0d8a640 1 -- start start 2023-12-16T20:21:53.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.351+0000 7fdda0d8a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd9c151510 0x7fdd9c0cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:53.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.351+0000 7fdda0d8a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdd9c0c61a0 0x7fdd9c0cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:53.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.351+0000 7fdda0d8a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9c15b6e0 con 0x7fdd9c0728b0 2023-12-16T20:21:53.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.351+0000 7fdda0d8a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd9c15a880 con 0x7fdd9c0c61a0 2023-12-16T20:21:53.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.351+0000 7fdda0d8a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c06f7e0 con 0x7fdd9c151510 2023-12-16T20:21:53.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.352+0000 7fdd99d9b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fdd9c0728b0 0x7fdd9c0c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34428/0 (socket says 172.21.15.87:34428) 2023-12-16T20:21:53.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.352+0000 7fdd99d9b640 1 -- 172.21.15.87:0/3671808087 learned_addr learned my addr 172.21.15.87:0/3671808087 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:53.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.352+0000 7fdd9a59c640 1 --2- 172.21.15.87:0/3671808087 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd9c151510 0x7fdd9c0cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:53.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.352+0000 7fdd9ad9d640 1 --2- 172.21.15.87:0/3671808087 >> v2:172.21.15.195:3300/0 conn(0x7fdd9c0c61a0 0x7fdd9c0cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:53.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.354+0000 7fdd9a59c640 1 -- 172.21.15.87:0/3671808087 >> v2:172.21.15.195:3300/0 conn(0x7fdd9c0c61a0 msgr2=0x7fdd9c0cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:53.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.354+0000 7fdd9a59c640 1 --2- 172.21.15.87:0/3671808087 >> v2:172.21.15.195:3300/0 conn(0x7fdd9c0c61a0 0x7fdd9c0cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:53.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.354+0000 7fdd9a59c640 1 -- 172.21.15.87:0/3671808087 >> v1:172.21.15.87:6789/0 conn(0x7fdd9c0728b0 legacy=0x7fdd9c0c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:53.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.354+0000 7fdd9a59c640 1 -- 172.21.15.87:0/3671808087 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c15aad0 con 0x7fdd9c151510 2023-12-16T20:21:53.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.356+0000 7fdd9a59c640 1 --2- 172.21.15.87:0/3671808087 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd9c151510 0x7fdd9c0cae30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009d90 tx=0x7fdd8c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a139ae351ed42ce3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:53.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.359+0000 7fdd9959a640 1 -- 172.21.15.87:0/3671808087 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c02cc50 con 0x7fdd9c151510 2023-12-16T20:21:53.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.359+0000 7fdd9959a640 1 -- 172.21.15.87:0/3671808087 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c02cdb0 con 0x7fdd9c151510 2023-12-16T20:21:53.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.360+0000 7fdd9959a640 1 -- 172.21.15.87:0/3671808087 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c034660 con 0x7fdd9c151510 2023-12-16T20:21:53.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.360+0000 7fdda0d8a640 1 -- 172.21.15.87:0/3671808087 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd9c151510 msgr2=0x7fdd9c0cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:53.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.360+0000 7fdda0d8a640 1 --2- 172.21.15.87:0/3671808087 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd9c151510 0x7fdd9c0cae30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009d90 tx=0x7fdd8c02bea0 comp rx=0 tx=0).stop 2023-12-16T20:21:53.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.360+0000 7fdda0d8a640 1 -- 172.21.15.87:0/3671808087 shutdown_connections 2023-12-16T20:21:53.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.360+0000 7fdda0d8a640 1 --2- 172.21.15.87:0/3671808087 >> v2:172.21.15.195:3300/0 conn(0x7fdd9c0c61a0 0x7fdd9c0cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:53.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.360+0000 7fdda0d8a640 1 --2- 172.21.15.87:0/3671808087 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd9c151510 0x7fdd9c0cae30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:53.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.360+0000 7fdda0d8a640 1 -- 172.21.15.87:0/3671808087 >> 172.21.15.87:0/3671808087 conn(0x7fdd9c06cd60 msgr2=0x7fdd9c06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:53.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.360+0000 7fdda0d8a640 1 -- 172.21.15.87:0/3671808087 shutdown_connections 2023-12-16T20:21:53.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.360+0000 7fdda0d8a640 1 -- 172.21.15.87:0/3671808087 wait complete. 2023-12-16T20:21:53.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.362+0000 7fdda0d8a640 1 Processor -- start 2023-12-16T20:21:53.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.362+0000 7fdda0d8a640 1 -- start start 2023-12-16T20:21:53.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.362+0000 7fdda0d8a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd9c0728b0 0x7fdd9c1ef340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:53.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.362+0000 7fdda0d8a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd9c0c61a0 0x7fdd9c158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:53.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.362+0000 7fdda0d8a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd9c151510 0x7fdd9c0c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:53.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.362+0000 7fdda0d8a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c15a520 con 0x7fdd9c0728b0 2023-12-16T20:21:53.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.362+0000 7fdda0d8a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c150910 con 0x7fdd9c0c61a0 2023-12-16T20:21:53.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.362+0000 7fdda0d8a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c1593a0 con 0x7fdd9c151510 2023-12-16T20:21:53.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.363+0000 7fdd9a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd9c0728b0 0x7fdd9c1ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:53.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.363+0000 7fdd9ad9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd9c151510 0x7fdd9c0c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:53.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.363+0000 7fdd99d9b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd9c0c61a0 0x7fdd9c158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:53.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.363+0000 7fdd9a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd9c0728b0 0x7fdd9c1ef340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46674/0 (socket says 172.21.15.87:46674) 2023-12-16T20:21:53.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.363+0000 7fdd9a59c640 1 -- 172.21.15.87:0/2800973771 learned_addr learned my addr 172.21.15.87:0/2800973771 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:53.368 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.366+0000 7fdd9a59c640 1 -- 172.21.15.87:0/2800973771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd9c151510 msgr2=0x7fdd9c0c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:53.368 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.366+0000 7fdd9a59c640 1 --2- 172.21.15.87:0/2800973771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd9c151510 0x7fdd9c0c3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:53.368 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.366+0000 7fdd9a59c640 1 -- 172.21.15.87:0/2800973771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd9c0c61a0 msgr2=0x7fdd9c158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:53.368 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.366+0000 7fdd9a59c640 1 --2- 172.21.15.87:0/2800973771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd9c0c61a0 0x7fdd9c158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:53.368 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.366+0000 7fdd9a59c640 1 -- 172.21.15.87:0/2800973771 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c009a70 con 0x7fdd9c0728b0 2023-12-16T20:21:53.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.369+0000 7fdd9a59c640 1 --2- 172.21.15.87:0/2800973771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd9c0728b0 0x7fdd9c1ef340 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009e80 tx=0x7fdd8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:53.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.372+0000 7fdd8affd640 1 -- 172.21.15.87:0/2800973771 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c03e610 con 0x7fdd9c0728b0 2023-12-16T20:21:53.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.372+0000 7fdd8affd640 1 -- 172.21.15.87:0/2800973771 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c03e790 con 0x7fdd9c0728b0 2023-12-16T20:21:53.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.372+0000 7fdd8affd640 1 -- 172.21.15.87:0/2800973771 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c03eb40 con 0x7fdd9c0728b0 2023-12-16T20:21:53.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.372+0000 7fdda0d8a640 1 -- 172.21.15.87:0/2800973771 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9c1595c0 con 0x7fdd9c0728b0 2023-12-16T20:21:53.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.372+0000 7fdda0d8a640 1 -- 172.21.15.87:0/2800973771 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9c159b80 con 0x7fdd9c0728b0 2023-12-16T20:21:53.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.373+0000 7fdda0d8a640 1 -- 172.21.15.87:0/2800973771 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9c06f480 con 0x7fdd9c0728b0 2023-12-16T20:21:53.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.615+0000 7fdd8affd640 1 -- 172.21.15.87:0/2800973771 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fdd8c03b050 con 0x7fdd9c0728b0 2023-12-16T20:21:53.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.616+0000 7fdd8affd640 1 --2- 172.21.15.87:0/2800973771 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fdd7c06ae90 0x7fdd7c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:53.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.616+0000 7fdd99d9b640 1 --2- 172.21.15.87:0/2800973771 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fdd7c06ae90 0x7fdd7c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:53.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.616+0000 7fdd99d9b640 1 --2- 172.21.15.87:0/2800973771 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fdd7c06ae90 0x7fdd7c06d350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c1ecf70 tx=0x7fdd90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:53.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.629+0000 7fdd8affd640 1 -- 172.21.15.87:0/2800973771 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdd8c07a910 con 0x7fdd9c0728b0 2023-12-16T20:21:53.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.630+0000 7fdd8affd640 1 -- 172.21.15.87:0/2800973771 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fdd8c076c50 con 0x7fdd9c0728b0 2023-12-16T20:21:53.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.808+0000 7fdda0d8a640 1 -- 172.21.15.87:0/2800973771 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdd9c067500 con 0x7fdd9c0728b0 2023-12-16T20:21:53.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.813+0000 7fdd8affd640 1 -- 172.21.15.87:0/2800973771 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdd8c04d070 con 0x7fdd9c0728b0 2023-12-16T20:21:53.815 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2023-12-16T20:21:53.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.815+0000 7fdda0d8a640 1 -- 172.21.15.87:0/2800973771 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fdd7c06ae90 msgr2=0x7fdd7c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:53.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.815+0000 7fdda0d8a640 1 --2- 172.21.15.87:0/2800973771 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fdd7c06ae90 0x7fdd7c06d350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c1ecf70 tx=0x7fdd90009040 comp rx=0 tx=0).stop 2023-12-16T20:21:53.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.815+0000 7fdda0d8a640 1 -- 172.21.15.87:0/2800973771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd9c0728b0 msgr2=0x7fdd9c1ef340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:53.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.815+0000 7fdda0d8a640 1 --2- 172.21.15.87:0/2800973771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd9c0728b0 0x7fdd9c1ef340 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009e80 tx=0x7fdd8c004a40 comp rx=0 tx=0).stop 2023-12-16T20:21:53.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.815+0000 7fdda0d8a640 1 -- 172.21.15.87:0/2800973771 shutdown_connections 2023-12-16T20:21:53.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.815+0000 7fdda0d8a640 1 --2- 172.21.15.87:0/2800973771 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd9c151510 0x7fdd9c0c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:53.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.815+0000 7fdda0d8a640 1 --2- 172.21.15.87:0/2800973771 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fdd7c06ae90 0x7fdd7c06d350 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:53.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.815+0000 7fdda0d8a640 1 --2- 172.21.15.87:0/2800973771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd9c0c61a0 0x7fdd9c158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:53.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.815+0000 7fdda0d8a640 1 --2- 172.21.15.87:0/2800973771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd9c0728b0 0x7fdd9c1ef340 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:53.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.815+0000 7fdda0d8a640 1 -- 172.21.15.87:0/2800973771 >> 172.21.15.87:0/2800973771 conn(0x7fdd9c06cd60 msgr2=0x7fdd9c073850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:53.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.815+0000 7fdda0d8a640 1 -- 172.21.15.87:0/2800973771 shutdown_connections 2023-12-16T20:21:53.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.815+0000 7fdda0d8a640 1 -- 172.21.15.87:0/2800973771 wait complete. 2023-12-16T20:21:53.828 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:21:53.828 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T20:21:53.844 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:21:53.986 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.984+0000 7fc389d4c640 1 Processor -- start 2023-12-16T20:21:53.986 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.985+0000 7fc389d4c640 1 -- start start 2023-12-16T20:21:53.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.985+0000 7fc389d4c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc384153c70 0x7fc38415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:53.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.985+0000 7fc389d4c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc38415a700 con 0x7fc3840ceef0 2023-12-16T20:21:53.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.985+0000 7fc389d4c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3840ca870 con 0x7fc384153890 2023-12-16T20:21:53.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.985+0000 7fc389d4c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc384159af0 con 0x7fc384153c70 2023-12-16T20:21:53.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.986+0000 7fc382ffd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc384153c70 0x7fc38415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:53.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.986+0000 7fc382ffd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc384153c70 0x7fc38415d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:55806/0 (socket says 172.21.15.87:55806) 2023-12-16T20:21:53.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.986+0000 7fc382ffd640 1 -- 172.21.15.87:0/848873576 learned_addr learned my addr 172.21.15.87:0/848873576 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:53.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.989+0000 7fc382ffd640 1 -- 172.21.15.87:0/848873576 >> v1:172.21.15.195:6789/0 conn(0x7fc384153890 legacy=0x7fc3840c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:53.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.989+0000 7fc382ffd640 1 -- 172.21.15.87:0/848873576 >> v1:172.21.15.87:6789/0 conn(0x7fc3840ceef0 legacy=0x7fc38415aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:53.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.989+0000 7fc382ffd640 1 -- 172.21.15.87:0/848873576 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc384159dd0 con 0x7fc384153c70 2023-12-16T20:21:53.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:53.994+0000 7fc382ffd640 1 --2- 172.21.15.87:0/848873576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc384153c70 0x7fc38415d950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc378009870 tx=0x7fc37802ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9155b4a6de64e13 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.045+0000 7fc3827fc640 1 -- 172.21.15.87:0/848873576 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37802f840 con 0x7fc384153c70 2023-12-16T20:21:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.045+0000 7fc3827fc640 1 -- 172.21.15.87:0/848873576 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37802f9a0 con 0x7fc384153c70 2023-12-16T20:21:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.045+0000 7fc3827fc640 1 -- 172.21.15.87:0/848873576 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37802fd30 con 0x7fc384153c70 2023-12-16T20:21:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.046+0000 7fc389d4c640 1 -- 172.21.15.87:0/848873576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc384153c70 msgr2=0x7fc38415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.046+0000 7fc389d4c640 1 --2- 172.21.15.87:0/848873576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc384153c70 0x7fc38415d950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc378009870 tx=0x7fc37802ba20 comp rx=0 tx=0).stop 2023-12-16T20:21:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.046+0000 7fc389d4c640 1 -- 172.21.15.87:0/848873576 shutdown_connections 2023-12-16T20:21:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.046+0000 7fc389d4c640 1 --2- 172.21.15.87:0/848873576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc384153c70 0x7fc38415d950 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.046+0000 7fc389d4c640 1 -- 172.21.15.87:0/848873576 >> 172.21.15.87:0/848873576 conn(0x7fc38406ba00 msgr2=0x7fc38406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.046+0000 7fc389d4c640 1 -- 172.21.15.87:0/848873576 shutdown_connections 2023-12-16T20:21:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.046+0000 7fc389d4c640 1 -- 172.21.15.87:0/848873576 wait complete. 2023-12-16T20:21:54.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.048+0000 7fc389d4c640 1 Processor -- start 2023-12-16T20:21:54.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.048+0000 7fc389d4c640 1 -- start start 2023-12-16T20:21:54.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.049+0000 7fc389d4c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3840ceef0 0x7fc3841f0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:54.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.049+0000 7fc389d4c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc384153890 0x7fc38414db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:54.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.049+0000 7fc389d4c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc384153c70 0x7fc3840c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:54.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.049+0000 7fc389d4c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3840ce670 con 0x7fc384153c70 2023-12-16T20:21:54.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.049+0000 7fc389d4c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3841f07b0 con 0x7fc384153890 2023-12-16T20:21:54.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.049+0000 7fc389d4c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38414e070 con 0x7fc3840ceef0 2023-12-16T20:21:54.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.049+0000 7fc3837fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3840ceef0 0x7fc3841f0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:54.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.049+0000 7fc383fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc384153c70 0x7fc3840c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:54.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.049+0000 7fc3837fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3840ceef0 0x7fc3841f0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:56064/0 (socket says 172.21.15.87:56064) 2023-12-16T20:21:54.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.049+0000 7fc3837fe640 1 -- 172.21.15.87:0/1351871153 learned_addr learned my addr 172.21.15.87:0/1351871153 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:54.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.051+0000 7fc382ffd640 1 --2- 172.21.15.87:0/1351871153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc384153890 0x7fc38414db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:54.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.053+0000 7fc3837fe640 1 -- 172.21.15.87:0/1351871153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc384153890 msgr2=0x7fc38414db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:54.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.053+0000 7fc3837fe640 1 --2- 172.21.15.87:0/1351871153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc384153890 0x7fc38414db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:54.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.053+0000 7fc3837fe640 1 -- 172.21.15.87:0/1351871153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc384153c70 msgr2=0x7fc3840c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:54.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.053+0000 7fc3837fe640 1 --2- 172.21.15.87:0/1351871153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc384153c70 0x7fc3840c52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:54.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.053+0000 7fc3837fe640 1 -- 172.21.15.87:0/1351871153 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3780094d0 con 0x7fc3840ceef0 2023-12-16T20:21:54.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.055+0000 7fc3837fe640 1 --2- 172.21.15.87:0/1351871153 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3840ceef0 0x7fc3841f0270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc37400c430 tx=0x7fc37400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:54.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.059+0000 7fc36bfff640 1 -- 172.21.15.87:0/1351871153 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3740052d0 con 0x7fc3840ceef0 2023-12-16T20:21:54.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.059+0000 7fc36bfff640 1 -- 172.21.15.87:0/1351871153 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc374005450 con 0x7fc3840ceef0 2023-12-16T20:21:54.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.059+0000 7fc389d4c640 1 -- 172.21.15.87:0/1351871153 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3840b52b0 con 0x7fc3840ceef0 2023-12-16T20:21:54.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.059+0000 7fc36bfff640 1 -- 172.21.15.87:0/1351871153 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374007260 con 0x7fc3840ceef0 2023-12-16T20:21:54.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.059+0000 7fc389d4c640 1 -- 172.21.15.87:0/1351871153 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3840ccf00 con 0x7fc3840ceef0 2023-12-16T20:21:54.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.060+0000 7fc389d4c640 1 -- 172.21.15.87:0/1351871153 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc384067500 con 0x7fc3840ceef0 2023-12-16T20:21:54.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.078+0000 7fc36bfff640 1 -- 172.21.15.87:0/1351871153 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fc3740073c0 con 0x7fc3840ceef0 2023-12-16T20:21:54.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.078+0000 7fc36bfff640 1 --2- 172.21.15.87:0/1351871153 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc37006aec0 0x7fc37006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:54.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.079+0000 7fc382ffd640 1 --2- 172.21.15.87:0/1351871153 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc37006aec0 0x7fc37006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:54.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.079+0000 7fc382ffd640 1 --2- 172.21.15.87:0/1351871153 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc37006aec0 0x7fc37006d380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc378036000 tx=0x7fc378008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:54.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.081+0000 7fc36bfff640 1 -- 172.21.15.87:0/1351871153 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc374007670 con 0x7fc3840ceef0 2023-12-16T20:21:54.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.316+0000 7fc36bfff640 1 -- 172.21.15.87:0/1351871153 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fc374053fd0 con 0x7fc3840ceef0 2023-12-16T20:21:54.510 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.509+0000 7fc389d4c640 1 -- 172.21.15.87:0/1351871153 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3841530b0 con 0x7fc3840ceef0 2023-12-16T20:21:54.546 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.545+0000 7fc36bfff640 1 -- 172.21.15.87:0/1351871153 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fc374020020 con 0x7fc3840ceef0 2023-12-16T20:21:54.546 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:21:54.546 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:21:41.431615+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:21:22.654341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T20:21:33.728787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T20:21:34.846119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T20:21:38.657738+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:21:54.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.546+0000 7fc389d4c640 1 -- 172.21.15.87:0/1351871153 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc37006aec0 msgr2=0x7fc37006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:54.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.546+0000 7fc389d4c640 1 --2- 172.21.15.87:0/1351871153 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc37006aec0 0x7fc37006d380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc378036000 tx=0x7fc378008030 comp rx=0 tx=0).stop 2023-12-16T20:21:54.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.546+0000 7fc389d4c640 1 -- 172.21.15.87:0/1351871153 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3840ceef0 msgr2=0x7fc3841f0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:54.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.546+0000 7fc389d4c640 1 --2- 172.21.15.87:0/1351871153 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3840ceef0 0x7fc3841f0270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc37400c430 tx=0x7fc37400c8f0 comp rx=0 tx=0).stop 2023-12-16T20:21:54.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.547+0000 7fc389d4c640 1 -- 172.21.15.87:0/1351871153 shutdown_connections 2023-12-16T20:21:54.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.547+0000 7fc389d4c640 1 --2- 172.21.15.87:0/1351871153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc384153c70 0x7fc3840c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:54.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.547+0000 7fc389d4c640 1 --2- 172.21.15.87:0/1351871153 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc37006aec0 0x7fc37006d380 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:54.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.547+0000 7fc389d4c640 1 --2- 172.21.15.87:0/1351871153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc384153890 0x7fc38414db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:54.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.547+0000 7fc389d4c640 1 --2- 172.21.15.87:0/1351871153 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3840ceef0 0x7fc3841f0270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:54.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.547+0000 7fc389d4c640 1 -- 172.21.15.87:0/1351871153 >> 172.21.15.87:0/1351871153 conn(0x7fc38406ba00 msgr2=0x7fc384158d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:54.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.547+0000 7fc389d4c640 1 -- 172.21.15.87:0/1351871153 shutdown_connections 2023-12-16T20:21:54.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.547+0000 7fc389d4c640 1 -- 172.21.15.87:0/1351871153 wait complete. 2023-12-16T20:21:54.559 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T20:21:22.654341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T20:21:33.728787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T20:21:34.846119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-16T20:21:38.657738+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-16T20:21:54.560 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T20:21:54.662 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.661+0000 7f161c7ea640 1 Processor -- start 2023-12-16T20:21:54.662 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.661+0000 7f161c7ea640 1 -- start start 2023-12-16T20:21:54.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.662+0000 7f161c7ea640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f16140bff00 0x7f1614159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:54.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.662+0000 7f161c7ea640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1614072b60 con 0x7f16141501c0 2023-12-16T20:21:54.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.662+0000 7f161c7ea640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16140c1a90 con 0x7f1614156e60 2023-12-16T20:21:54.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.662+0000 7f161c7ea640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16141572d0 con 0x7f16140bff00 2023-12-16T20:21:54.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.662+0000 7f161a586640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f16141501c0 0x7f1614072450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34452/0 (socket says 172.21.15.87:34452) 2023-12-16T20:21:54.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.662+0000 7f161a586640 1 -- 172.21.15.87:0/3999440093 learned_addr learned my addr 172.21.15.87:0/3999440093 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:54.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.663+0000 7f1619d85640 1 --2- 172.21.15.87:0/3999440093 >> v2:172.21.15.195:3300/0 conn(0x7f16140bff00 0x7f1614159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:54.666 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.665+0000 7f1619584640 1 -- 172.21.15.87:0/3999440093 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591117129 0 0) 0x7f1614072b60 con 0x7f16141501c0 2023-12-16T20:21:54.666 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.665+0000 7f1619584640 1 -- 172.21.15.87:0/3999440093 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1600003520 con 0x7f16141501c0 2023-12-16T20:21:54.668 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.667+0000 7f1619d85640 1 -- 172.21.15.87:0/3999440093 >> v1:172.21.15.195:6789/0 conn(0x7f1614156e60 legacy=0x7f1614071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:54.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.667+0000 7f1619d85640 1 -- 172.21.15.87:0/3999440093 >> v1:172.21.15.87:6789/0 conn(0x7f16141501c0 legacy=0x7f1614072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:54.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.667+0000 7f1619d85640 1 -- 172.21.15.87:0/3999440093 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16140c1d30 con 0x7f16140bff00 2023-12-16T20:21:54.671 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.670+0000 7f1619d85640 1 --2- 172.21.15.87:0/3999440093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16140bff00 0x7f1614159860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f16040097a0 tx=0x7f160402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96def70134db913c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:54.675 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.674+0000 7f1619584640 1 -- 172.21.15.87:0/3999440093 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160402f810 con 0x7f16140bff00 2023-12-16T20:21:54.675 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.674+0000 7f1619584640 1 -- 172.21.15.87:0/3999440093 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160402f970 con 0x7f16140bff00 2023-12-16T20:21:54.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.674+0000 7f1619584640 1 -- 172.21.15.87:0/3999440093 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160402fd00 con 0x7f16140bff00 2023-12-16T20:21:54.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.675+0000 7f161c7ea640 1 -- 172.21.15.87:0/3999440093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16140bff00 msgr2=0x7f1614159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:54.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.675+0000 7f161c7ea640 1 --2- 172.21.15.87:0/3999440093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16140bff00 0x7f1614159860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f16040097a0 tx=0x7f160402b9f0 comp rx=0 tx=0).stop 2023-12-16T20:21:54.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.675+0000 7f161c7ea640 1 -- 172.21.15.87:0/3999440093 shutdown_connections 2023-12-16T20:21:54.677 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.675+0000 7f161c7ea640 1 --2- 172.21.15.87:0/3999440093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16140bff00 0x7f1614159860 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:54.677 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.675+0000 7f161c7ea640 1 -- 172.21.15.87:0/3999440093 >> 172.21.15.87:0/3999440093 conn(0x7f161406cd60 msgr2=0x7f161406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:54.677 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.675+0000 7f161c7ea640 1 -- 172.21.15.87:0/3999440093 shutdown_connections 2023-12-16T20:21:54.677 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.675+0000 7f161c7ea640 1 -- 172.21.15.87:0/3999440093 wait complete. 2023-12-16T20:21:54.677 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.676+0000 7f161c7ea640 1 Processor -- start 2023-12-16T20:21:54.677 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.676+0000 7f161c7ea640 1 -- start start 2023-12-16T20:21:54.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.677+0000 7f161c7ea640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16140bff00 0x7f16141553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:54.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.677+0000 7f161c7ea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16141501c0 0x7f16141ee970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:54.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.677+0000 7f161c7ea640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1614156e60 0x7f16140c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:54.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.677+0000 7f161c7ea640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16141f2700 con 0x7f1614156e60 2023-12-16T20:21:54.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.677+0000 7f161c7ea640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161414ab80 con 0x7f16140bff00 2023-12-16T20:21:54.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.677+0000 7f161c7ea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16140c4ac0 con 0x7f16141501c0 2023-12-16T20:21:54.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.677+0000 7f161ad87640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1614156e60 0x7f16140c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:54.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.678+0000 7f161a586640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16140bff00 0x7f16141553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:54.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.678+0000 7f1619d85640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16141501c0 0x7f16141ee970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:54.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.678+0000 7f161ad87640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1614156e60 0x7f16140c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46702/0 (socket says 172.21.15.87:46702) 2023-12-16T20:21:54.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.678+0000 7f161ad87640 1 -- 172.21.15.87:0/1582521128 learned_addr learned my addr 172.21.15.87:0/1582521128 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:54.683 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.681+0000 7f161ad87640 1 -- 172.21.15.87:0/1582521128 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16141501c0 msgr2=0x7f16141ee970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:54.683 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.681+0000 7f161ad87640 1 --2- 172.21.15.87:0/1582521128 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16141501c0 0x7f16141ee970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:54.683 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.681+0000 7f161ad87640 1 -- 172.21.15.87:0/1582521128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16140bff00 msgr2=0x7f16141553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:54.683 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.681+0000 7f161ad87640 1 --2- 172.21.15.87:0/1582521128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16140bff00 0x7f16141553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:54.683 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.681+0000 7f161ad87640 1 -- 172.21.15.87:0/1582521128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1604009400 con 0x7f1614156e60 2023-12-16T20:21:54.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.683+0000 7f161ad87640 1 --2- 172.21.15.87:0/1582521128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1614156e60 0x7f16140c6120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f160c00c7d0 tx=0x7f160c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:54.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.686+0000 7f160affd640 1 -- 172.21.15.87:0/1582521128 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c003b70 con 0x7f1614156e60 2023-12-16T20:21:54.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.686+0000 7f160affd640 1 -- 172.21.15.87:0/1582521128 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160c003cf0 con 0x7f1614156e60 2023-12-16T20:21:54.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.686+0000 7f161c7ea640 1 -- 172.21.15.87:0/1582521128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161414a600 con 0x7f1614156e60 2023-12-16T20:21:54.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.686+0000 7f160affd640 1 -- 172.21.15.87:0/1582521128 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c00aa90 con 0x7f1614156e60 2023-12-16T20:21:54.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.687+0000 7f161c7ea640 1 -- 172.21.15.87:0/1582521128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16141eeeb0 con 0x7f1614156e60 2023-12-16T20:21:54.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.687+0000 7f161c7ea640 1 -- 172.21.15.87:0/1582521128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16140c77e0 con 0x7f1614156e60 2023-12-16T20:21:54.707 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.705+0000 7f160affd640 1 -- 172.21.15.87:0/1582521128 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f160c00abf0 con 0x7f1614156e60 2023-12-16T20:21:54.707 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.706+0000 7f160affd640 1 --2- 172.21.15.87:0/1582521128 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f15f806ae90 0x7f15f806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:54.707 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.706+0000 7f161a586640 1 --2- 172.21.15.87:0/1582521128 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f15f806ae90 0x7f15f806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:54.707 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.706+0000 7f161a586640 1 --2- 172.21.15.87:0/1582521128 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f15f806ae90 0x7f15f806d350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f16100011e0 tx=0x7f1610007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:54.709 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.708+0000 7f160affd640 1 -- 172.21.15.87:0/1582521128 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f160c005800 con 0x7f1614156e60 2023-12-16T20:21:54.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:54.942+0000 7f160affd640 1 -- 172.21.15.87:0/1582521128 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f160c054ee0 con 0x7f1614156e60 2023-12-16T20:21:55.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.110+0000 7f161c7ea640 1 -- 172.21.15.87:0/1582521128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16141f2840 con 0x7f1614156e60 2023-12-16T20:21:55.116 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.115+0000 7f160affd640 1 -- 172.21.15.87:0/1582521128 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16141f2840 con 0x7f1614156e60 2023-12-16T20:21:55.116 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-12-16T20:21:55.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.117+0000 7f161c7ea640 1 -- 172.21.15.87:0/1582521128 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f15f806ae90 msgr2=0x7f15f806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:55.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.117+0000 7f161c7ea640 1 --2- 172.21.15.87:0/1582521128 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f15f806ae90 0x7f15f806d350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f16100011e0 tx=0x7f1610007d30 comp rx=0 tx=0).stop 2023-12-16T20:21:55.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.117+0000 7f161c7ea640 1 -- 172.21.15.87:0/1582521128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1614156e60 msgr2=0x7f16140c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:55.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.117+0000 7f161c7ea640 1 --2- 172.21.15.87:0/1582521128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1614156e60 0x7f16140c6120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f160c00c7d0 tx=0x7f160c00cc90 comp rx=0 tx=0).stop 2023-12-16T20:21:55.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.117+0000 7f161c7ea640 1 -- 172.21.15.87:0/1582521128 shutdown_connections 2023-12-16T20:21:55.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.117+0000 7f161c7ea640 1 --2- 172.21.15.87:0/1582521128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1614156e60 0x7f16140c6120 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.117+0000 7f161c7ea640 1 --2- 172.21.15.87:0/1582521128 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16141501c0 0x7f16141ee970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.117+0000 7f161c7ea640 1 --2- 172.21.15.87:0/1582521128 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f15f806ae90 0x7f15f806d350 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.117+0000 7f161c7ea640 1 --2- 172.21.15.87:0/1582521128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16140bff00 0x7f16141553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.117+0000 7f161c7ea640 1 -- 172.21.15.87:0/1582521128 >> 172.21.15.87:0/1582521128 conn(0x7f161406cd60 msgr2=0x7f161414cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:55.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.117+0000 7f161c7ea640 1 -- 172.21.15.87:0/1582521128 shutdown_connections 2023-12-16T20:21:55.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.117+0000 7f161c7ea640 1 -- 172.21.15.87:0/1582521128 wait complete. 2023-12-16T20:21:55.129 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T20:21:55.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.231+0000 7f3e5e741640 1 Processor -- start 2023-12-16T20:21:55.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.231+0000 7f3e5e741640 1 -- start start 2023-12-16T20:21:55.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.232+0000 7f3e5e741640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3e581501c0 0x7f3e58159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:55.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.232+0000 7f3e5e741640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3e580bff00 0x7f3e58156e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:55.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.232+0000 7f3e5e741640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e58072450 0x7f3e58071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:55.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.232+0000 7f3e5e741640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e580c1a90 con 0x7f3e581501c0 2023-12-16T20:21:55.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.232+0000 7f3e5e741640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e580c1d30 con 0x7f3e580bff00 2023-12-16T20:21:55.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.232+0000 7f3e5e741640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e580c2010 con 0x7f3e58072450 2023-12-16T20:21:55.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.233+0000 7f3e5ccde640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e58072450 0x7f3e58071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:55.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.233+0000 7f3e57fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3e581501c0 0x7f3e58159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:55.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.233+0000 7f3e577fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3e580bff00 0x7f3e58156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:55.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.233+0000 7f3e5ccde640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e58072450 0x7f3e58071710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:56096/0 (socket says 172.21.15.87:56096) 2023-12-16T20:21:55.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.233+0000 7f3e5ccde640 1 -- 172.21.15.87:0/1989161259 learned_addr learned my addr 172.21.15.87:0/1989161259 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:55.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.235+0000 7f3e5ccde640 1 -- 172.21.15.87:0/1989161259 >> v2:172.21.15.195:3300/0 conn(0x7f3e580bff00 msgr2=0x7f3e58156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:55.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.235+0000 7f3e5ccde640 1 --2- 172.21.15.87:0/1989161259 >> v2:172.21.15.195:3300/0 conn(0x7f3e580bff00 0x7f3e58156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.235+0000 7f3e5ccde640 1 -- 172.21.15.87:0/1989161259 >> v2:172.21.15.87:3300/0 conn(0x7f3e581501c0 msgr2=0x7f3e58159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:55.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.235+0000 7f3e5ccde640 1 --2- 172.21.15.87:0/1989161259 >> v2:172.21.15.87:3300/0 conn(0x7f3e581501c0 0x7f3e58159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.235+0000 7f3e5ccde640 1 -- 172.21.15.87:0/1989161259 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e58156380 con 0x7f3e58072450 2023-12-16T20:21:55.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.237+0000 7f3e5ccde640 1 --2- 172.21.15.87:0/1989161259 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e58072450 0x7f3e58071710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3e5806f9e0 tx=0x7f3e5002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=355b431a9fb8af30 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:55.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.241+0000 7f3e56ffd640 1 -- 172.21.15.87:0/1989161259 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5002cb00 con 0x7f3e58072450 2023-12-16T20:21:55.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.241+0000 7f3e56ffd640 1 -- 172.21.15.87:0/1989161259 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5002cc60 con 0x7f3e58072450 2023-12-16T20:21:55.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.241+0000 7f3e56ffd640 1 -- 172.21.15.87:0/1989161259 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e500343f0 con 0x7f3e58072450 2023-12-16T20:21:55.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.241+0000 7f3e5e741640 1 -- 172.21.15.87:0/1989161259 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e58072450 msgr2=0x7f3e58071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:55.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.241+0000 7f3e5e741640 1 --2- 172.21.15.87:0/1989161259 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e58072450 0x7f3e58071710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3e5806f9e0 tx=0x7f3e5002bf60 comp rx=0 tx=0).stop 2023-12-16T20:21:55.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.241+0000 7f3e5e741640 1 -- 172.21.15.87:0/1989161259 shutdown_connections 2023-12-16T20:21:55.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.241+0000 7f3e5e741640 1 --2- 172.21.15.87:0/1989161259 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e58072450 0x7f3e58071710 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.241+0000 7f3e5e741640 1 --2- 172.21.15.87:0/1989161259 >> v2:172.21.15.195:3300/0 conn(0x7f3e580bff00 0x7f3e58156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.241+0000 7f3e5e741640 1 --2- 172.21.15.87:0/1989161259 >> v2:172.21.15.87:3300/0 conn(0x7f3e581501c0 0x7f3e58159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.241+0000 7f3e5e741640 1 -- 172.21.15.87:0/1989161259 >> 172.21.15.87:0/1989161259 conn(0x7f3e5806cd60 msgr2=0x7f3e5806d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:55.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.241+0000 7f3e5e741640 1 -- 172.21.15.87:0/1989161259 shutdown_connections 2023-12-16T20:21:55.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.242+0000 7f3e5e741640 1 -- 172.21.15.87:0/1989161259 wait complete. 2023-12-16T20:21:55.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.243+0000 7f3e5e741640 1 Processor -- start 2023-12-16T20:21:55.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.243+0000 7f3e5e741640 1 -- start start 2023-12-16T20:21:55.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.243+0000 7f3e5e741640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e58072450 0x7f3e581eef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:55.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.243+0000 7f3e5e741640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e580bff00 0x7f3e58146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:55.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.243+0000 7f3e5e741640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e581501c0 0x7f3e581467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:55.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.243+0000 7f3e5e741640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5815ef30 con 0x7f3e581501c0 2023-12-16T20:21:55.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.243+0000 7f3e5e741640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e58160220 con 0x7f3e580bff00 2023-12-16T20:21:55.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.243+0000 7f3e5e741640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5815fca0 con 0x7f3e58072450 2023-12-16T20:21:55.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.244+0000 7f3e57fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e58072450 0x7f3e581eef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:55.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.244+0000 7f3e5ccde640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e581501c0 0x7f3e581467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:55.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.244+0000 7f3e577fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e580bff00 0x7f3e58146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:55.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.244+0000 7f3e57fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e58072450 0x7f3e581eef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:56100/0 (socket says 172.21.15.87:56100) 2023-12-16T20:21:55.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.244+0000 7f3e57fff640 1 -- 172.21.15.87:0/3587356640 learned_addr learned my addr 172.21.15.87:0/3587356640 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:55.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.248+0000 7f3e57fff640 1 -- 172.21.15.87:0/3587356640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e580bff00 msgr2=0x7f3e58146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:55.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.248+0000 7f3e57fff640 1 --2- 172.21.15.87:0/3587356640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e580bff00 0x7f3e58146280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.248+0000 7f3e57fff640 1 -- 172.21.15.87:0/3587356640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e581501c0 msgr2=0x7f3e581467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:55.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.248+0000 7f3e57fff640 1 --2- 172.21.15.87:0/3587356640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e581501c0 0x7f3e581467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.248+0000 7f3e57fff640 1 -- 172.21.15.87:0/3587356640 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e50009b30 con 0x7f3e58072450 2023-12-16T20:21:55.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.250+0000 7f3e57fff640 1 --2- 172.21.15.87:0/3587356640 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e58072450 0x7f3e581eef00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800e8a0 tx=0x7f3e4800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:55.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.254+0000 7f3e54ff9640 1 -- 172.21.15.87:0/3587356640 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e480094f0 con 0x7f3e58072450 2023-12-16T20:21:55.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.254+0000 7f3e54ff9640 1 -- 172.21.15.87:0/3587356640 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4800c940 con 0x7f3e58072450 2023-12-16T20:21:55.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.254+0000 7f3e5e741640 1 -- 172.21.15.87:0/3587356640 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e581f3020 con 0x7f3e58072450 2023-12-16T20:21:55.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.254+0000 7f3e54ff9640 1 -- 172.21.15.87:0/3587356640 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4800ccf0 con 0x7f3e58072450 2023-12-16T20:21:55.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.254+0000 7f3e5e741640 1 -- 172.21.15.87:0/3587356640 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e58146d00 con 0x7f3e58072450 2023-12-16T20:21:55.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.255+0000 7f3e5e741640 1 -- 172.21.15.87:0/3587356640 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5815f1a0 con 0x7f3e58072450 2023-12-16T20:21:55.501 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.499+0000 7f3e54ff9640 1 -- 172.21.15.87:0/3587356640 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f3e48013470 con 0x7f3e58072450 2023-12-16T20:21:55.501 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.500+0000 7f3e54ff9640 1 --2- 172.21.15.87:0/3587356640 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f3e4406ae90 0x7f3e4406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:55.501 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.500+0000 7f3e577fe640 1 --2- 172.21.15.87:0/3587356640 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f3e4406ae90 0x7f3e4406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:55.501 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.500+0000 7f3e577fe640 1 --2- 172.21.15.87:0/3587356640 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f3e4406ae90 0x7f3e4406d350 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3e580c5d90 tx=0x7f3e4c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:55.504 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.503+0000 7f3e54ff9640 1 -- 172.21.15.87:0/3587356640 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3e48058c30 con 0x7f3e58072450 2023-12-16T20:21:55.514 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.513+0000 7f3e54ff9640 1 -- 172.21.15.87:0/3587356640 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f3e48054f70 con 0x7f3e58072450 2023-12-16T20:21:55.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.688+0000 7f3e5e741640 1 -- 172.21.15.87:0/3587356640 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e580c77e0 con 0x7f3e58072450 2023-12-16T20:21:55.710 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.709+0000 7f3e54ff9640 1 -- 172.21.15.87:0/3587356640 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3e480170a0 con 0x7f3e58072450 2023-12-16T20:21:55.710 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-12-16T20:21:55.713 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.711+0000 7f3e5e741640 1 -- 172.21.15.87:0/3587356640 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f3e4406ae90 msgr2=0x7f3e4406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:55.713 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.711+0000 7f3e5e741640 1 --2- 172.21.15.87:0/3587356640 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f3e4406ae90 0x7f3e4406d350 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3e580c5d90 tx=0x7f3e4c009190 comp rx=0 tx=0).stop 2023-12-16T20:21:55.713 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.711+0000 7f3e5e741640 1 -- 172.21.15.87:0/3587356640 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e58072450 msgr2=0x7f3e581eef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:55.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.711+0000 7f3e5e741640 1 --2- 172.21.15.87:0/3587356640 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e58072450 0x7f3e581eef00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800e8a0 tx=0x7f3e4800ed60 comp rx=0 tx=0).stop 2023-12-16T20:21:55.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.711+0000 7f3e5e741640 1 -- 172.21.15.87:0/3587356640 shutdown_connections 2023-12-16T20:21:55.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.711+0000 7f3e5e741640 1 --2- 172.21.15.87:0/3587356640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e581501c0 0x7f3e581467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.711+0000 7f3e5e741640 1 --2- 172.21.15.87:0/3587356640 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f3e4406ae90 0x7f3e4406d350 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.711+0000 7f3e5e741640 1 --2- 172.21.15.87:0/3587356640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e580bff00 0x7f3e58146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.711+0000 7f3e5e741640 1 --2- 172.21.15.87:0/3587356640 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e58072450 0x7f3e581eef00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.711+0000 7f3e5e741640 1 -- 172.21.15.87:0/3587356640 >> 172.21.15.87:0/3587356640 conn(0x7f3e5806cd60 msgr2=0x7f3e5806f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:55.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.711+0000 7f3e5e741640 1 -- 172.21.15.87:0/3587356640 shutdown_connections 2023-12-16T20:21:55.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.711+0000 7f3e5e741640 1 -- 172.21.15.87:0/3587356640 wait complete. 2023-12-16T20:21:55.724 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T20:21:55.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.826+0000 7fb4e25c9640 1 Processor -- start 2023-12-16T20:21:55.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.826+0000 7fb4e25c9640 1 -- start start 2023-12-16T20:21:55.828 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.827+0000 7fb4e25c9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4dc0b1ff0 0x7fb4dc070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:55.828 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.827+0000 7fb4e25c9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb4dc0ccc50 0x7fb4dc070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:55.828 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.827+0000 7fb4e25c9640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4dc0cd1b0 con 0x7fb4dc151130 2023-12-16T20:21:55.828 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.827+0000 7fb4e25c9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4dc158340 con 0x7fb4dc0ccc50 2023-12-16T20:21:55.828 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.827+0000 7fb4e25c9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc0cd490 con 0x7fb4dc0b1ff0 2023-12-16T20:21:55.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.827+0000 7fb4db7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4dc0b1ff0 0x7fb4dc070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:55.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.827+0000 7fb4e0b66640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb4dc0ccc50 0x7fb4dc070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:55.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.827+0000 7fb4dbfff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fb4dc151130 0x7fb4dc157c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:37480/0 (socket says 172.21.15.87:37480) 2023-12-16T20:21:55.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.827+0000 7fb4dbfff640 1 -- 172.21.15.87:0/2956573300 learned_addr learned my addr 172.21.15.87:0/2956573300 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:55.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.830+0000 7fb4daffd640 1 -- 172.21.15.87:0/2956573300 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287143363 0 0) 0x7fb4dc0cd1b0 con 0x7fb4dc151130 2023-12-16T20:21:55.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.830+0000 7fb4daffd640 1 -- 172.21.15.87:0/2956573300 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4c4003520 con 0x7fb4dc151130 2023-12-16T20:21:55.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.830+0000 7fb4db7fe640 1 -- 172.21.15.87:0/2956573300 >> v2:172.21.15.87:3300/0 conn(0x7fb4dc0ccc50 msgr2=0x7fb4dc070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:55.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.830+0000 7fb4db7fe640 1 --2- 172.21.15.87:0/2956573300 >> v2:172.21.15.87:3300/0 conn(0x7fb4dc0ccc50 0x7fb4dc070fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.830+0000 7fb4db7fe640 1 -- 172.21.15.87:0/2956573300 >> v1:172.21.15.195:6789/0 conn(0x7fb4dc151130 legacy=0x7fb4dc157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:55.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.830+0000 7fb4db7fe640 1 -- 172.21.15.87:0/2956573300 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4dc0cd770 con 0x7fb4dc0b1ff0 2023-12-16T20:21:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.832+0000 7fb4db7fe640 1 --2- 172.21.15.87:0/2956573300 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4dc0b1ff0 0x7fb4dc070a90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00097d0 tx=0x7fb4d002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc16295ff59787fe server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:55.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.835+0000 7fb4daffd640 1 -- 172.21.15.87:0/2956573300 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0031890 con 0x7fb4dc0b1ff0 2023-12-16T20:21:55.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.835+0000 7fb4daffd640 1 -- 172.21.15.87:0/2956573300 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d00319f0 con 0x7fb4dc0b1ff0 2023-12-16T20:21:55.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.835+0000 7fb4daffd640 1 -- 172.21.15.87:0/2956573300 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0031d80 con 0x7fb4dc0b1ff0 2023-12-16T20:21:55.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.836+0000 7fb4e25c9640 1 -- 172.21.15.87:0/2956573300 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4dc0b1ff0 msgr2=0x7fb4dc070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:55.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.836+0000 7fb4e25c9640 1 --2- 172.21.15.87:0/2956573300 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4dc0b1ff0 0x7fb4dc070a90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00097d0 tx=0x7fb4d002b930 comp rx=0 tx=0).stop 2023-12-16T20:21:55.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.836+0000 7fb4e25c9640 1 -- 172.21.15.87:0/2956573300 shutdown_connections 2023-12-16T20:21:55.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.836+0000 7fb4e25c9640 1 --2- 172.21.15.87:0/2956573300 >> v2:172.21.15.87:3300/0 conn(0x7fb4dc0ccc50 0x7fb4dc070fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.836+0000 7fb4e25c9640 1 --2- 172.21.15.87:0/2956573300 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4dc0b1ff0 0x7fb4dc070a90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.836+0000 7fb4e25c9640 1 -- 172.21.15.87:0/2956573300 >> 172.21.15.87:0/2956573300 conn(0x7fb4dc06ab30 msgr2=0x7fb4dc06ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:55.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.836+0000 7fb4e25c9640 1 -- 172.21.15.87:0/2956573300 shutdown_connections 2023-12-16T20:21:55.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.836+0000 7fb4e25c9640 1 -- 172.21.15.87:0/2956573300 wait complete. 2023-12-16T20:21:55.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.837+0000 7fb4e25c9640 1 Processor -- start 2023-12-16T20:21:55.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.837+0000 7fb4e25c9640 1 -- start start 2023-12-16T20:21:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.838+0000 7fb4e25c9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4dc0b1ff0 0x7fb4dc0c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.838+0000 7fb4e25c9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4dc0ccc50 0x7fb4dc1ec9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.838+0000 7fb4e25c9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4dc151130 0x7fb4dc0cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.838+0000 7fb4e25c9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc0ccae0 con 0x7fb4dc151130 2023-12-16T20:21:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.838+0000 7fb4e25c9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc158660 con 0x7fb4dc0ccc50 2023-12-16T20:21:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.838+0000 7fb4e25c9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc158940 con 0x7fb4dc0b1ff0 2023-12-16T20:21:55.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.838+0000 7fb4e0b66640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4dc151130 0x7fb4dc0cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:55.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.838+0000 7fb4dbfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4dc0b1ff0 0x7fb4dc0c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:55.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.838+0000 7fb4db7fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4dc0ccc50 0x7fb4dc1ec9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:55.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.838+0000 7fb4dbfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4dc0b1ff0 0x7fb4dc0c4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:56130/0 (socket says 172.21.15.87:56130) 2023-12-16T20:21:55.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.839+0000 7fb4dbfff640 1 -- 172.21.15.87:0/3067727610 learned_addr learned my addr 172.21.15.87:0/3067727610 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:55.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.842+0000 7fb4dbfff640 1 -- 172.21.15.87:0/3067727610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4dc0ccc50 msgr2=0x7fb4dc1ec9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:55.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.842+0000 7fb4dbfff640 1 --2- 172.21.15.87:0/3067727610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4dc0ccc50 0x7fb4dc1ec9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.842+0000 7fb4dbfff640 1 -- 172.21.15.87:0/3067727610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4dc151130 msgr2=0x7fb4dc0cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:55.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.842+0000 7fb4dbfff640 1 --2- 172.21.15.87:0/3067727610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4dc151130 0x7fb4dc0cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:55.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.842+0000 7fb4dbfff640 1 -- 172.21.15.87:0/3067727610 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d0009400 con 0x7fb4dc0b1ff0 2023-12-16T20:21:55.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.844+0000 7fb4dbfff640 1 --2- 172.21.15.87:0/3067727610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4dc0b1ff0 0x7fb4dc0c4f10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00c3c0 tx=0x7fb4cc00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:55.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.848+0000 7fb4d8ff9640 1 -- 172.21.15.87:0/3067727610 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc005ce0 con 0x7fb4dc0b1ff0 2023-12-16T20:21:55.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.848+0000 7fb4d8ff9640 1 -- 172.21.15.87:0/3067727610 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4cc005e40 con 0x7fb4dc0b1ff0 2023-12-16T20:21:55.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.848+0000 7fb4d8ff9640 1 -- 172.21.15.87:0/3067727610 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc0072f0 con 0x7fb4dc0b1ff0 2023-12-16T20:21:55.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.848+0000 7fb4e25c9640 1 -- 172.21.15.87:0/3067727610 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4dc0cbda0 con 0x7fb4dc0b1ff0 2023-12-16T20:21:55.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.848+0000 7fb4e25c9640 1 -- 172.21.15.87:0/3067727610 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4dc158c20 con 0x7fb4dc0b1ff0 2023-12-16T20:21:55.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:55.849+0000 7fb4e25c9640 1 -- 172.21.15.87:0/3067727610 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4dc0cc2c0 con 0x7fb4dc0b1ff0 2023-12-16T20:21:56.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.091+0000 7fb4d8ff9640 1 -- 172.21.15.87:0/3067727610 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fb4cc007450 con 0x7fb4dc0b1ff0 2023-12-16T20:21:56.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.091+0000 7fb4d8ff9640 1 --2- 172.21.15.87:0/3067727610 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb4c806ae90 0x7fb4c806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:56.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.091+0000 7fb4db7fe640 1 --2- 172.21.15.87:0/3067727610 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb4c806ae90 0x7fb4c806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:56.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.092+0000 7fb4db7fe640 1 --2- 172.21.15.87:0/3067727610 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb4c806ae90 0x7fb4c806d350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0036000 tx=0x7fb4d003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:56.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.094+0000 7fb4d8ff9640 1 -- 172.21.15.87:0/3067727610 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb4cc057c40 con 0x7fb4dc0b1ff0 2023-12-16T20:21:56.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.104+0000 7fb4d8ff9640 1 -- 172.21.15.87:0/3067727610 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fb4cc053f80 con 0x7fb4dc0b1ff0 2023-12-16T20:21:56.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.275+0000 7fb4e25c9640 1 -- 172.21.15.87:0/3067727610 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb4dc0cc2c0 con 0x7fb4dc0b1ff0 2023-12-16T20:21:56.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.281+0000 7fb4d8ff9640 1 -- 172.21.15.87:0/3067727610 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb4dc0cc2c0 con 0x7fb4dc0b1ff0 2023-12-16T20:21:56.282 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-12-16T20:21:56.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.282+0000 7fb4e25c9640 1 -- 172.21.15.87:0/3067727610 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb4c806ae90 msgr2=0x7fb4c806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:56.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.282+0000 7fb4e25c9640 1 --2- 172.21.15.87:0/3067727610 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb4c806ae90 0x7fb4c806d350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0036000 tx=0x7fb4d003c040 comp rx=0 tx=0).stop 2023-12-16T20:21:56.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.282+0000 7fb4e25c9640 1 -- 172.21.15.87:0/3067727610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4dc0b1ff0 msgr2=0x7fb4dc0c4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:56.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.282+0000 7fb4e25c9640 1 --2- 172.21.15.87:0/3067727610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4dc0b1ff0 0x7fb4dc0c4f10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00c3c0 tx=0x7fb4cc00c880 comp rx=0 tx=0).stop 2023-12-16T20:21:56.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.282+0000 7fb4e25c9640 1 -- 172.21.15.87:0/3067727610 shutdown_connections 2023-12-16T20:21:56.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.282+0000 7fb4e25c9640 1 --2- 172.21.15.87:0/3067727610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4dc151130 0x7fb4dc0cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:56.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.282+0000 7fb4e25c9640 1 --2- 172.21.15.87:0/3067727610 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb4c806ae90 0x7fb4c806d350 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:56.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.282+0000 7fb4e25c9640 1 --2- 172.21.15.87:0/3067727610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4dc0ccc50 0x7fb4dc1ec9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:56.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.282+0000 7fb4e25c9640 1 --2- 172.21.15.87:0/3067727610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4dc0b1ff0 0x7fb4dc0c4f10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:56.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.282+0000 7fb4e25c9640 1 -- 172.21.15.87:0/3067727610 >> 172.21.15.87:0/3067727610 conn(0x7fb4dc06ab30 msgr2=0x7fb4dc155b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:56.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.282+0000 7fb4e25c9640 1 -- 172.21.15.87:0/3067727610 shutdown_connections 2023-12-16T20:21:56.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.283+0000 7fb4e25c9640 1 -- 172.21.15.87:0/3067727610 wait complete. 2023-12-16T20:21:56.295 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-16T20:21:56.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.396+0000 7fa1d8864640 1 Processor -- start 2023-12-16T20:21:56.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.396+0000 7fa1d8864640 1 -- start start 2023-12-16T20:21:56.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.397+0000 7fa1d8864640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa1d4153660 0x7fa1d415d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:56.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.397+0000 7fa1d8864640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa1d40caf70 0x7fa1d40cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:56.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.397+0000 7fa1d8864640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d415d950 con 0x7fa1d40c8e30 2023-12-16T20:21:56.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.397+0000 7fa1d8864640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d40ccc20 con 0x7fa1d40caf70 2023-12-16T20:21:56.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.397+0000 7fa1d8864640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d40c8730 con 0x7fa1d4153660 2023-12-16T20:21:56.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.397+0000 7fa1c9d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa1d40caf70 0x7fa1d40cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:56.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.398+0000 7fa1d259c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa1d4153660 0x7fa1d415d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:56.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.398+0000 7fa1c9d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa1d40caf70 0x7fa1d40cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46764/0 (socket says 172.21.15.87:46764) 2023-12-16T20:21:56.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.398+0000 7fa1c9d9b640 1 -- 172.21.15.87:0/3347220103 learned_addr learned my addr 172.21.15.87:0/3347220103 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:56.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.400+0000 7fa1d259c640 1 -- 172.21.15.87:0/3347220103 >> v2:172.21.15.87:3300/0 conn(0x7fa1d40caf70 msgr2=0x7fa1d40cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:56.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.400+0000 7fa1d259c640 1 --2- 172.21.15.87:0/3347220103 >> v2:172.21.15.87:3300/0 conn(0x7fa1d40caf70 0x7fa1d40cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:56.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.400+0000 7fa1d259c640 1 -- 172.21.15.87:0/3347220103 >> v1:172.21.15.87:6789/0 conn(0x7fa1d40c8e30 legacy=0x7fa1d40c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:56.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.400+0000 7fa1d259c640 1 -- 172.21.15.87:0/3347220103 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d40c8a10 con 0x7fa1d4153660 2023-12-16T20:21:56.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.402+0000 7fa1d259c640 1 --2- 172.21.15.87:0/3347220103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1d4153660 0x7fa1d415d410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40cde50 tx=0x7fa1c402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c629a0d695631a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:56.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.405+0000 7fa1d1d9b640 1 -- 172.21.15.87:0/3347220103 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4031830 con 0x7fa1d4153660 2023-12-16T20:21:56.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.405+0000 7fa1d1d9b640 1 -- 172.21.15.87:0/3347220103 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c4031990 con 0x7fa1d4153660 2023-12-16T20:21:56.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.406+0000 7fa1d1d9b640 1 -- 172.21.15.87:0/3347220103 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4031d20 con 0x7fa1d4153660 2023-12-16T20:21:56.408 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.406+0000 7fa1d8864640 1 -- 172.21.15.87:0/3347220103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1d4153660 msgr2=0x7fa1d415d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:56.408 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.406+0000 7fa1d8864640 1 --2- 172.21.15.87:0/3347220103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1d4153660 0x7fa1d415d410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40cde50 tx=0x7fa1c402b8d0 comp rx=0 tx=0).stop 2023-12-16T20:21:56.408 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.406+0000 7fa1d8864640 1 -- 172.21.15.87:0/3347220103 shutdown_connections 2023-12-16T20:21:56.408 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.406+0000 7fa1d8864640 1 --2- 172.21.15.87:0/3347220103 >> v2:172.21.15.87:3300/0 conn(0x7fa1d40caf70 0x7fa1d40cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:56.408 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.406+0000 7fa1d8864640 1 --2- 172.21.15.87:0/3347220103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1d4153660 0x7fa1d415d410 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:56.408 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.406+0000 7fa1d8864640 1 -- 172.21.15.87:0/3347220103 >> 172.21.15.87:0/3347220103 conn(0x7fa1d40709a0 msgr2=0x7fa1d4070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:56.408 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.406+0000 7fa1d8864640 1 -- 172.21.15.87:0/3347220103 shutdown_connections 2023-12-16T20:21:56.408 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.406+0000 7fa1d8864640 1 -- 172.21.15.87:0/3347220103 wait complete. 2023-12-16T20:21:56.409 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.408+0000 7fa1d8864640 1 Processor -- start 2023-12-16T20:21:56.409 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.408+0000 7fa1d8864640 1 -- start start 2023-12-16T20:21:56.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.408+0000 7fa1d8864640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa1d40c8e30 0x7fa1d406f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:56.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.409+0000 7fa1d8864640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d40caf70 0x7fa1d40b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:56.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.409+0000 7fa1d8864640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1d4153660 0x7fa1d413f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:56.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.409+0000 7fa1d8864640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d415c0c0 con 0x7fa1d40caf70 2023-12-16T20:21:56.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.409+0000 7fa1d8864640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d41f2e40 con 0x7fa1d4153660 2023-12-16T20:21:56.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.409+0000 7fa1d8864640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d40b2360 con 0x7fa1d40c8e30 2023-12-16T20:21:56.411 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.409+0000 7fa1c9d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d40caf70 0x7fa1d40b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:56.411 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.409+0000 7fa1d2d9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1d4153660 0x7fa1d413f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:56.411 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.409+0000 7fa1d259c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa1d40c8e30 0x7fa1d406f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:56.411 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.409+0000 7fa1c9d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d40caf70 0x7fa1d40b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46768/0 (socket says 172.21.15.87:46768) 2023-12-16T20:21:56.411 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.409+0000 7fa1c9d9b640 1 -- 172.21.15.87:0/2256849571 learned_addr learned my addr 172.21.15.87:0/2256849571 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:56.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.413+0000 7fa1d2d9d640 1 -- 172.21.15.87:0/2256849571 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa1d40c8e30 msgr2=0x7fa1d406f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:56.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.413+0000 7fa1d2d9d640 1 --2- 172.21.15.87:0/2256849571 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa1d40c8e30 0x7fa1d406f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:56.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.413+0000 7fa1d2d9d640 1 -- 172.21.15.87:0/2256849571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d40caf70 msgr2=0x7fa1d40b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:56.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.413+0000 7fa1d2d9d640 1 --2- 172.21.15.87:0/2256849571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d40caf70 0x7fa1d40b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:56.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.413+0000 7fa1d2d9d640 1 -- 172.21.15.87:0/2256849571 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c4009400 con 0x7fa1d4153660 2023-12-16T20:21:56.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.413+0000 7fa1d259c640 1 --2- 172.21.15.87:0/2256849571 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa1d40c8e30 0x7fa1d406f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:21:56.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.416+0000 7fa1d2d9d640 1 --2- 172.21.15.87:0/2256849571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1d4153660 0x7fa1d413f820 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00c690 tx=0x7fa1cc00cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:56.421 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.420+0000 7fa1cb7fe640 1 -- 172.21.15.87:0/2256849571 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc003b70 con 0x7fa1d4153660 2023-12-16T20:21:56.421 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.420+0000 7fa1cb7fe640 1 -- 172.21.15.87:0/2256849571 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc003cd0 con 0x7fa1d4153660 2023-12-16T20:21:56.421 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.420+0000 7fa1d8864640 1 -- 172.21.15.87:0/2256849571 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d41f28c0 con 0x7fa1d4153660 2023-12-16T20:21:56.421 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.420+0000 7fa1cb7fe640 1 -- 172.21.15.87:0/2256849571 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc005310 con 0x7fa1d4153660 2023-12-16T20:21:56.421 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.420+0000 7fa1d8864640 1 -- 172.21.15.87:0/2256849571 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d41f2b60 con 0x7fa1d4153660 2023-12-16T20:21:56.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.421+0000 7fa1d8864640 1 -- 172.21.15.87:0/2256849571 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d415c200 con 0x7fa1d4153660 2023-12-16T20:21:56.665 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.663+0000 7fa1cb7fe640 1 -- 172.21.15.87:0/2256849571 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fa1cc005470 con 0x7fa1d4153660 2023-12-16T20:21:56.665 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.663+0000 7fa1cb7fe640 1 --2- 172.21.15.87:0/2256849571 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa1b406aec0 0x7fa1b406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:56.665 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.663+0000 7fa1d259c640 1 --2- 172.21.15.87:0/2256849571 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa1b406aec0 0x7fa1b406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:56.665 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.664+0000 7fa1d259c640 1 --2- 172.21.15.87:0/2256849571 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa1b406aec0 0x7fa1b406d380 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4036000 tx=0x7fa1c403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:56.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.668+0000 7fa1cb7fe640 1 -- 172.21.15.87:0/2256849571 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa1cc058910 con 0x7fa1d4153660 2023-12-16T20:21:56.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.678+0000 7fa1cb7fe640 1 -- 172.21.15.87:0/2256849571 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fa1cc054c50 con 0x7fa1d4153660 2023-12-16T20:21:56.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.855+0000 7fa1d8864640 1 -- 172.21.15.87:0/2256849571 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa1d415c200 con 0x7fa1d4153660 2023-12-16T20:21:56.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.861+0000 7fa1cb7fe640 1 -- 172.21.15.87:0/2256849571 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa1d415c200 con 0x7fa1d4153660 2023-12-16T20:21:56.862 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-12-16T20:21:56.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.862+0000 7fa1d8864640 1 -- 172.21.15.87:0/2256849571 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa1b406aec0 msgr2=0x7fa1b406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:56.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.862+0000 7fa1d8864640 1 --2- 172.21.15.87:0/2256849571 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa1b406aec0 0x7fa1b406d380 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4036000 tx=0x7fa1c403c040 comp rx=0 tx=0).stop 2023-12-16T20:21:56.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.862+0000 7fa1d8864640 1 -- 172.21.15.87:0/2256849571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1d4153660 msgr2=0x7fa1d413f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:56.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.863+0000 7fa1d8864640 1 --2- 172.21.15.87:0/2256849571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1d4153660 0x7fa1d413f820 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00c690 tx=0x7fa1cc00cb50 comp rx=0 tx=0).stop 2023-12-16T20:21:56.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.863+0000 7fa1d8864640 1 -- 172.21.15.87:0/2256849571 shutdown_connections 2023-12-16T20:21:56.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.863+0000 7fa1d8864640 1 --2- 172.21.15.87:0/2256849571 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa1b406aec0 0x7fa1b406d380 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:56.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.863+0000 7fa1d8864640 1 --2- 172.21.15.87:0/2256849571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1d4153660 0x7fa1d413f820 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.863+0000 7fa1d8864640 1 --2- 172.21.15.87:0/2256849571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d40caf70 0x7fa1d40b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.863+0000 7fa1d8864640 1 --2- 172.21.15.87:0/2256849571 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa1d40c8e30 0x7fa1d406f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.863+0000 7fa1d8864640 1 -- 172.21.15.87:0/2256849571 >> 172.21.15.87:0/2256849571 conn(0x7fa1d40709a0 msgr2=0x7fa1d4152360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.863+0000 7fa1d8864640 1 -- 172.21.15.87:0/2256849571 shutdown_connections 2023-12-16T20:21:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.863+0000 7fa1d8864640 1 -- 172.21.15.87:0/2256849571 wait complete. 2023-12-16T20:21:56.875 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T20:21:56.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.974+0000 7fef34aec640 1 Processor -- start 2023-12-16T20:21:56.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.974+0000 7fef34aec640 1 -- start start 2023-12-16T20:21:56.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.975+0000 7fef34aec640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef301519d0 0x7fef3006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:56.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.975+0000 7fef34aec640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3006ff90 con 0x7fef301515f0 2023-12-16T20:21:56.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.975+0000 7fef34aec640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3006f980 con 0x7fef3006dde0 2023-12-16T20:21:56.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.975+0000 7fef34aec640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef300c40b0 con 0x7fef301519d0 2023-12-16T20:21:56.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.976+0000 7fef2e59c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fef301515f0 0x7fef3006a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34478/0 (socket says 172.21.15.87:34478) 2023-12-16T20:21:56.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.976+0000 7fef2e59c640 1 -- 172.21.15.87:0/1337240788 learned_addr learned my addr 172.21.15.87:0/1337240788 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:56.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.976+0000 7fef2dd9b640 1 --2- 172.21.15.87:0/1337240788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef301519d0 0x7fef3006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:56.980 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.979+0000 7fef2d59a640 1 -- 172.21.15.87:0/1337240788 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392132044 0 0) 0x7fef3006ff90 con 0x7fef301515f0 2023-12-16T20:21:56.980 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.979+0000 7fef2d59a640 1 -- 172.21.15.87:0/1337240788 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef18003520 con 0x7fef301515f0 2023-12-16T20:21:56.980 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.979+0000 7fef2d59a640 1 -- 172.21.15.87:0/1337240788 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490674284 0 0) 0x7fef3006f980 con 0x7fef3006dde0 2023-12-16T20:21:56.980 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.979+0000 7fef2dd9b640 1 -- 172.21.15.87:0/1337240788 >> v1:172.21.15.195:6789/0 conn(0x7fef3006dde0 legacy=0x7fef30161e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:56.980 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.979+0000 7fef2dd9b640 1 -- 172.21.15.87:0/1337240788 >> v1:172.21.15.87:6789/0 conn(0x7fef301515f0 legacy=0x7fef3006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:56.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.979+0000 7fef2dd9b640 1 -- 172.21.15.87:0/1337240788 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3006e810 con 0x7fef301519d0 2023-12-16T20:21:56.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.981+0000 7fef2dd9b640 1 --2- 172.21.15.87:0/1337240788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef301519d0 0x7fef3006b0b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fef200097d0 tx=0x7fef2002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=472155ae9e7c5f80 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:56.986 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.985+0000 7fef2d59a640 1 -- 172.21.15.87:0/1337240788 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef20031890 con 0x7fef301519d0 2023-12-16T20:21:56.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.985+0000 7fef2d59a640 1 -- 172.21.15.87:0/1337240788 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef200319f0 con 0x7fef301519d0 2023-12-16T20:21:56.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.985+0000 7fef2d59a640 1 -- 172.21.15.87:0/1337240788 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef20031d80 con 0x7fef301519d0 2023-12-16T20:21:56.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.985+0000 7fef34aec640 1 -- 172.21.15.87:0/1337240788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef301519d0 msgr2=0x7fef3006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:56.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.985+0000 7fef34aec640 1 --2- 172.21.15.87:0/1337240788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef301519d0 0x7fef3006b0b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fef200097d0 tx=0x7fef2002b930 comp rx=0 tx=0).stop 2023-12-16T20:21:56.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.985+0000 7fef34aec640 1 -- 172.21.15.87:0/1337240788 shutdown_connections 2023-12-16T20:21:56.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.985+0000 7fef34aec640 1 --2- 172.21.15.87:0/1337240788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef301519d0 0x7fef3006b0b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:56.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.985+0000 7fef34aec640 1 -- 172.21.15.87:0/1337240788 >> 172.21.15.87:0/1337240788 conn(0x7fef300cbf60 msgr2=0x7fef300cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:56.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.985+0000 7fef34aec640 1 -- 172.21.15.87:0/1337240788 shutdown_connections 2023-12-16T20:21:56.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.985+0000 7fef34aec640 1 -- 172.21.15.87:0/1337240788 wait complete. 2023-12-16T20:21:56.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.987+0000 7fef34aec640 1 Processor -- start 2023-12-16T20:21:56.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.987+0000 7fef34aec640 1 -- start start 2023-12-16T20:21:56.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.987+0000 7fef34aec640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef3006dde0 0x7fef30154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:56.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.987+0000 7fef34aec640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef301515f0 0x7fef30154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:56.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.987+0000 7fef34aec640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef301519d0 0x7fef301f2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:56.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.987+0000 7fef34aec640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef301532f0 con 0x7fef3006dde0 2023-12-16T20:21:56.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.987+0000 7fef34aec640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef300c2d80 con 0x7fef301519d0 2023-12-16T20:21:56.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.987+0000 7fef34aec640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef30153540 con 0x7fef301515f0 2023-12-16T20:21:56.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.988+0000 7fef2e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef3006dde0 0x7fef30154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:56.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.988+0000 7fef2dd9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef301515f0 0x7fef30154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:56.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.988+0000 7fef2ed9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef301519d0 0x7fef301f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:56.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.988+0000 7fef2dd9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef301515f0 0x7fef30154840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:56168/0 (socket says 172.21.15.87:56168) 2023-12-16T20:21:56.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.988+0000 7fef2dd9b640 1 -- 172.21.15.87:0/1532865377 learned_addr learned my addr 172.21.15.87:0/1532865377 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:56.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.992+0000 7fef2e59c640 1 -- 172.21.15.87:0/1532865377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef301515f0 msgr2=0x7fef30154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:56.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.992+0000 7fef2e59c640 1 --2- 172.21.15.87:0/1532865377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef301515f0 0x7fef30154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:56.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.992+0000 7fef2e59c640 1 -- 172.21.15.87:0/1532865377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef301519d0 msgr2=0x7fef301f2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:56.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.992+0000 7fef2e59c640 1 --2- 172.21.15.87:0/1532865377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef301519d0 0x7fef301f2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:56.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.992+0000 7fef2e59c640 1 -- 172.21.15.87:0/1532865377 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef20009400 con 0x7fef3006dde0 2023-12-16T20:21:56.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.994+0000 7fef2e59c640 1 --2- 172.21.15.87:0/1532865377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef3006dde0 0x7fef30154300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef2400c400 tx=0x7fef2400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:56.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.998+0000 7fef1effd640 1 -- 172.21.15.87:0/1532865377 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24005ce0 con 0x7fef3006dde0 2023-12-16T20:21:56.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.998+0000 7fef1effd640 1 -- 172.21.15.87:0/1532865377 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef24005e40 con 0x7fef3006dde0 2023-12-16T20:21:56.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.998+0000 7fef1effd640 1 -- 172.21.15.87:0/1532865377 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef240072f0 con 0x7fef3006dde0 2023-12-16T20:21:56.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.998+0000 7fef34aec640 1 -- 172.21.15.87:0/1532865377 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef30153820 con 0x7fef3006dde0 2023-12-16T20:21:56.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.998+0000 7fef34aec640 1 -- 172.21.15.87:0/1532865377 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef30153de0 con 0x7fef3006dde0 2023-12-16T20:21:57.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:56.999+0000 7fef34aec640 1 -- 172.21.15.87:0/1532865377 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef30153fd0 con 0x7fef3006dde0 2023-12-16T20:21:57.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.017+0000 7fef1effd640 1 -- 172.21.15.87:0/1532865377 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fef24007450 con 0x7fef3006dde0 2023-12-16T20:21:57.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.018+0000 7fef1effd640 1 --2- 172.21.15.87:0/1532865377 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fef1006ae90 0x7fef1006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:57.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.018+0000 7fef2dd9b640 1 --2- 172.21.15.87:0/1532865377 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fef1006ae90 0x7fef1006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:57.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.018+0000 7fef2dd9b640 1 --2- 172.21.15.87:0/1532865377 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fef1006ae90 0x7fef1006d350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fef2002b970 tx=0x7fef2003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:57.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.252+0000 7fef1effd640 1 -- 172.21.15.87:0/1532865377 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fef24058100 con 0x7fef3006dde0 2023-12-16T20:21:57.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.253+0000 7fef1effd640 1 -- 172.21.15.87:0/1532865377 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fef24054440 con 0x7fef3006dde0 2023-12-16T20:21:57.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.434+0000 7fef34aec640 1 -- 172.21.15.87:0/1532865377 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fef30067500 con 0x7fef3006dde0 2023-12-16T20:21:57.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.438+0000 7fef1effd640 1 -- 172.21.15.87:0/1532865377 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fef24017020 con 0x7fef3006dde0 2023-12-16T20:21:57.440 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2023-12-16T20:21:57.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.440+0000 7fef34aec640 1 -- 172.21.15.87:0/1532865377 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fef1006ae90 msgr2=0x7fef1006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:57.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.440+0000 7fef34aec640 1 --2- 172.21.15.87:0/1532865377 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fef1006ae90 0x7fef1006d350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fef2002b970 tx=0x7fef2003d040 comp rx=0 tx=0).stop 2023-12-16T20:21:57.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.440+0000 7fef34aec640 1 -- 172.21.15.87:0/1532865377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef3006dde0 msgr2=0x7fef30154300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:57.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.440+0000 7fef34aec640 1 --2- 172.21.15.87:0/1532865377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef3006dde0 0x7fef30154300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef2400c400 tx=0x7fef2400c8c0 comp rx=0 tx=0).stop 2023-12-16T20:21:57.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.440+0000 7fef34aec640 1 -- 172.21.15.87:0/1532865377 shutdown_connections 2023-12-16T20:21:57.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.440+0000 7fef34aec640 1 --2- 172.21.15.87:0/1532865377 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fef1006ae90 0x7fef1006d350 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:57.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.440+0000 7fef34aec640 1 --2- 172.21.15.87:0/1532865377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef301519d0 0x7fef301f2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:57.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.440+0000 7fef34aec640 1 --2- 172.21.15.87:0/1532865377 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef301515f0 0x7fef30154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:57.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.440+0000 7fef34aec640 1 --2- 172.21.15.87:0/1532865377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef3006dde0 0x7fef30154300 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:57.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.440+0000 7fef34aec640 1 -- 172.21.15.87:0/1532865377 >> 172.21.15.87:0/1532865377 conn(0x7fef300cbf60 msgr2=0x7fef300c4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:57.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.440+0000 7fef34aec640 1 -- 172.21.15.87:0/1532865377 shutdown_connections 2023-12-16T20:21:57.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.440+0000 7fef34aec640 1 -- 172.21.15.87:0/1532865377 wait complete. 2023-12-16T20:21:57.452 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2023-12-16T20:21:57.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:57.453 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-16T20:21:57.478 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi087.stderr:ceph-fuse[94047]: fuse finished with error 0 and tester_r 0 2023-12-16T20:21:57.479 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:21:57.527 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2023-12-16T20:21:57.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:21:57.527 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-16T20:21:57.545 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:21:57.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.683+0000 7fc3adb61640 1 Processor -- start 2023-12-16T20:21:57.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.683+0000 7fc3adb61640 1 -- start start 2023-12-16T20:21:57.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.683+0000 7fc3adb61640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc3a8151630 0x7fc3a806f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:57.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.683+0000 7fc3adb61640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3a80c2000 0x7fc3a80c2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:57.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.683+0000 7fc3adb61640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a80c29b0 con 0x7fc3a8157f50 2023-12-16T20:21:57.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.683+0000 7fc3adb61640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a815b9c0 con 0x7fc3a8151630 2023-12-16T20:21:57.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.683+0000 7fc3adb61640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a81583c0 con 0x7fc3a80c2000 2023-12-16T20:21:57.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.684+0000 7fc3a77fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc3a8151630 0x7fc3a806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:57.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.684+0000 7fc3a7fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3a80c2000 0x7fc3a80c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:57.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.684+0000 7fc3a7fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3a80c2000 0x7fc3a80c2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:56172/0 (socket says 172.21.15.87:56172) 2023-12-16T20:21:57.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.684+0000 7fc3a7fff640 1 -- 172.21.15.87:0/3964334399 learned_addr learned my addr 172.21.15.87:0/3964334399 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:57.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.687+0000 7fc3a77fe640 1 -- 172.21.15.87:0/3964334399 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3a80c2000 msgr2=0x7fc3a80c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:57.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.687+0000 7fc3a77fe640 1 --2- 172.21.15.87:0/3964334399 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3a80c2000 0x7fc3a80c2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:57.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.687+0000 7fc3a77fe640 1 -- 172.21.15.87:0/3964334399 >> v1:172.21.15.87:6789/0 conn(0x7fc3a8157f50 legacy=0x7fc3a80c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:57.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.687+0000 7fc3a77fe640 1 -- 172.21.15.87:0/3964334399 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a815ab60 con 0x7fc3a8151630 2023-12-16T20:21:57.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.691+0000 7fc3a77fe640 1 --2- 172.21.15.87:0/3964334399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3a8151630 0x7fc3a806f590 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc398009d90 tx=0x7fc39802bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3676737b5b564f5d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:57.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.695+0000 7fc3a67fc640 1 -- 172.21.15.87:0/3964334399 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39802cce0 con 0x7fc3a8151630 2023-12-16T20:21:57.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.695+0000 7fc3a67fc640 1 -- 172.21.15.87:0/3964334399 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39802ce40 con 0x7fc3a8151630 2023-12-16T20:21:57.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.695+0000 7fc3a67fc640 1 -- 172.21.15.87:0/3964334399 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398034660 con 0x7fc3a8151630 2023-12-16T20:21:57.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.696+0000 7fc3adb61640 1 -- 172.21.15.87:0/3964334399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3a8151630 msgr2=0x7fc3a806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:57.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.696+0000 7fc3adb61640 1 --2- 172.21.15.87:0/3964334399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3a8151630 0x7fc3a806f590 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc398009d90 tx=0x7fc39802bf30 comp rx=0 tx=0).stop 2023-12-16T20:21:57.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.696+0000 7fc3adb61640 1 -- 172.21.15.87:0/3964334399 shutdown_connections 2023-12-16T20:21:57.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.696+0000 7fc3adb61640 1 --2- 172.21.15.87:0/3964334399 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3a80c2000 0x7fc3a80c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:57.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.696+0000 7fc3adb61640 1 --2- 172.21.15.87:0/3964334399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3a8151630 0x7fc3a806f590 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:57.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.696+0000 7fc3adb61640 1 -- 172.21.15.87:0/3964334399 >> 172.21.15.87:0/3964334399 conn(0x7fc3a8061100 msgr2=0x7fc3a80614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:57.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.696+0000 7fc3adb61640 1 -- 172.21.15.87:0/3964334399 shutdown_connections 2023-12-16T20:21:57.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.696+0000 7fc3adb61640 1 -- 172.21.15.87:0/3964334399 wait complete. 2023-12-16T20:21:57.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.697+0000 7fc3adb61640 1 Processor -- start 2023-12-16T20:21:57.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.697+0000 7fc3adb61640 1 -- start start 2023-12-16T20:21:57.699 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.698+0000 7fc3adb61640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a80c2000 0x7fc3a806d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:57.699 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.698+0000 7fc3adb61640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3a8151630 0x7fc3a80c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:57.699 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.698+0000 7fc3adb61640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3a8157f50 0x7fc3a81f1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:57.699 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.698+0000 7fc3adb61640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a8159170 con 0x7fc3a80c2000 2023-12-16T20:21:57.699 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.698+0000 7fc3adb61640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a814c490 con 0x7fc3a8157f50 2023-12-16T20:21:57.699 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.698+0000 7fc3adb61640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a81593a0 con 0x7fc3a8151630 2023-12-16T20:21:57.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.699+0000 7fc3a7fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3a8157f50 0x7fc3a81f1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:57.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.699+0000 7fc3a6ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3a8151630 0x7fc3a80c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:57.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.699+0000 7fc3a6ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3a8151630 0x7fc3a80c4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:56176/0 (socket says 172.21.15.87:56176) 2023-12-16T20:21:57.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.699+0000 7fc3a6ffd640 1 -- 172.21.15.87:0/3914491440 learned_addr learned my addr 172.21.15.87:0/3914491440 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:57.704 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.703+0000 7fc3a6ffd640 1 -- 172.21.15.87:0/3914491440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3a8157f50 msgr2=0x7fc3a81f1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:57.704 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.703+0000 7fc3a6ffd640 1 --2- 172.21.15.87:0/3914491440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3a8157f50 0x7fc3a81f1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:57.704 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.703+0000 7fc3a6ffd640 1 -- 172.21.15.87:0/3914491440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a80c2000 msgr2=0x7fc3a806d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:57.704 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.703+0000 7fc3a6ffd640 1 --2- 172.21.15.87:0/3914491440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a80c2000 0x7fc3a806d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:57.704 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.703+0000 7fc3a6ffd640 1 -- 172.21.15.87:0/3914491440 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc398009a70 con 0x7fc3a8151630 2023-12-16T20:21:57.706 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.705+0000 7fc3a6ffd640 1 --2- 172.21.15.87:0/3914491440 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3a8151630 0x7fc3a80c4ef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc39000c400 tx=0x7fc39000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:57.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.713+0000 7fc39ffff640 1 -- 172.21.15.87:0/3914491440 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3900052d0 con 0x7fc3a8151630 2023-12-16T20:21:57.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.713+0000 7fc39ffff640 1 -- 172.21.15.87:0/3914491440 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc390005450 con 0x7fc3a8151630 2023-12-16T20:21:57.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.713+0000 7fc39ffff640 1 -- 172.21.15.87:0/3914491440 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc390007260 con 0x7fc3a8151630 2023-12-16T20:21:57.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.713+0000 7fc3adb61640 1 -- 172.21.15.87:0/3914491440 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a8159680 con 0x7fc3a8151630 2023-12-16T20:21:57.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.713+0000 7fc3adb61640 1 -- 172.21.15.87:0/3914491440 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a8159c40 con 0x7fc3a8151630 2023-12-16T20:21:57.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:57.714+0000 7fc3adb61640 1 -- 172.21.15.87:0/3914491440 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a80740e0 con 0x7fc3a8151630 2023-12-16T20:21:58.005 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.004+0000 7fc39ffff640 1 -- 172.21.15.87:0/3914491440 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fc3900073c0 con 0x7fc3a8151630 2023-12-16T20:21:58.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.004+0000 7fc39ffff640 1 --2- 172.21.15.87:0/3914491440 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc38806ae70 0x7fc38806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:58.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.004+0000 7fc3a77fe640 1 --2- 172.21.15.87:0/3914491440 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc38806ae70 0x7fc38806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:58.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.004+0000 7fc3a77fe640 1 --2- 172.21.15.87:0/3914491440 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc38806ae70 0x7fc38806d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc398036000 tx=0x7fc39802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:58.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.006+0000 7fc39ffff640 1 -- 172.21.15.87:0/3914491440 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc390058090 con 0x7fc3a8151630 2023-12-16T20:21:58.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.018+0000 7fc39ffff640 1 -- 172.21.15.87:0/3914491440 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fc3900543d0 con 0x7fc3a8151630 2023-12-16T20:21:58.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.188+0000 7fc3adb61640 1 -- 172.21.15.87:0/3914491440 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3a8159dd0 con 0x7fc3a8151630 2023-12-16T20:21:58.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.225+0000 7fc39ffff640 1 -- 172.21.15.87:0/3914491440 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fc390020070 con 0x7fc3a8151630 2023-12-16T20:21:58.226 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:21:58.227 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:21:41.431615+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:21:22.654341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T20:21:33.728787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T20:21:34.846119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T20:21:38.657738+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:21:58.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.226+0000 7fc3adb61640 1 -- 172.21.15.87:0/3914491440 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc38806ae70 msgr2=0x7fc38806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:58.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.226+0000 7fc3adb61640 1 --2- 172.21.15.87:0/3914491440 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc38806ae70 0x7fc38806d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc398036000 tx=0x7fc39802e000 comp rx=0 tx=0).stop 2023-12-16T20:21:58.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.227+0000 7fc3adb61640 1 -- 172.21.15.87:0/3914491440 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3a8151630 msgr2=0x7fc3a80c4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:58.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.227+0000 7fc3adb61640 1 --2- 172.21.15.87:0/3914491440 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3a8151630 0x7fc3a80c4ef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc39000c400 tx=0x7fc39000c8c0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.227+0000 7fc3adb61640 1 -- 172.21.15.87:0/3914491440 shutdown_connections 2023-12-16T20:21:58.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.227+0000 7fc3adb61640 1 --2- 172.21.15.87:0/3914491440 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc38806ae70 0x7fc38806d330 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.227+0000 7fc3adb61640 1 --2- 172.21.15.87:0/3914491440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3a8157f50 0x7fc3a81f1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.227+0000 7fc3adb61640 1 --2- 172.21.15.87:0/3914491440 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3a8151630 0x7fc3a80c4ef0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.227+0000 7fc3adb61640 1 --2- 172.21.15.87:0/3914491440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a80c2000 0x7fc3a806d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.227+0000 7fc3adb61640 1 -- 172.21.15.87:0/3914491440 >> 172.21.15.87:0/3914491440 conn(0x7fc3a8061100 msgr2=0x7fc3a80614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:58.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.227+0000 7fc3adb61640 1 -- 172.21.15.87:0/3914491440 shutdown_connections 2023-12-16T20:21:58.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.227+0000 7fc3adb61640 1 -- 172.21.15.87:0/3914491440 wait complete. 2023-12-16T20:21:58.240 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:21:58.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.343+0000 7fb699ae0640 1 Processor -- start 2023-12-16T20:21:58.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.343+0000 7fb699ae0640 1 -- start start 2023-12-16T20:21:58.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.344+0000 7fb699ae0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb69406f590 0x7fb694157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:58.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.344+0000 7fb699ae0640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb6940c2000 0x7fb6940c2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:58.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.344+0000 7fb699ae0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69406fa00 con 0x7fb694151630 2023-12-16T20:21:58.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.344+0000 7fb699ae0640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb694158490 con 0x7fb69406f590 2023-12-16T20:21:58.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.344+0000 7fb699ae0640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69415b9c0 con 0x7fb6940c2000 2023-12-16T20:21:58.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.344+0000 7fb6937fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb694151630 0x7fb6940c9bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34500/0 (socket says 172.21.15.87:34500) 2023-12-16T20:21:58.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.344+0000 7fb693fff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb6940c2000 0x7fb6940c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:58.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.344+0000 7fb6937fe640 1 -- 172.21.15.87:0/800789467 learned_addr learned my addr 172.21.15.87:0/800789467 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:58.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.344+0000 7fb68bfff640 1 --2- 172.21.15.87:0/800789467 >> v2:172.21.15.87:3300/0 conn(0x7fb69406f590 0x7fb694157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:58.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.347+0000 7fb693fff640 1 -- 172.21.15.87:0/800789467 >> v2:172.21.15.87:3300/0 conn(0x7fb69406f590 msgr2=0x7fb694157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:21:58.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.347+0000 7fb693fff640 1 --2- 172.21.15.87:0/800789467 >> v2:172.21.15.87:3300/0 conn(0x7fb69406f590 0x7fb694157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.347+0000 7fb693fff640 1 -- 172.21.15.87:0/800789467 >> v1:172.21.15.87:6789/0 conn(0x7fb694151630 legacy=0x7fb6940c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:58.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.347+0000 7fb693fff640 1 -- 172.21.15.87:0/800789467 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6940c2970 con 0x7fb6940c2000 2023-12-16T20:21:58.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.349+0000 7fb693fff640 1 --2- 172.21.15.87:0/800789467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6940c2000 0x7fb6940c2430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb694070710 tx=0x7fb68c02bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9d7e1ec1106d438 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:58.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.353+0000 7fb692ffd640 1 -- 172.21.15.87:0/800789467 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c02cd00 con 0x7fb6940c2000 2023-12-16T20:21:58.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.353+0000 7fb692ffd640 1 -- 172.21.15.87:0/800789467 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c02ce60 con 0x7fb6940c2000 2023-12-16T20:21:58.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.353+0000 7fb692ffd640 1 -- 172.21.15.87:0/800789467 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c034660 con 0x7fb6940c2000 2023-12-16T20:21:58.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.353+0000 7fb699ae0640 1 -- 172.21.15.87:0/800789467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6940c2000 msgr2=0x7fb6940c2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:58.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.353+0000 7fb699ae0640 1 --2- 172.21.15.87:0/800789467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6940c2000 0x7fb6940c2430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb694070710 tx=0x7fb68c02bf50 comp rx=0 tx=0).stop 2023-12-16T20:21:58.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.353+0000 7fb699ae0640 1 -- 172.21.15.87:0/800789467 shutdown_connections 2023-12-16T20:21:58.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.353+0000 7fb699ae0640 1 --2- 172.21.15.87:0/800789467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6940c2000 0x7fb6940c2430 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.353+0000 7fb699ae0640 1 --2- 172.21.15.87:0/800789467 >> v2:172.21.15.87:3300/0 conn(0x7fb69406f590 0x7fb694157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.353+0000 7fb699ae0640 1 -- 172.21.15.87:0/800789467 >> 172.21.15.87:0/800789467 conn(0x7fb694061100 msgr2=0x7fb6940614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:58.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.354+0000 7fb699ae0640 1 -- 172.21.15.87:0/800789467 shutdown_connections 2023-12-16T20:21:58.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.354+0000 7fb699ae0640 1 -- 172.21.15.87:0/800789467 wait complete. 2023-12-16T20:21:58.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.355+0000 7fb699ae0640 1 Processor -- start 2023-12-16T20:21:58.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.355+0000 7fb699ae0640 1 -- start start 2023-12-16T20:21:58.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.355+0000 7fb699ae0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb69406f590 0x7fb6940cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:58.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.355+0000 7fb699ae0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6940c2000 0x7fb694145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:58.359 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.355+0000 7fb699ae0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb694151630 0x7fb6941457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:58.359 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.355+0000 7fb699ae0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940b1790 con 0x7fb69406f590 2023-12-16T20:21:58.359 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.355+0000 7fb699ae0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940c6500 con 0x7fb694151630 2023-12-16T20:21:58.359 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.355+0000 7fb699ae0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69406f290 con 0x7fb6940c2000 2023-12-16T20:21:58.359 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.356+0000 7fb6937fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb69406f590 0x7fb6940cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:58.359 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.356+0000 7fb693fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb694151630 0x7fb6941457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:58.359 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.356+0000 7fb68bfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6940c2000 0x7fb694145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:58.359 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.356+0000 7fb6937fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb69406f590 0x7fb6940cbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46798/0 (socket says 172.21.15.87:46798) 2023-12-16T20:21:58.359 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.356+0000 7fb6937fe640 1 -- 172.21.15.87:0/2053226226 learned_addr learned my addr 172.21.15.87:0/2053226226 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:58.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.359+0000 7fb6937fe640 1 -- 172.21.15.87:0/2053226226 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6940c2000 msgr2=0x7fb694145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:58.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.359+0000 7fb6937fe640 1 --2- 172.21.15.87:0/2053226226 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6940c2000 0x7fb694145270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.359+0000 7fb6937fe640 1 -- 172.21.15.87:0/2053226226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb694151630 msgr2=0x7fb6941457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:58.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.359+0000 7fb6937fe640 1 --2- 172.21.15.87:0/2053226226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb694151630 0x7fb6941457b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.359+0000 7fb6937fe640 1 -- 172.21.15.87:0/2053226226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c009a70 con 0x7fb69406f590 2023-12-16T20:21:58.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.361+0000 7fb6937fe640 1 --2- 172.21.15.87:0/2053226226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb69406f590 0x7fb6940cbef0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb68400c3f0 tx=0x7fb68400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:58.366 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.365+0000 7fb690ff9640 1 -- 172.21.15.87:0/2053226226 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb684005ce0 con 0x7fb69406f590 2023-12-16T20:21:58.366 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.365+0000 7fb690ff9640 1 -- 172.21.15.87:0/2053226226 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb684005e40 con 0x7fb69406f590 2023-12-16T20:21:58.366 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.365+0000 7fb690ff9640 1 -- 172.21.15.87:0/2053226226 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6840072f0 con 0x7fb69406f590 2023-12-16T20:21:58.366 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.365+0000 7fb699ae0640 1 -- 172.21.15.87:0/2053226226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6940b14b0 con 0x7fb69406f590 2023-12-16T20:21:58.366 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.365+0000 7fb699ae0640 1 -- 172.21.15.87:0/2053226226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69406b740 con 0x7fb69406f590 2023-12-16T20:21:58.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.366+0000 7fb699ae0640 1 -- 172.21.15.87:0/2053226226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6940740e0 con 0x7fb69406f590 2023-12-16T20:21:58.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.384+0000 7fb690ff9640 1 -- 172.21.15.87:0/2053226226 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fb684007450 con 0x7fb69406f590 2023-12-16T20:21:58.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.384+0000 7fb690ff9640 1 --2- 172.21.15.87:0/2053226226 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb67406ae90 0x7fb67406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:58.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.384+0000 7fb68bfff640 1 --2- 172.21.15.87:0/2053226226 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb67406ae90 0x7fb67406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:58.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.385+0000 7fb68bfff640 1 --2- 172.21.15.87:0/2053226226 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb67406ae90 0x7fb67406d350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb6941460b0 tx=0x7fb67c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:58.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.388+0000 7fb690ff9640 1 -- 172.21.15.87:0/2053226226 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb684057d80 con 0x7fb69406f590 2023-12-16T20:21:58.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.620+0000 7fb690ff9640 1 -- 172.21.15.87:0/2053226226 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fb6840540c0 con 0x7fb69406f590 2023-12-16T20:21:58.797 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.796+0000 7fb699ae0640 1 -- 172.21.15.87:0/2053226226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6940c5350 con 0x7fb69406f590 2023-12-16T20:21:58.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.833+0000 7fb690ff9640 1 -- 172.21.15.87:0/2053226226 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fb684017090 con 0x7fb69406f590 2023-12-16T20:21:58.835 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:21:58.835 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:21:41.431615+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:21:22.654341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T20:21:33.728787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T20:21:34.846119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T20:21:38.657738+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:21:58.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.835+0000 7fb699ae0640 1 -- 172.21.15.87:0/2053226226 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb67406ae90 msgr2=0x7fb67406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:58.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.835+0000 7fb699ae0640 1 --2- 172.21.15.87:0/2053226226 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb67406ae90 0x7fb67406d350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb6941460b0 tx=0x7fb67c009190 comp rx=0 tx=0).stop 2023-12-16T20:21:58.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.835+0000 7fb699ae0640 1 -- 172.21.15.87:0/2053226226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb69406f590 msgr2=0x7fb6940cbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:58.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.835+0000 7fb699ae0640 1 --2- 172.21.15.87:0/2053226226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb69406f590 0x7fb6940cbef0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb68400c3f0 tx=0x7fb68400c8b0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.835+0000 7fb699ae0640 1 -- 172.21.15.87:0/2053226226 shutdown_connections 2023-12-16T20:21:58.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.835+0000 7fb699ae0640 1 --2- 172.21.15.87:0/2053226226 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fb67406ae90 0x7fb67406d350 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.835+0000 7fb699ae0640 1 --2- 172.21.15.87:0/2053226226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb694151630 0x7fb6941457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.835+0000 7fb699ae0640 1 --2- 172.21.15.87:0/2053226226 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb6940c2000 0x7fb694145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.835+0000 7fb699ae0640 1 --2- 172.21.15.87:0/2053226226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb69406f590 0x7fb6940cbef0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.835+0000 7fb699ae0640 1 -- 172.21.15.87:0/2053226226 >> 172.21.15.87:0/2053226226 conn(0x7fb694061100 msgr2=0x7fb6940c3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:58.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.835+0000 7fb699ae0640 1 -- 172.21.15.87:0/2053226226 shutdown_connections 2023-12-16T20:21:58.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.835+0000 7fb699ae0640 1 -- 172.21.15.87:0/2053226226 wait complete. 2023-12-16T20:21:58.848 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-16T20:21:58.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.950+0000 7fd6e89a9640 1 Processor -- start 2023-12-16T20:21:58.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.950+0000 7fd6e89a9640 1 -- start start 2023-12-16T20:21:58.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.951+0000 7fd6e89a9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e4153c70 0x7fd6e415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:58.953 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.951+0000 7fd6e89a9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e415a700 con 0x7fd6e40ceef0 2023-12-16T20:21:58.953 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.951+0000 7fd6e89a9640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e40ca870 con 0x7fd6e4153890 2023-12-16T20:21:58.953 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.951+0000 7fd6e89a9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e4159af0 con 0x7fd6e4153c70 2023-12-16T20:21:58.953 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.951+0000 7fd6e2d9d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd6e40ceef0 0x7fd6e415aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34504/0 (socket says 172.21.15.87:34504) 2023-12-16T20:21:58.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.951+0000 7fd6e2d9d640 1 -- 172.21.15.87:0/2921544340 learned_addr learned my addr 172.21.15.87:0/2921544340 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:21:58.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.953+0000 7fd6e1d9b640 1 --2- 172.21.15.87:0/2921544340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e4153c70 0x7fd6e415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:58.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.954+0000 7fd6e159a640 1 -- 172.21.15.87:0/2921544340 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120812690 0 0) 0x7fd6e415a700 con 0x7fd6e40ceef0 2023-12-16T20:21:58.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.954+0000 7fd6e159a640 1 -- 172.21.15.87:0/2921544340 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6cc003520 con 0x7fd6e40ceef0 2023-12-16T20:21:58.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.955+0000 7fd6e1d9b640 1 -- 172.21.15.87:0/2921544340 >> v1:172.21.15.195:6789/0 conn(0x7fd6e4153890 legacy=0x7fd6e40c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:58.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.955+0000 7fd6e1d9b640 1 -- 172.21.15.87:0/2921544340 >> v1:172.21.15.87:6789/0 conn(0x7fd6e40ceef0 legacy=0x7fd6e415aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:58.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.955+0000 7fd6e1d9b640 1 -- 172.21.15.87:0/2921544340 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e4159dd0 con 0x7fd6e4153c70 2023-12-16T20:21:58.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.957+0000 7fd6e1d9b640 1 --2- 172.21.15.87:0/2921544340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e4153c70 0x7fd6e415d950 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80097d0 tx=0x7fd6d802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a569af5ae54ab685 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:58.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.961+0000 7fd6e159a640 1 -- 172.21.15.87:0/2921544340 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8030880 con 0x7fd6e4153c70 2023-12-16T20:21:58.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.961+0000 7fd6e159a640 1 -- 172.21.15.87:0/2921544340 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d80309e0 con 0x7fd6e4153c70 2023-12-16T20:21:58.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.961+0000 7fd6e159a640 1 -- 172.21.15.87:0/2921544340 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8030d70 con 0x7fd6e4153c70 2023-12-16T20:21:58.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.962+0000 7fd6e89a9640 1 -- 172.21.15.87:0/2921544340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e4153c70 msgr2=0x7fd6e415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:58.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.962+0000 7fd6e89a9640 1 --2- 172.21.15.87:0/2921544340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e4153c70 0x7fd6e415d950 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80097d0 tx=0x7fd6d802b9c0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.962+0000 7fd6e89a9640 1 -- 172.21.15.87:0/2921544340 shutdown_connections 2023-12-16T20:21:58.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.962+0000 7fd6e89a9640 1 --2- 172.21.15.87:0/2921544340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e4153c70 0x7fd6e415d950 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.962+0000 7fd6e89a9640 1 -- 172.21.15.87:0/2921544340 >> 172.21.15.87:0/2921544340 conn(0x7fd6e406ba00 msgr2=0x7fd6e406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:21:58.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.962+0000 7fd6e89a9640 1 -- 172.21.15.87:0/2921544340 shutdown_connections 2023-12-16T20:21:58.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.962+0000 7fd6e89a9640 1 -- 172.21.15.87:0/2921544340 wait complete. 2023-12-16T20:21:58.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.963+0000 7fd6e89a9640 1 Processor -- start 2023-12-16T20:21:58.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.964+0000 7fd6e89a9640 1 -- start start 2023-12-16T20:21:58.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.964+0000 7fd6e89a9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6e40ceef0 0x7fd6e40ce980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:58.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.964+0000 7fd6e89a9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6e4153890 0x7fd6e414f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:58.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.964+0000 7fd6e89a9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e4153c70 0x7fd6e40b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:58.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.964+0000 7fd6e89a9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e40ce260 con 0x7fd6e4153890 2023-12-16T20:21:58.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.964+0000 7fd6e89a9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e41f3dc0 con 0x7fd6e40ceef0 2023-12-16T20:21:58.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.964+0000 7fd6e89a9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e4152b40 con 0x7fd6e4153c70 2023-12-16T20:21:58.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.965+0000 7fd6e2d9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e4153c70 0x7fd6e40b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:58.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.965+0000 7fd6e259c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6e40ceef0 0x7fd6e40ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:58.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.965+0000 7fd6e2d9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e4153c70 0x7fd6e40b3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:56198/0 (socket says 172.21.15.87:56198) 2023-12-16T20:21:58.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.965+0000 7fd6e2d9d640 1 -- 172.21.15.87:0/2240981761 learned_addr learned my addr 172.21.15.87:0/2240981761 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:21:58.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.968+0000 7fd6e2d9d640 1 -- 172.21.15.87:0/2240981761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6e40ceef0 msgr2=0x7fd6e40ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:58.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.968+0000 7fd6e2d9d640 1 --2- 172.21.15.87:0/2240981761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6e40ceef0 0x7fd6e40ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.968+0000 7fd6e2d9d640 1 -- 172.21.15.87:0/2240981761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6e4153890 msgr2=0x7fd6e414f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:21:58.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.968+0000 7fd6e2d9d640 1 --2- 172.21.15.87:0/2240981761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6e4153890 0x7fd6e414f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:21:58.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.968+0000 7fd6e2d9d640 1 -- 172.21.15.87:0/2240981761 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d8009400 con 0x7fd6e4153c70 2023-12-16T20:21:58.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.971+0000 7fd6e2d9d640 1 --2- 172.21.15.87:0/2240981761 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e4153c70 0x7fd6e40b3150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc00cb40 tx=0x7fd6dc00a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:58.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.973+0000 7fd6d2ffd640 1 -- 172.21.15.87:0/2240981761 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc00aca0 con 0x7fd6e4153c70 2023-12-16T20:21:58.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.973+0000 7fd6e89a9640 1 -- 172.21.15.87:0/2240981761 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e41f3ae0 con 0x7fd6e4153c70 2023-12-16T20:21:58.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.973+0000 7fd6e89a9640 1 -- 172.21.15.87:0/2240981761 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e40cdb80 con 0x7fd6e4153c70 2023-12-16T20:21:58.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.974+0000 7fd6e89a9640 1 -- 172.21.15.87:0/2240981761 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e4067500 con 0x7fd6e4153c70 2023-12-16T20:21:58.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.974+0000 7fd6d2ffd640 1 -- 172.21.15.87:0/2240981761 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc001c00 con 0x7fd6e4153c70 2023-12-16T20:21:58.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:58.974+0000 7fd6d2ffd640 1 -- 172.21.15.87:0/2240981761 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc01c640 con 0x7fd6e4153c70 2023-12-16T20:21:59.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:59.216+0000 7fd6d2ffd640 1 -- 172.21.15.87:0/2240981761 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fd6dc012400 con 0x7fd6e4153c70 2023-12-16T20:21:59.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:59.217+0000 7fd6d2ffd640 1 --2- 172.21.15.87:0/2240981761 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd6c406ae40 0x7fd6c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:21:59.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:59.217+0000 7fd6e259c640 1 --2- 172.21.15.87:0/2240981761 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd6c406ae40 0x7fd6c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:21:59.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:59.217+0000 7fd6e259c640 1 --2- 172.21.15.87:0/2240981761 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd6c406ae40 0x7fd6c406d300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4000f60 tx=0x7fd6d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:21:59.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:59.221+0000 7fd6d2ffd640 1 -- 172.21.15.87:0/2240981761 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd6dc058c40 con 0x7fd6e4153c70 2023-12-16T20:21:59.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:59.234+0000 7fd6d2ffd640 1 -- 172.21.15.87:0/2240981761 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fd6dc054f80 con 0x7fd6e4153c70 2023-12-16T20:21:59.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:21:59.439+0000 7fd6e89a9640 1 -- 172.21.15.87:0/2240981761 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd6e40cde80 con 0x7fd6e4153c70 2023-12-16T20:22:00.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.083+0000 7fd6d2ffd640 1 -- 172.21.15.87:0/2240981761 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd6dc0585a0 con 0x7fd6e4153c70 2023-12-16T20:22:00.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.084+0000 7fd6e89a9640 1 -- 172.21.15.87:0/2240981761 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd6c406ae40 msgr2=0x7fd6c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:00.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.084+0000 7fd6e89a9640 1 --2- 172.21.15.87:0/2240981761 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd6c406ae40 0x7fd6c406d300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4000f60 tx=0x7fd6d4009040 comp rx=0 tx=0).stop 2023-12-16T20:22:00.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.084+0000 7fd6e89a9640 1 -- 172.21.15.87:0/2240981761 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e4153c70 msgr2=0x7fd6e40b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:00.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.084+0000 7fd6e89a9640 1 --2- 172.21.15.87:0/2240981761 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e4153c70 0x7fd6e40b3150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc00cb40 tx=0x7fd6dc00a060 comp rx=0 tx=0).stop 2023-12-16T20:22:00.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.084+0000 7fd6e89a9640 1 -- 172.21.15.87:0/2240981761 shutdown_connections 2023-12-16T20:22:00.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.084+0000 7fd6e89a9640 1 --2- 172.21.15.87:0/2240981761 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e4153c70 0x7fd6e40b3150 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:00.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.084+0000 7fd6e89a9640 1 --2- 172.21.15.87:0/2240981761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6e4153890 0x7fd6e414f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:00.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.084+0000 7fd6e89a9640 1 --2- 172.21.15.87:0/2240981761 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd6c406ae40 0x7fd6c406d300 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:00.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.084+0000 7fd6e89a9640 1 --2- 172.21.15.87:0/2240981761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6e40ceef0 0x7fd6e40ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:00.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.084+0000 7fd6e89a9640 1 -- 172.21.15.87:0/2240981761 >> 172.21.15.87:0/2240981761 conn(0x7fd6e406ba00 msgr2=0x7fd6e4157dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:00.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.085+0000 7fd6e89a9640 1 -- 172.21.15.87:0/2240981761 shutdown_connections 2023-12-16T20:22:00.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.085+0000 7fd6e89a9640 1 -- 172.21.15.87:0/2240981761 wait complete. 2023-12-16T20:22:00.097 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300} 2023-12-16T20:22:00.097 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-16T20:22:00.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.199+0000 7f1ece2b4640 1 Processor -- start 2023-12-16T20:22:00.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.199+0000 7f1ece2b4640 1 -- start start 2023-12-16T20:22:00.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.200+0000 7f1ece2b4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1ec814fd70 0x7f1ec8070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:00.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.200+0000 7f1ece2b4640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1ec8159760 0x7f1ec8159b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:00.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.200+0000 7f1ece2b4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec8071420 con 0x7f1ec8071c40 2023-12-16T20:22:00.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.200+0000 7f1ece2b4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec8155b20 con 0x7f1ec814fd70 2023-12-16T20:22:00.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.200+0000 7f1ece2b4640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec815a0c0 con 0x7f1ec8159760 2023-12-16T20:22:00.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.201+0000 7f1ec7fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1ec814fd70 0x7f1ec8070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:00.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.201+0000 7f1ec77fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f1ec8071c40 0x7f1ec80c7970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34520/0 (socket says 172.21.15.87:34520) 2023-12-16T20:22:00.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.201+0000 7f1ec77fe640 1 -- 172.21.15.87:0/538595889 learned_addr learned my addr 172.21.15.87:0/538595889 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:00.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.201+0000 7f1ecc851640 1 --2- 172.21.15.87:0/538595889 >> v2:172.21.15.195:3300/0 conn(0x7f1ec8159760 0x7f1ec8159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:00.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.204+0000 7f1ecc851640 1 -- 172.21.15.87:0/538595889 >> v2:172.21.15.87:3300/0 conn(0x7f1ec814fd70 msgr2=0x7f1ec8070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:00.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.204+0000 7f1ecc851640 1 --2- 172.21.15.87:0/538595889 >> v2:172.21.15.87:3300/0 conn(0x7f1ec814fd70 0x7f1ec8070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:00.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.204+0000 7f1ecc851640 1 -- 172.21.15.87:0/538595889 >> v1:172.21.15.87:6789/0 conn(0x7f1ec8071c40 legacy=0x7f1ec80c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:00.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.204+0000 7f1ecc851640 1 -- 172.21.15.87:0/538595889 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec81592d0 con 0x7f1ec8159760 2023-12-16T20:22:00.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.206+0000 7f1ecc851640 1 --2- 172.21.15.87:0/538595889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ec8159760 0x7f1ec8159b80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1ec806f9b0 tx=0x7f1ec002bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c98835aef4f40f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:00.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.209+0000 7f1ec6ffd640 1 -- 172.21.15.87:0/538595889 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec002cb60 con 0x7f1ec8159760 2023-12-16T20:22:00.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.209+0000 7f1ec6ffd640 1 -- 172.21.15.87:0/538595889 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec002ccc0 con 0x7f1ec8159760 2023-12-16T20:22:00.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.209+0000 7f1ec6ffd640 1 -- 172.21.15.87:0/538595889 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0034660 con 0x7f1ec8159760 2023-12-16T20:22:00.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.210+0000 7f1ece2b4640 1 -- 172.21.15.87:0/538595889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ec8159760 msgr2=0x7f1ec8159b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:00.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.210+0000 7f1ece2b4640 1 --2- 172.21.15.87:0/538595889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ec8159760 0x7f1ec8159b80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1ec806f9b0 tx=0x7f1ec002bdb0 comp rx=0 tx=0).stop 2023-12-16T20:22:00.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.210+0000 7f1ece2b4640 1 -- 172.21.15.87:0/538595889 shutdown_connections 2023-12-16T20:22:00.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.210+0000 7f1ece2b4640 1 --2- 172.21.15.87:0/538595889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ec8159760 0x7f1ec8159b80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:00.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.210+0000 7f1ece2b4640 1 --2- 172.21.15.87:0/538595889 >> v2:172.21.15.87:3300/0 conn(0x7f1ec814fd70 0x7f1ec8070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:00.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.210+0000 7f1ece2b4640 1 -- 172.21.15.87:0/538595889 >> 172.21.15.87:0/538595889 conn(0x7f1ec806cd60 msgr2=0x7f1ec806d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:00.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.210+0000 7f1ece2b4640 1 -- 172.21.15.87:0/538595889 shutdown_connections 2023-12-16T20:22:00.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.210+0000 7f1ece2b4640 1 -- 172.21.15.87:0/538595889 wait complete. 2023-12-16T20:22:00.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.211+0000 7f1ece2b4640 1 Processor -- start 2023-12-16T20:22:00.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.211+0000 7f1ece2b4640 1 -- start start 2023-12-16T20:22:00.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.212+0000 7f1ece2b4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ec8071c40 0x7f1ec8145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:00.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.212+0000 7f1ece2b4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ec814fd70 0x7f1ec81f0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:00.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.212+0000 7f1ece2b4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ec8159760 0x7f1ec8073850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:00.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.212+0000 7f1ece2b4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec80c4dd0 con 0x7f1ec814fd70 2023-12-16T20:22:00.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.212+0000 7f1ece2b4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec80c29d0 con 0x7f1ec8071c40 2023-12-16T20:22:00.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.212+0000 7f1ece2b4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec814c0e0 con 0x7f1ec8159760 2023-12-16T20:22:00.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.212+0000 7f1ec77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ec814fd70 0x7f1ec81f0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:00.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.212+0000 7f1ecc851640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ec8159760 0x7f1ec8073850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:00.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.213+0000 7f1ec7fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ec8071c40 0x7f1ec8145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:00.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.213+0000 7f1ec77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ec814fd70 0x7f1ec81f0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46820/0 (socket says 172.21.15.87:46820) 2023-12-16T20:22:00.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.213+0000 7f1ec77fe640 1 -- 172.21.15.87:0/4239024038 learned_addr learned my addr 172.21.15.87:0/4239024038 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:00.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.216+0000 7f1ec77fe640 1 -- 172.21.15.87:0/4239024038 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ec8159760 msgr2=0x7f1ec8073850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:00.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.216+0000 7f1ec77fe640 1 --2- 172.21.15.87:0/4239024038 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ec8159760 0x7f1ec8073850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:00.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.216+0000 7f1ec77fe640 1 -- 172.21.15.87:0/4239024038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ec8071c40 msgr2=0x7f1ec8145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:00.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.216+0000 7f1ec77fe640 1 --2- 172.21.15.87:0/4239024038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ec8071c40 0x7f1ec8145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:00.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.216+0000 7f1ec77fe640 1 -- 172.21.15.87:0/4239024038 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec0009a70 con 0x7f1ec814fd70 2023-12-16T20:22:00.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.218+0000 7f1ec77fe640 1 --2- 172.21.15.87:0/4239024038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ec814fd70 0x7f1ec81f0c30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00c400 tx=0x7f1ebc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:00.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.220+0000 7f1ec4ff9640 1 -- 172.21.15.87:0/4239024038 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc005ce0 con 0x7f1ec814fd70 2023-12-16T20:22:00.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.220+0000 7f1ece2b4640 1 -- 172.21.15.87:0/4239024038 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec8146130 con 0x7f1ec814fd70 2023-12-16T20:22:00.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.220+0000 7f1ece2b4640 1 -- 172.21.15.87:0/4239024038 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec814be00 con 0x7f1ec814fd70 2023-12-16T20:22:00.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.221+0000 7f1ece2b4640 1 -- 172.21.15.87:0/4239024038 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec8067500 con 0x7f1ec814fd70 2023-12-16T20:22:00.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.222+0000 7f1ec4ff9640 1 -- 172.21.15.87:0/4239024038 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc005e40 con 0x7f1ec814fd70 2023-12-16T20:22:00.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.222+0000 7f1ec4ff9640 1 -- 172.21.15.87:0/4239024038 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc007270 con 0x7f1ec814fd70 2023-12-16T20:22:00.465 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.464+0000 7f1ec4ff9640 1 -- 172.21.15.87:0/4239024038 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f1ebc007490 con 0x7f1ec814fd70 2023-12-16T20:22:00.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.464+0000 7f1ec4ff9640 1 --2- 172.21.15.87:0/4239024038 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1eb406ae40 0x7f1eb406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:00.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.464+0000 7f1ec7fff640 1 --2- 172.21.15.87:0/4239024038 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1eb406ae40 0x7f1eb406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:00.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.465+0000 7f1ec7fff640 1 --2- 172.21.15.87:0/4239024038 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1eb406ae40 0x7f1eb406d300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800ac40 tx=0x7f1eb800a2a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:00.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.478+0000 7f1ec4ff9640 1 -- 172.21.15.87:0/4239024038 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ebc058000 con 0x7f1ec814fd70 2023-12-16T20:22:00.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.478+0000 7f1ec4ff9640 1 -- 172.21.15.87:0/4239024038 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f1ebc054340 con 0x7f1ec814fd70 2023-12-16T20:22:00.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:00.689+0000 7f1ece2b4640 1 -- 172.21.15.87:0/4239024038 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1ec8071420 con 0x7f1ec814fd70 2023-12-16T20:22:01.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.108+0000 7f1ec4ff9640 1 -- 172.21.15.87:0/4239024038 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1ec8071420 con 0x7f1ec814fd70 2023-12-16T20:22:01.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.110+0000 7f1ece2b4640 1 -- 172.21.15.87:0/4239024038 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1eb406ae40 msgr2=0x7f1eb406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:01.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.110+0000 7f1ece2b4640 1 --2- 172.21.15.87:0/4239024038 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1eb406ae40 0x7f1eb406d300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800ac40 tx=0x7f1eb800a2a0 comp rx=0 tx=0).stop 2023-12-16T20:22:01.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.110+0000 7f1ece2b4640 1 -- 172.21.15.87:0/4239024038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ec814fd70 msgr2=0x7f1ec81f0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:01.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.110+0000 7f1ece2b4640 1 --2- 172.21.15.87:0/4239024038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ec814fd70 0x7f1ec81f0c30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00c400 tx=0x7f1ebc00c8c0 comp rx=0 tx=0).stop 2023-12-16T20:22:01.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.110+0000 7f1ece2b4640 1 -- 172.21.15.87:0/4239024038 shutdown_connections 2023-12-16T20:22:01.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.110+0000 7f1ece2b4640 1 --2- 172.21.15.87:0/4239024038 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ec8159760 0x7f1ec8073850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:01.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.110+0000 7f1ece2b4640 1 --2- 172.21.15.87:0/4239024038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ec814fd70 0x7f1ec81f0c30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:01.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.110+0000 7f1ece2b4640 1 --2- 172.21.15.87:0/4239024038 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1eb406ae40 0x7f1eb406d300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:01.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.110+0000 7f1ece2b4640 1 --2- 172.21.15.87:0/4239024038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ec8071c40 0x7f1ec8145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:01.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.110+0000 7f1ece2b4640 1 -- 172.21.15.87:0/4239024038 >> 172.21.15.87:0/4239024038 conn(0x7f1ec806cd60 msgr2=0x7f1ec806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:01.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.110+0000 7f1ece2b4640 1 -- 172.21.15.87:0/4239024038 shutdown_connections 2023-12-16T20:22:01.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.110+0000 7f1ece2b4640 1 -- 172.21.15.87:0/4239024038 wait complete. 2023-12-16T20:22:01.123 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-12-16T20:22:01.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.225+0000 7f204cbea640 1 Processor -- start 2023-12-16T20:22:01.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.225+0000 7f204cbea640 1 -- start start 2023-12-16T20:22:01.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.226+0000 7f204cbea640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f20481537d0 0x7f204806a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:01.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.226+0000 7f204cbea640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204806e0f0 con 0x7f204806f160 2023-12-16T20:22:01.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.226+0000 7f204cbea640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2048159710 con 0x7f20480c2e40 2023-12-16T20:22:01.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.226+0000 7f204cbea640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20480c72d0 con 0x7f20481537d0 2023-12-16T20:22:01.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.226+0000 7f2046d9d640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f20480c2e40 0x7f2048163f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:44816/0 (socket says 172.21.15.87:44816) 2023-12-16T20:22:01.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.226+0000 7f2046d9d640 1 -- 172.21.15.87:0/2577471137 learned_addr learned my addr 172.21.15.87:0/2577471137 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:01.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.227+0000 7f204659c640 1 --2- 172.21.15.87:0/2577471137 >> v2:172.21.15.87:3300/0 conn(0x7f20481537d0 0x7f204806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:01.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.229+0000 7f2045d9b640 1 -- 172.21.15.87:0/2577471137 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166747931 0 0) 0x7f2048159710 con 0x7f20480c2e40 2023-12-16T20:22:01.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.229+0000 7f2045d9b640 1 -- 172.21.15.87:0/2577471137 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2034003520 con 0x7f20480c2e40 2023-12-16T20:22:01.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.232+0000 7f204659c640 1 -- 172.21.15.87:0/2577471137 >> v1:172.21.15.195:6789/0 conn(0x7f20480c2e40 legacy=0x7f2048163f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:01.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.232+0000 7f204659c640 1 -- 172.21.15.87:0/2577471137 >> v1:172.21.15.87:6789/0 conn(0x7f204806f160 legacy=0x7f2048159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:01.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.232+0000 7f204659c640 1 -- 172.21.15.87:0/2577471137 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20480c7590 con 0x7f20481537d0 2023-12-16T20:22:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.235+0000 7f204659c640 1 --2- 172.21.15.87:0/2577471137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20481537d0 0x7f204806a500 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f20380097a0 tx=0x7f203802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92df4fe0baa9d27 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.240+0000 7f2045d9b640 1 -- 172.21.15.87:0/2577471137 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203802f810 con 0x7f20481537d0 2023-12-16T20:22:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.240+0000 7f2045d9b640 1 -- 172.21.15.87:0/2577471137 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203802f970 con 0x7f20481537d0 2023-12-16T20:22:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.240+0000 7f2045d9b640 1 -- 172.21.15.87:0/2577471137 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203802fd00 con 0x7f20481537d0 2023-12-16T20:22:01.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.241+0000 7f204cbea640 1 -- 172.21.15.87:0/2577471137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20481537d0 msgr2=0x7f204806a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:01.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.241+0000 7f204cbea640 1 --2- 172.21.15.87:0/2577471137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20481537d0 0x7f204806a500 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f20380097a0 tx=0x7f203802b9f0 comp rx=0 tx=0).stop 2023-12-16T20:22:01.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.241+0000 7f204cbea640 1 -- 172.21.15.87:0/2577471137 shutdown_connections 2023-12-16T20:22:01.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.241+0000 7f204cbea640 1 --2- 172.21.15.87:0/2577471137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20481537d0 0x7f204806a500 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.241+0000 7f204cbea640 1 -- 172.21.15.87:0/2577471137 >> 172.21.15.87:0/2577471137 conn(0x7f20480cbf60 msgr2=0x7f20480cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.241+0000 7f204cbea640 1 -- 172.21.15.87:0/2577471137 shutdown_connections 2023-12-16T20:22:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.241+0000 7f204cbea640 1 -- 172.21.15.87:0/2577471137 wait complete. 2023-12-16T20:22:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.242+0000 7f204cbea640 1 Processor -- start 2023-12-16T20:22:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.242+0000 7f204cbea640 1 -- start start 2023-12-16T20:22:01.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.243+0000 7f204cbea640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f204806f160 0x7f20480c5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:01.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.243+0000 7f204cbea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20480c2e40 0x7f204815c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:01.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.243+0000 7f204cbea640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20481537d0 0x7f20480c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:01.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.243+0000 7f204cbea640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20481ef580 con 0x7f204806f160 2023-12-16T20:22:01.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.243+0000 7f204cbea640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20481ef860 con 0x7f20481537d0 2023-12-16T20:22:01.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.243+0000 7f204cbea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20481efb40 con 0x7f20480c2e40 2023-12-16T20:22:01.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.243+0000 7f204659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f204806f160 0x7f20480c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:01.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.243+0000 7f203ffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20480c2e40 0x7f204815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:01.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.243+0000 7f2046d9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20481537d0 0x7f20480c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:01.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.243+0000 7f204659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f204806f160 0x7f20480c5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55468/0 (socket says 172.21.15.87:55468) 2023-12-16T20:22:01.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.243+0000 7f204659c640 1 -- 172.21.15.87:0/3456643552 learned_addr learned my addr 172.21.15.87:0/3456643552 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:01.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.247+0000 7f204659c640 1 -- 172.21.15.87:0/3456643552 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20480c2e40 msgr2=0x7f204815c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:01.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.247+0000 7f204659c640 1 --2- 172.21.15.87:0/3456643552 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20480c2e40 0x7f204815c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:01.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.247+0000 7f204659c640 1 -- 172.21.15.87:0/3456643552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20481537d0 msgr2=0x7f20480c3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:01.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.247+0000 7f204659c640 1 --2- 172.21.15.87:0/3456643552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20481537d0 0x7f20480c3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:01.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.247+0000 7f204659c640 1 -- 172.21.15.87:0/3456643552 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2038009400 con 0x7f204806f160 2023-12-16T20:22:01.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.250+0000 7f204659c640 1 --2- 172.21.15.87:0/3456643552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f204806f160 0x7f20480c5310 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f20380098c0 tx=0x7f20380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:01.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.253+0000 7f203effd640 1 -- 172.21.15.87:0/3456643552 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038046070 con 0x7f204806f160 2023-12-16T20:22:01.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.253+0000 7f203effd640 1 -- 172.21.15.87:0/3456643552 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20380376d0 con 0x7f204806f160 2023-12-16T20:22:01.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.253+0000 7f203effd640 1 -- 172.21.15.87:0/3456643552 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203803b040 con 0x7f204806f160 2023-12-16T20:22:01.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.253+0000 7f204cbea640 1 -- 172.21.15.87:0/3456643552 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20481efe20 con 0x7f204806f160 2023-12-16T20:22:01.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.253+0000 7f204cbea640 1 -- 172.21.15.87:0/3456643552 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204815c770 con 0x7f204806f160 2023-12-16T20:22:01.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.254+0000 7f204cbea640 1 -- 172.21.15.87:0/3456643552 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20480c3790 con 0x7f204806f160 2023-12-16T20:22:01.274 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.273+0000 7f203effd640 1 -- 172.21.15.87:0/3456643552 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f2038037a80 con 0x7f204806f160 2023-12-16T20:22:01.274 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.273+0000 7f203effd640 1 --2- 172.21.15.87:0/3456643552 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f202806ae90 0x7f202806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:01.274 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.273+0000 7f203ffff640 1 --2- 172.21.15.87:0/3456643552 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f202806ae90 0x7f202806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:01.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.273+0000 7f203ffff640 1 --2- 172.21.15.87:0/3456643552 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f202806ae90 0x7f202806d350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f20480cc9a0 tx=0x7f2030009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:01.510 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.509+0000 7f203effd640 1 -- 172.21.15.87:0/3456643552 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2038043e20 con 0x7f204806f160 2023-12-16T20:22:01.511 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.509+0000 7f203effd640 1 -- 172.21.15.87:0/3456643552 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f20380775d0 con 0x7f204806f160 2023-12-16T20:22:01.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:01.715+0000 7f204cbea640 1 -- 172.21.15.87:0/3456643552 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f20480c3790 con 0x7f204806f160 2023-12-16T20:22:02.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.122+0000 7f203effd640 1 -- 172.21.15.87:0/3456643552 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v10) v1 ==== 115+0+0 (secure 0 0 0) 0x7f20480c3790 con 0x7f204806f160 2023-12-16T20:22:02.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.124+0000 7f204cbea640 1 -- 172.21.15.87:0/3456643552 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f202806ae90 msgr2=0x7f202806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:02.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.124+0000 7f204cbea640 1 --2- 172.21.15.87:0/3456643552 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f202806ae90 0x7f202806d350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f20480cc9a0 tx=0x7f2030009040 comp rx=0 tx=0).stop 2023-12-16T20:22:02.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.124+0000 7f204cbea640 1 -- 172.21.15.87:0/3456643552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f204806f160 msgr2=0x7f20480c5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:02.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.124+0000 7f204cbea640 1 --2- 172.21.15.87:0/3456643552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f204806f160 0x7f20480c5310 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f20380098c0 tx=0x7f20380046c0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.124+0000 7f204cbea640 1 -- 172.21.15.87:0/3456643552 shutdown_connections 2023-12-16T20:22:02.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.124+0000 7f204cbea640 1 --2- 172.21.15.87:0/3456643552 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f202806ae90 0x7f202806d350 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.124+0000 7f204cbea640 1 --2- 172.21.15.87:0/3456643552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20481537d0 0x7f20480c3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.124+0000 7f204cbea640 1 --2- 172.21.15.87:0/3456643552 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20480c2e40 0x7f204815c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.124+0000 7f204cbea640 1 --2- 172.21.15.87:0/3456643552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f204806f160 0x7f20480c5310 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.124+0000 7f204cbea640 1 -- 172.21.15.87:0/3456643552 >> 172.21.15.87:0/3456643552 conn(0x7f20480cbf60 msgr2=0x7f20480c81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:02.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.124+0000 7f204cbea640 1 -- 172.21.15.87:0/3456643552 shutdown_connections 2023-12-16T20:22:02.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.124+0000 7f204cbea640 1 -- 172.21.15.87:0/3456643552 wait complete. 2023-12-16T20:22:02.137 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-16T20:22:02.137 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T20:22:02.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.238+0000 7f9e04c0e640 1 Processor -- start 2023-12-16T20:22:02.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.238+0000 7f9e04c0e640 1 -- start start 2023-12-16T20:22:02.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.239+0000 7f9e04c0e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e00153900 0x7f9e000c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:02.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.239+0000 7f9e04c0e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9e00159660 0x7f9e000ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:02.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.239+0000 7f9e04c0e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0015a650 con 0x7f9e000c9360 2023-12-16T20:22:02.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.239+0000 7f9e04c0e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0015ce10 con 0x7f9e00159660 2023-12-16T20:22:02.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.239+0000 7f9e04c0e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0006d190 con 0x7f9e00153900 2023-12-16T20:22:02.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.262+0000 7f9dfed9d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9e000c9360 0x7f9e0015d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54894/0 (socket says 172.21.15.87:54894) 2023-12-16T20:22:02.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.262+0000 7f9dfed9d640 1 -- 172.21.15.87:0/2181768600 learned_addr learned my addr 172.21.15.87:0/2181768600 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.264+0000 7f9dfe59c640 1 --2- 172.21.15.87:0/2181768600 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e00153900 0x7f9e000c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.265+0000 7f9dfdd9b640 1 -- 172.21.15.87:0/2181768600 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3724139085 0 0) 0x7f9e0015a650 con 0x7f9e000c9360 2023-12-16T20:22:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.265+0000 7f9dfdd9b640 1 -- 172.21.15.87:0/2181768600 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dec003520 con 0x7f9e000c9360 2023-12-16T20:22:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.268+0000 7f9dfdd9b640 1 -- 172.21.15.87:0/2181768600 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1614711700 0 0) 0x7f9dec003520 con 0x7f9e000c9360 2023-12-16T20:22:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.268+0000 7f9dfdd9b640 1 -- 172.21.15.87:0/2181768600 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e00153900 msgr2=0x7f9e000c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.268+0000 7f9dfdd9b640 1 --2- 172.21.15.87:0/2181768600 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e00153900 0x7f9e000c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.268+0000 7f9dfdd9b640 1 -- 172.21.15.87:0/2181768600 >> v2:172.21.15.195:3300/0 conn(0x7f9e00159660 msgr2=0x7f9e000ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.268+0000 7f9dfdd9b640 1 --2- 172.21.15.87:0/2181768600 >> v2:172.21.15.195:3300/0 conn(0x7f9e00159660 0x7f9e000ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.268+0000 7f9dfdd9b640 1 -- 172.21.15.87:0/2181768600 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e00159af0 con 0x7f9e000c9360 2023-12-16T20:22:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.268+0000 7f9dfdd9b640 1 -- 172.21.15.87:0/2181768600 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1165302485 0 0) 0x7f9df80019f0 con 0x7f9e000c9360 2023-12-16T20:22:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.268+0000 7f9dfdd9b640 1 -- 172.21.15.87:0/2181768600 >> v1:172.21.15.87:6789/0 conn(0x7f9e000c9360 legacy=0x7f9e0015d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:02.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.268+0000 7f9dfdd9b640 1 --2- 172.21.15.87:0/2181768600 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e00153900 0x7f9dec003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:02.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.268+0000 7f9dfdd9b640 1 --2- 172.21.15.87:0/2181768600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9dec003f40 0x7f9dec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:02.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.268+0000 7f9dfdd9b640 1 --2- 172.21.15.87:0/2181768600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dec004d00 0x7f9dec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:02.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.268+0000 7f9dfdd9b640 1 -- 172.21.15.87:0/2181768600 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0015ce10 con 0x7f9dec004d00 2023-12-16T20:22:02.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.268+0000 7f9dfdd9b640 1 -- 172.21.15.87:0/2181768600 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0006d190 con 0x7f9dec003f40 2023-12-16T20:22:02.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.268+0000 7f9dfdd9b640 1 -- 172.21.15.87:0/2181768600 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec00bb10 con 0x7f9e00153900 2023-12-16T20:22:02.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.273+0000 7f9dfed9d640 1 --2- 172.21.15.87:0/2181768600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dec004d00 0x7f9dec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:02.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.275+0000 7f9dfed9d640 1 -- 172.21.15.87:0/2181768600 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e00153900 msgr2=0x7f9dec003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:02.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.275+0000 7f9dfed9d640 1 --2- 172.21.15.87:0/2181768600 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e00153900 0x7f9dec003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.275+0000 7f9dfed9d640 1 -- 172.21.15.87:0/2181768600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9dec003f40 msgr2=0x7f9dec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:02.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.275+0000 7f9dfed9d640 1 --2- 172.21.15.87:0/2181768600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9dec003f40 0x7f9dec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.275+0000 7f9dfed9d640 1 -- 172.21.15.87:0/2181768600 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec003520 con 0x7f9dec004d00 2023-12-16T20:22:02.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.277+0000 7f9dfed9d640 1 --2- 172.21.15.87:0/2181768600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dec004d00 0x7f9dec005180 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9df80013d0 tx=0x7f9dec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e3276768d3ae6b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:02.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.281+0000 7f9dfdd9b640 1 -- 172.21.15.87:0/2181768600 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df8034630 con 0x7f9dec004d00 2023-12-16T20:22:02.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.281+0000 7f9dfdd9b640 1 -- 172.21.15.87:0/2181768600 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df802f070 con 0x7f9dec004d00 2023-12-16T20:22:02.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.281+0000 7f9dfdd9b640 1 -- 172.21.15.87:0/2181768600 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df8034a50 con 0x7f9dec004d00 2023-12-16T20:22:02.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.281+0000 7f9e04c0e640 1 -- 172.21.15.87:0/2181768600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dec004d00 msgr2=0x7f9dec005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:02.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.281+0000 7f9e04c0e640 1 --2- 172.21.15.87:0/2181768600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dec004d00 0x7f9dec005180 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9df80013d0 tx=0x7f9dec0057f0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.281+0000 7f9dfed9d640 1 -- 172.21.15.87:0/2181768600 reap_dead start 2023-12-16T20:22:02.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.281+0000 7f9e04c0e640 1 -- 172.21.15.87:0/2181768600 shutdown_connections 2023-12-16T20:22:02.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.281+0000 7f9e04c0e640 1 -- 172.21.15.87:0/2181768600 >> 172.21.15.87:0/2181768600 conn(0x7f9e00061100 msgr2=0x7f9e000614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:02.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.281+0000 7f9e04c0e640 1 -- 172.21.15.87:0/2181768600 shutdown_connections 2023-12-16T20:22:02.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.281+0000 7f9e04c0e640 1 -- 172.21.15.87:0/2181768600 wait complete. 2023-12-16T20:22:02.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.283+0000 7f9e04c0e640 1 Processor -- start 2023-12-16T20:22:02.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.283+0000 7f9e04c0e640 1 -- start start 2023-12-16T20:22:02.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.284+0000 7f9e04c0e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9dec004d00 0x7f9e00154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:02.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.284+0000 7f9e04c0e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e001e2f60 0x7f9e001f0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:02.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.284+0000 7f9e04c0e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e001f3140 0x7f9e0014adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:02.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.284+0000 7f9e04c0e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e001effb0 con 0x7f9e001e2f60 2023-12-16T20:22:02.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.284+0000 7f9e04c0e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e001f3680 con 0x7f9e001f3140 2023-12-16T20:22:02.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.284+0000 7f9e04c0e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e001f3960 con 0x7f9dec004d00 2023-12-16T20:22:02.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.286+0000 7f9dfed9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e001f3140 0x7f9e0014adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:02.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.287+0000 7f9dfed9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e001f3140 0x7f9e0014adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:39162/0 (socket says 172.21.15.87:39162) 2023-12-16T20:22:02.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.287+0000 7f9dfed9d640 1 -- 172.21.15.87:0/815038899 learned_addr learned my addr 172.21.15.87:0/815038899 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:02.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.291+0000 7f9dfed9d640 1 -- 172.21.15.87:0/815038899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9dec004d00 msgr2=0x7f9e00154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:02.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.291+0000 7f9dfed9d640 1 --2- 172.21.15.87:0/815038899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9dec004d00 0x7f9e00154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.291+0000 7f9dfed9d640 1 -- 172.21.15.87:0/815038899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e001e2f60 msgr2=0x7f9e001f0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:02.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.291+0000 7f9dfed9d640 1 --2- 172.21.15.87:0/815038899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e001e2f60 0x7f9e001f0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.291+0000 7f9dfed9d640 1 -- 172.21.15.87:0/815038899 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e001f3c40 con 0x7f9e001f3140 2023-12-16T20:22:02.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.293+0000 7f9dfed9d640 1 --2- 172.21.15.87:0/815038899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e001f3140 0x7f9e0014adc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9df8001220 tx=0x7f9df8001360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:02.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.297+0000 7f9df6ffd640 1 -- 172.21.15.87:0/815038899 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df8034840 con 0x7f9e001f3140 2023-12-16T20:22:02.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.297+0000 7f9df6ffd640 1 -- 172.21.15.87:0/815038899 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df80349a0 con 0x7f9e001f3140 2023-12-16T20:22:02.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.297+0000 7f9e04c0e640 1 -- 172.21.15.87:0/815038899 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e001f3f20 con 0x7f9e001f3140 2023-12-16T20:22:02.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.297+0000 7f9df6ffd640 1 -- 172.21.15.87:0/815038899 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df8034d10 con 0x7f9e001f3140 2023-12-16T20:22:02.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.297+0000 7f9e04c0e640 1 -- 172.21.15.87:0/815038899 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e001e3580 con 0x7f9e001f3140 2023-12-16T20:22:02.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.298+0000 7f9e04c0e640 1 -- 172.21.15.87:0/815038899 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e001efdb0 con 0x7f9e001f3140 2023-12-16T20:22:02.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.318+0000 7f9df6ffd640 1 -- 172.21.15.87:0/815038899 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f9df8031030 con 0x7f9e001f3140 2023-12-16T20:22:02.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.319+0000 7f9df6ffd640 1 --2- 172.21.15.87:0/815038899 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f9de006aec0 0x7f9de006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:02.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.319+0000 7f9dfe59c640 1 --2- 172.21.15.87:0/815038899 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f9de006aec0 0x7f9de006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:02.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.319+0000 7f9dfe59c640 1 --2- 172.21.15.87:0/815038899 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f9de006aec0 0x7f9de006d380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009a40 tx=0x7f9df0009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:02.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.320+0000 7f9df6ffd640 1 -- 172.21.15.87:0/815038899 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9df80333d0 con 0x7f9e001f3140 2023-12-16T20:22:02.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.558+0000 7f9df6ffd640 1 -- 172.21.15.87:0/815038899 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f9df80775c0 con 0x7f9e001f3140 2023-12-16T20:22:02.765 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.763+0000 7f9e04c0e640 1 -- 172.21.15.87:0/815038899 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e001efdb0 con 0x7f9e001f3140 2023-12-16T20:22:02.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.776+0000 7f9df6ffd640 1 -- 172.21.15.87:0/815038899 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6526 (secure 0 0 0) 0x7f9df807abe0 con 0x7f9e001f3140 2023-12-16T20:22:02.777 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:22:02.778 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2198156124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2198156124},{"type":"v1","addr":"172.21.15.87:6835","nonce":2198156124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3187160209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3187160209},{"type":"v1","addr":"172.21.15.195:6833","nonce":3187160209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3703236183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":3703236183},{"type":"v1","addr":"172.21.15.87:6837","nonce":3703236183}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1942743723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1942743723},{"type":"v1","addr":"172.21.15.87:6839","nonce":1942743723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/3327792325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3327792325},{"type":"v1","addr":"172.21.15.195:6836","nonce":3327792325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T20:21:36.158936+0000","modified":"2023-12-16T20:22:01.721931+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6837/3093855583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3093855583},{"type":"v1","addr":"172.21.15.195:6837","nonce":3093855583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T20:22:02.778 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 10 2023-12-16T20:22:02.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.778+0000 7f9e04c0e640 1 -- 172.21.15.87:0/815038899 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f9de006aec0 msgr2=0x7f9de006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:02.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.778+0000 7f9e04c0e640 1 --2- 172.21.15.87:0/815038899 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f9de006aec0 0x7f9de006d380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009a40 tx=0x7f9df0009500 comp rx=0 tx=0).stop 2023-12-16T20:22:02.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.778+0000 7f9e04c0e640 1 -- 172.21.15.87:0/815038899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e001f3140 msgr2=0x7f9e0014adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:02.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.778+0000 7f9e04c0e640 1 --2- 172.21.15.87:0/815038899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e001f3140 0x7f9e0014adc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9df8001220 tx=0x7f9df8001360 comp rx=0 tx=0).stop 2023-12-16T20:22:02.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.778+0000 7f9e04c0e640 1 -- 172.21.15.87:0/815038899 shutdown_connections 2023-12-16T20:22:02.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.778+0000 7f9e04c0e640 1 --2- 172.21.15.87:0/815038899 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f9de006aec0 0x7f9de006d380 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.778+0000 7f9e04c0e640 1 --2- 172.21.15.87:0/815038899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e001f3140 0x7f9e0014adc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.778+0000 7f9e04c0e640 1 --2- 172.21.15.87:0/815038899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e001e2f60 0x7f9e001f0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.778+0000 7f9e04c0e640 1 --2- 172.21.15.87:0/815038899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9dec004d00 0x7f9e00154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.778+0000 7f9e04c0e640 1 -- 172.21.15.87:0/815038899 >> 172.21.15.87:0/815038899 conn(0x7f9e00061100 msgr2=0x7f9e00151210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:02.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.778+0000 7f9e04c0e640 1 -- 172.21.15.87:0/815038899 shutdown_connections 2023-12-16T20:22:02.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.778+0000 7f9e04c0e640 1 -- 172.21.15.87:0/815038899 wait complete. 2023-12-16T20:22:02.791 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:22:02.890 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.889+0000 7fc461b78640 1 Processor -- start 2023-12-16T20:22:02.891 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.889+0000 7fc461b78640 1 -- start start 2023-12-16T20:22:02.891 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.890+0000 7fc461b78640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45c06fa00 0x7fc45c0c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:02.891 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.890+0000 7fc461b78640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc45c0c5e60 0x7fc45c0c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:02.891 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.890+0000 7fc461b78640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45c159fa0 con 0x7fc45c153be0 2023-12-16T20:22:02.891 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.890+0000 7fc461b78640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45c0c3340 con 0x7fc45c0c5e60 2023-12-16T20:22:02.892 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.890+0000 7fc461b78640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c153fc0 con 0x7fc45c06fa00 2023-12-16T20:22:02.892 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.891+0000 7fc45affd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45c06fa00 0x7fc45c0c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:02.892 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.891+0000 7fc45b7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc45c153be0 0x7fc45c159890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54906/0 (socket says 172.21.15.87:54906) 2023-12-16T20:22:02.892 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.891+0000 7fc45b7fe640 1 -- 172.21.15.87:0/257401092 learned_addr learned my addr 172.21.15.87:0/257401092 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:02.892 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.891+0000 7fc45bfff640 1 --2- 172.21.15.87:0/257401092 >> v2:172.21.15.87:3300/0 conn(0x7fc45c0c5e60 0x7fc45c0c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:02.894 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.893+0000 7fc45affd640 1 -- 172.21.15.87:0/257401092 >> v2:172.21.15.87:3300/0 conn(0x7fc45c0c5e60 msgr2=0x7fc45c0c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:02.894 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.893+0000 7fc45affd640 1 --2- 172.21.15.87:0/257401092 >> v2:172.21.15.87:3300/0 conn(0x7fc45c0c5e60 0x7fc45c0c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.895 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.893+0000 7fc45affd640 1 -- 172.21.15.87:0/257401092 >> v1:172.21.15.87:6789/0 conn(0x7fc45c153be0 legacy=0x7fc45c159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:02.895 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.893+0000 7fc45affd640 1 -- 172.21.15.87:0/257401092 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c06b7b0 con 0x7fc45c06fa00 2023-12-16T20:22:02.896 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.895+0000 7fc45affd640 1 --2- 172.21.15.87:0/257401092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45c06fa00 0x7fc45c0c41b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc4500097a0 tx=0x7fc45002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d6542bfd06ff87e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:02.900 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.898+0000 7fc45a7fc640 1 -- 172.21.15.87:0/257401092 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450031830 con 0x7fc45c06fa00 2023-12-16T20:22:02.900 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.898+0000 7fc45a7fc640 1 -- 172.21.15.87:0/257401092 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc450031990 con 0x7fc45c06fa00 2023-12-16T20:22:02.900 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.899+0000 7fc45a7fc640 1 -- 172.21.15.87:0/257401092 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450031d20 con 0x7fc45c06fa00 2023-12-16T20:22:02.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.899+0000 7fc461b78640 1 -- 172.21.15.87:0/257401092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45c06fa00 msgr2=0x7fc45c0c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:02.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.899+0000 7fc461b78640 1 --2- 172.21.15.87:0/257401092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45c06fa00 0x7fc45c0c41b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc4500097a0 tx=0x7fc45002b8d0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.899+0000 7fc461b78640 1 -- 172.21.15.87:0/257401092 shutdown_connections 2023-12-16T20:22:02.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.899+0000 7fc461b78640 1 --2- 172.21.15.87:0/257401092 >> v2:172.21.15.87:3300/0 conn(0x7fc45c0c5e60 0x7fc45c0c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.899+0000 7fc461b78640 1 --2- 172.21.15.87:0/257401092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45c06fa00 0x7fc45c0c41b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.899+0000 7fc461b78640 1 -- 172.21.15.87:0/257401092 >> 172.21.15.87:0/257401092 conn(0x7fc45c0c7f60 msgr2=0x7fc45c0c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:02.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.899+0000 7fc461b78640 1 -- 172.21.15.87:0/257401092 shutdown_connections 2023-12-16T20:22:02.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.899+0000 7fc461b78640 1 -- 172.21.15.87:0/257401092 wait complete. 2023-12-16T20:22:02.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.900+0000 7fc461b78640 1 Processor -- start 2023-12-16T20:22:02.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.901+0000 7fc461b78640 1 -- start start 2023-12-16T20:22:02.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.901+0000 7fc461b78640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45c06fa00 0x7fc45c14b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:02.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.901+0000 7fc461b78640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc45c0c5e60 0x7fc45c0c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:02.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.901+0000 7fc461b78640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc45c153be0 0x7fc45c1574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:02.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.901+0000 7fc461b78640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c1590d0 con 0x7fc45c153be0 2023-12-16T20:22:02.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.901+0000 7fc461b78640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c14b6b0 con 0x7fc45c0c5e60 2023-12-16T20:22:02.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.901+0000 7fc461b78640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c1ef910 con 0x7fc45c06fa00 2023-12-16T20:22:02.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.902+0000 7fc45bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc45c153be0 0x7fc45c1574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:02.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.902+0000 7fc45b7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45c06fa00 0x7fc45c14b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:02.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.902+0000 7fc45bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc45c153be0 0x7fc45c1574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55498/0 (socket says 172.21.15.87:55498) 2023-12-16T20:22:02.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.902+0000 7fc45bfff640 1 -- 172.21.15.87:0/1117510681 learned_addr learned my addr 172.21.15.87:0/1117510681 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:02.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.902+0000 7fc45affd640 1 --2- 172.21.15.87:0/1117510681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc45c0c5e60 0x7fc45c0c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:02.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.905+0000 7fc45bfff640 1 -- 172.21.15.87:0/1117510681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45c06fa00 msgr2=0x7fc45c14b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:02.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.905+0000 7fc45bfff640 1 --2- 172.21.15.87:0/1117510681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45c06fa00 0x7fc45c14b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.905+0000 7fc45bfff640 1 -- 172.21.15.87:0/1117510681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc45c0c5e60 msgr2=0x7fc45c0c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:02.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.905+0000 7fc45bfff640 1 --2- 172.21.15.87:0/1117510681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc45c0c5e60 0x7fc45c0c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:02.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.905+0000 7fc45bfff640 1 -- 172.21.15.87:0/1117510681 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc450009400 con 0x7fc45c153be0 2023-12-16T20:22:02.908 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.908+0000 7fc45bfff640 1 --2- 172.21.15.87:0/1117510681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc45c153be0 0x7fc45c1574f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc45400efc0 tx=0x7fc45400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:02.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.909+0000 7fc443fff640 1 -- 172.21.15.87:0/1117510681 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454009b10 con 0x7fc45c153be0 2023-12-16T20:22:02.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.909+0000 7fc461b78640 1 -- 172.21.15.87:0/1117510681 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45c1f3920 con 0x7fc45c153be0 2023-12-16T20:22:02.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.910+0000 7fc461b78640 1 -- 172.21.15.87:0/1117510681 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45c1efe90 con 0x7fc45c153be0 2023-12-16T20:22:02.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.910+0000 7fc461b78640 1 -- 172.21.15.87:0/1117510681 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45c0c36f0 con 0x7fc45c153be0 2023-12-16T20:22:02.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.911+0000 7fc443fff640 1 -- 172.21.15.87:0/1117510681 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45400f040 con 0x7fc45c153be0 2023-12-16T20:22:02.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:02.911+0000 7fc443fff640 1 -- 172.21.15.87:0/1117510681 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454014680 con 0x7fc45c153be0 2023-12-16T20:22:03.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.151+0000 7fc443fff640 1 -- 172.21.15.87:0/1117510681 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fc4540147e0 con 0x7fc45c153be0 2023-12-16T20:22:03.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.152+0000 7fc443fff640 1 --2- 172.21.15.87:0/1117510681 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc44806ae70 0x7fc44806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:03.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.152+0000 7fc45b7fe640 1 --2- 172.21.15.87:0/1117510681 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc44806ae70 0x7fc44806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:03.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.152+0000 7fc45b7fe640 1 --2- 172.21.15.87:0/1117510681 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc44806ae70 0x7fc44806d330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc44c007fd0 tx=0x7fc44c007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:03.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.165+0000 7fc443fff640 1 -- 172.21.15.87:0/1117510681 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc454059670 con 0x7fc45c153be0 2023-12-16T20:22:03.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.165+0000 7fc443fff640 1 -- 172.21.15.87:0/1117510681 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fc4540559b0 con 0x7fc45c153be0 2023-12-16T20:22:03.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.345+0000 7fc461b78640 1 -- 172.21.15.87:0/1117510681 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc45c067500 con 0x7fc45c153be0 2023-12-16T20:22:03.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.427+0000 7fc443fff640 1 -- 172.21.15.87:0/1117510681 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fc454058fd0 con 0x7fc45c153be0 2023-12-16T20:22:03.429 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:22:03.429 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:21:41.431615+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:21:22.654341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T20:21:33.728787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T20:21:34.846119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T20:21:38.657738+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:22:03.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.430+0000 7fc461b78640 1 -- 172.21.15.87:0/1117510681 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc44806ae70 msgr2=0x7fc44806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:03.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.430+0000 7fc461b78640 1 --2- 172.21.15.87:0/1117510681 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc44806ae70 0x7fc44806d330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc44c007fd0 tx=0x7fc44c007e80 comp rx=0 tx=0).stop 2023-12-16T20:22:03.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.430+0000 7fc461b78640 1 -- 172.21.15.87:0/1117510681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc45c153be0 msgr2=0x7fc45c1574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.430+0000 7fc461b78640 1 --2- 172.21.15.87:0/1117510681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc45c153be0 0x7fc45c1574f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc45400efc0 tx=0x7fc45400c490 comp rx=0 tx=0).stop 2023-12-16T20:22:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.430+0000 7fc461b78640 1 -- 172.21.15.87:0/1117510681 shutdown_connections 2023-12-16T20:22:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.430+0000 7fc461b78640 1 --2- 172.21.15.87:0/1117510681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc45c153be0 0x7fc45c1574f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.430+0000 7fc461b78640 1 --2- 172.21.15.87:0/1117510681 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc44806ae70 0x7fc44806d330 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.430+0000 7fc461b78640 1 --2- 172.21.15.87:0/1117510681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc45c0c5e60 0x7fc45c0c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.430+0000 7fc461b78640 1 --2- 172.21.15.87:0/1117510681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45c06fa00 0x7fc45c14b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.430+0000 7fc461b78640 1 -- 172.21.15.87:0/1117510681 >> 172.21.15.87:0/1117510681 conn(0x7fc45c0c7f60 msgr2=0x7fc45c14cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.430+0000 7fc461b78640 1 -- 172.21.15.87:0/1117510681 shutdown_connections 2023-12-16T20:22:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.430+0000 7fc461b78640 1 -- 172.21.15.87:0/1117510681 wait complete. 2023-12-16T20:22:03.443 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-16T20:22:03.444 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T20:22:03.545 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.544+0000 7f57c824b640 1 Processor -- start 2023-12-16T20:22:03.546 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.544+0000 7f57c824b640 1 -- start start 2023-12-16T20:22:03.546 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.545+0000 7f57c824b640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f57c006f160 0x7f57c0159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:03.546 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.545+0000 7f57c824b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c006e0f0 con 0x7f57c01537d0 2023-12-16T20:22:03.546 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.545+0000 7f57c824b640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c0159710 con 0x7f57c00c2e40 2023-12-16T20:22:03.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.545+0000 7f57c824b640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c00c72d0 con 0x7f57c006f160 2023-12-16T20:22:03.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.545+0000 7f57c5fe7640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f57c01537d0 0x7f57c006a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54918/0 (socket says 172.21.15.87:54918) 2023-12-16T20:22:03.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.545+0000 7f57c5fe7640 1 -- 172.21.15.87:0/3757375378 learned_addr learned my addr 172.21.15.87:0/3757375378 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:03.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.546+0000 7f57c57e6640 1 --2- 172.21.15.87:0/3757375378 >> v2:172.21.15.195:3300/0 conn(0x7f57c006f160 0x7f57c0159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:03.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.548+0000 7f57c4fe5640 1 -- 172.21.15.87:0/3757375378 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959419716 0 0) 0x7f57c006e0f0 con 0x7f57c01537d0 2023-12-16T20:22:03.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.548+0000 7f57c4fe5640 1 -- 172.21.15.87:0/3757375378 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57ac003520 con 0x7f57c01537d0 2023-12-16T20:22:03.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.549+0000 7f57c57e6640 1 -- 172.21.15.87:0/3757375378 >> v1:172.21.15.195:6789/0 conn(0x7f57c00c2e40 legacy=0x7f57c0163f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:03.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.549+0000 7f57c57e6640 1 -- 172.21.15.87:0/3757375378 >> v1:172.21.15.87:6789/0 conn(0x7f57c01537d0 legacy=0x7f57c006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:03.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.549+0000 7f57c57e6640 1 -- 172.21.15.87:0/3757375378 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c00c7590 con 0x7f57c006f160 2023-12-16T20:22:03.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.552+0000 7f57c57e6640 1 --2- 172.21.15.87:0/3757375378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57c006f160 0x7f57c0159bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f57b00097a0 tx=0x7f57b002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a1752d37a20880d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:03.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.556+0000 7f57c4fe5640 1 -- 172.21.15.87:0/3757375378 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b002f810 con 0x7f57c006f160 2023-12-16T20:22:03.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.556+0000 7f57c4fe5640 1 -- 172.21.15.87:0/3757375378 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b002f970 con 0x7f57c006f160 2023-12-16T20:22:03.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.556+0000 7f57c4fe5640 1 -- 172.21.15.87:0/3757375378 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b002fd00 con 0x7f57c006f160 2023-12-16T20:22:03.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.557+0000 7f57c824b640 1 -- 172.21.15.87:0/3757375378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57c006f160 msgr2=0x7f57c0159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:03.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.557+0000 7f57c824b640 1 --2- 172.21.15.87:0/3757375378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57c006f160 0x7f57c0159bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f57b00097a0 tx=0x7f57b002b9f0 comp rx=0 tx=0).stop 2023-12-16T20:22:03.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.557+0000 7f57c824b640 1 -- 172.21.15.87:0/3757375378 shutdown_connections 2023-12-16T20:22:03.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.557+0000 7f57c824b640 1 --2- 172.21.15.87:0/3757375378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57c006f160 0x7f57c0159bf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:03.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.557+0000 7f57c824b640 1 -- 172.21.15.87:0/3757375378 >> 172.21.15.87:0/3757375378 conn(0x7f57c00cbf60 msgr2=0x7f57c00cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:03.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.557+0000 7f57c824b640 1 -- 172.21.15.87:0/3757375378 shutdown_connections 2023-12-16T20:22:03.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.557+0000 7f57c824b640 1 -- 172.21.15.87:0/3757375378 wait complete. 2023-12-16T20:22:03.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.558+0000 7f57c824b640 1 Processor -- start 2023-12-16T20:22:03.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.558+0000 7f57c824b640 1 -- start start 2023-12-16T20:22:03.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.559+0000 7f57c824b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57c006f160 0x7f57c015aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:03.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.559+0000 7f57c824b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57c00c2e40 0x7f57c01f2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:03.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.559+0000 7f57c824b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57c01537d0 0x7f57c00c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:03.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.559+0000 7f57c824b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c01589d0 con 0x7f57c01537d0 2023-12-16T20:22:03.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.559+0000 7f57c824b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0159100 con 0x7f57c00c2e40 2023-12-16T20:22:03.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.559+0000 7f57c824b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0158df0 con 0x7f57c006f160 2023-12-16T20:22:03.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.559+0000 7f57c67e8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57c01537d0 0x7f57c00c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:03.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.559+0000 7f57c5fe7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57c006f160 0x7f57c015aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:03.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.559+0000 7f57c67e8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57c01537d0 0x7f57c00c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55504/0 (socket says 172.21.15.87:55504) 2023-12-16T20:22:03.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.559+0000 7f57c67e8640 1 -- 172.21.15.87:0/1792201379 learned_addr learned my addr 172.21.15.87:0/1792201379 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:03.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.559+0000 7f57c57e6640 1 --2- 172.21.15.87:0/1792201379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57c00c2e40 0x7f57c01f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:03.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.562+0000 7f57c67e8640 1 -- 172.21.15.87:0/1792201379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57c006f160 msgr2=0x7f57c015aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:03.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.562+0000 7f57c67e8640 1 --2- 172.21.15.87:0/1792201379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57c006f160 0x7f57c015aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:03.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.562+0000 7f57c67e8640 1 -- 172.21.15.87:0/1792201379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57c00c2e40 msgr2=0x7f57c01f2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:03.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.562+0000 7f57c67e8640 1 --2- 172.21.15.87:0/1792201379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57c00c2e40 0x7f57c01f2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:03.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.562+0000 7f57c67e8640 1 -- 172.21.15.87:0/1792201379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b0009400 con 0x7f57c01537d0 2023-12-16T20:22:03.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.565+0000 7f57c67e8640 1 --2- 172.21.15.87:0/1792201379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57c01537d0 0x7f57c00c3360 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f57b800c7a0 tx=0x7f57b800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:03.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.568+0000 7f57b67fc640 1 -- 172.21.15.87:0/1792201379 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8003b70 con 0x7f57c01537d0 2023-12-16T20:22:03.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.568+0000 7f57b67fc640 1 -- 172.21.15.87:0/1792201379 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b8003cf0 con 0x7f57c01537d0 2023-12-16T20:22:03.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.568+0000 7f57b67fc640 1 -- 172.21.15.87:0/1792201379 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b800aa90 con 0x7f57c01537d0 2023-12-16T20:22:03.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.568+0000 7f57c824b640 1 -- 172.21.15.87:0/1792201379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c00c61d0 con 0x7f57c01537d0 2023-12-16T20:22:03.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.568+0000 7f57c824b640 1 -- 172.21.15.87:0/1792201379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c00c5ef0 con 0x7f57c01537d0 2023-12-16T20:22:03.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.569+0000 7f57c824b640 1 -- 172.21.15.87:0/1792201379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c0158b10 con 0x7f57c01537d0 2023-12-16T20:22:03.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.587+0000 7f57b67fc640 1 -- 172.21.15.87:0/1792201379 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f57b800abf0 con 0x7f57c01537d0 2023-12-16T20:22:03.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.587+0000 7f57b67fc640 1 --2- 172.21.15.87:0/1792201379 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f57a406ae90 0x7f57a406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:03.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.587+0000 7f57c5fe7640 1 --2- 172.21.15.87:0/1792201379 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f57a406ae90 0x7f57a406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:03.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.588+0000 7f57c5fe7640 1 --2- 172.21.15.87:0/1792201379 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f57a406ae90 0x7f57a406d350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f57bc0011e0 tx=0x7f57bc007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:03.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.589+0000 7f57b67fc640 1 -- 172.21.15.87:0/1792201379 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f57b8005800 con 0x7f57c01537d0 2023-12-16T20:22:03.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.817+0000 7f57b67fc640 1 -- 172.21.15.87:0/1792201379 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f57b8054d90 con 0x7f57c01537d0 2023-12-16T20:22:03.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:03.991+0000 7f57c824b640 1 -- 172.21.15.87:0/1792201379 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f57c006e730 con 0x7f57a406ae90 2023-12-16T20:22:04.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.000+0000 7f57b67fc640 1 -- 172.21.15.87:0/1792201379 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345322 (secure 0 0 0) 0x7f57bc005850 con 0x7f57a406ae90 2023-12-16T20:22:04.006 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:22:04.009 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-12-16T20:22:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.003+0000 7f57c824b640 1 -- 172.21.15.87:0/1792201379 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f57a406ae90 msgr2=0x7f57a406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.003+0000 7f57c824b640 1 --2- 172.21.15.87:0/1792201379 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f57a406ae90 0x7f57a406d350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f57bc0011e0 tx=0x7f57bc007d30 comp rx=0 tx=0).stop 2023-12-16T20:22:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.003+0000 7f57c824b640 1 -- 172.21.15.87:0/1792201379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57c01537d0 msgr2=0x7f57c00c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.003+0000 7f57c824b640 1 --2- 172.21.15.87:0/1792201379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57c01537d0 0x7f57c00c3360 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f57b800c7a0 tx=0x7f57b800cc60 comp rx=0 tx=0).stop 2023-12-16T20:22:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.003+0000 7f57c824b640 1 -- 172.21.15.87:0/1792201379 shutdown_connections 2023-12-16T20:22:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.003+0000 7f57c824b640 1 --2- 172.21.15.87:0/1792201379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57c01537d0 0x7f57c00c3360 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.003+0000 7f57c824b640 1 --2- 172.21.15.87:0/1792201379 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f57a406ae90 0x7f57a406d350 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.003+0000 7f57c824b640 1 --2- 172.21.15.87:0/1792201379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57c00c2e40 0x7f57c01f2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.003+0000 7f57c824b640 1 --2- 172.21.15.87:0/1792201379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57c006f160 0x7f57c015aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.003+0000 7f57c824b640 1 -- 172.21.15.87:0/1792201379 >> 172.21.15.87:0/1792201379 conn(0x7f57c00cbf60 msgr2=0x7f57c00c8230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:04.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.003+0000 7f57c824b640 1 -- 172.21.15.87:0/1792201379 shutdown_connections 2023-12-16T20:22:04.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.003+0000 7f57c824b640 1 -- 172.21.15.87:0/1792201379 wait complete. 2023-12-16T20:22:04.015 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-12-16T20:22:02.283826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595006,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222592,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754752128,"statfs":{"total":773094113280,"available":772866179072,"internally_reserved":0,"allocated":2326528,"data_stored":2025716,"data_compressed":65176,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2228,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002410"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738410+0000","last_change":"2023-12-16T20:21:35.413343+0000","last_active":"2023-12-16T20:21:40.738410+0000","last_peered":"2023-12-16T20:21:40.738410+0000","last_clean":"2023-12-16T20:21:40.738410+0000","last_became_active":"2023-12-16T20:21:35.413075+0000","last_became_peered":"2023-12-16T20:21:35.413075+0000","last_unstale":"2023-12-16T20:21:40.738410+0000","last_undegraded":"2023-12-16T20:21:40.738410+0000","last_fullsized":"2023-12-16T20:21:40.738410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672090+0000","last_change":"2023-12-16T20:21:36.542907+0000","last_active":"2023-12-16T20:21:40.672090+0000","last_peered":"2023-12-16T20:21:40.672090+0000","last_clean":"2023-12-16T20:21:40.672090+0000","last_became_active":"2023-12-16T20:21:36.542667+0000","last_became_peered":"2023-12-16T20:21:36.542667+0000","last_unstale":"2023-12-16T20:21:40.672090+0000","last_undegraded":"2023-12-16T20:21:40.672090+0000","last_fullsized":"2023-12-16T20:21:40.672090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.876874+0000","last_change":"2023-12-16T20:21:41.216466+0000","last_active":"2023-12-16T20:21:41.876874+0000","last_peered":"2023-12-16T20:21:41.876874+0000","last_clean":"2023-12-16T20:21:41.876874+0000","last_became_active":"2023-12-16T20:21:41.216062+0000","last_became_peered":"2023-12-16T20:21:41.216062+0000","last_unstale":"2023-12-16T20:21:41.876874+0000","last_undegraded":"2023-12-16T20:21:41.876874+0000","last_fullsized":"2023-12-16T20:21:41.876874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:33:01.663841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672276+0000","last_change":"2023-12-16T20:21:35.420038+0000","last_active":"2023-12-16T20:21:40.672276+0000","last_peered":"2023-12-16T20:21:40.672276+0000","last_clean":"2023-12-16T20:21:40.672276+0000","last_became_active":"2023-12-16T20:21:35.419745+0000","last_became_peered":"2023-12-16T20:21:35.419745+0000","last_unstale":"2023-12-16T20:21:40.672276+0000","last_undegraded":"2023-12-16T20:21:40.672276+0000","last_fullsized":"2023-12-16T20:21:40.672276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738303+0000","last_change":"2023-12-16T20:21:36.552916+0000","last_active":"2023-12-16T20:21:40.738303+0000","last_peered":"2023-12-16T20:21:40.738303+0000","last_clean":"2023-12-16T20:21:40.738303+0000","last_became_active":"2023-12-16T20:21:36.552621+0000","last_became_peered":"2023-12-16T20:21:36.552621+0000","last_unstale":"2023-12-16T20:21:40.738303+0000","last_undegraded":"2023-12-16T20:21:40.738303+0000","last_fullsized":"2023-12-16T20:21:40.738303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877621+0000","last_change":"2023-12-16T20:21:40.754959+0000","last_active":"2023-12-16T20:21:41.877621+0000","last_peered":"2023-12-16T20:21:41.877621+0000","last_clean":"2023-12-16T20:21:41.877621+0000","last_became_active":"2023-12-16T20:21:40.754509+0000","last_became_peered":"2023-12-16T20:21:40.754509+0000","last_unstale":"2023-12-16T20:21:41.877621+0000","last_undegraded":"2023-12-16T20:21:41.877621+0000","last_fullsized":"2023-12-16T20:21:41.877621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:21.787809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211739+0000","last_change":"2023-12-16T20:21:35.427622+0000","last_active":"2023-12-16T20:21:41.211739+0000","last_peered":"2023-12-16T20:21:41.211739+0000","last_clean":"2023-12-16T20:21:41.211739+0000","last_became_active":"2023-12-16T20:21:35.427317+0000","last_became_peered":"2023-12-16T20:21:35.427317+0000","last_unstale":"2023-12-16T20:21:41.211739+0000","last_undegraded":"2023-12-16T20:21:41.211739+0000","last_fullsized":"2023-12-16T20:21:41.211739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791265+0000","last_change":"2023-12-16T20:21:36.551723+0000","last_active":"2023-12-16T20:21:40.791265+0000","last_peered":"2023-12-16T20:21:40.791265+0000","last_clean":"2023-12-16T20:21:40.791265+0000","last_became_active":"2023-12-16T20:21:36.551475+0000","last_became_peered":"2023-12-16T20:21:36.551475+0000","last_unstale":"2023-12-16T20:21:40.791265+0000","last_undegraded":"2023-12-16T20:21:40.791265+0000","last_fullsized":"2023-12-16T20:21:40.791265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877788+0000","last_change":"2023-12-16T20:21:40.753693+0000","last_active":"2023-12-16T20:21:41.877788+0000","last_peered":"2023-12-16T20:21:41.877788+0000","last_clean":"2023-12-16T20:21:41.877788+0000","last_became_active":"2023-12-16T20:21:40.753268+0000","last_became_peered":"2023-12-16T20:21:40.753268+0000","last_unstale":"2023-12-16T20:21:41.877788+0000","last_undegraded":"2023-12-16T20:21:41.877788+0000","last_fullsized":"2023-12-16T20:21:41.877788+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:39.757419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211396+0000","last_change":"2023-12-16T20:21:35.413521+0000","last_active":"2023-12-16T20:21:41.211396+0000","last_peered":"2023-12-16T20:21:41.211396+0000","last_clean":"2023-12-16T20:21:41.211396+0000","last_became_active":"2023-12-16T20:21:35.413234+0000","last_became_peered":"2023-12-16T20:21:35.413234+0000","last_unstale":"2023-12-16T20:21:41.211396+0000","last_undegraded":"2023-12-16T20:21:41.211396+0000","last_fullsized":"2023-12-16T20:21:41.211396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791426+0000","last_change":"2023-12-16T20:21:36.554419+0000","last_active":"2023-12-16T20:21:40.791426+0000","last_peered":"2023-12-16T20:21:40.791426+0000","last_clean":"2023-12-16T20:21:40.791426+0000","last_became_active":"2023-12-16T20:21:36.554014+0000","last_became_peered":"2023-12-16T20:21:36.554014+0000","last_unstale":"2023-12-16T20:21:40.791426+0000","last_undegraded":"2023-12-16T20:21:40.791426+0000","last_fullsized":"2023-12-16T20:21:40.791426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:03.543973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877746+0000","last_change":"2023-12-16T20:21:40.794852+0000","last_active":"2023-12-16T20:21:41.877746+0000","last_peered":"2023-12-16T20:21:41.877746+0000","last_clean":"2023-12-16T20:21:41.877746+0000","last_became_active":"2023-12-16T20:21:40.794471+0000","last_became_peered":"2023-12-16T20:21:40.794471+0000","last_unstale":"2023-12-16T20:21:41.877746+0000","last_undegraded":"2023-12-16T20:21:41.877746+0000","last_fullsized":"2023-12-16T20:21:41.877746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:25.004850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752195+0000","last_change":"2023-12-16T20:21:36.542450+0000","last_active":"2023-12-16T20:21:40.752195+0000","last_peered":"2023-12-16T20:21:40.752195+0000","last_clean":"2023-12-16T20:21:40.752195+0000","last_became_active":"2023-12-16T20:21:36.542157+0000","last_became_peered":"2023-12-16T20:21:36.542157+0000","last_unstale":"2023-12-16T20:21:40.752195+0000","last_undegraded":"2023-12-16T20:21:40.752195+0000","last_fullsized":"2023-12-16T20:21:40.752195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211548+0000","last_change":"2023-12-16T20:21:35.413681+0000","last_active":"2023-12-16T20:21:41.211548+0000","last_peered":"2023-12-16T20:21:41.211548+0000","last_clean":"2023-12-16T20:21:41.211548+0000","last_became_active":"2023-12-16T20:21:35.413400+0000","last_became_peered":"2023-12-16T20:21:35.413400+0000","last_unstale":"2023-12-16T20:21:41.211548+0000","last_undegraded":"2023-12-16T20:21:41.211548+0000","last_fullsized":"2023-12-16T20:21:41.211548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:27.767422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.878229+0000","last_change":"2023-12-16T20:21:40.745971+0000","last_active":"2023-12-16T20:21:41.878229+0000","last_peered":"2023-12-16T20:21:41.878229+0000","last_clean":"2023-12-16T20:21:41.878229+0000","last_became_active":"2023-12-16T20:21:40.745544+0000","last_became_peered":"2023-12-16T20:21:40.745544+0000","last_unstale":"2023-12-16T20:21:41.878229+0000","last_undegraded":"2023-12-16T20:21:41.878229+0000","last_fullsized":"2023-12-16T20:21:41.878229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:18.981353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672085+0000","last_change":"2023-12-16T20:21:36.526277+0000","last_active":"2023-12-16T20:21:40.672085+0000","last_peered":"2023-12-16T20:21:40.672085+0000","last_clean":"2023-12-16T20:21:40.672085+0000","last_became_active":"2023-12-16T20:21:36.525983+0000","last_became_peered":"2023-12-16T20:21:36.525983+0000","last_unstale":"2023-12-16T20:21:40.672085+0000","last_undegraded":"2023-12-16T20:21:40.672085+0000","last_fullsized":"2023-12-16T20:21:40.672085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743603+0000","last_change":"2023-12-16T20:21:35.420017+0000","last_active":"2023-12-16T20:21:40.743603+0000","last_peered":"2023-12-16T20:21:40.743603+0000","last_clean":"2023-12-16T20:21:40.743603+0000","last_became_active":"2023-12-16T20:21:35.419731+0000","last_became_peered":"2023-12-16T20:21:35.419731+0000","last_unstale":"2023-12-16T20:21:40.743603+0000","last_undegraded":"2023-12-16T20:21:40.743603+0000","last_fullsized":"2023-12-16T20:21:40.743603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:29.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.878175+0000","last_change":"2023-12-16T20:21:40.755335+0000","last_active":"2023-12-16T20:21:41.878175+0000","last_peered":"2023-12-16T20:21:41.878175+0000","last_clean":"2023-12-16T20:21:41.878175+0000","last_became_active":"2023-12-16T20:21:40.754829+0000","last_became_peered":"2023-12-16T20:21:40.754829+0000","last_unstale":"2023-12-16T20:21:41.878175+0000","last_undegraded":"2023-12-16T20:21:41.878175+0000","last_fullsized":"2023-12-16T20:21:41.878175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.673227+0000","last_change":"2023-12-16T20:21:36.518939+0000","last_active":"2023-12-16T20:21:40.673227+0000","last_peered":"2023-12-16T20:21:40.673227+0000","last_clean":"2023-12-16T20:21:40.673227+0000","last_became_active":"2023-12-16T20:21:36.518686+0000","last_became_peered":"2023-12-16T20:21:36.518686+0000","last_unstale":"2023-12-16T20:21:40.673227+0000","last_undegraded":"2023-12-16T20:21:40.673227+0000","last_fullsized":"2023-12-16T20:21:40.673227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742823+0000","last_change":"2023-12-16T20:21:35.416372+0000","last_active":"2023-12-16T20:21:40.742823+0000","last_peered":"2023-12-16T20:21:40.742823+0000","last_clean":"2023-12-16T20:21:40.742823+0000","last_became_active":"2023-12-16T20:21:35.416067+0000","last_became_peered":"2023-12-16T20:21:35.416067+0000","last_unstale":"2023-12-16T20:21:40.742823+0000","last_undegraded":"2023-12-16T20:21:40.742823+0000","last_fullsized":"2023-12-16T20:21:40.742823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:37.215505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.432342+0000","last_change":"2023-12-16T20:21:41.215250+0000","last_active":"2023-12-16T20:21:43.432342+0000","last_peered":"2023-12-16T20:21:43.432342+0000","last_clean":"2023-12-16T20:21:43.432342+0000","last_became_active":"2023-12-16T20:21:41.214198+0000","last_became_peered":"2023-12-16T20:21:41.214198+0000","last_unstale":"2023-12-16T20:21:43.432342+0000","last_undegraded":"2023-12-16T20:21:43.432342+0000","last_fullsized":"2023-12-16T20:21:43.432342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:41.263768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726299+0000","last_change":"2023-12-16T20:21:36.536797+0000","last_active":"2023-12-16T20:21:40.726299+0000","last_peered":"2023-12-16T20:21:40.726299+0000","last_clean":"2023-12-16T20:21:40.726299+0000","last_became_active":"2023-12-16T20:21:36.536321+0000","last_became_peered":"2023-12-16T20:21:36.536321+0000","last_unstale":"2023-12-16T20:21:40.726299+0000","last_undegraded":"2023-12-16T20:21:40.726299+0000","last_fullsized":"2023-12-16T20:21:40.726299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:55:55.607439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211371+0000","last_change":"2023-12-16T20:21:35.425939+0000","last_active":"2023-12-16T20:21:41.211371+0000","last_peered":"2023-12-16T20:21:41.211371+0000","last_clean":"2023-12-16T20:21:41.211371+0000","last_became_active":"2023-12-16T20:21:35.420547+0000","last_became_peered":"2023-12-16T20:21:35.420547+0000","last_unstale":"2023-12-16T20:21:41.211371+0000","last_undegraded":"2023-12-16T20:21:41.211371+0000","last_fullsized":"2023-12-16T20:21:41.211371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:58:31.980302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.878401+0000","last_change":"2023-12-16T20:21:40.757445+0000","last_active":"2023-12-16T20:21:41.878401+0000","last_peered":"2023-12-16T20:21:41.878401+0000","last_clean":"2023-12-16T20:21:41.878401+0000","last_became_active":"2023-12-16T20:21:40.756997+0000","last_became_peered":"2023-12-16T20:21:40.756997+0000","last_unstale":"2023-12-16T20:21:41.878401+0000","last_undegraded":"2023-12-16T20:21:41.878401+0000","last_fullsized":"2023-12-16T20:21:41.878401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:32.702839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738149+0000","last_change":"2023-12-16T20:21:36.524943+0000","last_active":"2023-12-16T20:21:40.738149+0000","last_peered":"2023-12-16T20:21:40.738149+0000","last_clean":"2023-12-16T20:21:40.738149+0000","last_became_active":"2023-12-16T20:21:36.524703+0000","last_became_peered":"2023-12-16T20:21:36.524703+0000","last_unstale":"2023-12-16T20:21:40.738149+0000","last_undegraded":"2023-12-16T20:21:40.738149+0000","last_fullsized":"2023-12-16T20:21:40.738149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.753645+0000","last_change":"2023-12-16T20:21:35.428736+0000","last_active":"2023-12-16T20:21:40.753645+0000","last_peered":"2023-12-16T20:21:40.753645+0000","last_clean":"2023-12-16T20:21:40.753645+0000","last_became_active":"2023-12-16T20:21:35.428465+0000","last_became_peered":"2023-12-16T20:21:35.428465+0000","last_unstale":"2023-12-16T20:21:40.753645+0000","last_undegraded":"2023-12-16T20:21:40.753645+0000","last_fullsized":"2023-12-16T20:21:40.753645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877780+0000","last_change":"2023-12-16T20:21:41.213330+0000","last_active":"2023-12-16T20:21:41.877780+0000","last_peered":"2023-12-16T20:21:41.877780+0000","last_clean":"2023-12-16T20:21:41.877780+0000","last_became_active":"2023-12-16T20:21:41.212976+0000","last_became_peered":"2023-12-16T20:21:41.212976+0000","last_unstale":"2023-12-16T20:21:41.877780+0000","last_undegraded":"2023-12-16T20:21:41.877780+0000","last_fullsized":"2023-12-16T20:21:41.877780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:32:02.178544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672371+0000","last_change":"2023-12-16T20:21:36.518956+0000","last_active":"2023-12-16T20:21:40.672371+0000","last_peered":"2023-12-16T20:21:40.672371+0000","last_clean":"2023-12-16T20:21:40.672371+0000","last_became_active":"2023-12-16T20:21:36.518673+0000","last_became_peered":"2023-12-16T20:21:36.518673+0000","last_unstale":"2023-12-16T20:21:40.672371+0000","last_undegraded":"2023-12-16T20:21:40.672371+0000","last_fullsized":"2023-12-16T20:21:40.672371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743808+0000","last_change":"2023-12-16T20:21:35.423292+0000","last_active":"2023-12-16T20:21:40.743808+0000","last_peered":"2023-12-16T20:21:40.743808+0000","last_clean":"2023-12-16T20:21:40.743808+0000","last_became_active":"2023-12-16T20:21:35.423045+0000","last_became_peered":"2023-12-16T20:21:35.423045+0000","last_unstale":"2023-12-16T20:21:40.743808+0000","last_undegraded":"2023-12-16T20:21:40.743808+0000","last_fullsized":"2023-12-16T20:21:40.743808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.876800+0000","last_change":"2023-12-16T20:21:41.216113+0000","last_active":"2023-12-16T20:21:41.876800+0000","last_peered":"2023-12-16T20:21:41.876800+0000","last_clean":"2023-12-16T20:21:41.876800+0000","last_became_active":"2023-12-16T20:21:41.215747+0000","last_became_peered":"2023-12-16T20:21:41.215747+0000","last_unstale":"2023-12-16T20:21:41.876800+0000","last_undegraded":"2023-12-16T20:21:41.876800+0000","last_fullsized":"2023-12-16T20:21:41.876800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:10:17.859148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742993+0000","last_change":"2023-12-16T20:21:36.451660+0000","last_active":"2023-12-16T20:21:40.742993+0000","last_peered":"2023-12-16T20:21:40.742993+0000","last_clean":"2023-12-16T20:21:40.742993+0000","last_became_active":"2023-12-16T20:21:36.451404+0000","last_became_peered":"2023-12-16T20:21:36.451404+0000","last_unstale":"2023-12-16T20:21:40.742993+0000","last_undegraded":"2023-12-16T20:21:40.742993+0000","last_fullsized":"2023-12-16T20:21:40.742993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211871+0000","last_change":"2023-12-16T20:21:35.420184+0000","last_active":"2023-12-16T20:21:41.211871+0000","last_peered":"2023-12-16T20:21:41.211871+0000","last_clean":"2023-12-16T20:21:41.211871+0000","last_became_active":"2023-12-16T20:21:35.419917+0000","last_became_peered":"2023-12-16T20:21:35.419917+0000","last_unstale":"2023-12-16T20:21:41.211871+0000","last_undegraded":"2023-12-16T20:21:41.211871+0000","last_fullsized":"2023-12-16T20:21:41.211871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:19.491578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.135002+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:21:44.135002+0000","last_peered":"2023-12-16T20:21:44.135002+0000","last_clean":"2023-12-16T20:21:44.135002+0000","last_became_active":"2023-12-16T20:21:41.212704+0000","last_became_peered":"2023-12-16T20:21:41.212704+0000","last_unstale":"2023-12-16T20:21:44.135002+0000","last_undegraded":"2023-12-16T20:21:44.135002+0000","last_fullsized":"2023-12-16T20:21:44.135002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:11.201128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791502+0000","last_change":"2023-12-16T20:21:36.555288+0000","last_active":"2023-12-16T20:21:40.791502+0000","last_peered":"2023-12-16T20:21:40.791502+0000","last_clean":"2023-12-16T20:21:40.791502+0000","last_became_active":"2023-12-16T20:21:36.555011+0000","last_became_peered":"2023-12-16T20:21:36.555011+0000","last_unstale":"2023-12-16T20:21:40.791502+0000","last_undegraded":"2023-12-16T20:21:40.791502+0000","last_fullsized":"2023-12-16T20:21:40.791502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:06.805922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743003+0000","last_change":"2023-12-16T20:21:35.417945+0000","last_active":"2023-12-16T20:21:40.743003+0000","last_peered":"2023-12-16T20:21:40.743003+0000","last_clean":"2023-12-16T20:21:40.743003+0000","last_became_active":"2023-12-16T20:21:35.417683+0000","last_became_peered":"2023-12-16T20:21:35.417683+0000","last_unstale":"2023-12-16T20:21:40.743003+0000","last_undegraded":"2023-12-16T20:21:40.743003+0000","last_fullsized":"2023-12-16T20:21:40.743003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:18.427670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.431936+0000","last_change":"2023-12-16T20:21:40.794299+0000","last_active":"2023-12-16T20:21:43.431936+0000","last_peered":"2023-12-16T20:21:43.431936+0000","last_clean":"2023-12-16T20:21:43.431936+0000","last_became_active":"2023-12-16T20:21:40.793754+0000","last_became_peered":"2023-12-16T20:21:40.793754+0000","last_unstale":"2023-12-16T20:21:43.431936+0000","last_undegraded":"2023-12-16T20:21:43.431936+0000","last_fullsized":"2023-12-16T20:21:43.431936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:10.036962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726356+0000","last_change":"2023-12-16T20:21:36.534278+0000","last_active":"2023-12-16T20:21:40.726356+0000","last_peered":"2023-12-16T20:21:40.726356+0000","last_clean":"2023-12-16T20:21:40.726356+0000","last_became_active":"2023-12-16T20:21:36.533651+0000","last_became_peered":"2023-12-16T20:21:36.533651+0000","last_unstale":"2023-12-16T20:21:40.726356+0000","last_undegraded":"2023-12-16T20:21:40.726356+0000","last_fullsized":"2023-12-16T20:21:40.726356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:58:33.098369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.792221+0000","last_change":"2023-12-16T20:21:35.422128+0000","last_active":"2023-12-16T20:21:40.792221+0000","last_peered":"2023-12-16T20:21:40.792221+0000","last_clean":"2023-12-16T20:21:40.792221+0000","last_became_active":"2023-12-16T20:21:35.421875+0000","last_became_peered":"2023-12-16T20:21:35.421875+0000","last_unstale":"2023-12-16T20:21:40.792221+0000","last_undegraded":"2023-12-16T20:21:40.792221+0000","last_fullsized":"2023-12-16T20:21:40.792221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:24.569380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.432241+0000","last_change":"2023-12-16T20:21:40.754363+0000","last_active":"2023-12-16T20:21:43.432241+0000","last_peered":"2023-12-16T20:21:43.432241+0000","last_clean":"2023-12-16T20:21:43.432241+0000","last_became_active":"2023-12-16T20:21:40.753994+0000","last_became_peered":"2023-12-16T20:21:40.753994+0000","last_unstale":"2023-12-16T20:21:43.432241+0000","last_undegraded":"2023-12-16T20:21:43.432241+0000","last_fullsized":"2023-12-16T20:21:43.432241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:07.939178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742945+0000","last_change":"2023-12-16T20:21:36.451488+0000","last_active":"2023-12-16T20:21:40.742945+0000","last_peered":"2023-12-16T20:21:40.742945+0000","last_clean":"2023-12-16T20:21:40.742945+0000","last_became_active":"2023-12-16T20:21:36.451231+0000","last_became_peered":"2023-12-16T20:21:36.451231+0000","last_unstale":"2023-12-16T20:21:40.742945+0000","last_undegraded":"2023-12-16T20:21:40.742945+0000","last_fullsized":"2023-12-16T20:21:40.742945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725582+0000","last_change":"2023-12-16T20:21:35.420494+0000","last_active":"2023-12-16T20:21:40.725582+0000","last_peered":"2023-12-16T20:21:40.725582+0000","last_clean":"2023-12-16T20:21:40.725582+0000","last_became_active":"2023-12-16T20:21:35.420236+0000","last_became_peered":"2023-12-16T20:21:35.420236+0000","last_unstale":"2023-12-16T20:21:40.725582+0000","last_undegraded":"2023-12-16T20:21:40.725582+0000","last_fullsized":"2023-12-16T20:21:40.725582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:55:54.489373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.432363+0000","last_change":"2023-12-16T20:21:40.794400+0000","last_active":"2023-12-16T20:21:43.432363+0000","last_peered":"2023-12-16T20:21:43.432363+0000","last_clean":"2023-12-16T20:21:43.432363+0000","last_became_active":"2023-12-16T20:21:40.793947+0000","last_became_peered":"2023-12-16T20:21:40.793947+0000","last_unstale":"2023-12-16T20:21:43.432363+0000","last_undegraded":"2023-12-16T20:21:43.432363+0000","last_fullsized":"2023-12-16T20:21:43.432363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:16.656597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.737925+0000","last_change":"2023-12-16T20:21:36.535835+0000","last_active":"2023-12-16T20:21:40.737925+0000","last_peered":"2023-12-16T20:21:40.737925+0000","last_clean":"2023-12-16T20:21:40.737925+0000","last_became_active":"2023-12-16T20:21:36.535571+0000","last_became_peered":"2023-12-16T20:21:36.535571+0000","last_unstale":"2023-12-16T20:21:40.737925+0000","last_undegraded":"2023-12-16T20:21:40.737925+0000","last_fullsized":"2023-12-16T20:21:40.737925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:54.719426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211381+0000","last_change":"2023-12-16T20:21:35.418993+0000","last_active":"2023-12-16T20:21:41.211381+0000","last_peered":"2023-12-16T20:21:41.211381+0000","last_clean":"2023-12-16T20:21:41.211381+0000","last_became_active":"2023-12-16T20:21:35.418751+0000","last_became_peered":"2023-12-16T20:21:35.418751+0000","last_unstale":"2023-12-16T20:21:41.211381+0000","last_undegraded":"2023-12-16T20:21:41.211381+0000","last_fullsized":"2023-12-16T20:21:41.211381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:18.391557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.135405+0000","last_change":"2023-12-16T20:21:41.214405+0000","last_active":"2023-12-16T20:21:44.135405+0000","last_peered":"2023-12-16T20:21:44.135405+0000","last_clean":"2023-12-16T20:21:44.135405+0000","last_became_active":"2023-12-16T20:21:41.213977+0000","last_became_peered":"2023-12-16T20:21:41.213977+0000","last_unstale":"2023-12-16T20:21:44.135405+0000","last_undegraded":"2023-12-16T20:21:44.135405+0000","last_fullsized":"2023-12-16T20:21:44.135405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:16.656597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.671919+0000","last_change":"2023-12-16T20:21:36.551240+0000","last_active":"2023-12-16T20:21:40.671919+0000","last_peered":"2023-12-16T20:21:40.671919+0000","last_clean":"2023-12-16T20:21:40.671919+0000","last_became_active":"2023-12-16T20:21:36.550997+0000","last_became_peered":"2023-12-16T20:21:36.550997+0000","last_unstale":"2023-12-16T20:21:40.671919+0000","last_undegraded":"2023-12-16T20:21:40.671919+0000","last_fullsized":"2023-12-16T20:21:40.671919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791233+0000","last_change":"2023-12-16T20:21:35.416258+0000","last_active":"2023-12-16T20:21:40.791233+0000","last_peered":"2023-12-16T20:21:40.791233+0000","last_clean":"2023-12-16T20:21:40.791233+0000","last_became_active":"2023-12-16T20:21:35.415984+0000","last_became_peered":"2023-12-16T20:21:35.415984+0000","last_unstale":"2023-12-16T20:21:40.791233+0000","last_undegraded":"2023-12-16T20:21:40.791233+0000","last_fullsized":"2023-12-16T20:21:40.791233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:06.872220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211463+0000","last_change":"2023-12-16T20:21:25.196796+0000","last_active":"2023-12-16T20:21:41.211463+0000","last_peered":"2023-12-16T20:21:41.211463+0000","last_clean":"2023-12-16T20:21:41.211463+0000","last_became_active":"2023-12-16T20:21:25.195675+0000","last_became_peered":"2023-12-16T20:21:25.195675+0000","last_unstale":"2023-12-16T20:21:41.211463+0000","last_undegraded":"2023-12-16T20:21:41.211463+0000","last_fullsized":"2023-12-16T20:21:41.211463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:23.008820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:23.008820+0000","last_clean_scrub_stamp":"2023-12-16T20:21:23.008820+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:46:02.232774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.184671+0000","last_change":"2023-12-16T20:21:41.214322+0000","last_active":"2023-12-16T20:21:44.184671+0000","last_peered":"2023-12-16T20:21:44.184671+0000","last_clean":"2023-12-16T20:21:44.184671+0000","last_became_active":"2023-12-16T20:21:41.214012+0000","last_became_peered":"2023-12-16T20:21:41.214012+0000","last_unstale":"2023-12-16T20:21:44.184671+0000","last_undegraded":"2023-12-16T20:21:44.184671+0000","last_fullsized":"2023-12-16T20:21:44.184671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:18.981353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211688+0000","last_change":"2023-12-16T20:21:36.552920+0000","last_active":"2023-12-16T20:21:41.211688+0000","last_peered":"2023-12-16T20:21:41.211688+0000","last_clean":"2023-12-16T20:21:41.211688+0000","last_became_active":"2023-12-16T20:21:36.552619+0000","last_became_peered":"2023-12-16T20:21:36.552619+0000","last_unstale":"2023-12-16T20:21:41.211688+0000","last_undegraded":"2023-12-16T20:21:41.211688+0000","last_fullsized":"2023-12-16T20:21:41.211688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:14.586148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725929+0000","last_change":"2023-12-16T20:21:35.413597+0000","last_active":"2023-12-16T20:21:40.725929+0000","last_peered":"2023-12-16T20:21:40.725929+0000","last_clean":"2023-12-16T20:21:40.725929+0000","last_became_active":"2023-12-16T20:21:35.413308+0000","last_became_peered":"2023-12-16T20:21:35.413308+0000","last_unstale":"2023-12-16T20:21:40.725929+0000","last_undegraded":"2023-12-16T20:21:40.725929+0000","last_fullsized":"2023-12-16T20:21:40.725929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:55:39.544748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.184449+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:21:44.184449+0000","last_peered":"2023-12-16T20:21:44.184449+0000","last_clean":"2023-12-16T20:21:44.184449+0000","last_became_active":"2023-12-16T20:21:41.212608+0000","last_became_peered":"2023-12-16T20:21:41.212608+0000","last_unstale":"2023-12-16T20:21:44.184449+0000","last_undegraded":"2023-12-16T20:21:44.184449+0000","last_fullsized":"2023-12-16T20:21:44.184449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791343+0000","last_change":"2023-12-16T20:21:36.555870+0000","last_active":"2023-12-16T20:21:40.791343+0000","last_peered":"2023-12-16T20:21:40.791343+0000","last_clean":"2023-12-16T20:21:40.791343+0000","last_became_active":"2023-12-16T20:21:36.555631+0000","last_became_peered":"2023-12-16T20:21:36.555631+0000","last_unstale":"2023-12-16T20:21:40.791343+0000","last_undegraded":"2023-12-16T20:21:40.791343+0000","last_fullsized":"2023-12-16T20:21:40.791343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:10.421516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743686+0000","last_change":"2023-12-16T20:21:35.416140+0000","last_active":"2023-12-16T20:21:40.743686+0000","last_peered":"2023-12-16T20:21:40.743686+0000","last_clean":"2023-12-16T20:21:40.743686+0000","last_became_active":"2023-12-16T20:21:35.415810+0000","last_became_peered":"2023-12-16T20:21:35.415810+0000","last_unstale":"2023-12-16T20:21:40.743686+0000","last_undegraded":"2023-12-16T20:21:40.743686+0000","last_fullsized":"2023-12-16T20:21:40.743686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.135131+0000","last_change":"2023-12-16T20:21:40.794366+0000","last_active":"2023-12-16T20:21:44.135131+0000","last_peered":"2023-12-16T20:21:44.135131+0000","last_clean":"2023-12-16T20:21:44.135131+0000","last_became_active":"2023-12-16T20:21:40.793989+0000","last_became_peered":"2023-12-16T20:21:40.793989+0000","last_unstale":"2023-12-16T20:21:44.135131+0000","last_undegraded":"2023-12-16T20:21:44.135131+0000","last_fullsized":"2023-12-16T20:21:44.135131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:41.263768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211819+0000","last_change":"2023-12-16T20:21:36.536346+0000","last_active":"2023-12-16T20:21:41.211819+0000","last_peered":"2023-12-16T20:21:41.211819+0000","last_clean":"2023-12-16T20:21:41.211819+0000","last_became_active":"2023-12-16T20:21:36.536093+0000","last_became_peered":"2023-12-16T20:21:36.536093+0000","last_unstale":"2023-12-16T20:21:41.211819+0000","last_undegraded":"2023-12-16T20:21:41.211819+0000","last_fullsized":"2023-12-16T20:21:41.211819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:12.261391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725494+0000","last_change":"2023-12-16T20:21:35.420314+0000","last_active":"2023-12-16T20:21:40.725494+0000","last_peered":"2023-12-16T20:21:40.725494+0000","last_clean":"2023-12-16T20:21:40.725494+0000","last_became_active":"2023-12-16T20:21:35.420074+0000","last_became_peered":"2023-12-16T20:21:35.420074+0000","last_unstale":"2023-12-16T20:21:40.725494+0000","last_undegraded":"2023-12-16T20:21:40.725494+0000","last_fullsized":"2023-12-16T20:21:40.725494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:29.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.109595+0000","last_change":"2023-12-16T20:21:41.215282+0000","last_active":"2023-12-16T20:21:44.109595+0000","last_peered":"2023-12-16T20:21:44.109595+0000","last_clean":"2023-12-16T20:21:44.109595+0000","last_became_active":"2023-12-16T20:21:41.214939+0000","last_became_peered":"2023-12-16T20:21:41.214939+0000","last_unstale":"2023-12-16T20:21:44.109595+0000","last_undegraded":"2023-12-16T20:21:44.109595+0000","last_fullsized":"2023-12-16T20:21:44.109595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:06:12.245089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211732+0000","last_change":"2023-12-16T20:21:36.534345+0000","last_active":"2023-12-16T20:21:41.211732+0000","last_peered":"2023-12-16T20:21:41.211732+0000","last_clean":"2023-12-16T20:21:41.211732+0000","last_became_active":"2023-12-16T20:21:36.534064+0000","last_became_peered":"2023-12-16T20:21:36.534064+0000","last_unstale":"2023-12-16T20:21:41.211732+0000","last_undegraded":"2023-12-16T20:21:41.211732+0000","last_fullsized":"2023-12-16T20:21:41.211732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:05.641757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725865+0000","last_change":"2023-12-16T20:21:35.390941+0000","last_active":"2023-12-16T20:21:40.725865+0000","last_peered":"2023-12-16T20:21:40.725865+0000","last_clean":"2023-12-16T20:21:40.725865+0000","last_became_active":"2023-12-16T20:21:35.390740+0000","last_became_peered":"2023-12-16T20:21:35.390740+0000","last_unstale":"2023-12-16T20:21:40.725865+0000","last_undegraded":"2023-12-16T20:21:40.725865+0000","last_fullsized":"2023-12-16T20:21:40.725865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:00:44.009248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877589+0000","last_change":"2023-12-16T20:21:40.754355+0000","last_active":"2023-12-16T20:21:41.877589+0000","last_peered":"2023-12-16T20:21:41.877589+0000","last_clean":"2023-12-16T20:21:41.877589+0000","last_became_active":"2023-12-16T20:21:40.753981+0000","last_became_peered":"2023-12-16T20:21:40.753981+0000","last_unstale":"2023-12-16T20:21:41.877589+0000","last_undegraded":"2023-12-16T20:21:41.877589+0000","last_fullsized":"2023-12-16T20:21:41.877589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:09.125671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211363+0000","last_change":"2023-12-16T20:21:36.537080+0000","last_active":"2023-12-16T20:21:41.211363+0000","last_peered":"2023-12-16T20:21:41.211363+0000","last_clean":"2023-12-16T20:21:41.211363+0000","last_became_active":"2023-12-16T20:21:36.536822+0000","last_became_peered":"2023-12-16T20:21:36.536822+0000","last_unstale":"2023-12-16T20:21:41.211363+0000","last_undegraded":"2023-12-16T20:21:41.211363+0000","last_fullsized":"2023-12-16T20:21:41.211363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725357+0000","last_change":"2023-12-16T20:21:35.417113+0000","last_active":"2023-12-16T20:21:40.725357+0000","last_peered":"2023-12-16T20:21:40.725357+0000","last_clean":"2023-12-16T20:21:40.725357+0000","last_became_active":"2023-12-16T20:21:35.416850+0000","last_became_peered":"2023-12-16T20:21:35.416850+0000","last_unstale":"2023-12-16T20:21:40.725357+0000","last_undegraded":"2023-12-16T20:21:40.725357+0000","last_fullsized":"2023-12-16T20:21:40.725357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:00:44.009248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.135099+0000","last_change":"2023-12-16T20:21:40.755436+0000","last_active":"2023-12-16T20:21:44.135099+0000","last_peered":"2023-12-16T20:21:44.135099+0000","last_clean":"2023-12-16T20:21:44.135099+0000","last_became_active":"2023-12-16T20:21:40.755041+0000","last_became_peered":"2023-12-16T20:21:40.755041+0000","last_unstale":"2023-12-16T20:21:44.135099+0000","last_undegraded":"2023-12-16T20:21:44.135099+0000","last_fullsized":"2023-12-16T20:21:44.135099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:07.939178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752017+0000","last_change":"2023-12-16T20:21:36.541160+0000","last_active":"2023-12-16T20:21:40.752017+0000","last_peered":"2023-12-16T20:21:40.752017+0000","last_clean":"2023-12-16T20:21:40.752017+0000","last_became_active":"2023-12-16T20:21:36.540861+0000","last_became_peered":"2023-12-16T20:21:36.540861+0000","last_unstale":"2023-12-16T20:21:40.752017+0000","last_undegraded":"2023-12-16T20:21:40.752017+0000","last_fullsized":"2023-12-16T20:21:40.752017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.751989+0000","last_change":"2023-12-16T20:21:35.425071+0000","last_active":"2023-12-16T20:21:40.751989+0000","last_peered":"2023-12-16T20:21:40.751989+0000","last_clean":"2023-12-16T20:21:40.751989+0000","last_became_active":"2023-12-16T20:21:35.424822+0000","last_became_peered":"2023-12-16T20:21:35.424822+0000","last_unstale":"2023-12-16T20:21:40.751989+0000","last_undegraded":"2023-12-16T20:21:40.751989+0000","last_fullsized":"2023-12-16T20:21:40.751989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877590+0000","last_change":"2023-12-16T20:21:41.215346+0000","last_active":"2023-12-16T20:21:41.877590+0000","last_peered":"2023-12-16T20:21:41.877590+0000","last_clean":"2023-12-16T20:21:41.877590+0000","last_became_active":"2023-12-16T20:21:41.215002+0000","last_became_peered":"2023-12-16T20:21:41.215002+0000","last_unstale":"2023-12-16T20:21:41.877590+0000","last_undegraded":"2023-12-16T20:21:41.877590+0000","last_fullsized":"2023-12-16T20:21:41.877590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:10:42.982067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211447+0000","last_change":"2023-12-16T20:21:36.535791+0000","last_active":"2023-12-16T20:21:41.211447+0000","last_peered":"2023-12-16T20:21:41.211447+0000","last_clean":"2023-12-16T20:21:41.211447+0000","last_became_active":"2023-12-16T20:21:36.535447+0000","last_became_peered":"2023-12-16T20:21:36.535447+0000","last_unstale":"2023-12-16T20:21:41.211447+0000","last_undegraded":"2023-12-16T20:21:41.211447+0000","last_fullsized":"2023-12-16T20:21:41.211447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:28.307634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.792143+0000","last_change":"2023-12-16T20:21:35.423533+0000","last_active":"2023-12-16T20:21:40.792143+0000","last_peered":"2023-12-16T20:21:40.792143+0000","last_clean":"2023-12-16T20:21:40.792143+0000","last_became_active":"2023-12-16T20:21:35.423275+0000","last_became_peered":"2023-12-16T20:21:35.423275+0000","last_unstale":"2023-12-16T20:21:40.792143+0000","last_undegraded":"2023-12-16T20:21:40.792143+0000","last_fullsized":"2023-12-16T20:21:40.792143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:27.767422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877232+0000","last_change":"2023-12-16T20:21:41.213083+0000","last_active":"2023-12-16T20:21:41.877232+0000","last_peered":"2023-12-16T20:21:41.877232+0000","last_clean":"2023-12-16T20:21:41.877232+0000","last_became_active":"2023-12-16T20:21:41.212699+0000","last_became_peered":"2023-12-16T20:21:41.212699+0000","last_unstale":"2023-12-16T20:21:41.877232+0000","last_undegraded":"2023-12-16T20:21:41.877232+0000","last_fullsized":"2023-12-16T20:21:41.877232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:14:45.966119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.737960+0000","last_change":"2023-12-16T20:21:36.523928+0000","last_active":"2023-12-16T20:21:40.737960+0000","last_peered":"2023-12-16T20:21:40.737960+0000","last_clean":"2023-12-16T20:21:40.737960+0000","last_became_active":"2023-12-16T20:21:36.523649+0000","last_became_peered":"2023-12-16T20:21:36.523649+0000","last_unstale":"2023-12-16T20:21:40.737960+0000","last_undegraded":"2023-12-16T20:21:40.737960+0000","last_fullsized":"2023-12-16T20:21:40.737960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:33.657782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738298+0000","last_change":"2023-12-16T20:21:35.388611+0000","last_active":"2023-12-16T20:21:40.738298+0000","last_peered":"2023-12-16T20:21:40.738298+0000","last_clean":"2023-12-16T20:21:40.738298+0000","last_became_active":"2023-12-16T20:21:35.388392+0000","last_became_peered":"2023-12-16T20:21:35.388392+0000","last_unstale":"2023-12-16T20:21:40.738298+0000","last_undegraded":"2023-12-16T20:21:40.738298+0000","last_fullsized":"2023-12-16T20:21:40.738298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.110162+0000","last_change":"2023-12-16T20:21:41.213106+0000","last_active":"2023-12-16T20:21:44.110162+0000","last_peered":"2023-12-16T20:21:44.110162+0000","last_clean":"2023-12-16T20:21:44.110162+0000","last_became_active":"2023-12-16T20:21:41.212721+0000","last_became_peered":"2023-12-16T20:21:41.212721+0000","last_unstale":"2023-12-16T20:21:44.110162+0000","last_undegraded":"2023-12-16T20:21:44.110162+0000","last_fullsized":"2023-12-16T20:21:44.110162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:47:15.750172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211594+0000","last_change":"2023-12-16T20:21:36.519774+0000","last_active":"2023-12-16T20:21:41.211594+0000","last_peered":"2023-12-16T20:21:41.211594+0000","last_clean":"2023-12-16T20:21:41.211594+0000","last_became_active":"2023-12-16T20:21:36.519561+0000","last_became_peered":"2023-12-16T20:21:36.519561+0000","last_unstale":"2023-12-16T20:21:41.211594+0000","last_undegraded":"2023-12-16T20:21:41.211594+0000","last_fullsized":"2023-12-16T20:21:41.211594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:10.421516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:57.487368+0000","last_change":"2023-12-16T20:21:35.426168+0000","last_active":"2023-12-16T20:21:57.487368+0000","last_peered":"2023-12-16T20:21:57.487368+0000","last_clean":"2023-12-16T20:21:57.487368+0000","last_became_active":"2023-12-16T20:21:35.425929+0000","last_became_peered":"2023-12-16T20:21:35.425929+0000","last_unstale":"2023-12-16T20:21:57.487368+0000","last_undegraded":"2023-12-16T20:21:57.487368+0000","last_fullsized":"2023-12-16T20:21:57.487368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3840,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.431983+0000","last_change":"2023-12-16T20:21:40.754204+0000","last_active":"2023-12-16T20:21:43.431983+0000","last_peered":"2023-12-16T20:21:43.431983+0000","last_clean":"2023-12-16T20:21:43.431983+0000","last_became_active":"2023-12-16T20:21:40.753624+0000","last_became_peered":"2023-12-16T20:21:40.753624+0000","last_unstale":"2023-12-16T20:21:43.431983+0000","last_undegraded":"2023-12-16T20:21:43.431983+0000","last_fullsized":"2023-12-16T20:21:43.431983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:11.201128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726787+0000","last_change":"2023-12-16T20:21:36.534827+0000","last_active":"2023-12-16T20:21:40.726787+0000","last_peered":"2023-12-16T20:21:40.726787+0000","last_clean":"2023-12-16T20:21:40.726787+0000","last_became_active":"2023-12-16T20:21:36.533790+0000","last_became_peered":"2023-12-16T20:21:36.533790+0000","last_unstale":"2023-12-16T20:21:40.726787+0000","last_undegraded":"2023-12-16T20:21:40.726787+0000","last_fullsized":"2023-12-16T20:21:40.726787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:19.545737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743602+0000","last_change":"2023-12-16T20:21:35.416050+0000","last_active":"2023-12-16T20:21:40.743602+0000","last_peered":"2023-12-16T20:21:40.743602+0000","last_clean":"2023-12-16T20:21:40.743602+0000","last_became_active":"2023-12-16T20:21:35.415790+0000","last_became_peered":"2023-12-16T20:21:35.415790+0000","last_unstale":"2023-12-16T20:21:40.743602+0000","last_undegraded":"2023-12-16T20:21:40.743602+0000","last_fullsized":"2023-12-16T20:21:40.743602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.878018+0000","last_change":"2023-12-16T20:21:40.795197+0000","last_active":"2023-12-16T20:21:41.878018+0000","last_peered":"2023-12-16T20:21:41.878018+0000","last_clean":"2023-12-16T20:21:41.878018+0000","last_became_active":"2023-12-16T20:21:40.793667+0000","last_became_peered":"2023-12-16T20:21:40.793667+0000","last_unstale":"2023-12-16T20:21:41.878018+0000","last_undegraded":"2023-12-16T20:21:41.878018+0000","last_fullsized":"2023-12-16T20:21:41.878018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:32.304405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738312+0000","last_change":"2023-12-16T20:21:36.552680+0000","last_active":"2023-12-16T20:21:40.738312+0000","last_peered":"2023-12-16T20:21:40.738312+0000","last_clean":"2023-12-16T20:21:40.738312+0000","last_became_active":"2023-12-16T20:21:36.552482+0000","last_became_peered":"2023-12-16T20:21:36.552482+0000","last_unstale":"2023-12-16T20:21:40.738312+0000","last_undegraded":"2023-12-16T20:21:40.738312+0000","last_fullsized":"2023-12-16T20:21:40.738312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791458+0000","last_change":"2023-12-16T20:21:35.428379+0000","last_active":"2023-12-16T20:21:40.791458+0000","last_peered":"2023-12-16T20:21:40.791458+0000","last_clean":"2023-12-16T20:21:40.791458+0000","last_became_active":"2023-12-16T20:21:35.428100+0000","last_became_peered":"2023-12-16T20:21:35.428100+0000","last_unstale":"2023-12-16T20:21:40.791458+0000","last_undegraded":"2023-12-16T20:21:40.791458+0000","last_fullsized":"2023-12-16T20:21:40.791458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:44.330608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.876983+0000","last_change":"2023-12-16T20:21:40.753333+0000","last_active":"2023-12-16T20:21:41.876983+0000","last_peered":"2023-12-16T20:21:41.876983+0000","last_clean":"2023-12-16T20:21:41.876983+0000","last_became_active":"2023-12-16T20:21:40.752957+0000","last_became_peered":"2023-12-16T20:21:40.752957+0000","last_unstale":"2023-12-16T20:21:41.876983+0000","last_undegraded":"2023-12-16T20:21:41.876983+0000","last_fullsized":"2023-12-16T20:21:41.876983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:47:15.750172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791368+0000","last_change":"2023-12-16T20:21:36.552227+0000","last_active":"2023-12-16T20:21:40.791368+0000","last_peered":"2023-12-16T20:21:40.791368+0000","last_clean":"2023-12-16T20:21:40.791368+0000","last_became_active":"2023-12-16T20:21:36.551953+0000","last_became_peered":"2023-12-16T20:21:36.551953+0000","last_unstale":"2023-12-16T20:21:40.791368+0000","last_undegraded":"2023-12-16T20:21:40.791368+0000","last_fullsized":"2023-12-16T20:21:40.791368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:14.586148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.753542+0000","last_change":"2023-12-16T20:21:35.430197+0000","last_active":"2023-12-16T20:21:40.753542+0000","last_peered":"2023-12-16T20:21:40.753542+0000","last_clean":"2023-12-16T20:21:40.753542+0000","last_became_active":"2023-12-16T20:21:35.429940+0000","last_became_peered":"2023-12-16T20:21:35.429940+0000","last_unstale":"2023-12-16T20:21:40.753542+0000","last_undegraded":"2023-12-16T20:21:40.753542+0000","last_fullsized":"2023-12-16T20:21:40.753542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.876977+0000","last_change":"2023-12-16T20:21:41.216238+0000","last_active":"2023-12-16T20:21:41.876977+0000","last_peered":"2023-12-16T20:21:41.876977+0000","last_clean":"2023-12-16T20:21:41.876977+0000","last_became_active":"2023-12-16T20:21:41.215893+0000","last_became_peered":"2023-12-16T20:21:41.215893+0000","last_unstale":"2023-12-16T20:21:41.876977+0000","last_undegraded":"2023-12-16T20:21:41.876977+0000","last_fullsized":"2023-12-16T20:21:41.876977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:06:12.245089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.134901+0000","last_change":"2023-12-16T20:21:41.215277+0000","last_active":"2023-12-16T20:21:44.134901+0000","last_peered":"2023-12-16T20:21:44.134901+0000","last_clean":"2023-12-16T20:21:44.134901+0000","last_became_active":"2023-12-16T20:21:41.214950+0000","last_became_peered":"2023-12-16T20:21:41.214950+0000","last_unstale":"2023-12-16T20:21:44.134901+0000","last_undegraded":"2023-12-16T20:21:44.134901+0000","last_fullsized":"2023-12-16T20:21:44.134901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:10.036962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742636+0000","last_change":"2023-12-16T20:21:36.519789+0000","last_active":"2023-12-16T20:21:40.742636+0000","last_peered":"2023-12-16T20:21:40.742636+0000","last_clean":"2023-12-16T20:21:40.742636+0000","last_became_active":"2023-12-16T20:21:36.519476+0000","last_became_peered":"2023-12-16T20:21:36.519476+0000","last_unstale":"2023-12-16T20:21:40.742636+0000","last_undegraded":"2023-12-16T20:21:40.742636+0000","last_fullsized":"2023-12-16T20:21:40.742636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791067+0000","last_change":"2023-12-16T20:21:35.415150+0000","last_active":"2023-12-16T20:21:40.791067+0000","last_peered":"2023-12-16T20:21:40.791067+0000","last_clean":"2023-12-16T20:21:40.791067+0000","last_became_active":"2023-12-16T20:21:35.414846+0000","last_became_peered":"2023-12-16T20:21:35.414846+0000","last_unstale":"2023-12-16T20:21:40.791067+0000","last_undegraded":"2023-12-16T20:21:40.791067+0000","last_fullsized":"2023-12-16T20:21:40.791067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:37.215505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.184929+0000","last_change":"2023-12-16T20:21:40.794438+0000","last_active":"2023-12-16T20:21:44.184929+0000","last_peered":"2023-12-16T20:21:44.184929+0000","last_clean":"2023-12-16T20:21:44.184929+0000","last_became_active":"2023-12-16T20:21:40.794073+0000","last_became_peered":"2023-12-16T20:21:40.794073+0000","last_unstale":"2023-12-16T20:21:44.184929+0000","last_undegraded":"2023-12-16T20:21:44.184929+0000","last_fullsized":"2023-12-16T20:21:44.184929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:32.702839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.673163+0000","last_change":"2023-12-16T20:21:36.524670+0000","last_active":"2023-12-16T20:21:40.673163+0000","last_peered":"2023-12-16T20:21:40.673163+0000","last_clean":"2023-12-16T20:21:40.673163+0000","last_became_active":"2023-12-16T20:21:36.523837+0000","last_became_peered":"2023-12-16T20:21:36.523837+0000","last_unstale":"2023-12-16T20:21:40.673163+0000","last_undegraded":"2023-12-16T20:21:40.673163+0000","last_fullsized":"2023-12-16T20:21:40.673163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672390+0000","last_change":"2023-12-16T20:21:35.422176+0000","last_active":"2023-12-16T20:21:40.672390+0000","last_peered":"2023-12-16T20:21:40.672390+0000","last_clean":"2023-12-16T20:21:40.672390+0000","last_became_active":"2023-12-16T20:21:35.421982+0000","last_became_peered":"2023-12-16T20:21:35.421982+0000","last_unstale":"2023-12-16T20:21:40.672390+0000","last_undegraded":"2023-12-16T20:21:40.672390+0000","last_fullsized":"2023-12-16T20:21:40.672390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752314+0000","last_change":"2023-12-16T20:21:35.424509+0000","last_active":"2023-12-16T20:21:40.752314+0000","last_peered":"2023-12-16T20:21:40.752314+0000","last_clean":"2023-12-16T20:21:40.752314+0000","last_became_active":"2023-12-16T20:21:35.424254+0000","last_became_peered":"2023-12-16T20:21:35.424254+0000","last_unstale":"2023-12-16T20:21:40.752314+0000","last_undegraded":"2023-12-16T20:21:40.752314+0000","last_fullsized":"2023-12-16T20:21:40.752314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738189+0000","last_change":"2023-12-16T20:21:36.533903+0000","last_active":"2023-12-16T20:21:40.738189+0000","last_peered":"2023-12-16T20:21:40.738189+0000","last_clean":"2023-12-16T20:21:40.738189+0000","last_became_active":"2023-12-16T20:21:36.533574+0000","last_became_peered":"2023-12-16T20:21:36.533574+0000","last_unstale":"2023-12-16T20:21:40.738189+0000","last_undegraded":"2023-12-16T20:21:40.738189+0000","last_fullsized":"2023-12-16T20:21:40.738189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.874054+0000","last_change":"2023-12-16T20:21:40.794426+0000","last_active":"2023-12-16T20:21:41.874054+0000","last_peered":"2023-12-16T20:21:41.874054+0000","last_clean":"2023-12-16T20:21:41.874054+0000","last_became_active":"2023-12-16T20:21:40.794082+0000","last_became_peered":"2023-12-16T20:21:40.794082+0000","last_unstale":"2023-12-16T20:21:41.874054+0000","last_undegraded":"2023-12-16T20:21:41.874054+0000","last_fullsized":"2023-12-16T20:21:41.874054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:39:04.889495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672682+0000","last_change":"2023-12-16T20:21:35.419910+0000","last_active":"2023-12-16T20:21:40.672682+0000","last_peered":"2023-12-16T20:21:40.672682+0000","last_clean":"2023-12-16T20:21:40.672682+0000","last_became_active":"2023-12-16T20:21:35.419409+0000","last_became_peered":"2023-12-16T20:21:35.419409+0000","last_unstale":"2023-12-16T20:21:40.672682+0000","last_undegraded":"2023-12-16T20:21:40.672682+0000","last_fullsized":"2023-12-16T20:21:40.672682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726492+0000","last_change":"2023-12-16T20:21:36.533684+0000","last_active":"2023-12-16T20:21:40.726492+0000","last_peered":"2023-12-16T20:21:40.726492+0000","last_clean":"2023-12-16T20:21:40.726492+0000","last_became_active":"2023-12-16T20:21:36.533325+0000","last_became_peered":"2023-12-16T20:21:36.533325+0000","last_unstale":"2023-12-16T20:21:40.726492+0000","last_undegraded":"2023-12-16T20:21:40.726492+0000","last_fullsized":"2023-12-16T20:21:40.726492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:30.795818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877493+0000","last_change":"2023-12-16T20:21:40.745455+0000","last_active":"2023-12-16T20:21:41.877493+0000","last_peered":"2023-12-16T20:21:41.877493+0000","last_clean":"2023-12-16T20:21:41.877493+0000","last_became_active":"2023-12-16T20:21:40.744731+0000","last_became_peered":"2023-12-16T20:21:40.744731+0000","last_unstale":"2023-12-16T20:21:41.877493+0000","last_undegraded":"2023-12-16T20:21:41.877493+0000","last_fullsized":"2023-12-16T20:21:41.877493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:17:56.583460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.751939+0000","last_change":"2023-12-16T20:21:36.542529+0000","last_active":"2023-12-16T20:21:40.751939+0000","last_peered":"2023-12-16T20:21:40.751939+0000","last_clean":"2023-12-16T20:21:40.751939+0000","last_became_active":"2023-12-16T20:21:36.542287+0000","last_became_peered":"2023-12-16T20:21:36.542287+0000","last_unstale":"2023-12-16T20:21:40.751939+0000","last_undegraded":"2023-12-16T20:21:40.751939+0000","last_fullsized":"2023-12-16T20:21:40.751939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725563+0000","last_change":"2023-12-16T20:21:36.551193+0000","last_active":"2023-12-16T20:21:40.725563+0000","last_peered":"2023-12-16T20:21:40.725563+0000","last_clean":"2023-12-16T20:21:40.725563+0000","last_became_active":"2023-12-16T20:21:36.550911+0000","last_became_peered":"2023-12-16T20:21:36.550911+0000","last_unstale":"2023-12-16T20:21:40.725563+0000","last_undegraded":"2023-12-16T20:21:40.725563+0000","last_fullsized":"2023-12-16T20:21:40.725563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:19.545737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.792258+0000","last_change":"2023-12-16T20:21:36.556390+0000","last_active":"2023-12-16T20:21:40.792258+0000","last_peered":"2023-12-16T20:21:40.792258+0000","last_clean":"2023-12-16T20:21:40.792258+0000","last_became_active":"2023-12-16T20:21:36.555822+0000","last_became_peered":"2023-12-16T20:21:36.555822+0000","last_unstale":"2023-12-16T20:21:40.792258+0000","last_undegraded":"2023-12-16T20:21:40.792258+0000","last_fullsized":"2023-12-16T20:21:40.792258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:28.307634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738168+0000","last_change":"2023-12-16T20:21:36.525171+0000","last_active":"2023-12-16T20:21:40.738168+0000","last_peered":"2023-12-16T20:21:40.738168+0000","last_clean":"2023-12-16T20:21:40.738168+0000","last_became_active":"2023-12-16T20:21:36.524747+0000","last_became_peered":"2023-12-16T20:21:36.524747+0000","last_unstale":"2023-12-16T20:21:40.738168+0000","last_undegraded":"2023-12-16T20:21:40.738168+0000","last_fullsized":"2023-12-16T20:21:40.738168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672419+0000","last_change":"2023-12-16T20:21:36.533944+0000","last_active":"2023-12-16T20:21:40.672419+0000","last_peered":"2023-12-16T20:21:40.672419+0000","last_clean":"2023-12-16T20:21:40.672419+0000","last_became_active":"2023-12-16T20:21:36.533682+0000","last_became_peered":"2023-12-16T20:21:36.533682+0000","last_unstale":"2023-12-16T20:21:40.672419+0000","last_undegraded":"2023-12-16T20:21:40.672419+0000","last_fullsized":"2023-12-16T20:21:40.672419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:20.609645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742898+0000","last_change":"2023-12-16T20:21:36.519818+0000","last_active":"2023-12-16T20:21:40.742898+0000","last_peered":"2023-12-16T20:21:40.742898+0000","last_clean":"2023-12-16T20:21:40.742898+0000","last_became_active":"2023-12-16T20:21:36.519545+0000","last_became_peered":"2023-12-16T20:21:36.519545+0000","last_unstale":"2023-12-16T20:21:40.742898+0000","last_undegraded":"2023-12-16T20:21:40.742898+0000","last_fullsized":"2023-12-16T20:21:40.742898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.753739+0000","last_change":"2023-12-16T20:21:36.542706+0000","last_active":"2023-12-16T20:21:40.753739+0000","last_peered":"2023-12-16T20:21:40.753739+0000","last_clean":"2023-12-16T20:21:40.753739+0000","last_became_active":"2023-12-16T20:21:36.542184+0000","last_became_peered":"2023-12-16T20:21:36.542184+0000","last_unstale":"2023-12-16T20:21:40.753739+0000","last_undegraded":"2023-12-16T20:21:40.753739+0000","last_fullsized":"2023-12-16T20:21:40.753739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672194+0000","last_change":"2023-12-16T20:21:36.536726+0000","last_active":"2023-12-16T20:21:40.672194+0000","last_peered":"2023-12-16T20:21:40.672194+0000","last_clean":"2023-12-16T20:21:40.672194+0000","last_became_active":"2023-12-16T20:21:36.536439+0000","last_became_peered":"2023-12-16T20:21:36.536439+0000","last_unstale":"2023-12-16T20:21:40.672194+0000","last_undegraded":"2023-12-16T20:21:40.672194+0000","last_fullsized":"2023-12-16T20:21:40.672194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.790945+0000","last_change":"2023-12-16T20:21:36.555521+0000","last_active":"2023-12-16T20:21:40.790945+0000","last_peered":"2023-12-16T20:21:40.790945+0000","last_clean":"2023-12-16T20:21:40.790945+0000","last_became_active":"2023-12-16T20:21:36.555100+0000","last_became_peered":"2023-12-16T20:21:36.555100+0000","last_unstale":"2023-12-16T20:21:40.790945+0000","last_undegraded":"2023-12-16T20:21:40.790945+0000","last_fullsized":"2023-12-16T20:21:40.790945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672520+0000","last_change":"2023-12-16T20:21:36.535856+0000","last_active":"2023-12-16T20:21:40.672520+0000","last_peered":"2023-12-16T20:21:40.672520+0000","last_clean":"2023-12-16T20:21:40.672520+0000","last_became_active":"2023-12-16T20:21:36.535600+0000","last_became_peered":"2023-12-16T20:21:36.535600+0000","last_unstale":"2023-12-16T20:21:40.672520+0000","last_undegraded":"2023-12-16T20:21:40.672520+0000","last_fullsized":"2023-12-16T20:21:40.672520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791686+0000","last_change":"2023-12-16T20:21:36.553376+0000","last_active":"2023-12-16T20:21:40.791686+0000","last_peered":"2023-12-16T20:21:40.791686+0000","last_clean":"2023-12-16T20:21:40.791686+0000","last_became_active":"2023-12-16T20:21:36.553155+0000","last_became_peered":"2023-12-16T20:21:36.553155+0000","last_unstale":"2023-12-16T20:21:40.791686+0000","last_undegraded":"2023-12-16T20:21:40.791686+0000","last_fullsized":"2023-12-16T20:21:40.791686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738115+0000","last_change":"2023-12-16T20:21:36.524517+0000","last_active":"2023-12-16T20:21:40.738115+0000","last_peered":"2023-12-16T20:21:40.738115+0000","last_clean":"2023-12-16T20:21:40.738115+0000","last_became_active":"2023-12-16T20:21:36.524166+0000","last_became_peered":"2023-12-16T20:21:36.524166+0000","last_unstale":"2023-12-16T20:21:40.738115+0000","last_undegraded":"2023-12-16T20:21:40.738115+0000","last_fullsized":"2023-12-16T20:21:40.738115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752601+0000","last_change":"2023-12-16T20:21:36.542513+0000","last_active":"2023-12-16T20:21:40.752601+0000","last_peered":"2023-12-16T20:21:40.752601+0000","last_clean":"2023-12-16T20:21:40.752601+0000","last_became_active":"2023-12-16T20:21:36.542191+0000","last_became_peered":"2023-12-16T20:21:36.542191+0000","last_unstale":"2023-12-16T20:21:40.752601+0000","last_undegraded":"2023-12-16T20:21:40.752601+0000","last_fullsized":"2023-12-16T20:21:40.752601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211817+0000","last_change":"2023-12-16T20:21:36.518582+0000","last_active":"2023-12-16T20:21:41.211817+0000","last_peered":"2023-12-16T20:21:41.211817+0000","last_clean":"2023-12-16T20:21:41.211817+0000","last_became_active":"2023-12-16T20:21:36.518348+0000","last_became_peered":"2023-12-16T20:21:36.518348+0000","last_unstale":"2023-12-16T20:21:41.211817+0000","last_undegraded":"2023-12-16T20:21:41.211817+0000","last_fullsized":"2023-12-16T20:21:41.211817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:06.805922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725472+0000","last_change":"2023-12-16T20:21:36.544461+0000","last_active":"2023-12-16T20:21:40.725472+0000","last_peered":"2023-12-16T20:21:40.725472+0000","last_clean":"2023-12-16T20:21:40.725472+0000","last_became_active":"2023-12-16T20:21:36.544225+0000","last_became_peered":"2023-12-16T20:21:36.544225+0000","last_unstale":"2023-12-16T20:21:40.725472+0000","last_undegraded":"2023-12-16T20:21:40.725472+0000","last_fullsized":"2023-12-16T20:21:40.725472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:45:02.439240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791694+0000","last_change":"2023-12-16T20:21:36.554370+0000","last_active":"2023-12-16T20:21:40.791694+0000","last_peered":"2023-12-16T20:21:40.791694+0000","last_clean":"2023-12-16T20:21:40.791694+0000","last_became_active":"2023-12-16T20:21:36.554130+0000","last_became_peered":"2023-12-16T20:21:36.554130+0000","last_unstale":"2023-12-16T20:21:40.791694+0000","last_undegraded":"2023-12-16T20:21:40.791694+0000","last_fullsized":"2023-12-16T20:21:40.791694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:05.641757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.790872+0000","last_change":"2023-12-16T20:21:36.555346+0000","last_active":"2023-12-16T20:21:40.790872+0000","last_peered":"2023-12-16T20:21:40.790872+0000","last_clean":"2023-12-16T20:21:40.790872+0000","last_became_active":"2023-12-16T20:21:36.554772+0000","last_became_peered":"2023-12-16T20:21:36.554772+0000","last_unstale":"2023-12-16T20:21:40.790872+0000","last_undegraded":"2023-12-16T20:21:40.790872+0000","last_fullsized":"2023-12-16T20:21:40.790872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742743+0000","last_change":"2023-12-16T20:21:36.534502+0000","last_active":"2023-12-16T20:21:40.742743+0000","last_peered":"2023-12-16T20:21:40.742743+0000","last_clean":"2023-12-16T20:21:40.742743+0000","last_became_active":"2023-12-16T20:21:36.534307+0000","last_became_peered":"2023-12-16T20:21:36.534307+0000","last_unstale":"2023-12-16T20:21:40.742743+0000","last_undegraded":"2023-12-16T20:21:40.742743+0000","last_fullsized":"2023-12-16T20:21:40.742743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.737870+0000","last_change":"2023-12-16T20:21:36.525661+0000","last_active":"2023-12-16T20:21:40.737870+0000","last_peered":"2023-12-16T20:21:40.737870+0000","last_clean":"2023-12-16T20:21:40.737870+0000","last_became_active":"2023-12-16T20:21:36.525427+0000","last_became_peered":"2023-12-16T20:21:36.525427+0000","last_unstale":"2023-12-16T20:21:40.737870+0000","last_undegraded":"2023-12-16T20:21:40.737870+0000","last_fullsized":"2023-12-16T20:21:40.737870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:39:00.494290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672421+0000","last_change":"2023-12-16T20:21:36.542756+0000","last_active":"2023-12-16T20:21:40.672421+0000","last_peered":"2023-12-16T20:21:40.672421+0000","last_clean":"2023-12-16T20:21:40.672421+0000","last_became_active":"2023-12-16T20:21:36.542513+0000","last_became_peered":"2023-12-16T20:21:36.542513+0000","last_unstale":"2023-12-16T20:21:40.672421+0000","last_undegraded":"2023-12-16T20:21:40.672421+0000","last_fullsized":"2023-12-16T20:21:40.672421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726700+0000","last_change":"2023-12-16T20:21:36.544754+0000","last_active":"2023-12-16T20:21:40.726700+0000","last_peered":"2023-12-16T20:21:40.726700+0000","last_clean":"2023-12-16T20:21:40.726700+0000","last_became_active":"2023-12-16T20:21:36.544492+0000","last_became_peered":"2023-12-16T20:21:36.544492+0000","last_unstale":"2023-12-16T20:21:40.726700+0000","last_undegraded":"2023-12-16T20:21:40.726700+0000","last_fullsized":"2023-12-16T20:21:40.726700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:19.509623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752407+0000","last_change":"2023-12-16T20:21:36.552022+0000","last_active":"2023-12-16T20:21:40.752407+0000","last_peered":"2023-12-16T20:21:40.752407+0000","last_clean":"2023-12-16T20:21:40.752407+0000","last_became_active":"2023-12-16T20:21:36.551775+0000","last_became_peered":"2023-12-16T20:21:36.551775+0000","last_unstale":"2023-12-16T20:21:40.752407+0000","last_undegraded":"2023-12-16T20:21:40.752407+0000","last_fullsized":"2023-12-16T20:21:40.752407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.753663+0000","last_change":"2023-12-16T20:21:36.551107+0000","last_active":"2023-12-16T20:21:40.753663+0000","last_peered":"2023-12-16T20:21:40.753663+0000","last_clean":"2023-12-16T20:21:40.753663+0000","last_became_active":"2023-12-16T20:21:36.550815+0000","last_became_peered":"2023-12-16T20:21:36.550815+0000","last_unstale":"2023-12-16T20:21:40.753663+0000","last_undegraded":"2023-12-16T20:21:40.753663+0000","last_fullsized":"2023-12-16T20:21:40.753663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211809+0000","last_change":"2023-12-16T20:21:36.554041+0000","last_active":"2023-12-16T20:21:41.211809+0000","last_peered":"2023-12-16T20:21:41.211809+0000","last_clean":"2023-12-16T20:21:41.211809+0000","last_became_active":"2023-12-16T20:21:36.553708+0000","last_became_peered":"2023-12-16T20:21:36.553708+0000","last_unstale":"2023-12-16T20:21:41.211809+0000","last_undegraded":"2023-12-16T20:21:41.211809+0000","last_fullsized":"2023-12-16T20:21:41.211809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:36.868562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.671819+0000","last_change":"2023-12-16T20:21:36.551348+0000","last_active":"2023-12-16T20:21:40.671819+0000","last_peered":"2023-12-16T20:21:40.671819+0000","last_clean":"2023-12-16T20:21:40.671819+0000","last_became_active":"2023-12-16T20:21:36.551066+0000","last_became_peered":"2023-12-16T20:21:36.551066+0000","last_unstale":"2023-12-16T20:21:40.671819+0000","last_undegraded":"2023-12-16T20:21:40.671819+0000","last_fullsized":"2023-12-16T20:21:40.671819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211281+0000","last_change":"2023-12-16T20:21:36.523828+0000","last_active":"2023-12-16T20:21:41.211281+0000","last_peered":"2023-12-16T20:21:41.211281+0000","last_clean":"2023-12-16T20:21:41.211281+0000","last_became_active":"2023-12-16T20:21:36.523604+0000","last_became_peered":"2023-12-16T20:21:36.523604+0000","last_unstale":"2023-12-16T20:21:41.211281+0000","last_undegraded":"2023-12-16T20:21:41.211281+0000","last_fullsized":"2023-12-16T20:21:41.211281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791600+0000","last_change":"2023-12-16T20:21:36.556286+0000","last_active":"2023-12-16T20:21:40.791600+0000","last_peered":"2023-12-16T20:21:40.791600+0000","last_clean":"2023-12-16T20:21:40.791600+0000","last_became_active":"2023-12-16T20:21:36.556041+0000","last_became_peered":"2023-12-16T20:21:36.556041+0000","last_unstale":"2023-12-16T20:21:40.791600+0000","last_undegraded":"2023-12-16T20:21:40.791600+0000","last_fullsized":"2023-12-16T20:21:40.791600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211340+0000","last_change":"2023-12-16T20:21:36.518408+0000","last_active":"2023-12-16T20:21:41.211340+0000","last_peered":"2023-12-16T20:21:41.211340+0000","last_clean":"2023-12-16T20:21:41.211340+0000","last_became_active":"2023-12-16T20:21:36.518138+0000","last_became_peered":"2023-12-16T20:21:36.518138+0000","last_unstale":"2023-12-16T20:21:41.211340+0000","last_undegraded":"2023-12-16T20:21:41.211340+0000","last_fullsized":"2023-12-16T20:21:41.211340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791179+0000","last_change":"2023-12-16T20:21:36.555311+0000","last_active":"2023-12-16T20:21:40.791179+0000","last_peered":"2023-12-16T20:21:40.791179+0000","last_clean":"2023-12-16T20:21:40.791179+0000","last_became_active":"2023-12-16T20:21:36.555041+0000","last_became_peered":"2023-12-16T20:21:36.555041+0000","last_unstale":"2023-12-16T20:21:40.791179+0000","last_undegraded":"2023-12-16T20:21:40.791179+0000","last_fullsized":"2023-12-16T20:21:40.791179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:20.609645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738053+0000","last_change":"2023-12-16T20:21:36.524036+0000","last_active":"2023-12-16T20:21:40.738053+0000","last_peered":"2023-12-16T20:21:40.738053+0000","last_clean":"2023-12-16T20:21:40.738053+0000","last_became_active":"2023-12-16T20:21:36.523784+0000","last_became_peered":"2023-12-16T20:21:36.523784+0000","last_unstale":"2023-12-16T20:21:40.738053+0000","last_undegraded":"2023-12-16T20:21:40.738053+0000","last_fullsized":"2023-12-16T20:21:40.738053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743757+0000","last_change":"2023-12-16T20:21:36.526391+0000","last_active":"2023-12-16T20:21:40.743757+0000","last_peered":"2023-12-16T20:21:40.743757+0000","last_clean":"2023-12-16T20:21:40.743757+0000","last_became_active":"2023-12-16T20:21:36.526151+0000","last_became_peered":"2023-12-16T20:21:36.526151+0000","last_unstale":"2023-12-16T20:21:40.743757+0000","last_undegraded":"2023-12-16T20:21:40.743757+0000","last_fullsized":"2023-12-16T20:21:40.743757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211659+0000","last_change":"2023-12-16T20:21:36.543566+0000","last_active":"2023-12-16T20:21:41.211659+0000","last_peered":"2023-12-16T20:21:41.211659+0000","last_clean":"2023-12-16T20:21:41.211659+0000","last_became_active":"2023-12-16T20:21:36.543306+0000","last_became_peered":"2023-12-16T20:21:36.543306+0000","last_unstale":"2023-12-16T20:21:41.211659+0000","last_undegraded":"2023-12-16T20:21:41.211659+0000","last_fullsized":"2023-12-16T20:21:41.211659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:03.543973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4638,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65176,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":695413,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":104589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":104623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":695469,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T20:22:04.022 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T20:22:04.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.155+0000 7fd39bcc9640 1 Processor -- start 2023-12-16T20:22:04.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.155+0000 7fd39bcc9640 1 -- start start 2023-12-16T20:22:04.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.156+0000 7fd39bcc9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd3941504e0 0x7fd39406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:04.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.156+0000 7fd39bcc9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3940c7190 0x7fd39406e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:04.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.156+0000 7fd39bcc9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3940c5f60 con 0x7fd3940c7700 2023-12-16T20:22:04.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.156+0000 7fd39bcc9640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3940c2c60 con 0x7fd3941504e0 2023-12-16T20:22:04.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.156+0000 7fd39bcc9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3940c2f20 con 0x7fd3940c7190 2023-12-16T20:22:04.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.157+0000 7fd39a266640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd3940c7700 0x7fd3940c7ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54932/0 (socket says 172.21.15.87:54932) 2023-12-16T20:22:04.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.157+0000 7fd39a266640 1 -- 172.21.15.87:0/3897921663 learned_addr learned my addr 172.21.15.87:0/3897921663 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:04.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.157+0000 7fd399264640 1 --2- 172.21.15.87:0/3897921663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3940c7190 0x7fd39406e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:04.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.159+0000 7fd399264640 1 -- 172.21.15.87:0/3897921663 >> v2:172.21.15.195:3300/0 conn(0x7fd3941504e0 msgr2=0x7fd39406e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:04.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.159+0000 7fd399264640 1 --2- 172.21.15.87:0/3897921663 >> v2:172.21.15.195:3300/0 conn(0x7fd3941504e0 0x7fd39406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.159+0000 7fd399264640 1 -- 172.21.15.87:0/3897921663 >> v1:172.21.15.87:6789/0 conn(0x7fd3940c7700 legacy=0x7fd3940c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:04.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.159+0000 7fd399264640 1 -- 172.21.15.87:0/3897921663 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3940c61b0 con 0x7fd3940c7190 2023-12-16T20:22:04.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.161+0000 7fd399264640 1 --2- 172.21.15.87:0/3897921663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3940c7190 0x7fd39406e6e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd3840097a0 tx=0x7fd38402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=422d49ec4dec6cb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:04.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.165+0000 7fd398a63640 1 -- 172.21.15.87:0/3897921663 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38402e070 con 0x7fd3940c7190 2023-12-16T20:22:04.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.165+0000 7fd398a63640 1 -- 172.21.15.87:0/3897921663 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3840315a0 con 0x7fd3940c7190 2023-12-16T20:22:04.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.165+0000 7fd398a63640 1 -- 172.21.15.87:0/3897921663 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384031930 con 0x7fd3940c7190 2023-12-16T20:22:04.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.165+0000 7fd39bcc9640 1 -- 172.21.15.87:0/3897921663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3940c7190 msgr2=0x7fd39406e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:04.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.165+0000 7fd39bcc9640 1 --2- 172.21.15.87:0/3897921663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3940c7190 0x7fd39406e6e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd3840097a0 tx=0x7fd38402b840 comp rx=0 tx=0).stop 2023-12-16T20:22:04.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.165+0000 7fd39bcc9640 1 -- 172.21.15.87:0/3897921663 shutdown_connections 2023-12-16T20:22:04.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.165+0000 7fd39bcc9640 1 --2- 172.21.15.87:0/3897921663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3940c7190 0x7fd39406e6e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.165+0000 7fd39bcc9640 1 --2- 172.21.15.87:0/3897921663 >> v2:172.21.15.195:3300/0 conn(0x7fd3941504e0 0x7fd39406e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.165+0000 7fd39bcc9640 1 -- 172.21.15.87:0/3897921663 >> 172.21.15.87:0/3897921663 conn(0x7fd3940cbef0 msgr2=0x7fd3940cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:04.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.166+0000 7fd39bcc9640 1 -- 172.21.15.87:0/3897921663 shutdown_connections 2023-12-16T20:22:04.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.166+0000 7fd39bcc9640 1 -- 172.21.15.87:0/3897921663 wait complete. 2023-12-16T20:22:04.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.167+0000 7fd39bcc9640 1 Processor -- start 2023-12-16T20:22:04.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.167+0000 7fd39bcc9640 1 -- start start 2023-12-16T20:22:04.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.167+0000 7fd39bcc9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3940c7190 0x7fd39414ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:04.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.167+0000 7fd39bcc9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3940c7700 0x7fd3940c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:04.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.167+0000 7fd39bcc9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3941504e0 0x7fd3940c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:04.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.167+0000 7fd39bcc9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39414f0e0 con 0x7fd3940c7700 2023-12-16T20:22:04.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.167+0000 7fd39bcc9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3940c4010 con 0x7fd3941504e0 2023-12-16T20:22:04.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.167+0000 7fd39bcc9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39415a0c0 con 0x7fd3940c7190 2023-12-16T20:22:04.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.168+0000 7fd399a65640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3940c7190 0x7fd39414ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:04.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.168+0000 7fd399264640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3940c7700 0x7fd3940c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:04.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.168+0000 7fd399a65640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3940c7190 0x7fd39414ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:35256/0 (socket says 172.21.15.87:35256) 2023-12-16T20:22:04.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.168+0000 7fd399a65640 1 -- 172.21.15.87:0/679008149 learned_addr learned my addr 172.21.15.87:0/679008149 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:04.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.169+0000 7fd39a266640 1 --2- 172.21.15.87:0/679008149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3941504e0 0x7fd3940c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:04.173 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.171+0000 7fd399a65640 1 -- 172.21.15.87:0/679008149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3941504e0 msgr2=0x7fd3940c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:04.173 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.171+0000 7fd399a65640 1 --2- 172.21.15.87:0/679008149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3941504e0 0x7fd3940c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.173 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.171+0000 7fd399a65640 1 -- 172.21.15.87:0/679008149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3940c7700 msgr2=0x7fd3940c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:04.173 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.171+0000 7fd399a65640 1 --2- 172.21.15.87:0/679008149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3940c7700 0x7fd3940c44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.173 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.171+0000 7fd399a65640 1 -- 172.21.15.87:0/679008149 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd384009400 con 0x7fd3940c7190 2023-12-16T20:22:04.175 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.174+0000 7fd399a65640 1 --2- 172.21.15.87:0/679008149 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3940c7190 0x7fd39414ba40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd39000b440 tx=0x7fd39000b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:04.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.178+0000 7fd38a7fc640 1 -- 172.21.15.87:0/679008149 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390011890 con 0x7fd3940c7190 2023-12-16T20:22:04.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.178+0000 7fd38a7fc640 1 -- 172.21.15.87:0/679008149 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3900119f0 con 0x7fd3940c7190 2023-12-16T20:22:04.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.178+0000 7fd38a7fc640 1 -- 172.21.15.87:0/679008149 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390011da0 con 0x7fd3940c7190 2023-12-16T20:22:04.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.178+0000 7fd39bcc9640 1 -- 172.21.15.87:0/679008149 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39414c400 con 0x7fd3940c7190 2023-12-16T20:22:04.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.178+0000 7fd39bcc9640 1 -- 172.21.15.87:0/679008149 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3940c3ca0 con 0x7fd3940c7190 2023-12-16T20:22:04.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.179+0000 7fd39bcc9640 1 -- 172.21.15.87:0/679008149 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3940740e0 con 0x7fd3940c7190 2023-12-16T20:22:04.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.422+0000 7fd38a7fc640 1 -- 172.21.15.87:0/679008149 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fd39001a400 con 0x7fd3940c7190 2023-12-16T20:22:04.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.423+0000 7fd38a7fc640 1 --2- 172.21.15.87:0/679008149 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd37806aec0 0x7fd37806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:04.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.423+0000 7fd399264640 1 --2- 172.21.15.87:0/679008149 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd37806aec0 0x7fd37806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:04.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.423+0000 7fd399264640 1 --2- 172.21.15.87:0/679008149 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd37806aec0 0x7fd37806d380 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd384036000 tx=0x7fd38403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:04.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.428+0000 7fd38a7fc640 1 -- 172.21.15.87:0/679008149 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd390059370 con 0x7fd3940c7190 2023-12-16T20:22:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.440+0000 7fd38a7fc640 1 -- 172.21.15.87:0/679008149 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fd390054fb0 con 0x7fd3940c7190 2023-12-16T20:22:04.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.614+0000 7fd39bcc9640 1 -- 172.21.15.87:0/679008149 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd39414cac0 con 0x7fd37806aec0 2023-12-16T20:22:04.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.623+0000 7fd38a7fc640 1 -- 172.21.15.87:0/679008149 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345321 (secure 0 0 0) 0x7fd39414cac0 con 0x7fd37806aec0 2023-12-16T20:22:04.628 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:22:04.631 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-12-16T20:22:04.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.626+0000 7fd39bcc9640 1 -- 172.21.15.87:0/679008149 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd37806aec0 msgr2=0x7fd37806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.626+0000 7fd39bcc9640 1 --2- 172.21.15.87:0/679008149 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd37806aec0 0x7fd37806d380 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd384036000 tx=0x7fd38403d040 comp rx=0 tx=0).stop 2023-12-16T20:22:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.626+0000 7fd39bcc9640 1 -- 172.21.15.87:0/679008149 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3940c7190 msgr2=0x7fd39414ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.626+0000 7fd39bcc9640 1 --2- 172.21.15.87:0/679008149 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3940c7190 0x7fd39414ba40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd39000b440 tx=0x7fd39000b900 comp rx=0 tx=0).stop 2023-12-16T20:22:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.626+0000 7fd39bcc9640 1 -- 172.21.15.87:0/679008149 shutdown_connections 2023-12-16T20:22:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.626+0000 7fd39bcc9640 1 --2- 172.21.15.87:0/679008149 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd37806aec0 0x7fd37806d380 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.626+0000 7fd39bcc9640 1 --2- 172.21.15.87:0/679008149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3941504e0 0x7fd3940c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.626+0000 7fd39bcc9640 1 --2- 172.21.15.87:0/679008149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3940c7700 0x7fd3940c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.626+0000 7fd39bcc9640 1 --2- 172.21.15.87:0/679008149 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3940c7190 0x7fd39414ba40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.626+0000 7fd39bcc9640 1 -- 172.21.15.87:0/679008149 >> 172.21.15.87:0/679008149 conn(0x7fd3940cbef0 msgr2=0x7fd39414e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.626+0000 7fd39bcc9640 1 -- 172.21.15.87:0/679008149 shutdown_connections 2023-12-16T20:22:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.626+0000 7fd39bcc9640 1 -- 172.21.15.87:0/679008149 wait complete. 2023-12-16T20:22:04.638 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-12-16T20:22:04.284551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595006,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222592,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754752128,"statfs":{"total":773094113280,"available":772866179072,"internally_reserved":0,"allocated":2326528,"data_stored":2025716,"data_compressed":65176,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002773"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738410+0000","last_change":"2023-12-16T20:21:35.413343+0000","last_active":"2023-12-16T20:21:40.738410+0000","last_peered":"2023-12-16T20:21:40.738410+0000","last_clean":"2023-12-16T20:21:40.738410+0000","last_became_active":"2023-12-16T20:21:35.413075+0000","last_became_peered":"2023-12-16T20:21:35.413075+0000","last_unstale":"2023-12-16T20:21:40.738410+0000","last_undegraded":"2023-12-16T20:21:40.738410+0000","last_fullsized":"2023-12-16T20:21:40.738410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672090+0000","last_change":"2023-12-16T20:21:36.542907+0000","last_active":"2023-12-16T20:21:40.672090+0000","last_peered":"2023-12-16T20:21:40.672090+0000","last_clean":"2023-12-16T20:21:40.672090+0000","last_became_active":"2023-12-16T20:21:36.542667+0000","last_became_peered":"2023-12-16T20:21:36.542667+0000","last_unstale":"2023-12-16T20:21:40.672090+0000","last_undegraded":"2023-12-16T20:21:40.672090+0000","last_fullsized":"2023-12-16T20:21:40.672090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.876874+0000","last_change":"2023-12-16T20:21:41.216466+0000","last_active":"2023-12-16T20:21:41.876874+0000","last_peered":"2023-12-16T20:21:41.876874+0000","last_clean":"2023-12-16T20:21:41.876874+0000","last_became_active":"2023-12-16T20:21:41.216062+0000","last_became_peered":"2023-12-16T20:21:41.216062+0000","last_unstale":"2023-12-16T20:21:41.876874+0000","last_undegraded":"2023-12-16T20:21:41.876874+0000","last_fullsized":"2023-12-16T20:21:41.876874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:33:01.663841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672276+0000","last_change":"2023-12-16T20:21:35.420038+0000","last_active":"2023-12-16T20:21:40.672276+0000","last_peered":"2023-12-16T20:21:40.672276+0000","last_clean":"2023-12-16T20:21:40.672276+0000","last_became_active":"2023-12-16T20:21:35.419745+0000","last_became_peered":"2023-12-16T20:21:35.419745+0000","last_unstale":"2023-12-16T20:21:40.672276+0000","last_undegraded":"2023-12-16T20:21:40.672276+0000","last_fullsized":"2023-12-16T20:21:40.672276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738303+0000","last_change":"2023-12-16T20:21:36.552916+0000","last_active":"2023-12-16T20:21:40.738303+0000","last_peered":"2023-12-16T20:21:40.738303+0000","last_clean":"2023-12-16T20:21:40.738303+0000","last_became_active":"2023-12-16T20:21:36.552621+0000","last_became_peered":"2023-12-16T20:21:36.552621+0000","last_unstale":"2023-12-16T20:21:40.738303+0000","last_undegraded":"2023-12-16T20:21:40.738303+0000","last_fullsized":"2023-12-16T20:21:40.738303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877621+0000","last_change":"2023-12-16T20:21:40.754959+0000","last_active":"2023-12-16T20:21:41.877621+0000","last_peered":"2023-12-16T20:21:41.877621+0000","last_clean":"2023-12-16T20:21:41.877621+0000","last_became_active":"2023-12-16T20:21:40.754509+0000","last_became_peered":"2023-12-16T20:21:40.754509+0000","last_unstale":"2023-12-16T20:21:41.877621+0000","last_undegraded":"2023-12-16T20:21:41.877621+0000","last_fullsized":"2023-12-16T20:21:41.877621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:21.787809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211739+0000","last_change":"2023-12-16T20:21:35.427622+0000","last_active":"2023-12-16T20:21:41.211739+0000","last_peered":"2023-12-16T20:21:41.211739+0000","last_clean":"2023-12-16T20:21:41.211739+0000","last_became_active":"2023-12-16T20:21:35.427317+0000","last_became_peered":"2023-12-16T20:21:35.427317+0000","last_unstale":"2023-12-16T20:21:41.211739+0000","last_undegraded":"2023-12-16T20:21:41.211739+0000","last_fullsized":"2023-12-16T20:21:41.211739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791265+0000","last_change":"2023-12-16T20:21:36.551723+0000","last_active":"2023-12-16T20:21:40.791265+0000","last_peered":"2023-12-16T20:21:40.791265+0000","last_clean":"2023-12-16T20:21:40.791265+0000","last_became_active":"2023-12-16T20:21:36.551475+0000","last_became_peered":"2023-12-16T20:21:36.551475+0000","last_unstale":"2023-12-16T20:21:40.791265+0000","last_undegraded":"2023-12-16T20:21:40.791265+0000","last_fullsized":"2023-12-16T20:21:40.791265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877788+0000","last_change":"2023-12-16T20:21:40.753693+0000","last_active":"2023-12-16T20:21:41.877788+0000","last_peered":"2023-12-16T20:21:41.877788+0000","last_clean":"2023-12-16T20:21:41.877788+0000","last_became_active":"2023-12-16T20:21:40.753268+0000","last_became_peered":"2023-12-16T20:21:40.753268+0000","last_unstale":"2023-12-16T20:21:41.877788+0000","last_undegraded":"2023-12-16T20:21:41.877788+0000","last_fullsized":"2023-12-16T20:21:41.877788+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:39.757419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211396+0000","last_change":"2023-12-16T20:21:35.413521+0000","last_active":"2023-12-16T20:21:41.211396+0000","last_peered":"2023-12-16T20:21:41.211396+0000","last_clean":"2023-12-16T20:21:41.211396+0000","last_became_active":"2023-12-16T20:21:35.413234+0000","last_became_peered":"2023-12-16T20:21:35.413234+0000","last_unstale":"2023-12-16T20:21:41.211396+0000","last_undegraded":"2023-12-16T20:21:41.211396+0000","last_fullsized":"2023-12-16T20:21:41.211396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791426+0000","last_change":"2023-12-16T20:21:36.554419+0000","last_active":"2023-12-16T20:21:40.791426+0000","last_peered":"2023-12-16T20:21:40.791426+0000","last_clean":"2023-12-16T20:21:40.791426+0000","last_became_active":"2023-12-16T20:21:36.554014+0000","last_became_peered":"2023-12-16T20:21:36.554014+0000","last_unstale":"2023-12-16T20:21:40.791426+0000","last_undegraded":"2023-12-16T20:21:40.791426+0000","last_fullsized":"2023-12-16T20:21:40.791426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:03.543973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877746+0000","last_change":"2023-12-16T20:21:40.794852+0000","last_active":"2023-12-16T20:21:41.877746+0000","last_peered":"2023-12-16T20:21:41.877746+0000","last_clean":"2023-12-16T20:21:41.877746+0000","last_became_active":"2023-12-16T20:21:40.794471+0000","last_became_peered":"2023-12-16T20:21:40.794471+0000","last_unstale":"2023-12-16T20:21:41.877746+0000","last_undegraded":"2023-12-16T20:21:41.877746+0000","last_fullsized":"2023-12-16T20:21:41.877746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:25.004850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752195+0000","last_change":"2023-12-16T20:21:36.542450+0000","last_active":"2023-12-16T20:21:40.752195+0000","last_peered":"2023-12-16T20:21:40.752195+0000","last_clean":"2023-12-16T20:21:40.752195+0000","last_became_active":"2023-12-16T20:21:36.542157+0000","last_became_peered":"2023-12-16T20:21:36.542157+0000","last_unstale":"2023-12-16T20:21:40.752195+0000","last_undegraded":"2023-12-16T20:21:40.752195+0000","last_fullsized":"2023-12-16T20:21:40.752195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211548+0000","last_change":"2023-12-16T20:21:35.413681+0000","last_active":"2023-12-16T20:21:41.211548+0000","last_peered":"2023-12-16T20:21:41.211548+0000","last_clean":"2023-12-16T20:21:41.211548+0000","last_became_active":"2023-12-16T20:21:35.413400+0000","last_became_peered":"2023-12-16T20:21:35.413400+0000","last_unstale":"2023-12-16T20:21:41.211548+0000","last_undegraded":"2023-12-16T20:21:41.211548+0000","last_fullsized":"2023-12-16T20:21:41.211548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:27.767422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.878229+0000","last_change":"2023-12-16T20:21:40.745971+0000","last_active":"2023-12-16T20:21:41.878229+0000","last_peered":"2023-12-16T20:21:41.878229+0000","last_clean":"2023-12-16T20:21:41.878229+0000","last_became_active":"2023-12-16T20:21:40.745544+0000","last_became_peered":"2023-12-16T20:21:40.745544+0000","last_unstale":"2023-12-16T20:21:41.878229+0000","last_undegraded":"2023-12-16T20:21:41.878229+0000","last_fullsized":"2023-12-16T20:21:41.878229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:18.981353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672085+0000","last_change":"2023-12-16T20:21:36.526277+0000","last_active":"2023-12-16T20:21:40.672085+0000","last_peered":"2023-12-16T20:21:40.672085+0000","last_clean":"2023-12-16T20:21:40.672085+0000","last_became_active":"2023-12-16T20:21:36.525983+0000","last_became_peered":"2023-12-16T20:21:36.525983+0000","last_unstale":"2023-12-16T20:21:40.672085+0000","last_undegraded":"2023-12-16T20:21:40.672085+0000","last_fullsized":"2023-12-16T20:21:40.672085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743603+0000","last_change":"2023-12-16T20:21:35.420017+0000","last_active":"2023-12-16T20:21:40.743603+0000","last_peered":"2023-12-16T20:21:40.743603+0000","last_clean":"2023-12-16T20:21:40.743603+0000","last_became_active":"2023-12-16T20:21:35.419731+0000","last_became_peered":"2023-12-16T20:21:35.419731+0000","last_unstale":"2023-12-16T20:21:40.743603+0000","last_undegraded":"2023-12-16T20:21:40.743603+0000","last_fullsized":"2023-12-16T20:21:40.743603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:29.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.878175+0000","last_change":"2023-12-16T20:21:40.755335+0000","last_active":"2023-12-16T20:21:41.878175+0000","last_peered":"2023-12-16T20:21:41.878175+0000","last_clean":"2023-12-16T20:21:41.878175+0000","last_became_active":"2023-12-16T20:21:40.754829+0000","last_became_peered":"2023-12-16T20:21:40.754829+0000","last_unstale":"2023-12-16T20:21:41.878175+0000","last_undegraded":"2023-12-16T20:21:41.878175+0000","last_fullsized":"2023-12-16T20:21:41.878175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.673227+0000","last_change":"2023-12-16T20:21:36.518939+0000","last_active":"2023-12-16T20:21:40.673227+0000","last_peered":"2023-12-16T20:21:40.673227+0000","last_clean":"2023-12-16T20:21:40.673227+0000","last_became_active":"2023-12-16T20:21:36.518686+0000","last_became_peered":"2023-12-16T20:21:36.518686+0000","last_unstale":"2023-12-16T20:21:40.673227+0000","last_undegraded":"2023-12-16T20:21:40.673227+0000","last_fullsized":"2023-12-16T20:21:40.673227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742823+0000","last_change":"2023-12-16T20:21:35.416372+0000","last_active":"2023-12-16T20:21:40.742823+0000","last_peered":"2023-12-16T20:21:40.742823+0000","last_clean":"2023-12-16T20:21:40.742823+0000","last_became_active":"2023-12-16T20:21:35.416067+0000","last_became_peered":"2023-12-16T20:21:35.416067+0000","last_unstale":"2023-12-16T20:21:40.742823+0000","last_undegraded":"2023-12-16T20:21:40.742823+0000","last_fullsized":"2023-12-16T20:21:40.742823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:37.215505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.432342+0000","last_change":"2023-12-16T20:21:41.215250+0000","last_active":"2023-12-16T20:21:43.432342+0000","last_peered":"2023-12-16T20:21:43.432342+0000","last_clean":"2023-12-16T20:21:43.432342+0000","last_became_active":"2023-12-16T20:21:41.214198+0000","last_became_peered":"2023-12-16T20:21:41.214198+0000","last_unstale":"2023-12-16T20:21:43.432342+0000","last_undegraded":"2023-12-16T20:21:43.432342+0000","last_fullsized":"2023-12-16T20:21:43.432342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:41.263768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726299+0000","last_change":"2023-12-16T20:21:36.536797+0000","last_active":"2023-12-16T20:21:40.726299+0000","last_peered":"2023-12-16T20:21:40.726299+0000","last_clean":"2023-12-16T20:21:40.726299+0000","last_became_active":"2023-12-16T20:21:36.536321+0000","last_became_peered":"2023-12-16T20:21:36.536321+0000","last_unstale":"2023-12-16T20:21:40.726299+0000","last_undegraded":"2023-12-16T20:21:40.726299+0000","last_fullsized":"2023-12-16T20:21:40.726299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:55:55.607439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211371+0000","last_change":"2023-12-16T20:21:35.425939+0000","last_active":"2023-12-16T20:21:41.211371+0000","last_peered":"2023-12-16T20:21:41.211371+0000","last_clean":"2023-12-16T20:21:41.211371+0000","last_became_active":"2023-12-16T20:21:35.420547+0000","last_became_peered":"2023-12-16T20:21:35.420547+0000","last_unstale":"2023-12-16T20:21:41.211371+0000","last_undegraded":"2023-12-16T20:21:41.211371+0000","last_fullsized":"2023-12-16T20:21:41.211371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:58:31.980302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.878401+0000","last_change":"2023-12-16T20:21:40.757445+0000","last_active":"2023-12-16T20:21:41.878401+0000","last_peered":"2023-12-16T20:21:41.878401+0000","last_clean":"2023-12-16T20:21:41.878401+0000","last_became_active":"2023-12-16T20:21:40.756997+0000","last_became_peered":"2023-12-16T20:21:40.756997+0000","last_unstale":"2023-12-16T20:21:41.878401+0000","last_undegraded":"2023-12-16T20:21:41.878401+0000","last_fullsized":"2023-12-16T20:21:41.878401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:32.702839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738149+0000","last_change":"2023-12-16T20:21:36.524943+0000","last_active":"2023-12-16T20:21:40.738149+0000","last_peered":"2023-12-16T20:21:40.738149+0000","last_clean":"2023-12-16T20:21:40.738149+0000","last_became_active":"2023-12-16T20:21:36.524703+0000","last_became_peered":"2023-12-16T20:21:36.524703+0000","last_unstale":"2023-12-16T20:21:40.738149+0000","last_undegraded":"2023-12-16T20:21:40.738149+0000","last_fullsized":"2023-12-16T20:21:40.738149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.753645+0000","last_change":"2023-12-16T20:21:35.428736+0000","last_active":"2023-12-16T20:21:40.753645+0000","last_peered":"2023-12-16T20:21:40.753645+0000","last_clean":"2023-12-16T20:21:40.753645+0000","last_became_active":"2023-12-16T20:21:35.428465+0000","last_became_peered":"2023-12-16T20:21:35.428465+0000","last_unstale":"2023-12-16T20:21:40.753645+0000","last_undegraded":"2023-12-16T20:21:40.753645+0000","last_fullsized":"2023-12-16T20:21:40.753645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877780+0000","last_change":"2023-12-16T20:21:41.213330+0000","last_active":"2023-12-16T20:21:41.877780+0000","last_peered":"2023-12-16T20:21:41.877780+0000","last_clean":"2023-12-16T20:21:41.877780+0000","last_became_active":"2023-12-16T20:21:41.212976+0000","last_became_peered":"2023-12-16T20:21:41.212976+0000","last_unstale":"2023-12-16T20:21:41.877780+0000","last_undegraded":"2023-12-16T20:21:41.877780+0000","last_fullsized":"2023-12-16T20:21:41.877780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:32:02.178544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672371+0000","last_change":"2023-12-16T20:21:36.518956+0000","last_active":"2023-12-16T20:21:40.672371+0000","last_peered":"2023-12-16T20:21:40.672371+0000","last_clean":"2023-12-16T20:21:40.672371+0000","last_became_active":"2023-12-16T20:21:36.518673+0000","last_became_peered":"2023-12-16T20:21:36.518673+0000","last_unstale":"2023-12-16T20:21:40.672371+0000","last_undegraded":"2023-12-16T20:21:40.672371+0000","last_fullsized":"2023-12-16T20:21:40.672371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743808+0000","last_change":"2023-12-16T20:21:35.423292+0000","last_active":"2023-12-16T20:21:40.743808+0000","last_peered":"2023-12-16T20:21:40.743808+0000","last_clean":"2023-12-16T20:21:40.743808+0000","last_became_active":"2023-12-16T20:21:35.423045+0000","last_became_peered":"2023-12-16T20:21:35.423045+0000","last_unstale":"2023-12-16T20:21:40.743808+0000","last_undegraded":"2023-12-16T20:21:40.743808+0000","last_fullsized":"2023-12-16T20:21:40.743808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.876800+0000","last_change":"2023-12-16T20:21:41.216113+0000","last_active":"2023-12-16T20:21:41.876800+0000","last_peered":"2023-12-16T20:21:41.876800+0000","last_clean":"2023-12-16T20:21:41.876800+0000","last_became_active":"2023-12-16T20:21:41.215747+0000","last_became_peered":"2023-12-16T20:21:41.215747+0000","last_unstale":"2023-12-16T20:21:41.876800+0000","last_undegraded":"2023-12-16T20:21:41.876800+0000","last_fullsized":"2023-12-16T20:21:41.876800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:10:17.859148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742993+0000","last_change":"2023-12-16T20:21:36.451660+0000","last_active":"2023-12-16T20:21:40.742993+0000","last_peered":"2023-12-16T20:21:40.742993+0000","last_clean":"2023-12-16T20:21:40.742993+0000","last_became_active":"2023-12-16T20:21:36.451404+0000","last_became_peered":"2023-12-16T20:21:36.451404+0000","last_unstale":"2023-12-16T20:21:40.742993+0000","last_undegraded":"2023-12-16T20:21:40.742993+0000","last_fullsized":"2023-12-16T20:21:40.742993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211871+0000","last_change":"2023-12-16T20:21:35.420184+0000","last_active":"2023-12-16T20:21:41.211871+0000","last_peered":"2023-12-16T20:21:41.211871+0000","last_clean":"2023-12-16T20:21:41.211871+0000","last_became_active":"2023-12-16T20:21:35.419917+0000","last_became_peered":"2023-12-16T20:21:35.419917+0000","last_unstale":"2023-12-16T20:21:41.211871+0000","last_undegraded":"2023-12-16T20:21:41.211871+0000","last_fullsized":"2023-12-16T20:21:41.211871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:19.491578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.135002+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:21:44.135002+0000","last_peered":"2023-12-16T20:21:44.135002+0000","last_clean":"2023-12-16T20:21:44.135002+0000","last_became_active":"2023-12-16T20:21:41.212704+0000","last_became_peered":"2023-12-16T20:21:41.212704+0000","last_unstale":"2023-12-16T20:21:44.135002+0000","last_undegraded":"2023-12-16T20:21:44.135002+0000","last_fullsized":"2023-12-16T20:21:44.135002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:11.201128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791502+0000","last_change":"2023-12-16T20:21:36.555288+0000","last_active":"2023-12-16T20:21:40.791502+0000","last_peered":"2023-12-16T20:21:40.791502+0000","last_clean":"2023-12-16T20:21:40.791502+0000","last_became_active":"2023-12-16T20:21:36.555011+0000","last_became_peered":"2023-12-16T20:21:36.555011+0000","last_unstale":"2023-12-16T20:21:40.791502+0000","last_undegraded":"2023-12-16T20:21:40.791502+0000","last_fullsized":"2023-12-16T20:21:40.791502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:06.805922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743003+0000","last_change":"2023-12-16T20:21:35.417945+0000","last_active":"2023-12-16T20:21:40.743003+0000","last_peered":"2023-12-16T20:21:40.743003+0000","last_clean":"2023-12-16T20:21:40.743003+0000","last_became_active":"2023-12-16T20:21:35.417683+0000","last_became_peered":"2023-12-16T20:21:35.417683+0000","last_unstale":"2023-12-16T20:21:40.743003+0000","last_undegraded":"2023-12-16T20:21:40.743003+0000","last_fullsized":"2023-12-16T20:21:40.743003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:18.427670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.431936+0000","last_change":"2023-12-16T20:21:40.794299+0000","last_active":"2023-12-16T20:21:43.431936+0000","last_peered":"2023-12-16T20:21:43.431936+0000","last_clean":"2023-12-16T20:21:43.431936+0000","last_became_active":"2023-12-16T20:21:40.793754+0000","last_became_peered":"2023-12-16T20:21:40.793754+0000","last_unstale":"2023-12-16T20:21:43.431936+0000","last_undegraded":"2023-12-16T20:21:43.431936+0000","last_fullsized":"2023-12-16T20:21:43.431936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:10.036962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726356+0000","last_change":"2023-12-16T20:21:36.534278+0000","last_active":"2023-12-16T20:21:40.726356+0000","last_peered":"2023-12-16T20:21:40.726356+0000","last_clean":"2023-12-16T20:21:40.726356+0000","last_became_active":"2023-12-16T20:21:36.533651+0000","last_became_peered":"2023-12-16T20:21:36.533651+0000","last_unstale":"2023-12-16T20:21:40.726356+0000","last_undegraded":"2023-12-16T20:21:40.726356+0000","last_fullsized":"2023-12-16T20:21:40.726356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:58:33.098369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.792221+0000","last_change":"2023-12-16T20:21:35.422128+0000","last_active":"2023-12-16T20:21:40.792221+0000","last_peered":"2023-12-16T20:21:40.792221+0000","last_clean":"2023-12-16T20:21:40.792221+0000","last_became_active":"2023-12-16T20:21:35.421875+0000","last_became_peered":"2023-12-16T20:21:35.421875+0000","last_unstale":"2023-12-16T20:21:40.792221+0000","last_undegraded":"2023-12-16T20:21:40.792221+0000","last_fullsized":"2023-12-16T20:21:40.792221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:24.569380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.432241+0000","last_change":"2023-12-16T20:21:40.754363+0000","last_active":"2023-12-16T20:21:43.432241+0000","last_peered":"2023-12-16T20:21:43.432241+0000","last_clean":"2023-12-16T20:21:43.432241+0000","last_became_active":"2023-12-16T20:21:40.753994+0000","last_became_peered":"2023-12-16T20:21:40.753994+0000","last_unstale":"2023-12-16T20:21:43.432241+0000","last_undegraded":"2023-12-16T20:21:43.432241+0000","last_fullsized":"2023-12-16T20:21:43.432241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:07.939178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742945+0000","last_change":"2023-12-16T20:21:36.451488+0000","last_active":"2023-12-16T20:21:40.742945+0000","last_peered":"2023-12-16T20:21:40.742945+0000","last_clean":"2023-12-16T20:21:40.742945+0000","last_became_active":"2023-12-16T20:21:36.451231+0000","last_became_peered":"2023-12-16T20:21:36.451231+0000","last_unstale":"2023-12-16T20:21:40.742945+0000","last_undegraded":"2023-12-16T20:21:40.742945+0000","last_fullsized":"2023-12-16T20:21:40.742945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725582+0000","last_change":"2023-12-16T20:21:35.420494+0000","last_active":"2023-12-16T20:21:40.725582+0000","last_peered":"2023-12-16T20:21:40.725582+0000","last_clean":"2023-12-16T20:21:40.725582+0000","last_became_active":"2023-12-16T20:21:35.420236+0000","last_became_peered":"2023-12-16T20:21:35.420236+0000","last_unstale":"2023-12-16T20:21:40.725582+0000","last_undegraded":"2023-12-16T20:21:40.725582+0000","last_fullsized":"2023-12-16T20:21:40.725582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:55:54.489373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.432363+0000","last_change":"2023-12-16T20:21:40.794400+0000","last_active":"2023-12-16T20:21:43.432363+0000","last_peered":"2023-12-16T20:21:43.432363+0000","last_clean":"2023-12-16T20:21:43.432363+0000","last_became_active":"2023-12-16T20:21:40.793947+0000","last_became_peered":"2023-12-16T20:21:40.793947+0000","last_unstale":"2023-12-16T20:21:43.432363+0000","last_undegraded":"2023-12-16T20:21:43.432363+0000","last_fullsized":"2023-12-16T20:21:43.432363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:16.656597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.737925+0000","last_change":"2023-12-16T20:21:36.535835+0000","last_active":"2023-12-16T20:21:40.737925+0000","last_peered":"2023-12-16T20:21:40.737925+0000","last_clean":"2023-12-16T20:21:40.737925+0000","last_became_active":"2023-12-16T20:21:36.535571+0000","last_became_peered":"2023-12-16T20:21:36.535571+0000","last_unstale":"2023-12-16T20:21:40.737925+0000","last_undegraded":"2023-12-16T20:21:40.737925+0000","last_fullsized":"2023-12-16T20:21:40.737925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:54.719426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211381+0000","last_change":"2023-12-16T20:21:35.418993+0000","last_active":"2023-12-16T20:21:41.211381+0000","last_peered":"2023-12-16T20:21:41.211381+0000","last_clean":"2023-12-16T20:21:41.211381+0000","last_became_active":"2023-12-16T20:21:35.418751+0000","last_became_peered":"2023-12-16T20:21:35.418751+0000","last_unstale":"2023-12-16T20:21:41.211381+0000","last_undegraded":"2023-12-16T20:21:41.211381+0000","last_fullsized":"2023-12-16T20:21:41.211381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:18.391557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.135405+0000","last_change":"2023-12-16T20:21:41.214405+0000","last_active":"2023-12-16T20:21:44.135405+0000","last_peered":"2023-12-16T20:21:44.135405+0000","last_clean":"2023-12-16T20:21:44.135405+0000","last_became_active":"2023-12-16T20:21:41.213977+0000","last_became_peered":"2023-12-16T20:21:41.213977+0000","last_unstale":"2023-12-16T20:21:44.135405+0000","last_undegraded":"2023-12-16T20:21:44.135405+0000","last_fullsized":"2023-12-16T20:21:44.135405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:16.656597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.671919+0000","last_change":"2023-12-16T20:21:36.551240+0000","last_active":"2023-12-16T20:21:40.671919+0000","last_peered":"2023-12-16T20:21:40.671919+0000","last_clean":"2023-12-16T20:21:40.671919+0000","last_became_active":"2023-12-16T20:21:36.550997+0000","last_became_peered":"2023-12-16T20:21:36.550997+0000","last_unstale":"2023-12-16T20:21:40.671919+0000","last_undegraded":"2023-12-16T20:21:40.671919+0000","last_fullsized":"2023-12-16T20:21:40.671919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791233+0000","last_change":"2023-12-16T20:21:35.416258+0000","last_active":"2023-12-16T20:21:40.791233+0000","last_peered":"2023-12-16T20:21:40.791233+0000","last_clean":"2023-12-16T20:21:40.791233+0000","last_became_active":"2023-12-16T20:21:35.415984+0000","last_became_peered":"2023-12-16T20:21:35.415984+0000","last_unstale":"2023-12-16T20:21:40.791233+0000","last_undegraded":"2023-12-16T20:21:40.791233+0000","last_fullsized":"2023-12-16T20:21:40.791233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:06.872220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211463+0000","last_change":"2023-12-16T20:21:25.196796+0000","last_active":"2023-12-16T20:21:41.211463+0000","last_peered":"2023-12-16T20:21:41.211463+0000","last_clean":"2023-12-16T20:21:41.211463+0000","last_became_active":"2023-12-16T20:21:25.195675+0000","last_became_peered":"2023-12-16T20:21:25.195675+0000","last_unstale":"2023-12-16T20:21:41.211463+0000","last_undegraded":"2023-12-16T20:21:41.211463+0000","last_fullsized":"2023-12-16T20:21:41.211463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:23.008820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:23.008820+0000","last_clean_scrub_stamp":"2023-12-16T20:21:23.008820+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:46:02.232774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.184671+0000","last_change":"2023-12-16T20:21:41.214322+0000","last_active":"2023-12-16T20:21:44.184671+0000","last_peered":"2023-12-16T20:21:44.184671+0000","last_clean":"2023-12-16T20:21:44.184671+0000","last_became_active":"2023-12-16T20:21:41.214012+0000","last_became_peered":"2023-12-16T20:21:41.214012+0000","last_unstale":"2023-12-16T20:21:44.184671+0000","last_undegraded":"2023-12-16T20:21:44.184671+0000","last_fullsized":"2023-12-16T20:21:44.184671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:18.981353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211688+0000","last_change":"2023-12-16T20:21:36.552920+0000","last_active":"2023-12-16T20:21:41.211688+0000","last_peered":"2023-12-16T20:21:41.211688+0000","last_clean":"2023-12-16T20:21:41.211688+0000","last_became_active":"2023-12-16T20:21:36.552619+0000","last_became_peered":"2023-12-16T20:21:36.552619+0000","last_unstale":"2023-12-16T20:21:41.211688+0000","last_undegraded":"2023-12-16T20:21:41.211688+0000","last_fullsized":"2023-12-16T20:21:41.211688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:14.586148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725929+0000","last_change":"2023-12-16T20:21:35.413597+0000","last_active":"2023-12-16T20:21:40.725929+0000","last_peered":"2023-12-16T20:21:40.725929+0000","last_clean":"2023-12-16T20:21:40.725929+0000","last_became_active":"2023-12-16T20:21:35.413308+0000","last_became_peered":"2023-12-16T20:21:35.413308+0000","last_unstale":"2023-12-16T20:21:40.725929+0000","last_undegraded":"2023-12-16T20:21:40.725929+0000","last_fullsized":"2023-12-16T20:21:40.725929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:55:39.544748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.184449+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:21:44.184449+0000","last_peered":"2023-12-16T20:21:44.184449+0000","last_clean":"2023-12-16T20:21:44.184449+0000","last_became_active":"2023-12-16T20:21:41.212608+0000","last_became_peered":"2023-12-16T20:21:41.212608+0000","last_unstale":"2023-12-16T20:21:44.184449+0000","last_undegraded":"2023-12-16T20:21:44.184449+0000","last_fullsized":"2023-12-16T20:21:44.184449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791343+0000","last_change":"2023-12-16T20:21:36.555870+0000","last_active":"2023-12-16T20:21:40.791343+0000","last_peered":"2023-12-16T20:21:40.791343+0000","last_clean":"2023-12-16T20:21:40.791343+0000","last_became_active":"2023-12-16T20:21:36.555631+0000","last_became_peered":"2023-12-16T20:21:36.555631+0000","last_unstale":"2023-12-16T20:21:40.791343+0000","last_undegraded":"2023-12-16T20:21:40.791343+0000","last_fullsized":"2023-12-16T20:21:40.791343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:10.421516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743686+0000","last_change":"2023-12-16T20:21:35.416140+0000","last_active":"2023-12-16T20:21:40.743686+0000","last_peered":"2023-12-16T20:21:40.743686+0000","last_clean":"2023-12-16T20:21:40.743686+0000","last_became_active":"2023-12-16T20:21:35.415810+0000","last_became_peered":"2023-12-16T20:21:35.415810+0000","last_unstale":"2023-12-16T20:21:40.743686+0000","last_undegraded":"2023-12-16T20:21:40.743686+0000","last_fullsized":"2023-12-16T20:21:40.743686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.135131+0000","last_change":"2023-12-16T20:21:40.794366+0000","last_active":"2023-12-16T20:21:44.135131+0000","last_peered":"2023-12-16T20:21:44.135131+0000","last_clean":"2023-12-16T20:21:44.135131+0000","last_became_active":"2023-12-16T20:21:40.793989+0000","last_became_peered":"2023-12-16T20:21:40.793989+0000","last_unstale":"2023-12-16T20:21:44.135131+0000","last_undegraded":"2023-12-16T20:21:44.135131+0000","last_fullsized":"2023-12-16T20:21:44.135131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:41.263768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211819+0000","last_change":"2023-12-16T20:21:36.536346+0000","last_active":"2023-12-16T20:21:41.211819+0000","last_peered":"2023-12-16T20:21:41.211819+0000","last_clean":"2023-12-16T20:21:41.211819+0000","last_became_active":"2023-12-16T20:21:36.536093+0000","last_became_peered":"2023-12-16T20:21:36.536093+0000","last_unstale":"2023-12-16T20:21:41.211819+0000","last_undegraded":"2023-12-16T20:21:41.211819+0000","last_fullsized":"2023-12-16T20:21:41.211819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:12.261391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725494+0000","last_change":"2023-12-16T20:21:35.420314+0000","last_active":"2023-12-16T20:21:40.725494+0000","last_peered":"2023-12-16T20:21:40.725494+0000","last_clean":"2023-12-16T20:21:40.725494+0000","last_became_active":"2023-12-16T20:21:35.420074+0000","last_became_peered":"2023-12-16T20:21:35.420074+0000","last_unstale":"2023-12-16T20:21:40.725494+0000","last_undegraded":"2023-12-16T20:21:40.725494+0000","last_fullsized":"2023-12-16T20:21:40.725494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:29.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.109595+0000","last_change":"2023-12-16T20:21:41.215282+0000","last_active":"2023-12-16T20:21:44.109595+0000","last_peered":"2023-12-16T20:21:44.109595+0000","last_clean":"2023-12-16T20:21:44.109595+0000","last_became_active":"2023-12-16T20:21:41.214939+0000","last_became_peered":"2023-12-16T20:21:41.214939+0000","last_unstale":"2023-12-16T20:21:44.109595+0000","last_undegraded":"2023-12-16T20:21:44.109595+0000","last_fullsized":"2023-12-16T20:21:44.109595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:06:12.245089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211732+0000","last_change":"2023-12-16T20:21:36.534345+0000","last_active":"2023-12-16T20:21:41.211732+0000","last_peered":"2023-12-16T20:21:41.211732+0000","last_clean":"2023-12-16T20:21:41.211732+0000","last_became_active":"2023-12-16T20:21:36.534064+0000","last_became_peered":"2023-12-16T20:21:36.534064+0000","last_unstale":"2023-12-16T20:21:41.211732+0000","last_undegraded":"2023-12-16T20:21:41.211732+0000","last_fullsized":"2023-12-16T20:21:41.211732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:05.641757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725865+0000","last_change":"2023-12-16T20:21:35.390941+0000","last_active":"2023-12-16T20:21:40.725865+0000","last_peered":"2023-12-16T20:21:40.725865+0000","last_clean":"2023-12-16T20:21:40.725865+0000","last_became_active":"2023-12-16T20:21:35.390740+0000","last_became_peered":"2023-12-16T20:21:35.390740+0000","last_unstale":"2023-12-16T20:21:40.725865+0000","last_undegraded":"2023-12-16T20:21:40.725865+0000","last_fullsized":"2023-12-16T20:21:40.725865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:00:44.009248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877589+0000","last_change":"2023-12-16T20:21:40.754355+0000","last_active":"2023-12-16T20:21:41.877589+0000","last_peered":"2023-12-16T20:21:41.877589+0000","last_clean":"2023-12-16T20:21:41.877589+0000","last_became_active":"2023-12-16T20:21:40.753981+0000","last_became_peered":"2023-12-16T20:21:40.753981+0000","last_unstale":"2023-12-16T20:21:41.877589+0000","last_undegraded":"2023-12-16T20:21:41.877589+0000","last_fullsized":"2023-12-16T20:21:41.877589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:09.125671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211363+0000","last_change":"2023-12-16T20:21:36.537080+0000","last_active":"2023-12-16T20:21:41.211363+0000","last_peered":"2023-12-16T20:21:41.211363+0000","last_clean":"2023-12-16T20:21:41.211363+0000","last_became_active":"2023-12-16T20:21:36.536822+0000","last_became_peered":"2023-12-16T20:21:36.536822+0000","last_unstale":"2023-12-16T20:21:41.211363+0000","last_undegraded":"2023-12-16T20:21:41.211363+0000","last_fullsized":"2023-12-16T20:21:41.211363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725357+0000","last_change":"2023-12-16T20:21:35.417113+0000","last_active":"2023-12-16T20:21:40.725357+0000","last_peered":"2023-12-16T20:21:40.725357+0000","last_clean":"2023-12-16T20:21:40.725357+0000","last_became_active":"2023-12-16T20:21:35.416850+0000","last_became_peered":"2023-12-16T20:21:35.416850+0000","last_unstale":"2023-12-16T20:21:40.725357+0000","last_undegraded":"2023-12-16T20:21:40.725357+0000","last_fullsized":"2023-12-16T20:21:40.725357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:00:44.009248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.135099+0000","last_change":"2023-12-16T20:21:40.755436+0000","last_active":"2023-12-16T20:21:44.135099+0000","last_peered":"2023-12-16T20:21:44.135099+0000","last_clean":"2023-12-16T20:21:44.135099+0000","last_became_active":"2023-12-16T20:21:40.755041+0000","last_became_peered":"2023-12-16T20:21:40.755041+0000","last_unstale":"2023-12-16T20:21:44.135099+0000","last_undegraded":"2023-12-16T20:21:44.135099+0000","last_fullsized":"2023-12-16T20:21:44.135099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:07.939178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752017+0000","last_change":"2023-12-16T20:21:36.541160+0000","last_active":"2023-12-16T20:21:40.752017+0000","last_peered":"2023-12-16T20:21:40.752017+0000","last_clean":"2023-12-16T20:21:40.752017+0000","last_became_active":"2023-12-16T20:21:36.540861+0000","last_became_peered":"2023-12-16T20:21:36.540861+0000","last_unstale":"2023-12-16T20:21:40.752017+0000","last_undegraded":"2023-12-16T20:21:40.752017+0000","last_fullsized":"2023-12-16T20:21:40.752017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.751989+0000","last_change":"2023-12-16T20:21:35.425071+0000","last_active":"2023-12-16T20:21:40.751989+0000","last_peered":"2023-12-16T20:21:40.751989+0000","last_clean":"2023-12-16T20:21:40.751989+0000","last_became_active":"2023-12-16T20:21:35.424822+0000","last_became_peered":"2023-12-16T20:21:35.424822+0000","last_unstale":"2023-12-16T20:21:40.751989+0000","last_undegraded":"2023-12-16T20:21:40.751989+0000","last_fullsized":"2023-12-16T20:21:40.751989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877590+0000","last_change":"2023-12-16T20:21:41.215346+0000","last_active":"2023-12-16T20:21:41.877590+0000","last_peered":"2023-12-16T20:21:41.877590+0000","last_clean":"2023-12-16T20:21:41.877590+0000","last_became_active":"2023-12-16T20:21:41.215002+0000","last_became_peered":"2023-12-16T20:21:41.215002+0000","last_unstale":"2023-12-16T20:21:41.877590+0000","last_undegraded":"2023-12-16T20:21:41.877590+0000","last_fullsized":"2023-12-16T20:21:41.877590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:10:42.982067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211447+0000","last_change":"2023-12-16T20:21:36.535791+0000","last_active":"2023-12-16T20:21:41.211447+0000","last_peered":"2023-12-16T20:21:41.211447+0000","last_clean":"2023-12-16T20:21:41.211447+0000","last_became_active":"2023-12-16T20:21:36.535447+0000","last_became_peered":"2023-12-16T20:21:36.535447+0000","last_unstale":"2023-12-16T20:21:41.211447+0000","last_undegraded":"2023-12-16T20:21:41.211447+0000","last_fullsized":"2023-12-16T20:21:41.211447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:28.307634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.792143+0000","last_change":"2023-12-16T20:21:35.423533+0000","last_active":"2023-12-16T20:21:40.792143+0000","last_peered":"2023-12-16T20:21:40.792143+0000","last_clean":"2023-12-16T20:21:40.792143+0000","last_became_active":"2023-12-16T20:21:35.423275+0000","last_became_peered":"2023-12-16T20:21:35.423275+0000","last_unstale":"2023-12-16T20:21:40.792143+0000","last_undegraded":"2023-12-16T20:21:40.792143+0000","last_fullsized":"2023-12-16T20:21:40.792143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:27.767422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877232+0000","last_change":"2023-12-16T20:21:41.213083+0000","last_active":"2023-12-16T20:21:41.877232+0000","last_peered":"2023-12-16T20:21:41.877232+0000","last_clean":"2023-12-16T20:21:41.877232+0000","last_became_active":"2023-12-16T20:21:41.212699+0000","last_became_peered":"2023-12-16T20:21:41.212699+0000","last_unstale":"2023-12-16T20:21:41.877232+0000","last_undegraded":"2023-12-16T20:21:41.877232+0000","last_fullsized":"2023-12-16T20:21:41.877232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:14:45.966119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.737960+0000","last_change":"2023-12-16T20:21:36.523928+0000","last_active":"2023-12-16T20:21:40.737960+0000","last_peered":"2023-12-16T20:21:40.737960+0000","last_clean":"2023-12-16T20:21:40.737960+0000","last_became_active":"2023-12-16T20:21:36.523649+0000","last_became_peered":"2023-12-16T20:21:36.523649+0000","last_unstale":"2023-12-16T20:21:40.737960+0000","last_undegraded":"2023-12-16T20:21:40.737960+0000","last_fullsized":"2023-12-16T20:21:40.737960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:33.657782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738298+0000","last_change":"2023-12-16T20:21:35.388611+0000","last_active":"2023-12-16T20:21:40.738298+0000","last_peered":"2023-12-16T20:21:40.738298+0000","last_clean":"2023-12-16T20:21:40.738298+0000","last_became_active":"2023-12-16T20:21:35.388392+0000","last_became_peered":"2023-12-16T20:21:35.388392+0000","last_unstale":"2023-12-16T20:21:40.738298+0000","last_undegraded":"2023-12-16T20:21:40.738298+0000","last_fullsized":"2023-12-16T20:21:40.738298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.110162+0000","last_change":"2023-12-16T20:21:41.213106+0000","last_active":"2023-12-16T20:21:44.110162+0000","last_peered":"2023-12-16T20:21:44.110162+0000","last_clean":"2023-12-16T20:21:44.110162+0000","last_became_active":"2023-12-16T20:21:41.212721+0000","last_became_peered":"2023-12-16T20:21:41.212721+0000","last_unstale":"2023-12-16T20:21:44.110162+0000","last_undegraded":"2023-12-16T20:21:44.110162+0000","last_fullsized":"2023-12-16T20:21:44.110162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:47:15.750172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211594+0000","last_change":"2023-12-16T20:21:36.519774+0000","last_active":"2023-12-16T20:21:41.211594+0000","last_peered":"2023-12-16T20:21:41.211594+0000","last_clean":"2023-12-16T20:21:41.211594+0000","last_became_active":"2023-12-16T20:21:36.519561+0000","last_became_peered":"2023-12-16T20:21:36.519561+0000","last_unstale":"2023-12-16T20:21:41.211594+0000","last_undegraded":"2023-12-16T20:21:41.211594+0000","last_fullsized":"2023-12-16T20:21:41.211594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:10.421516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:57.487368+0000","last_change":"2023-12-16T20:21:35.426168+0000","last_active":"2023-12-16T20:21:57.487368+0000","last_peered":"2023-12-16T20:21:57.487368+0000","last_clean":"2023-12-16T20:21:57.487368+0000","last_became_active":"2023-12-16T20:21:35.425929+0000","last_became_peered":"2023-12-16T20:21:35.425929+0000","last_unstale":"2023-12-16T20:21:57.487368+0000","last_undegraded":"2023-12-16T20:21:57.487368+0000","last_fullsized":"2023-12-16T20:21:57.487368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3840,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.431983+0000","last_change":"2023-12-16T20:21:40.754204+0000","last_active":"2023-12-16T20:21:43.431983+0000","last_peered":"2023-12-16T20:21:43.431983+0000","last_clean":"2023-12-16T20:21:43.431983+0000","last_became_active":"2023-12-16T20:21:40.753624+0000","last_became_peered":"2023-12-16T20:21:40.753624+0000","last_unstale":"2023-12-16T20:21:43.431983+0000","last_undegraded":"2023-12-16T20:21:43.431983+0000","last_fullsized":"2023-12-16T20:21:43.431983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:11.201128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726787+0000","last_change":"2023-12-16T20:21:36.534827+0000","last_active":"2023-12-16T20:21:40.726787+0000","last_peered":"2023-12-16T20:21:40.726787+0000","last_clean":"2023-12-16T20:21:40.726787+0000","last_became_active":"2023-12-16T20:21:36.533790+0000","last_became_peered":"2023-12-16T20:21:36.533790+0000","last_unstale":"2023-12-16T20:21:40.726787+0000","last_undegraded":"2023-12-16T20:21:40.726787+0000","last_fullsized":"2023-12-16T20:21:40.726787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:19.545737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743602+0000","last_change":"2023-12-16T20:21:35.416050+0000","last_active":"2023-12-16T20:21:40.743602+0000","last_peered":"2023-12-16T20:21:40.743602+0000","last_clean":"2023-12-16T20:21:40.743602+0000","last_became_active":"2023-12-16T20:21:35.415790+0000","last_became_peered":"2023-12-16T20:21:35.415790+0000","last_unstale":"2023-12-16T20:21:40.743602+0000","last_undegraded":"2023-12-16T20:21:40.743602+0000","last_fullsized":"2023-12-16T20:21:40.743602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.878018+0000","last_change":"2023-12-16T20:21:40.795197+0000","last_active":"2023-12-16T20:21:41.878018+0000","last_peered":"2023-12-16T20:21:41.878018+0000","last_clean":"2023-12-16T20:21:41.878018+0000","last_became_active":"2023-12-16T20:21:40.793667+0000","last_became_peered":"2023-12-16T20:21:40.793667+0000","last_unstale":"2023-12-16T20:21:41.878018+0000","last_undegraded":"2023-12-16T20:21:41.878018+0000","last_fullsized":"2023-12-16T20:21:41.878018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:32.304405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738312+0000","last_change":"2023-12-16T20:21:36.552680+0000","last_active":"2023-12-16T20:21:40.738312+0000","last_peered":"2023-12-16T20:21:40.738312+0000","last_clean":"2023-12-16T20:21:40.738312+0000","last_became_active":"2023-12-16T20:21:36.552482+0000","last_became_peered":"2023-12-16T20:21:36.552482+0000","last_unstale":"2023-12-16T20:21:40.738312+0000","last_undegraded":"2023-12-16T20:21:40.738312+0000","last_fullsized":"2023-12-16T20:21:40.738312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791458+0000","last_change":"2023-12-16T20:21:35.428379+0000","last_active":"2023-12-16T20:21:40.791458+0000","last_peered":"2023-12-16T20:21:40.791458+0000","last_clean":"2023-12-16T20:21:40.791458+0000","last_became_active":"2023-12-16T20:21:35.428100+0000","last_became_peered":"2023-12-16T20:21:35.428100+0000","last_unstale":"2023-12-16T20:21:40.791458+0000","last_undegraded":"2023-12-16T20:21:40.791458+0000","last_fullsized":"2023-12-16T20:21:40.791458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:44.330608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.876983+0000","last_change":"2023-12-16T20:21:40.753333+0000","last_active":"2023-12-16T20:21:41.876983+0000","last_peered":"2023-12-16T20:21:41.876983+0000","last_clean":"2023-12-16T20:21:41.876983+0000","last_became_active":"2023-12-16T20:21:40.752957+0000","last_became_peered":"2023-12-16T20:21:40.752957+0000","last_unstale":"2023-12-16T20:21:41.876983+0000","last_undegraded":"2023-12-16T20:21:41.876983+0000","last_fullsized":"2023-12-16T20:21:41.876983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:47:15.750172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791368+0000","last_change":"2023-12-16T20:21:36.552227+0000","last_active":"2023-12-16T20:21:40.791368+0000","last_peered":"2023-12-16T20:21:40.791368+0000","last_clean":"2023-12-16T20:21:40.791368+0000","last_became_active":"2023-12-16T20:21:36.551953+0000","last_became_peered":"2023-12-16T20:21:36.551953+0000","last_unstale":"2023-12-16T20:21:40.791368+0000","last_undegraded":"2023-12-16T20:21:40.791368+0000","last_fullsized":"2023-12-16T20:21:40.791368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:14.586148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.753542+0000","last_change":"2023-12-16T20:21:35.430197+0000","last_active":"2023-12-16T20:21:40.753542+0000","last_peered":"2023-12-16T20:21:40.753542+0000","last_clean":"2023-12-16T20:21:40.753542+0000","last_became_active":"2023-12-16T20:21:35.429940+0000","last_became_peered":"2023-12-16T20:21:35.429940+0000","last_unstale":"2023-12-16T20:21:40.753542+0000","last_undegraded":"2023-12-16T20:21:40.753542+0000","last_fullsized":"2023-12-16T20:21:40.753542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.876977+0000","last_change":"2023-12-16T20:21:41.216238+0000","last_active":"2023-12-16T20:21:41.876977+0000","last_peered":"2023-12-16T20:21:41.876977+0000","last_clean":"2023-12-16T20:21:41.876977+0000","last_became_active":"2023-12-16T20:21:41.215893+0000","last_became_peered":"2023-12-16T20:21:41.215893+0000","last_unstale":"2023-12-16T20:21:41.876977+0000","last_undegraded":"2023-12-16T20:21:41.876977+0000","last_fullsized":"2023-12-16T20:21:41.876977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:06:12.245089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.134901+0000","last_change":"2023-12-16T20:21:41.215277+0000","last_active":"2023-12-16T20:21:44.134901+0000","last_peered":"2023-12-16T20:21:44.134901+0000","last_clean":"2023-12-16T20:21:44.134901+0000","last_became_active":"2023-12-16T20:21:41.214950+0000","last_became_peered":"2023-12-16T20:21:41.214950+0000","last_unstale":"2023-12-16T20:21:44.134901+0000","last_undegraded":"2023-12-16T20:21:44.134901+0000","last_fullsized":"2023-12-16T20:21:44.134901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:10.036962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742636+0000","last_change":"2023-12-16T20:21:36.519789+0000","last_active":"2023-12-16T20:21:40.742636+0000","last_peered":"2023-12-16T20:21:40.742636+0000","last_clean":"2023-12-16T20:21:40.742636+0000","last_became_active":"2023-12-16T20:21:36.519476+0000","last_became_peered":"2023-12-16T20:21:36.519476+0000","last_unstale":"2023-12-16T20:21:40.742636+0000","last_undegraded":"2023-12-16T20:21:40.742636+0000","last_fullsized":"2023-12-16T20:21:40.742636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791067+0000","last_change":"2023-12-16T20:21:35.415150+0000","last_active":"2023-12-16T20:21:40.791067+0000","last_peered":"2023-12-16T20:21:40.791067+0000","last_clean":"2023-12-16T20:21:40.791067+0000","last_became_active":"2023-12-16T20:21:35.414846+0000","last_became_peered":"2023-12-16T20:21:35.414846+0000","last_unstale":"2023-12-16T20:21:40.791067+0000","last_undegraded":"2023-12-16T20:21:40.791067+0000","last_fullsized":"2023-12-16T20:21:40.791067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:37.215505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.184929+0000","last_change":"2023-12-16T20:21:40.794438+0000","last_active":"2023-12-16T20:21:44.184929+0000","last_peered":"2023-12-16T20:21:44.184929+0000","last_clean":"2023-12-16T20:21:44.184929+0000","last_became_active":"2023-12-16T20:21:40.794073+0000","last_became_peered":"2023-12-16T20:21:40.794073+0000","last_unstale":"2023-12-16T20:21:44.184929+0000","last_undegraded":"2023-12-16T20:21:44.184929+0000","last_fullsized":"2023-12-16T20:21:44.184929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:32.702839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.673163+0000","last_change":"2023-12-16T20:21:36.524670+0000","last_active":"2023-12-16T20:21:40.673163+0000","last_peered":"2023-12-16T20:21:40.673163+0000","last_clean":"2023-12-16T20:21:40.673163+0000","last_became_active":"2023-12-16T20:21:36.523837+0000","last_became_peered":"2023-12-16T20:21:36.523837+0000","last_unstale":"2023-12-16T20:21:40.673163+0000","last_undegraded":"2023-12-16T20:21:40.673163+0000","last_fullsized":"2023-12-16T20:21:40.673163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672390+0000","last_change":"2023-12-16T20:21:35.422176+0000","last_active":"2023-12-16T20:21:40.672390+0000","last_peered":"2023-12-16T20:21:40.672390+0000","last_clean":"2023-12-16T20:21:40.672390+0000","last_became_active":"2023-12-16T20:21:35.421982+0000","last_became_peered":"2023-12-16T20:21:35.421982+0000","last_unstale":"2023-12-16T20:21:40.672390+0000","last_undegraded":"2023-12-16T20:21:40.672390+0000","last_fullsized":"2023-12-16T20:21:40.672390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752314+0000","last_change":"2023-12-16T20:21:35.424509+0000","last_active":"2023-12-16T20:21:40.752314+0000","last_peered":"2023-12-16T20:21:40.752314+0000","last_clean":"2023-12-16T20:21:40.752314+0000","last_became_active":"2023-12-16T20:21:35.424254+0000","last_became_peered":"2023-12-16T20:21:35.424254+0000","last_unstale":"2023-12-16T20:21:40.752314+0000","last_undegraded":"2023-12-16T20:21:40.752314+0000","last_fullsized":"2023-12-16T20:21:40.752314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738189+0000","last_change":"2023-12-16T20:21:36.533903+0000","last_active":"2023-12-16T20:21:40.738189+0000","last_peered":"2023-12-16T20:21:40.738189+0000","last_clean":"2023-12-16T20:21:40.738189+0000","last_became_active":"2023-12-16T20:21:36.533574+0000","last_became_peered":"2023-12-16T20:21:36.533574+0000","last_unstale":"2023-12-16T20:21:40.738189+0000","last_undegraded":"2023-12-16T20:21:40.738189+0000","last_fullsized":"2023-12-16T20:21:40.738189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.874054+0000","last_change":"2023-12-16T20:21:40.794426+0000","last_active":"2023-12-16T20:21:41.874054+0000","last_peered":"2023-12-16T20:21:41.874054+0000","last_clean":"2023-12-16T20:21:41.874054+0000","last_became_active":"2023-12-16T20:21:40.794082+0000","last_became_peered":"2023-12-16T20:21:40.794082+0000","last_unstale":"2023-12-16T20:21:41.874054+0000","last_undegraded":"2023-12-16T20:21:41.874054+0000","last_fullsized":"2023-12-16T20:21:41.874054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:39:04.889495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672682+0000","last_change":"2023-12-16T20:21:35.419910+0000","last_active":"2023-12-16T20:21:40.672682+0000","last_peered":"2023-12-16T20:21:40.672682+0000","last_clean":"2023-12-16T20:21:40.672682+0000","last_became_active":"2023-12-16T20:21:35.419409+0000","last_became_peered":"2023-12-16T20:21:35.419409+0000","last_unstale":"2023-12-16T20:21:40.672682+0000","last_undegraded":"2023-12-16T20:21:40.672682+0000","last_fullsized":"2023-12-16T20:21:40.672682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726492+0000","last_change":"2023-12-16T20:21:36.533684+0000","last_active":"2023-12-16T20:21:40.726492+0000","last_peered":"2023-12-16T20:21:40.726492+0000","last_clean":"2023-12-16T20:21:40.726492+0000","last_became_active":"2023-12-16T20:21:36.533325+0000","last_became_peered":"2023-12-16T20:21:36.533325+0000","last_unstale":"2023-12-16T20:21:40.726492+0000","last_undegraded":"2023-12-16T20:21:40.726492+0000","last_fullsized":"2023-12-16T20:21:40.726492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:30.795818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877493+0000","last_change":"2023-12-16T20:21:40.745455+0000","last_active":"2023-12-16T20:21:41.877493+0000","last_peered":"2023-12-16T20:21:41.877493+0000","last_clean":"2023-12-16T20:21:41.877493+0000","last_became_active":"2023-12-16T20:21:40.744731+0000","last_became_peered":"2023-12-16T20:21:40.744731+0000","last_unstale":"2023-12-16T20:21:41.877493+0000","last_undegraded":"2023-12-16T20:21:41.877493+0000","last_fullsized":"2023-12-16T20:21:41.877493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:17:56.583460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.751939+0000","last_change":"2023-12-16T20:21:36.542529+0000","last_active":"2023-12-16T20:21:40.751939+0000","last_peered":"2023-12-16T20:21:40.751939+0000","last_clean":"2023-12-16T20:21:40.751939+0000","last_became_active":"2023-12-16T20:21:36.542287+0000","last_became_peered":"2023-12-16T20:21:36.542287+0000","last_unstale":"2023-12-16T20:21:40.751939+0000","last_undegraded":"2023-12-16T20:21:40.751939+0000","last_fullsized":"2023-12-16T20:21:40.751939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725563+0000","last_change":"2023-12-16T20:21:36.551193+0000","last_active":"2023-12-16T20:21:40.725563+0000","last_peered":"2023-12-16T20:21:40.725563+0000","last_clean":"2023-12-16T20:21:40.725563+0000","last_became_active":"2023-12-16T20:21:36.550911+0000","last_became_peered":"2023-12-16T20:21:36.550911+0000","last_unstale":"2023-12-16T20:21:40.725563+0000","last_undegraded":"2023-12-16T20:21:40.725563+0000","last_fullsized":"2023-12-16T20:21:40.725563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:19.545737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.792258+0000","last_change":"2023-12-16T20:21:36.556390+0000","last_active":"2023-12-16T20:21:40.792258+0000","last_peered":"2023-12-16T20:21:40.792258+0000","last_clean":"2023-12-16T20:21:40.792258+0000","last_became_active":"2023-12-16T20:21:36.555822+0000","last_became_peered":"2023-12-16T20:21:36.555822+0000","last_unstale":"2023-12-16T20:21:40.792258+0000","last_undegraded":"2023-12-16T20:21:40.792258+0000","last_fullsized":"2023-12-16T20:21:40.792258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:28.307634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738168+0000","last_change":"2023-12-16T20:21:36.525171+0000","last_active":"2023-12-16T20:21:40.738168+0000","last_peered":"2023-12-16T20:21:40.738168+0000","last_clean":"2023-12-16T20:21:40.738168+0000","last_became_active":"2023-12-16T20:21:36.524747+0000","last_became_peered":"2023-12-16T20:21:36.524747+0000","last_unstale":"2023-12-16T20:21:40.738168+0000","last_undegraded":"2023-12-16T20:21:40.738168+0000","last_fullsized":"2023-12-16T20:21:40.738168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672419+0000","last_change":"2023-12-16T20:21:36.533944+0000","last_active":"2023-12-16T20:21:40.672419+0000","last_peered":"2023-12-16T20:21:40.672419+0000","last_clean":"2023-12-16T20:21:40.672419+0000","last_became_active":"2023-12-16T20:21:36.533682+0000","last_became_peered":"2023-12-16T20:21:36.533682+0000","last_unstale":"2023-12-16T20:21:40.672419+0000","last_undegraded":"2023-12-16T20:21:40.672419+0000","last_fullsized":"2023-12-16T20:21:40.672419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:20.609645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742898+0000","last_change":"2023-12-16T20:21:36.519818+0000","last_active":"2023-12-16T20:21:40.742898+0000","last_peered":"2023-12-16T20:21:40.742898+0000","last_clean":"2023-12-16T20:21:40.742898+0000","last_became_active":"2023-12-16T20:21:36.519545+0000","last_became_peered":"2023-12-16T20:21:36.519545+0000","last_unstale":"2023-12-16T20:21:40.742898+0000","last_undegraded":"2023-12-16T20:21:40.742898+0000","last_fullsized":"2023-12-16T20:21:40.742898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.753739+0000","last_change":"2023-12-16T20:21:36.542706+0000","last_active":"2023-12-16T20:21:40.753739+0000","last_peered":"2023-12-16T20:21:40.753739+0000","last_clean":"2023-12-16T20:21:40.753739+0000","last_became_active":"2023-12-16T20:21:36.542184+0000","last_became_peered":"2023-12-16T20:21:36.542184+0000","last_unstale":"2023-12-16T20:21:40.753739+0000","last_undegraded":"2023-12-16T20:21:40.753739+0000","last_fullsized":"2023-12-16T20:21:40.753739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672194+0000","last_change":"2023-12-16T20:21:36.536726+0000","last_active":"2023-12-16T20:21:40.672194+0000","last_peered":"2023-12-16T20:21:40.672194+0000","last_clean":"2023-12-16T20:21:40.672194+0000","last_became_active":"2023-12-16T20:21:36.536439+0000","last_became_peered":"2023-12-16T20:21:36.536439+0000","last_unstale":"2023-12-16T20:21:40.672194+0000","last_undegraded":"2023-12-16T20:21:40.672194+0000","last_fullsized":"2023-12-16T20:21:40.672194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.790945+0000","last_change":"2023-12-16T20:21:36.555521+0000","last_active":"2023-12-16T20:21:40.790945+0000","last_peered":"2023-12-16T20:21:40.790945+0000","last_clean":"2023-12-16T20:21:40.790945+0000","last_became_active":"2023-12-16T20:21:36.555100+0000","last_became_peered":"2023-12-16T20:21:36.555100+0000","last_unstale":"2023-12-16T20:21:40.790945+0000","last_undegraded":"2023-12-16T20:21:40.790945+0000","last_fullsized":"2023-12-16T20:21:40.790945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672520+0000","last_change":"2023-12-16T20:21:36.535856+0000","last_active":"2023-12-16T20:21:40.672520+0000","last_peered":"2023-12-16T20:21:40.672520+0000","last_clean":"2023-12-16T20:21:40.672520+0000","last_became_active":"2023-12-16T20:21:36.535600+0000","last_became_peered":"2023-12-16T20:21:36.535600+0000","last_unstale":"2023-12-16T20:21:40.672520+0000","last_undegraded":"2023-12-16T20:21:40.672520+0000","last_fullsized":"2023-12-16T20:21:40.672520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791686+0000","last_change":"2023-12-16T20:21:36.553376+0000","last_active":"2023-12-16T20:21:40.791686+0000","last_peered":"2023-12-16T20:21:40.791686+0000","last_clean":"2023-12-16T20:21:40.791686+0000","last_became_active":"2023-12-16T20:21:36.553155+0000","last_became_peered":"2023-12-16T20:21:36.553155+0000","last_unstale":"2023-12-16T20:21:40.791686+0000","last_undegraded":"2023-12-16T20:21:40.791686+0000","last_fullsized":"2023-12-16T20:21:40.791686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738115+0000","last_change":"2023-12-16T20:21:36.524517+0000","last_active":"2023-12-16T20:21:40.738115+0000","last_peered":"2023-12-16T20:21:40.738115+0000","last_clean":"2023-12-16T20:21:40.738115+0000","last_became_active":"2023-12-16T20:21:36.524166+0000","last_became_peered":"2023-12-16T20:21:36.524166+0000","last_unstale":"2023-12-16T20:21:40.738115+0000","last_undegraded":"2023-12-16T20:21:40.738115+0000","last_fullsized":"2023-12-16T20:21:40.738115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752601+0000","last_change":"2023-12-16T20:21:36.542513+0000","last_active":"2023-12-16T20:21:40.752601+0000","last_peered":"2023-12-16T20:21:40.752601+0000","last_clean":"2023-12-16T20:21:40.752601+0000","last_became_active":"2023-12-16T20:21:36.542191+0000","last_became_peered":"2023-12-16T20:21:36.542191+0000","last_unstale":"2023-12-16T20:21:40.752601+0000","last_undegraded":"2023-12-16T20:21:40.752601+0000","last_fullsized":"2023-12-16T20:21:40.752601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211817+0000","last_change":"2023-12-16T20:21:36.518582+0000","last_active":"2023-12-16T20:21:41.211817+0000","last_peered":"2023-12-16T20:21:41.211817+0000","last_clean":"2023-12-16T20:21:41.211817+0000","last_became_active":"2023-12-16T20:21:36.518348+0000","last_became_peered":"2023-12-16T20:21:36.518348+0000","last_unstale":"2023-12-16T20:21:41.211817+0000","last_undegraded":"2023-12-16T20:21:41.211817+0000","last_fullsized":"2023-12-16T20:21:41.211817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:06.805922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725472+0000","last_change":"2023-12-16T20:21:36.544461+0000","last_active":"2023-12-16T20:21:40.725472+0000","last_peered":"2023-12-16T20:21:40.725472+0000","last_clean":"2023-12-16T20:21:40.725472+0000","last_became_active":"2023-12-16T20:21:36.544225+0000","last_became_peered":"2023-12-16T20:21:36.544225+0000","last_unstale":"2023-12-16T20:21:40.725472+0000","last_undegraded":"2023-12-16T20:21:40.725472+0000","last_fullsized":"2023-12-16T20:21:40.725472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:45:02.439240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791694+0000","last_change":"2023-12-16T20:21:36.554370+0000","last_active":"2023-12-16T20:21:40.791694+0000","last_peered":"2023-12-16T20:21:40.791694+0000","last_clean":"2023-12-16T20:21:40.791694+0000","last_became_active":"2023-12-16T20:21:36.554130+0000","last_became_peered":"2023-12-16T20:21:36.554130+0000","last_unstale":"2023-12-16T20:21:40.791694+0000","last_undegraded":"2023-12-16T20:21:40.791694+0000","last_fullsized":"2023-12-16T20:21:40.791694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:05.641757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.790872+0000","last_change":"2023-12-16T20:21:36.555346+0000","last_active":"2023-12-16T20:21:40.790872+0000","last_peered":"2023-12-16T20:21:40.790872+0000","last_clean":"2023-12-16T20:21:40.790872+0000","last_became_active":"2023-12-16T20:21:36.554772+0000","last_became_peered":"2023-12-16T20:21:36.554772+0000","last_unstale":"2023-12-16T20:21:40.790872+0000","last_undegraded":"2023-12-16T20:21:40.790872+0000","last_fullsized":"2023-12-16T20:21:40.790872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742743+0000","last_change":"2023-12-16T20:21:36.534502+0000","last_active":"2023-12-16T20:21:40.742743+0000","last_peered":"2023-12-16T20:21:40.742743+0000","last_clean":"2023-12-16T20:21:40.742743+0000","last_became_active":"2023-12-16T20:21:36.534307+0000","last_became_peered":"2023-12-16T20:21:36.534307+0000","last_unstale":"2023-12-16T20:21:40.742743+0000","last_undegraded":"2023-12-16T20:21:40.742743+0000","last_fullsized":"2023-12-16T20:21:40.742743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.737870+0000","last_change":"2023-12-16T20:21:36.525661+0000","last_active":"2023-12-16T20:21:40.737870+0000","last_peered":"2023-12-16T20:21:40.737870+0000","last_clean":"2023-12-16T20:21:40.737870+0000","last_became_active":"2023-12-16T20:21:36.525427+0000","last_became_peered":"2023-12-16T20:21:36.525427+0000","last_unstale":"2023-12-16T20:21:40.737870+0000","last_undegraded":"2023-12-16T20:21:40.737870+0000","last_fullsized":"2023-12-16T20:21:40.737870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:39:00.494290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672421+0000","last_change":"2023-12-16T20:21:36.542756+0000","last_active":"2023-12-16T20:21:40.672421+0000","last_peered":"2023-12-16T20:21:40.672421+0000","last_clean":"2023-12-16T20:21:40.672421+0000","last_became_active":"2023-12-16T20:21:36.542513+0000","last_became_peered":"2023-12-16T20:21:36.542513+0000","last_unstale":"2023-12-16T20:21:40.672421+0000","last_undegraded":"2023-12-16T20:21:40.672421+0000","last_fullsized":"2023-12-16T20:21:40.672421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726700+0000","last_change":"2023-12-16T20:21:36.544754+0000","last_active":"2023-12-16T20:21:40.726700+0000","last_peered":"2023-12-16T20:21:40.726700+0000","last_clean":"2023-12-16T20:21:40.726700+0000","last_became_active":"2023-12-16T20:21:36.544492+0000","last_became_peered":"2023-12-16T20:21:36.544492+0000","last_unstale":"2023-12-16T20:21:40.726700+0000","last_undegraded":"2023-12-16T20:21:40.726700+0000","last_fullsized":"2023-12-16T20:21:40.726700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:19.509623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752407+0000","last_change":"2023-12-16T20:21:36.552022+0000","last_active":"2023-12-16T20:21:40.752407+0000","last_peered":"2023-12-16T20:21:40.752407+0000","last_clean":"2023-12-16T20:21:40.752407+0000","last_became_active":"2023-12-16T20:21:36.551775+0000","last_became_peered":"2023-12-16T20:21:36.551775+0000","last_unstale":"2023-12-16T20:21:40.752407+0000","last_undegraded":"2023-12-16T20:21:40.752407+0000","last_fullsized":"2023-12-16T20:21:40.752407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.753663+0000","last_change":"2023-12-16T20:21:36.551107+0000","last_active":"2023-12-16T20:21:40.753663+0000","last_peered":"2023-12-16T20:21:40.753663+0000","last_clean":"2023-12-16T20:21:40.753663+0000","last_became_active":"2023-12-16T20:21:36.550815+0000","last_became_peered":"2023-12-16T20:21:36.550815+0000","last_unstale":"2023-12-16T20:21:40.753663+0000","last_undegraded":"2023-12-16T20:21:40.753663+0000","last_fullsized":"2023-12-16T20:21:40.753663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211809+0000","last_change":"2023-12-16T20:21:36.554041+0000","last_active":"2023-12-16T20:21:41.211809+0000","last_peered":"2023-12-16T20:21:41.211809+0000","last_clean":"2023-12-16T20:21:41.211809+0000","last_became_active":"2023-12-16T20:21:36.553708+0000","last_became_peered":"2023-12-16T20:21:36.553708+0000","last_unstale":"2023-12-16T20:21:41.211809+0000","last_undegraded":"2023-12-16T20:21:41.211809+0000","last_fullsized":"2023-12-16T20:21:41.211809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:36.868562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.671819+0000","last_change":"2023-12-16T20:21:36.551348+0000","last_active":"2023-12-16T20:21:40.671819+0000","last_peered":"2023-12-16T20:21:40.671819+0000","last_clean":"2023-12-16T20:21:40.671819+0000","last_became_active":"2023-12-16T20:21:36.551066+0000","last_became_peered":"2023-12-16T20:21:36.551066+0000","last_unstale":"2023-12-16T20:21:40.671819+0000","last_undegraded":"2023-12-16T20:21:40.671819+0000","last_fullsized":"2023-12-16T20:21:40.671819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211281+0000","last_change":"2023-12-16T20:21:36.523828+0000","last_active":"2023-12-16T20:21:41.211281+0000","last_peered":"2023-12-16T20:21:41.211281+0000","last_clean":"2023-12-16T20:21:41.211281+0000","last_became_active":"2023-12-16T20:21:36.523604+0000","last_became_peered":"2023-12-16T20:21:36.523604+0000","last_unstale":"2023-12-16T20:21:41.211281+0000","last_undegraded":"2023-12-16T20:21:41.211281+0000","last_fullsized":"2023-12-16T20:21:41.211281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791600+0000","last_change":"2023-12-16T20:21:36.556286+0000","last_active":"2023-12-16T20:21:40.791600+0000","last_peered":"2023-12-16T20:21:40.791600+0000","last_clean":"2023-12-16T20:21:40.791600+0000","last_became_active":"2023-12-16T20:21:36.556041+0000","last_became_peered":"2023-12-16T20:21:36.556041+0000","last_unstale":"2023-12-16T20:21:40.791600+0000","last_undegraded":"2023-12-16T20:21:40.791600+0000","last_fullsized":"2023-12-16T20:21:40.791600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211340+0000","last_change":"2023-12-16T20:21:36.518408+0000","last_active":"2023-12-16T20:21:41.211340+0000","last_peered":"2023-12-16T20:21:41.211340+0000","last_clean":"2023-12-16T20:21:41.211340+0000","last_became_active":"2023-12-16T20:21:36.518138+0000","last_became_peered":"2023-12-16T20:21:36.518138+0000","last_unstale":"2023-12-16T20:21:41.211340+0000","last_undegraded":"2023-12-16T20:21:41.211340+0000","last_fullsized":"2023-12-16T20:21:41.211340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791179+0000","last_change":"2023-12-16T20:21:36.555311+0000","last_active":"2023-12-16T20:21:40.791179+0000","last_peered":"2023-12-16T20:21:40.791179+0000","last_clean":"2023-12-16T20:21:40.791179+0000","last_became_active":"2023-12-16T20:21:36.555041+0000","last_became_peered":"2023-12-16T20:21:36.555041+0000","last_unstale":"2023-12-16T20:21:40.791179+0000","last_undegraded":"2023-12-16T20:21:40.791179+0000","last_fullsized":"2023-12-16T20:21:40.791179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:20.609645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738053+0000","last_change":"2023-12-16T20:21:36.524036+0000","last_active":"2023-12-16T20:21:40.738053+0000","last_peered":"2023-12-16T20:21:40.738053+0000","last_clean":"2023-12-16T20:21:40.738053+0000","last_became_active":"2023-12-16T20:21:36.523784+0000","last_became_peered":"2023-12-16T20:21:36.523784+0000","last_unstale":"2023-12-16T20:21:40.738053+0000","last_undegraded":"2023-12-16T20:21:40.738053+0000","last_fullsized":"2023-12-16T20:21:40.738053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743757+0000","last_change":"2023-12-16T20:21:36.526391+0000","last_active":"2023-12-16T20:21:40.743757+0000","last_peered":"2023-12-16T20:21:40.743757+0000","last_clean":"2023-12-16T20:21:40.743757+0000","last_became_active":"2023-12-16T20:21:36.526151+0000","last_became_peered":"2023-12-16T20:21:36.526151+0000","last_unstale":"2023-12-16T20:21:40.743757+0000","last_undegraded":"2023-12-16T20:21:40.743757+0000","last_fullsized":"2023-12-16T20:21:40.743757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211659+0000","last_change":"2023-12-16T20:21:36.543566+0000","last_active":"2023-12-16T20:21:41.211659+0000","last_peered":"2023-12-16T20:21:41.211659+0000","last_clean":"2023-12-16T20:21:41.211659+0000","last_became_active":"2023-12-16T20:21:36.543306+0000","last_became_peered":"2023-12-16T20:21:36.543306+0000","last_unstale":"2023-12-16T20:21:41.211659+0000","last_undegraded":"2023-12-16T20:21:41.211659+0000","last_fullsized":"2023-12-16T20:21:41.211659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:03.543973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4638,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65176,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":695413,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":104589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":104623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":695469,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T20:22:04.644 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-16T20:22:04.645 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-16T20:22:04.645 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-16T20:22:04.645 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-16T20:22:04.646 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-16T20:22:04.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.778+0000 7f0ebbfff640 1 Processor -- start 2023-12-16T20:22:04.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.778+0000 7f0ebbfff640 1 -- start start 2023-12-16T20:22:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.779+0000 7f0ebbfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0ebc0c6b90 0x7f0ebc072400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.779+0000 7f0ebbfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ebc1599b0 0x7f0ebc159e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.779+0000 7f0ebbfff640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ebc06f630 con 0x7f0ebc0c67b0 2023-12-16T20:22:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.779+0000 7f0ebbfff640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ebc159520 con 0x7f0ebc0c6b90 2023-12-16T20:22:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.779+0000 7f0ebbfff640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc15a360 con 0x7f0ebc1599b0 2023-12-16T20:22:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.780+0000 7f0eb27fc640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0ebc0c6b90 0x7f0ebc072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.780+0000 7f0ebb7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ebc1599b0 0x7f0ebc159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.780+0000 7f0ebb7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ebc1599b0 0x7f0ebc159e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:35258/0 (socket says 172.21.15.87:35258) 2023-12-16T20:22:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.780+0000 7f0ebb7fe640 1 -- 172.21.15.87:0/1061167795 learned_addr learned my addr 172.21.15.87:0/1061167795 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.782+0000 7f0ebb7fe640 1 -- 172.21.15.87:0/1061167795 >> v2:172.21.15.195:3300/0 conn(0x7f0ebc0c6b90 msgr2=0x7f0ebc072400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.783+0000 7f0ebb7fe640 1 --2- 172.21.15.87:0/1061167795 >> v2:172.21.15.195:3300/0 conn(0x7f0ebc0c6b90 0x7f0ebc072400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.783+0000 7f0ebb7fe640 1 -- 172.21.15.87:0/1061167795 >> v1:172.21.15.195:6789/0 conn(0x7f0ebc0c67b0 legacy=0x7f0ebc06fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.783+0000 7f0ebb7fe640 1 -- 172.21.15.87:0/1061167795 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ebc0705a0 con 0x7f0ebc1599b0 2023-12-16T20:22:04.786 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.785+0000 7f0ebb7fe640 1 --2- 172.21.15.87:0/1061167795 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ebc1599b0 0x7f0ebc159e20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009e50 tx=0x7f0eb402bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71ced2733b7bacdf server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.790+0000 7f0eba7fc640 1 -- 172.21.15.87:0/1061167795 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb402cb90 con 0x7f0ebc1599b0 2023-12-16T20:22:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.790+0000 7f0eba7fc640 1 -- 172.21.15.87:0/1061167795 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb402ccf0 con 0x7f0ebc1599b0 2023-12-16T20:22:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.790+0000 7f0eba7fc640 1 -- 172.21.15.87:0/1061167795 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4034610 con 0x7f0ebc1599b0 2023-12-16T20:22:04.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.791+0000 7f0ebbfff640 1 -- 172.21.15.87:0/1061167795 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ebc1599b0 msgr2=0x7f0ebc159e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:04.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.791+0000 7f0ebbfff640 1 --2- 172.21.15.87:0/1061167795 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ebc1599b0 0x7f0ebc159e20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009e50 tx=0x7f0eb402bff0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.791+0000 7f0ebbfff640 1 -- 172.21.15.87:0/1061167795 shutdown_connections 2023-12-16T20:22:04.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.791+0000 7f0ebbfff640 1 --2- 172.21.15.87:0/1061167795 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ebc1599b0 0x7f0ebc159e20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.791+0000 7f0ebbfff640 1 --2- 172.21.15.87:0/1061167795 >> v2:172.21.15.195:3300/0 conn(0x7f0ebc0c6b90 0x7f0ebc072400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.791+0000 7f0ebbfff640 1 -- 172.21.15.87:0/1061167795 >> 172.21.15.87:0/1061167795 conn(0x7f0ebc06b610 msgr2=0x7f0ebc06b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:04.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.791+0000 7f0ebbfff640 1 -- 172.21.15.87:0/1061167795 shutdown_connections 2023-12-16T20:22:04.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.791+0000 7f0ebbfff640 1 -- 172.21.15.87:0/1061167795 wait complete. 2023-12-16T20:22:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.792+0000 7f0ebbfff640 1 Processor -- start 2023-12-16T20:22:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.792+0000 7f0ebbfff640 1 -- start start 2023-12-16T20:22:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.793+0000 7f0ebbfff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ebc0c67b0 0x7f0ebc1f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.793+0000 7f0ebbfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ebc0c6b90 0x7f0ebc14c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.793+0000 7f0ebbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ebc1599b0 0x7f0ebc0c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.793+0000 7f0ebbfff640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc1f33d0 con 0x7f0ebc1599b0 2023-12-16T20:22:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.793+0000 7f0ebbfff640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc14bfe0 con 0x7f0ebc0c67b0 2023-12-16T20:22:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.793+0000 7f0ebbfff640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc0ad060 con 0x7f0ebc0c6b90 2023-12-16T20:22:04.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.793+0000 7f0eb27fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ebc0c6b90 0x7f0ebc14c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:04.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.794+0000 7f0ebb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ebc1599b0 0x7f0ebc0c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:04.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.794+0000 7f0ebaffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ebc0c67b0 0x7f0ebc1f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:04.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.794+0000 7f0eb27fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ebc0c6b90 0x7f0ebc14c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:35266/0 (socket says 172.21.15.87:35266) 2023-12-16T20:22:04.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.794+0000 7f0eb27fc640 1 -- 172.21.15.87:0/2384428488 learned_addr learned my addr 172.21.15.87:0/2384428488 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:04.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.797+0000 7f0eb27fc640 1 -- 172.21.15.87:0/2384428488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ebc0c67b0 msgr2=0x7f0ebc1f2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:04.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.797+0000 7f0eb27fc640 1 --2- 172.21.15.87:0/2384428488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ebc0c67b0 0x7f0ebc1f2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.797+0000 7f0eb27fc640 1 -- 172.21.15.87:0/2384428488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ebc1599b0 msgr2=0x7f0ebc0c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:04.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.797+0000 7f0eb27fc640 1 --2- 172.21.15.87:0/2384428488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ebc1599b0 0x7f0ebc0c5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:04.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.797+0000 7f0eb27fc640 1 -- 172.21.15.87:0/2384428488 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb4009b30 con 0x7f0ebc0c6b90 2023-12-16T20:22:04.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.799+0000 7f0eb27fc640 1 --2- 172.21.15.87:0/2384428488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ebc0c6b90 0x7f0ebc14c470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ea400e9b0 tx=0x7f0ea400ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:04.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.803+0000 7f0eb3fff640 1 -- 172.21.15.87:0/2384428488 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4009670 con 0x7f0ebc0c6b90 2023-12-16T20:22:04.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.803+0000 7f0eb3fff640 1 -- 172.21.15.87:0/2384428488 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea400c9a0 con 0x7f0ebc0c6b90 2023-12-16T20:22:04.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.803+0000 7f0ebbfff640 1 -- 172.21.15.87:0/2384428488 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ebc14ab00 con 0x7f0ebc0c6b90 2023-12-16T20:22:04.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.803+0000 7f0eb3fff640 1 -- 172.21.15.87:0/2384428488 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea400cd50 con 0x7f0ebc0c6b90 2023-12-16T20:22:04.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.803+0000 7f0ebbfff640 1 -- 172.21.15.87:0/2384428488 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ebc14b0c0 con 0x7f0ebc0c6b90 2023-12-16T20:22:04.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:04.804+0000 7f0ebbfff640 1 -- 172.21.15.87:0/2384428488 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ebc0c12d0 con 0x7f0ebc0c6b90 2023-12-16T20:22:05.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.045+0000 7f0eb3fff640 1 -- 172.21.15.87:0/2384428488 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f0ea4013470 con 0x7f0ebc0c6b90 2023-12-16T20:22:05.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.045+0000 7f0eb3fff640 1 --2- 172.21.15.87:0/2384428488 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0e9c06ae90 0x7f0e9c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:05.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.046+0000 7f0ebaffd640 1 --2- 172.21.15.87:0/2384428488 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0e9c06ae90 0x7f0e9c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:05.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.046+0000 7f0ebaffd640 1 --2- 172.21.15.87:0/2384428488 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0e9c06ae90 0x7f0e9c06d350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0016e0 tx=0x7f0eac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:05.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.049+0000 7f0eb3fff640 1 -- 172.21.15.87:0/2384428488 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0ea4058dc0 con 0x7f0ebc0c6b90 2023-12-16T20:22:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.060+0000 7f0eb3fff640 1 -- 172.21.15.87:0/2384428488 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f0ea4055100 con 0x7f0ebc0c6b90 2023-12-16T20:22:05.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.276+0000 7f0ebbfff640 1 -- 172.21.15.87:0/2384428488 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0ebc14c150 con 0x7f0ebc0c6b90 2023-12-16T20:22:05.421 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.420+0000 7f0eb3fff640 1 -- 172.21.15.87:0/2384428488 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171030 (secure 0 0 0) 0x7f0ea4017090 con 0x7f0ebc0c6b90 2023-12-16T20:22:05.423 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:22:05.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.423+0000 7f0ebbfff640 1 -- 172.21.15.87:0/2384428488 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0e9c06ae90 msgr2=0x7f0e9c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:05.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.423+0000 7f0ebbfff640 1 --2- 172.21.15.87:0/2384428488 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0e9c06ae90 0x7f0e9c06d350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0016e0 tx=0x7f0eac009040 comp rx=0 tx=0).stop 2023-12-16T20:22:05.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.423+0000 7f0ebbfff640 1 -- 172.21.15.87:0/2384428488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ebc0c6b90 msgr2=0x7f0ebc14c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:05.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.423+0000 7f0ebbfff640 1 --2- 172.21.15.87:0/2384428488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ebc0c6b90 0x7f0ebc14c470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ea400e9b0 tx=0x7f0ea400ee70 comp rx=0 tx=0).stop 2023-12-16T20:22:05.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.423+0000 7f0ebbfff640 1 -- 172.21.15.87:0/2384428488 shutdown_connections 2023-12-16T20:22:05.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.423+0000 7f0ebbfff640 1 --2- 172.21.15.87:0/2384428488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ebc1599b0 0x7f0ebc0c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:05.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.423+0000 7f0ebbfff640 1 --2- 172.21.15.87:0/2384428488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ebc0c6b90 0x7f0ebc14c470 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:05.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.423+0000 7f0ebbfff640 1 --2- 172.21.15.87:0/2384428488 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0e9c06ae90 0x7f0e9c06d350 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:05.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.423+0000 7f0ebbfff640 1 --2- 172.21.15.87:0/2384428488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ebc0c67b0 0x7f0ebc1f2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:05.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.423+0000 7f0ebbfff640 1 -- 172.21.15.87:0/2384428488 >> 172.21.15.87:0/2384428488 conn(0x7f0ebc06b610 msgr2=0x7f0ebc06f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:05.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.423+0000 7f0ebbfff640 1 -- 172.21.15.87:0/2384428488 shutdown_connections 2023-12-16T20:22:05.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.423+0000 7f0ebbfff640 1 -- 172.21.15.87:0/2384428488 wait complete. 2023-12-16T20:22:05.436 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":5,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":748553150},{"type":"v1","addr":"172.21.15.87:6801","nonce":748553150}]},"active_addr":"172.21.15.87:6801/748553150","active_change":"2023-12-16T20:21:11.973991+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":467713541}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":1453194211}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":3241289861}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":4274649593}]}]} 2023-12-16T20:22:05.440 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-16T20:22:05.440 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-16T20:22:05.440 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:22:05.542 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.540+0000 7fbbcee15640 1 Processor -- start 2023-12-16T20:22:05.542 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.541+0000 7fbbcee15640 1 -- start start 2023-12-16T20:22:05.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.542+0000 7fbbcee15640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbbc81504e0 0x7fbbc806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:05.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.542+0000 7fbbcee15640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc80c7190 0x7fbbc806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:05.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.542+0000 7fbbcee15640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc80c5f60 con 0x7fbbc80c7700 2023-12-16T20:22:05.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.542+0000 7fbbcee15640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc80c2c60 con 0x7fbbc81504e0 2023-12-16T20:22:05.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.542+0000 7fbbcee15640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc80c2f20 con 0x7fbbc80c7190 2023-12-16T20:22:05.544 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.542+0000 7fbbc7fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc80c7190 0x7fbbc806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:05.544 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.543+0000 7fbbc7fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc80c7190 0x7fbbc806e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:35270/0 (socket says 172.21.15.87:35270) 2023-12-16T20:22:05.544 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.543+0000 7fbbc7fff640 1 -- 172.21.15.87:0/1788382694 learned_addr learned my addr 172.21.15.87:0/1788382694 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:05.544 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.543+0000 7fbbccbb1640 1 --2- 172.21.15.87:0/1788382694 >> v2:172.21.15.87:3300/0 conn(0x7fbbc81504e0 0x7fbbc806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:05.546 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.545+0000 7fbbc7fff640 1 -- 172.21.15.87:0/1788382694 >> v2:172.21.15.87:3300/0 conn(0x7fbbc81504e0 msgr2=0x7fbbc806e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:05.546 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.545+0000 7fbbc7fff640 1 --2- 172.21.15.87:0/1788382694 >> v2:172.21.15.87:3300/0 conn(0x7fbbc81504e0 0x7fbbc806e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:05.546 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.545+0000 7fbbc7fff640 1 -- 172.21.15.87:0/1788382694 >> v1:172.21.15.87:6789/0 conn(0x7fbbc80c7700 legacy=0x7fbbc80c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:05.546 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.545+0000 7fbbc7fff640 1 -- 172.21.15.87:0/1788382694 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc80c61b0 con 0x7fbbc80c7190 2023-12-16T20:22:05.548 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.547+0000 7fbbc7fff640 1 --2- 172.21.15.87:0/1788382694 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc80c7190 0x7fbbc806e6e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400bb10 tx=0x7fbbb402e0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb33ed7e2f8d2f48 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:05.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.550+0000 7fbbc77fe640 1 -- 172.21.15.87:0/1788382694 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb402ee70 con 0x7fbbc80c7190 2023-12-16T20:22:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.550+0000 7fbbc77fe640 1 -- 172.21.15.87:0/1788382694 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb4036440 con 0x7fbbc80c7190 2023-12-16T20:22:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.550+0000 7fbbc77fe640 1 -- 172.21.15.87:0/1788382694 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb40367d0 con 0x7fbbc80c7190 2023-12-16T20:22:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.551+0000 7fbbcee15640 1 -- 172.21.15.87:0/1788382694 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc80c7190 msgr2=0x7fbbc806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.551+0000 7fbbcee15640 1 --2- 172.21.15.87:0/1788382694 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc80c7190 0x7fbbc806e6e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400bb10 tx=0x7fbbb402e0c0 comp rx=0 tx=0).stop 2023-12-16T20:22:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.551+0000 7fbbcee15640 1 -- 172.21.15.87:0/1788382694 shutdown_connections 2023-12-16T20:22:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.551+0000 7fbbcee15640 1 --2- 172.21.15.87:0/1788382694 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc80c7190 0x7fbbc806e6e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.551+0000 7fbbcee15640 1 --2- 172.21.15.87:0/1788382694 >> v2:172.21.15.87:3300/0 conn(0x7fbbc81504e0 0x7fbbc806e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.551+0000 7fbbcee15640 1 -- 172.21.15.87:0/1788382694 >> 172.21.15.87:0/1788382694 conn(0x7fbbc80cbef0 msgr2=0x7fbbc80cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.551+0000 7fbbcee15640 1 -- 172.21.15.87:0/1788382694 shutdown_connections 2023-12-16T20:22:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.551+0000 7fbbcee15640 1 -- 172.21.15.87:0/1788382694 wait complete. 2023-12-16T20:22:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.552+0000 7fbbcee15640 1 Processor -- start 2023-12-16T20:22:05.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.552+0000 7fbbcee15640 1 -- start start 2023-12-16T20:22:05.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.553+0000 7fbbcee15640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc80c7190 0x7fbbc80ad210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:05.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.553+0000 7fbbcee15640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc80c7700 0x7fbbc81492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:05.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.553+0000 7fbbcee15640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbc81504e0 0x7fbbc8158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:05.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.553+0000 7fbbcee15640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc80b19f0 con 0x7fbbc81504e0 2023-12-16T20:22:05.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.553+0000 7fbbcee15640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc815a1e0 con 0x7fbbc80c7700 2023-12-16T20:22:05.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.553+0000 7fbbcee15640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc815a480 con 0x7fbbc80c7190 2023-12-16T20:22:05.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.554+0000 7fbbcd3b2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbc81504e0 0x7fbbc8158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:05.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.554+0000 7fbbccbb1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc80c7190 0x7fbbc80ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:05.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.554+0000 7fbbcd3b2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbc81504e0 0x7fbbc8158500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55542/0 (socket says 172.21.15.87:55542) 2023-12-16T20:22:05.556 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.554+0000 7fbbcd3b2640 1 -- 172.21.15.87:0/422368966 learned_addr learned my addr 172.21.15.87:0/422368966 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:05.556 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.554+0000 7fbbc7fff640 1 --2- 172.21.15.87:0/422368966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc80c7700 0x7fbbc81492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:05.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.557+0000 7fbbccbb1640 1 -- 172.21.15.87:0/422368966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc80c7700 msgr2=0x7fbbc81492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:05.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.557+0000 7fbbccbb1640 1 --2- 172.21.15.87:0/422368966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc80c7700 0x7fbbc81492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:05.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.557+0000 7fbbccbb1640 1 -- 172.21.15.87:0/422368966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbc81504e0 msgr2=0x7fbbc8158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:05.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.557+0000 7fbbccbb1640 1 --2- 172.21.15.87:0/422368966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbc81504e0 0x7fbbc8158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:05.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.557+0000 7fbbccbb1640 1 -- 172.21.15.87:0/422368966 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb400b770 con 0x7fbbc80c7190 2023-12-16T20:22:05.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.559+0000 7fbbccbb1640 1 --2- 172.21.15.87:0/422368966 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc80c7190 0x7fbbc80ad210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc00e870 tx=0x7fbbbc00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:05.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.563+0000 7fbbc57fa640 1 -- 172.21.15.87:0/422368966 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc00ee60 con 0x7fbbc80c7190 2023-12-16T20:22:05.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.563+0000 7fbbc57fa640 1 -- 172.21.15.87:0/422368966 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc00c940 con 0x7fbbc80c7190 2023-12-16T20:22:05.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.563+0000 7fbbc57fa640 1 -- 172.21.15.87:0/422368966 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc00ccd0 con 0x7fbbc80c7190 2023-12-16T20:22:05.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.563+0000 7fbbcee15640 1 -- 172.21.15.87:0/422368966 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc8157570 con 0x7fbbc80c7190 2023-12-16T20:22:05.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.563+0000 7fbbcee15640 1 -- 172.21.15.87:0/422368966 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc80c5670 con 0x7fbbc80c7190 2023-12-16T20:22:05.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.564+0000 7fbbcee15640 1 -- 172.21.15.87:0/422368966 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc8157390 con 0x7fbbc80c7190 2023-12-16T20:22:05.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.581+0000 7fbbc57fa640 1 -- 172.21.15.87:0/422368966 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fbbbc013470 con 0x7fbbc80c7190 2023-12-16T20:22:05.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.582+0000 7fbbc57fa640 1 --2- 172.21.15.87:0/422368966 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fbbac06ae90 0x7fbbac06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:05.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.582+0000 7fbbc7fff640 1 --2- 172.21.15.87:0/422368966 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fbbac06ae90 0x7fbbac06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:05.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.582+0000 7fbbc7fff640 1 --2- 172.21.15.87:0/422368966 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fbbac06ae90 0x7fbbac06d350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4038000 tx=0x7fbbb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:05.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.586+0000 7fbbc57fa640 1 -- 172.21.15.87:0/422368966 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbbbc00ce30 con 0x7fbbc80c7190 2023-12-16T20:22:05.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.819+0000 7fbbc57fa640 1 -- 172.21.15.87:0/422368966 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fbbbc054e70 con 0x7fbbc80c7190 2023-12-16T20:22:05.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:05.987+0000 7fbbcee15640 1 -- 172.21.15.87:0/422368966 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbc80740e0 con 0x7fbbc80c7190 2023-12-16T20:22:06.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.025+0000 7fbbc57fa640 1 -- 172.21.15.87:0/422368966 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fbbbc021090 con 0x7fbbc80c7190 2023-12-16T20:22:06.026 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:22:06.026 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:21:41.431615+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:21:22.654341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T20:21:33.728787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T20:21:34.846119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T20:21:38.657738+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:22:06.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.026+0000 7fbbcee15640 1 -- 172.21.15.87:0/422368966 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fbbac06ae90 msgr2=0x7fbbac06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.026+0000 7fbbcee15640 1 --2- 172.21.15.87:0/422368966 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fbbac06ae90 0x7fbbac06d350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4038000 tx=0x7fbbb4008040 comp rx=0 tx=0).stop 2023-12-16T20:22:06.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.026+0000 7fbbcee15640 1 -- 172.21.15.87:0/422368966 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc80c7190 msgr2=0x7fbbc80ad210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.026+0000 7fbbcee15640 1 --2- 172.21.15.87:0/422368966 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc80c7190 0x7fbbc80ad210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc00e870 tx=0x7fbbbc00ed30 comp rx=0 tx=0).stop 2023-12-16T20:22:06.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.026+0000 7fbbcee15640 1 -- 172.21.15.87:0/422368966 shutdown_connections 2023-12-16T20:22:06.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.026+0000 7fbbcee15640 1 --2- 172.21.15.87:0/422368966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbc81504e0 0x7fbbc8158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.026+0000 7fbbcee15640 1 --2- 172.21.15.87:0/422368966 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fbbac06ae90 0x7fbbac06d350 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.026+0000 7fbbcee15640 1 --2- 172.21.15.87:0/422368966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc80c7700 0x7fbbc81492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.026+0000 7fbbcee15640 1 --2- 172.21.15.87:0/422368966 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc80c7190 0x7fbbc80ad210 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.026+0000 7fbbcee15640 1 -- 172.21.15.87:0/422368966 >> 172.21.15.87:0/422368966 conn(0x7fbbc80cbef0 msgr2=0x7fbbc806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:06.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.026+0000 7fbbcee15640 1 -- 172.21.15.87:0/422368966 shutdown_connections 2023-12-16T20:22:06.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.026+0000 7fbbcee15640 1 -- 172.21.15.87:0/422368966 wait complete. 2023-12-16T20:22:06.039 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-16T20:22:06.039 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:22:06.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.137+0000 7f47cd01c640 1 Processor -- start 2023-12-16T20:22:06.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.137+0000 7f47cd01c640 1 -- start start 2023-12-16T20:22:06.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.138+0000 7f47cd01c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f47c81538f0 0x7f47c80c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.138+0000 7f47cd01c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f47c8159b70 0x7f47c8159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.138+0000 7f47cd01c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c81596e0 con 0x7f47c80c7b90 2023-12-16T20:22:06.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.138+0000 7f47cd01c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c80ca630 con 0x7f47c8159b70 2023-12-16T20:22:06.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.138+0000 7f47cd01c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c815a520 con 0x7f47c81538f0 2023-12-16T20:22:06.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.139+0000 7f47c759e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f47c8159b70 0x7f47c8159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.139+0000 7f47c6d9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f47c81538f0 0x7f47c80c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.139+0000 7f47c759e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f47c8159b70 0x7f47c8159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55546/0 (socket says 172.21.15.87:55546) 2023-12-16T20:22:06.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.139+0000 7f47c759e640 1 -- 172.21.15.87:0/3970314494 learned_addr learned my addr 172.21.15.87:0/3970314494 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:06.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.141+0000 7f47c759e640 1 -- 172.21.15.87:0/3970314494 >> v2:172.21.15.195:3300/0 conn(0x7f47c81538f0 msgr2=0x7f47c80c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:06.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.141+0000 7f47c759e640 1 --2- 172.21.15.87:0/3970314494 >> v2:172.21.15.195:3300/0 conn(0x7f47c81538f0 0x7f47c80c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.141+0000 7f47c759e640 1 -- 172.21.15.87:0/3970314494 >> v1:172.21.15.195:6789/0 conn(0x7f47c80c7b90 legacy=0x7f47c806b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.141+0000 7f47c759e640 1 -- 172.21.15.87:0/3970314494 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c80c2f40 con 0x7f47c8159b70 2023-12-16T20:22:06.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.143+0000 7f47c759e640 1 --2- 172.21.15.87:0/3970314494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c8159b70 0x7f47c8159fe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f47c8072b10 tx=0x7f47c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231b75f8b34eeaa4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:06.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.147+0000 7f47c5d9b640 1 -- 172.21.15.87:0/3970314494 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c0031870 con 0x7f47c8159b70 2023-12-16T20:22:06.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.147+0000 7f47c5d9b640 1 -- 172.21.15.87:0/3970314494 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c00319d0 con 0x7f47c8159b70 2023-12-16T20:22:06.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.147+0000 7f47c5d9b640 1 -- 172.21.15.87:0/3970314494 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c0031d60 con 0x7f47c8159b70 2023-12-16T20:22:06.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.147+0000 7f47cd01c640 1 -- 172.21.15.87:0/3970314494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c8159b70 msgr2=0x7f47c8159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.147+0000 7f47cd01c640 1 --2- 172.21.15.87:0/3970314494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c8159b70 0x7f47c8159fe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f47c8072b10 tx=0x7f47c002b910 comp rx=0 tx=0).stop 2023-12-16T20:22:06.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.147+0000 7f47cd01c640 1 -- 172.21.15.87:0/3970314494 shutdown_connections 2023-12-16T20:22:06.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.147+0000 7f47cd01c640 1 --2- 172.21.15.87:0/3970314494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c8159b70 0x7f47c8159fe0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.147+0000 7f47cd01c640 1 --2- 172.21.15.87:0/3970314494 >> v2:172.21.15.195:3300/0 conn(0x7f47c81538f0 0x7f47c80c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.147+0000 7f47cd01c640 1 -- 172.21.15.87:0/3970314494 >> 172.21.15.87:0/3970314494 conn(0x7f47c8060f20 msgr2=0x7f47c8061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:06.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.147+0000 7f47cd01c640 1 -- 172.21.15.87:0/3970314494 shutdown_connections 2023-12-16T20:22:06.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.147+0000 7f47cd01c640 1 -- 172.21.15.87:0/3970314494 wait complete. 2023-12-16T20:22:06.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.149+0000 7f47cd01c640 1 Processor -- start 2023-12-16T20:22:06.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.149+0000 7f47cd01c640 1 -- start start 2023-12-16T20:22:06.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.150+0000 7f47cd01c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c80c7b90 0x7f47c814c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.150+0000 7f47cd01c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c81538f0 0x7f47c814ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.150+0000 7f47cd01c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47c8159b70 0x7f47c815bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.150+0000 7f47cd01c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c81f00c0 con 0x7f47c80c7b90 2023-12-16T20:22:06.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.150+0000 7f47cd01c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c81ef260 con 0x7f47c81538f0 2023-12-16T20:22:06.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.150+0000 7f47cd01c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c81ef540 con 0x7f47c8159b70 2023-12-16T20:22:06.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.150+0000 7f47c6d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c80c7b90 0x7f47c814c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.150+0000 7f47c659c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c81538f0 0x7f47c814ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.150+0000 7f47c759e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47c8159b70 0x7f47c815bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.150+0000 7f47c6d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c80c7b90 0x7f47c814c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55558/0 (socket says 172.21.15.87:55558) 2023-12-16T20:22:06.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.150+0000 7f47c6d9d640 1 -- 172.21.15.87:0/927839703 learned_addr learned my addr 172.21.15.87:0/927839703 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:06.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.154+0000 7f47c659c640 1 -- 172.21.15.87:0/927839703 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47c8159b70 msgr2=0x7f47c815bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.154+0000 7f47c659c640 1 --2- 172.21.15.87:0/927839703 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47c8159b70 0x7f47c815bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.154+0000 7f47c659c640 1 -- 172.21.15.87:0/927839703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c80c7b90 msgr2=0x7f47c814c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.154+0000 7f47c659c640 1 --2- 172.21.15.87:0/927839703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c80c7b90 0x7f47c814c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.154+0000 7f47c659c640 1 -- 172.21.15.87:0/927839703 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c00094d0 con 0x7f47c81538f0 2023-12-16T20:22:06.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.157+0000 7f47c659c640 1 --2- 172.21.15.87:0/927839703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c81538f0 0x7f47c814ceb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00c3c0 tx=0x7f47bc00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.160+0000 7f47af7fe640 1 -- 172.21.15.87:0/927839703 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0052d0 con 0x7f47c81538f0 2023-12-16T20:22:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.160+0000 7f47af7fe640 1 -- 172.21.15.87:0/927839703 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc005450 con 0x7f47c81538f0 2023-12-16T20:22:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.161+0000 7f47af7fe640 1 -- 172.21.15.87:0/927839703 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc007260 con 0x7f47c81538f0 2023-12-16T20:22:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.161+0000 7f47cd01c640 1 -- 172.21.15.87:0/927839703 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c81ef820 con 0x7f47c81538f0 2023-12-16T20:22:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.161+0000 7f47cd01c640 1 -- 172.21.15.87:0/927839703 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c81efde0 con 0x7f47c81538f0 2023-12-16T20:22:06.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.162+0000 7f47cd01c640 1 -- 172.21.15.87:0/927839703 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c80c74b0 con 0x7f47c81538f0 2023-12-16T20:22:06.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.191+0000 7f47af7fe640 1 -- 172.21.15.87:0/927839703 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f47bc0073c0 con 0x7f47c81538f0 2023-12-16T20:22:06.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.192+0000 7f47af7fe640 1 --2- 172.21.15.87:0/927839703 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f47b406aec0 0x7f47b406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.192+0000 7f47c6d9d640 1 --2- 172.21.15.87:0/927839703 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f47b406aec0 0x7f47b406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.192+0000 7f47c6d9d640 1 --2- 172.21.15.87:0/927839703 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f47b406aec0 0x7f47b406d380 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f47b80094c0 tx=0x7f47b800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:06.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.194+0000 7f47af7fe640 1 -- 172.21.15.87:0/927839703 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f47bc058190 con 0x7f47c81538f0 2023-12-16T20:22:06.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.428+0000 7f47af7fe640 1 -- 172.21.15.87:0/927839703 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f47bc0544d0 con 0x7f47c81538f0 2023-12-16T20:22:06.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.610+0000 7f47cd01c640 1 -- 172.21.15.87:0/927839703 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47c8067500 con 0x7f47c81538f0 2023-12-16T20:22:06.768 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.766+0000 7f47af7fe640 1 -- 172.21.15.87:0/927839703 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f47bc020090 con 0x7f47c81538f0 2023-12-16T20:22:06.768 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:22:06.768 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:21:41.431615+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:21:22.654341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T20:21:33.728787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T20:21:34.846119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T20:21:38.657738+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:22:06.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.768+0000 7f47cd01c640 1 -- 172.21.15.87:0/927839703 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f47b406aec0 msgr2=0x7f47b406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.768+0000 7f47cd01c640 1 --2- 172.21.15.87:0/927839703 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f47b406aec0 0x7f47b406d380 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f47b80094c0 tx=0x7f47b800b040 comp rx=0 tx=0).stop 2023-12-16T20:22:06.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.768+0000 7f47cd01c640 1 -- 172.21.15.87:0/927839703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c81538f0 msgr2=0x7f47c814ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.768+0000 7f47cd01c640 1 --2- 172.21.15.87:0/927839703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c81538f0 0x7f47c814ceb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00c3c0 tx=0x7f47bc00c880 comp rx=0 tx=0).stop 2023-12-16T20:22:06.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.768+0000 7f47cd01c640 1 -- 172.21.15.87:0/927839703 shutdown_connections 2023-12-16T20:22:06.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.768+0000 7f47cd01c640 1 --2- 172.21.15.87:0/927839703 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f47c8159b70 0x7f47c815bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.768+0000 7f47cd01c640 1 --2- 172.21.15.87:0/927839703 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f47b406aec0 0x7f47b406d380 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.768+0000 7f47cd01c640 1 --2- 172.21.15.87:0/927839703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c81538f0 0x7f47c814ceb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.768+0000 7f47cd01c640 1 --2- 172.21.15.87:0/927839703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c80c7b90 0x7f47c814c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.768+0000 7f47cd01c640 1 -- 172.21.15.87:0/927839703 >> 172.21.15.87:0/927839703 conn(0x7f47c8060f20 msgr2=0x7f47c81522c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:06.771 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.768+0000 7f47cd01c640 1 -- 172.21.15.87:0/927839703 shutdown_connections 2023-12-16T20:22:06.771 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.768+0000 7f47cd01c640 1 -- 172.21.15.87:0/927839703 wait complete. 2023-12-16T20:22:06.781 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-16T20:22:06.782 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-16T20:22:06.782 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-16T20:22:06.782 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-16T20:22:06.783 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-16T20:22:06.783 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-16T20:22:06.784 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-16T20:22:06.784 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-16T20:22:06.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.953+0000 7f1cff59e640 1 Processor -- start 2023-12-16T20:22:06.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.953+0000 7f3f57c89640 1 Processor -- start 2023-12-16T20:22:06.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.953+0000 7f3f57c89640 1 -- start start 2023-12-16T20:22:06.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.953+0000 7f1cff59e640 1 -- start start 2023-12-16T20:22:06.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.954+0000 7f7eab59e640 1 Processor -- start 2023-12-16T20:22:06.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.954+0000 7fd648d3e640 1 Processor -- start 2023-12-16T20:22:06.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.954+0000 7f1a8b015640 1 Processor -- start 2023-12-16T20:22:06.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.954+0000 7f1a8b015640 1 -- start start 2023-12-16T20:22:06.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.955+0000 7fd648d3e640 1 -- start start 2023-12-16T20:22:06.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.954+0000 7f7eab59e640 1 -- start start 2023-12-16T20:22:06.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.955+0000 7fe20da89640 1 Processor -- start 2023-12-16T20:22:06.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.955+0000 7f1cff59e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1cf804f0d0 0x7f1cf80e3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.955+0000 7f1a8b015640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1a8414fac0 0x7f1a84071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.955+0000 7f1cff59e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cf804e360 0x7f1cf8035d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.955+0000 7f7eab59e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7eac157ab0 0x7f7eac06af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.955+0000 7f7eab59e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac0cc340 0x7f7eac15e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.955+0000 7f1cff59e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf8035870 con 0x7f1cf804cce0 2023-12-16T20:22:06.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.955+0000 7f1cff59e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf804e7c0 con 0x7f1cf804f0d0 2023-12-16T20:22:06.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.955+0000 7f1a8b015640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a840c0af0 con 0x7f1a840cb480 2023-12-16T20:22:06.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.955+0000 7f1a8b015640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a840c62f0 con 0x7f1a840cb0a0 2023-12-16T20:22:06.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.955+0000 7f7eab59e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eac0cb8f0 con 0x7f7eac0c7870 2023-12-16T20:22:06.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.955+0000 7f1a8b015640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8406f8a0 con 0x7f1a8414fac0 2023-12-16T20:22:06.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.955+0000 7f7eab59e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eac0cbf20 con 0x7f7eac157ab0 2023-12-16T20:22:06.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.955+0000 7f7eab59e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac15e7b0 con 0x7f7eac0cc340 2023-12-16T20:22:06.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.955+0000 7f1cff59e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf804dc70 con 0x7f1cf804e360 2023-12-16T20:22:06.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7f1cfe59c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1cf804f0d0 0x7f1cf80e3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.954+0000 7f3f57c89640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f4804b090 0x7f3f4804b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.954+0000 7f3f57c89640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3f480d4f90 0x7f3f48005e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.954+0000 7f3f57c89640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f48046f30 con 0x7f3f4800e2a0 2023-12-16T20:22:06.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.954+0000 7f3f57c89640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f48046170 con 0x7f3f480d4f90 2023-12-16T20:22:06.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.954+0000 7f3f57c89640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f48046450 con 0x7f3f4804b090 2023-12-16T20:22:06.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7f3f55a25640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3f4800e2a0 0x7f3f480db830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54952/0 (socket says 172.21.15.87:54952) 2023-12-16T20:22:06.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7f3f55a25640 1 -- 172.21.15.87:0/3293920668 learned_addr learned my addr 172.21.15.87:0/3293920668 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:06.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7f1a895b2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1a8414fac0 0x7f1a84071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7fd648d3e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd63c045810 0x7fd63c046890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7fd648d3e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd63c046dd0 0x7fd63c04b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7fd648d3e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63c046400 con 0x7fd63c0d8f40 2023-12-16T20:22:06.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7fd648d3e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63c0dfcf0 con 0x7fd63c045810 2023-12-16T20:22:06.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7fd648d3e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0df450 con 0x7fd63c046dd0 2023-12-16T20:22:06.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.955+0000 7feb77111640 1 Processor -- start 2023-12-16T20:22:06.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7feb77111640 1 -- start start 2023-12-16T20:22:06.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.955+0000 7fe20da89640 1 -- start start 2023-12-16T20:22:06.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7f1cfe59c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1cf804f0d0 0x7f1cf80e3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:39256/0 (socket says 172.21.15.87:39256) 2023-12-16T20:22:06.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7f1cfe59c640 1 -- 172.21.15.87:0/3982410073 learned_addr learned my addr 172.21.15.87:0/3982410073 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:06.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7f3f55224640 1 --2- 172.21.15.87:0/3293920668 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f4804b090 0x7f3f4804b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7f7ea9d9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac0cc340 0x7f7eac15e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7fe20da89640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe208153640 0x7fe208153a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7fe20da89640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2080c4210 0x7fe20815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7f1cfdd9b640 1 --2- 172.21.15.87:0/3982410073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cf804e360 0x7f1cf8035d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7fe20da89640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20815a6e0 con 0x7fe2080c4810 2023-12-16T20:22:06.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7f1a895b2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1a8414fac0 0x7f1a84071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55562/0 (socket says 172.21.15.87:55562) 2023-12-16T20:22:06.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.957+0000 7f1a895b2640 1 -- 172.21.15.87:0/3608018775 learned_addr learned my addr 172.21.15.87:0/3608018775 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:06.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7fe20da89640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe20806bba0 con 0x7fe208153640 2023-12-16T20:22:06.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.956+0000 7fe20da89640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20806be60 con 0x7fe2080c4210 2023-12-16T20:22:06.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.957+0000 7f7ea9d9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac0cc340 0x7f7eac15e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:35302/0 (socket says 172.21.15.87:35302) 2023-12-16T20:22:06.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.957+0000 7f7ea9d9b640 1 -- 172.21.15.87:0/1254136756 learned_addr learned my addr 172.21.15.87:0/1254136756 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:06.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.957+0000 7feb77111640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7feb700c72a0 0x7feb700c5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.957+0000 7feb77111640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb700c9ab0 0x7feb70161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.957+0000 7feb77111640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7015dfb0 con 0x7feb700c7680 2023-12-16T20:22:06.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.957+0000 7feb77111640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb701613e0 con 0x7feb700c72a0 2023-12-16T20:22:06.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.957+0000 7feb77111640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7015dda0 con 0x7feb700c9ab0 2023-12-16T20:22:06.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.958+0000 7f2d5ed27640 1 Processor -- start 2023-12-16T20:22:06.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.958+0000 7f2d5ed27640 1 -- start start 2023-12-16T20:22:06.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.959+0000 7f1cfe59c640 1 -- 172.21.15.87:0/3982410073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cf804e360 msgr2=0x7f1cf8035d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:06.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.959+0000 7f1cfe59c640 1 --2- 172.21.15.87:0/3982410073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cf804e360 0x7f1cf8035d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.959+0000 7f1cfe59c640 1 -- 172.21.15.87:0/3982410073 >> v1:172.21.15.195:6789/0 conn(0x7f1cf804cce0 legacy=0x7f1cf80376d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:06.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.959+0000 7f1cfe59c640 1 -- 172.21.15.87:0/3982410073 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf804d6b0 con 0x7f1cf804f0d0 2023-12-16T20:22:06.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.959+0000 7f2d5ed27640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2d5815b2f0 0x7f2d580c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.959+0000 7f1a895b2640 1 -- 172.21.15.87:0/3608018775 >> v1:172.21.15.195:6789/0 conn(0x7f1a840cb0a0 legacy=0x7f1a8406f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:06.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.959+0000 7f1a895b2640 1 -- 172.21.15.87:0/3608018775 >> v1:172.21.15.87:6789/0 conn(0x7f1a840cb480 legacy=0x7f1a8414f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:06.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.959+0000 7f2d5ed27640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d580ca0a0 con 0x7f2d58151530 2023-12-16T20:22:06.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.959+0000 7f1a895b2640 1 -- 172.21.15.87:0/3608018775 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a840c0d40 con 0x7f1a8414fac0 2023-12-16T20:22:06.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.959+0000 7f2d5ed27640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d580c2150 con 0x7f2d580c9710 2023-12-16T20:22:06.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.959+0000 7f2d5ed27640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d58157420 con 0x7f2d5815b2f0 2023-12-16T20:22:06.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.961+0000 7f3f56226640 1 --2- 172.21.15.87:0/3293920668 >> v2:172.21.15.195:3300/0 conn(0x7f3f480d4f90 0x7f3f48005e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.961+0000 7f7ea9d9b640 1 -- 172.21.15.87:0/1254136756 >> v2:172.21.15.195:3300/0 conn(0x7f7eac157ab0 msgr2=0x7f7eac06af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:06.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.961+0000 7f7ea9d9b640 1 --2- 172.21.15.87:0/1254136756 >> v2:172.21.15.195:3300/0 conn(0x7f7eac157ab0 0x7f7eac06af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.961+0000 7f7ea9d9b640 1 -- 172.21.15.87:0/1254136756 >> v1:172.21.15.195:6789/0 conn(0x7f7eac0c7870 legacy=0x7f7eac06f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:06.971 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.961+0000 7f7ea9d9b640 1 -- 172.21.15.87:0/1254136756 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac06a600 con 0x7f7eac0cc340 2023-12-16T20:22:06.971 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.961+0000 7fd641d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd63c045810 0x7fd63c046890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.971 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.962+0000 7fd641d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd63c045810 0x7fd63c046890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55574/0 (socket says 172.21.15.87:55574) 2023-12-16T20:22:06.971 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.962+0000 7fd641d9b640 1 -- 172.21.15.87:0/3286541755 learned_addr learned my addr 172.21.15.87:0/3286541755 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:06.971 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.962+0000 7f1a895b2640 1 --2- 172.21.15.87:0/3608018775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a8414fac0 0x7f1a84071d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c007360 tx=0x7f1a6c02cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0a0d9c5de2dc7b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:06.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.965+0000 7f2d5dd25640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2d58151530 0x7f2d580c8700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54972/0 (socket says 172.21.15.87:54972) 2023-12-16T20:22:06.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.965+0000 7f2d5dd25640 1 -- 172.21.15.87:0/1597875062 learned_addr learned my addr 172.21.15.87:0/1597875062 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:06.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.966+0000 7fe2077fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe208153640 0x7fe208153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.966+0000 7f3f55224640 1 -- 172.21.15.87:0/3293920668 >> v2:172.21.15.195:3300/0 conn(0x7f3f480d4f90 msgr2=0x7f3f48005e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:06.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.966+0000 7f3f55224640 1 --2- 172.21.15.87:0/3293920668 >> v2:172.21.15.195:3300/0 conn(0x7f3f480d4f90 0x7f3f48005e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.966+0000 7f3f55224640 1 -- 172.21.15.87:0/3293920668 >> v1:172.21.15.87:6789/0 conn(0x7f3f4800e2a0 legacy=0x7f3f480db830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:06.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.966+0000 7f3f55224640 1 -- 172.21.15.87:0/3293920668 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f48046730 con 0x7f3f4804b090 2023-12-16T20:22:06.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.968+0000 7fd641d9b640 1 -- 172.21.15.87:0/3286541755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd63c046dd0 msgr2=0x7fd63c04b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:06.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.968+0000 7fd641d9b640 1 --2- 172.21.15.87:0/3286541755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd63c046dd0 0x7fd63c04b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.968+0000 7fd641d9b640 1 -- 172.21.15.87:0/3286541755 >> v1:172.21.15.195:6789/0 conn(0x7fd63c0d8f40 legacy=0x7fd63c0deca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.968+0000 7fd641d9b640 1 -- 172.21.15.87:0/3286541755 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c0df730 con 0x7fd63c045810 2023-12-16T20:22:06.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.968+0000 7feb76910640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7feb700c7680 0x7feb7015d690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54968/0 (socket says 172.21.15.87:54968) 2023-12-16T20:22:06.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.968+0000 7feb76910640 1 -- 172.21.15.87:0/2653516686 learned_addr learned my addr 172.21.15.87:0/2653516686 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:06.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.969+0000 7fe2077fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe208153640 0x7fe208153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:39286/0 (socket says 172.21.15.87:39286) 2023-12-16T20:22:06.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.969+0000 7fe2077fe640 1 -- 172.21.15.87:0/2284346263 learned_addr learned my addr 172.21.15.87:0/2284346263 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:06.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.971+0000 7f3f55224640 1 --2- 172.21.15.87:0/3293920668 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f4804b090 0x7f3f4804b620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3f400097a0 tx=0x7f3f4002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be9f065ffa3dc878 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:06.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.971+0000 7f7ea9d9b640 1 --2- 172.21.15.87:0/1254136756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac0cc340 0x7f7eac15e270 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009870 tx=0x7f7ea002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86cc7bf01a89f930 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:06.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.971+0000 7fd641d9b640 1 --2- 172.21.15.87:0/3286541755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd63c045810 0x7fd63c046890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd638009870 tx=0x7fd63802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ac79f3dc4383cd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:06.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.971+0000 7fe206ffd640 1 --2- 172.21.15.87:0/2284346263 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2080c4210 0x7fe20815a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.973+0000 7feb7590e640 1 --2- 172.21.15.87:0/2653516686 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb700c9ab0 0x7feb70161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.974+0000 7fe2077fe640 1 -- 172.21.15.87:0/2284346263 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2080c4210 msgr2=0x7fe20815a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:06.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.975+0000 7fe2077fe640 1 --2- 172.21.15.87:0/2284346263 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2080c4210 0x7fe20815a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.975+0000 7fe2077fe640 1 -- 172.21.15.87:0/2284346263 >> v1:172.21.15.195:6789/0 conn(0x7fe2080c4810 legacy=0x7fe2080b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:06.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.975+0000 7fe2077fe640 1 -- 172.21.15.87:0/2284346263 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20806c140 con 0x7fe208153640 2023-12-16T20:22:06.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.976+0000 7f1a837fe640 1 -- 172.21.15.87:0/3608018775 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c008df0 con 0x7f1a8414fac0 2023-12-16T20:22:06.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.976+0000 7f1a837fe640 1 -- 172.21.15.87:0/3608018775 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c00a0d0 con 0x7f1a8414fac0 2023-12-16T20:22:06.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.976+0000 7f1a837fe640 1 -- 172.21.15.87:0/3608018775 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c00a460 con 0x7f1a8414fac0 2023-12-16T20:22:06.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.976+0000 7f2d5cd23640 1 -- 172.21.15.87:0/1597875062 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385527318 0 0) 0x7f2d580ca0a0 con 0x7f2d58151530 2023-12-16T20:22:06.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.976+0000 7f2d5cd23640 1 -- 172.21.15.87:0/1597875062 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d44003520 con 0x7f2d58151530 2023-12-16T20:22:06.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.976+0000 7f1a8b015640 1 -- 172.21.15.87:0/3608018775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a8414fac0 msgr2=0x7f1a84071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.976+0000 7f1a8b015640 1 --2- 172.21.15.87:0/3608018775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a8414fac0 0x7f1a84071d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c007360 tx=0x7f1a6c02cac0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.976+0000 7f2d5e526640 1 --2- 172.21.15.87:0/1597875062 >> v2:172.21.15.195:3300/0 conn(0x7f2d5815b2f0 0x7f2d580c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.979 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.976+0000 7feb7510d640 1 -- 172.21.15.87:0/2653516686 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292716339 0 0) 0x7feb7015dfb0 con 0x7feb700c7680 2023-12-16T20:22:06.979 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.977+0000 7feb7510d640 1 -- 172.21.15.87:0/2653516686 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb5c003520 con 0x7feb700c7680 2023-12-16T20:22:06.979 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.977+0000 7f1a8b015640 1 -- 172.21.15.87:0/3608018775 shutdown_connections 2023-12-16T20:22:06.980 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.977+0000 7f1a8b015640 1 --2- 172.21.15.87:0/3608018775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a8414fac0 0x7f1a84071d80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.980 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.977+0000 7f1a8b015640 1 -- 172.21.15.87:0/3608018775 >> 172.21.15.87:0/3608018775 conn(0x7f1a8406cd60 msgr2=0x7f1a8406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:06.980 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.977+0000 7f1a8b015640 1 -- 172.21.15.87:0/3608018775 shutdown_connections 2023-12-16T20:22:06.980 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.977+0000 7f1a8b015640 1 -- 172.21.15.87:0/3608018775 wait complete. 2023-12-16T20:22:06.980 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.978+0000 7f1a8b015640 1 Processor -- start 2023-12-16T20:22:06.980 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.978+0000 7f1a8b015640 1 -- start start 2023-12-16T20:22:06.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.979+0000 7f1a8b015640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a840cb0a0 0x7f1a84071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.979+0000 7f1a8b015640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a840cb480 0x7f1a840ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.979+0000 7f1a8b015640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a8414fac0 0x7f1a840ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.979+0000 7f1a8b015640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a84158630 con 0x7f1a840cb0a0 2023-12-16T20:22:06.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.979+0000 7f1a8b015640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840c8ce0 con 0x7f1a8414fac0 2023-12-16T20:22:06.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.979+0000 7f1a8b015640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840c8f60 con 0x7f1a840cb480 2023-12-16T20:22:06.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.980+0000 7fe2077fe640 1 --2- 172.21.15.87:0/2284346263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe208153640 0x7fe208153a20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009870 tx=0x7fe1f802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55e52da91a9e0c8e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:06.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.981+0000 7f1cfe59c640 1 --2- 172.21.15.87:0/3982410073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cf804f0d0 0x7f1cf80e3000 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0009870 tx=0x7f1cf002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=899cbe747cc703e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:06.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.982+0000 7feb7590e640 1 -- 172.21.15.87:0/2653516686 >> v2:172.21.15.195:3300/0 conn(0x7feb700c72a0 msgr2=0x7feb700c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:06.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.982+0000 7feb7590e640 1 --2- 172.21.15.87:0/2653516686 >> v2:172.21.15.195:3300/0 conn(0x7feb700c72a0 0x7feb700c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.982+0000 7feb7590e640 1 -- 172.21.15.87:0/2653516686 >> v1:172.21.15.87:6789/0 conn(0x7feb700c7680 legacy=0x7feb7015d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.982+0000 7feb7590e640 1 -- 172.21.15.87:0/2653516686 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7015e290 con 0x7feb700c9ab0 2023-12-16T20:22:06.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.983+0000 7f2d5e526640 1 -- 172.21.15.87:0/1597875062 >> v1:172.21.15.195:6789/0 conn(0x7f2d580c9710 legacy=0x7f2d5815abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.983+0000 7f2d5e526640 1 -- 172.21.15.87:0/1597875062 >> v1:172.21.15.87:6789/0 conn(0x7f2d58151530 legacy=0x7f2d580c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.983+0000 7f2d5e526640 1 -- 172.21.15.87:0/1597875062 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d58157700 con 0x7f2d5815b2f0 2023-12-16T20:22:06.986 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.985+0000 7f3f54a23640 1 -- 172.21.15.87:0/3293920668 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40031830 con 0x7f3f4804b090 2023-12-16T20:22:06.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.985+0000 7f3f54a23640 1 -- 172.21.15.87:0/3293920668 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f40031990 con 0x7f3f4804b090 2023-12-16T20:22:06.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.985+0000 7f3f54a23640 1 -- 172.21.15.87:0/3293920668 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40031d20 con 0x7f3f4804b090 2023-12-16T20:22:06.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.986+0000 7f1a83fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a840cb480 0x7f1a840ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.986+0000 7f3f57c89640 1 -- 172.21.15.87:0/3293920668 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f4804b090 msgr2=0x7f3f4804b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.986+0000 7f3f57c89640 1 --2- 172.21.15.87:0/3293920668 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f4804b090 0x7f3f4804b620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3f400097a0 tx=0x7f3f4002b8d0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.986+0000 7f3f57c89640 1 -- 172.21.15.87:0/3293920668 shutdown_connections 2023-12-16T20:22:06.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.986+0000 7f3f57c89640 1 --2- 172.21.15.87:0/3293920668 >> v2:172.21.15.195:3300/0 conn(0x7f3f480d4f90 0x7f3f48005e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.986+0000 7f3f57c89640 1 --2- 172.21.15.87:0/3293920668 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f4804b090 0x7f3f4804b620 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.986+0000 7f3f57c89640 1 -- 172.21.15.87:0/3293920668 >> 172.21.15.87:0/3293920668 conn(0x7f3f48050180 msgr2=0x7f3f48050590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:06.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.986+0000 7f1a83fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a840cb480 0x7f1a840ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:35362/0 (socket says 172.21.15.87:35362) 2023-12-16T20:22:06.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.986+0000 7f1a83fff640 1 -- 172.21.15.87:0/3560410971 learned_addr learned my addr 172.21.15.87:0/3560410971 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:06.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.986+0000 7f3f57c89640 1 -- 172.21.15.87:0/3293920668 shutdown_connections 2023-12-16T20:22:06.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.986+0000 7f3f57c89640 1 -- 172.21.15.87:0/3293920668 wait complete. 2023-12-16T20:22:06.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.986+0000 7fd64159a640 1 -- 172.21.15.87:0/3286541755 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63802f840 con 0x7fd63c045810 2023-12-16T20:22:06.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.986+0000 7fd64159a640 1 -- 172.21.15.87:0/3286541755 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63802f9a0 con 0x7fd63c045810 2023-12-16T20:22:06.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.986+0000 7fd64159a640 1 -- 172.21.15.87:0/3286541755 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63802fd30 con 0x7fd63c045810 2023-12-16T20:22:06.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.987+0000 7feb7590e640 1 --2- 172.21.15.87:0/2653516686 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb700c9ab0 0x7feb70161800 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0097a0 tx=0x7feb6c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6be0db2dbf295a8d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:06.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.987+0000 7fd648d3e640 1 -- 172.21.15.87:0/3286541755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd63c045810 msgr2=0x7fd63c046890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.987+0000 7fd648d3e640 1 --2- 172.21.15.87:0/3286541755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd63c045810 0x7fd63c046890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd638009870 tx=0x7fd63802ba20 comp rx=0 tx=0).stop 2023-12-16T20:22:06.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.987+0000 7fd648d3e640 1 -- 172.21.15.87:0/3286541755 shutdown_connections 2023-12-16T20:22:06.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.988+0000 7f3f57c89640 1 Processor -- start 2023-12-16T20:22:06.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.988+0000 7fd648d3e640 1 --2- 172.21.15.87:0/3286541755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd63c046dd0 0x7fd63c04b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.988+0000 7fd648d3e640 1 --2- 172.21.15.87:0/3286541755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd63c045810 0x7fd63c046890 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.988+0000 7fd648d3e640 1 -- 172.21.15.87:0/3286541755 >> 172.21.15.87:0/3286541755 conn(0x7fd63c0505d0 msgr2=0x7fd63c0509e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:06.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.988+0000 7f3f57c89640 1 -- start start 2023-12-16T20:22:06.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.988+0000 7fd648d3e640 1 -- 172.21.15.87:0/3286541755 shutdown_connections 2023-12-16T20:22:06.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.988+0000 7fd648d3e640 1 -- 172.21.15.87:0/3286541755 wait complete. 2023-12-16T20:22:06.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.988+0000 7f3f57c89640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4800e2a0 0x7f3f480dd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.988+0000 7f3f57c89640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f4804b090 0x7f3f480d6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.988+0000 7f3f57c89640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f480d4f90 0x7f3f480d7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.988+0000 7f3f57c89640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f480ce2b0 con 0x7f3f4800e2a0 2023-12-16T20:22:06.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.988+0000 7f3f57c89640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f480d6990 con 0x7f3f4804b090 2023-12-16T20:22:06.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.988+0000 7f3f57c89640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f480cd230 con 0x7f3f480d4f90 2023-12-16T20:22:06.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.989+0000 7f1a88db1640 1 --2- 172.21.15.87:0/3560410971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a840cb0a0 0x7f1a84071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.989+0000 7fd648d3e640 1 Processor -- start 2023-12-16T20:22:06.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.989+0000 7fd648d3e640 1 -- start start 2023-12-16T20:22:06.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.990+0000 7f1a83fff640 1 -- 172.21.15.87:0/3560410971 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a8414fac0 msgr2=0x7f1a840ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.990+0000 7f1a83fff640 1 --2- 172.21.15.87:0/3560410971 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a8414fac0 0x7f1a840ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.990+0000 7f1a83fff640 1 -- 172.21.15.87:0/3560410971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a840cb0a0 msgr2=0x7f1a84071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.990+0000 7f1a83fff640 1 --2- 172.21.15.87:0/3560410971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a840cb0a0 0x7f1a84071ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.990+0000 7f1a83fff640 1 -- 172.21.15.87:0/3560410971 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c007040 con 0x7f1a840cb480 2023-12-16T20:22:06.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.990+0000 7fd648d3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd63c045810 0x7fd63c0d6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.990+0000 7fd648d3e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd63c046dd0 0x7fd63c0d73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.990+0000 7fd648d3e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd63c0d8f40 0x7fd63c1784f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.990+0000 7fd648d3e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0d0ec0 con 0x7fd63c045810 2023-12-16T20:22:06.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.990+0000 7fd648d3e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0d69f0 con 0x7fd63c0d8f40 2023-12-16T20:22:06.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.990+0000 7fd648d3e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0d2710 con 0x7fd63c046dd0 2023-12-16T20:22:06.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.992+0000 7fd64259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd63c045810 0x7fd63c0d6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.992+0000 7f3f55a25640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4800e2a0 0x7f3f480dd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:06.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.992+0000 7f1cfd59a640 1 -- 172.21.15.87:0/3982410073 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0030840 con 0x7f1cf804f0d0 2023-12-16T20:22:06.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.993+0000 7f1cfd59a640 1 -- 172.21.15.87:0/3982410073 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf00309a0 con 0x7f1cf804f0d0 2023-12-16T20:22:06.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.993+0000 7f1cfd59a640 1 -- 172.21.15.87:0/3982410073 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0030d30 con 0x7f1cf804f0d0 2023-12-16T20:22:06.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.993+0000 7f3f55a25640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4800e2a0 0x7f3f480dd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55600/0 (socket says 172.21.15.87:55600) 2023-12-16T20:22:06.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.993+0000 7f3f55a25640 1 -- 172.21.15.87:0/633377206 learned_addr learned my addr 172.21.15.87:0/633377206 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:06.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.993+0000 7fd64259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd63c045810 0x7fd63c0d6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55604/0 (socket says 172.21.15.87:55604) 2023-12-16T20:22:06.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.993+0000 7fd64259c640 1 -- 172.21.15.87:0/917810874 learned_addr learned my addr 172.21.15.87:0/917810874 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:06.997 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.993+0000 7f1cff59e640 1 -- 172.21.15.87:0/3982410073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cf804f0d0 msgr2=0x7f1cf80e3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.993+0000 7f1cff59e640 1 --2- 172.21.15.87:0/3982410073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cf804f0d0 0x7f1cf80e3000 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0009870 tx=0x7f1cf002b980 comp rx=0 tx=0).stop 2023-12-16T20:22:06.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.993+0000 7f1cff59e640 1 -- 172.21.15.87:0/3982410073 shutdown_connections 2023-12-16T20:22:06.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.993+0000 7f1cff59e640 1 --2- 172.21.15.87:0/3982410073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cf804e360 0x7f1cf8035d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.993+0000 7f1cff59e640 1 --2- 172.21.15.87:0/3982410073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cf804f0d0 0x7f1cf80e3000 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:06.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.993+0000 7f1cff59e640 1 -- 172.21.15.87:0/3982410073 >> 172.21.15.87:0/3982410073 conn(0x7f1cf800e090 msgr2=0x7f1cf800e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:06.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.993+0000 7f1cff59e640 1 -- 172.21.15.87:0/3982410073 shutdown_connections 2023-12-16T20:22:06.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.993+0000 7f1cff59e640 1 -- 172.21.15.87:0/3982410073 wait complete. 2023-12-16T20:22:06.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.995+0000 7f1cff59e640 1 Processor -- start 2023-12-16T20:22:06.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.995+0000 7f1cff59e640 1 -- start start 2023-12-16T20:22:06.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.995+0000 7f1cff59e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cf804cce0 0x7f1cf80d9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.995+0000 7f1cff59e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cf804e360 0x7f1cf80d7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.995+0000 7f1cff59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cf804f0d0 0x7f1cf80da770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:06.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.995+0000 7f1cff59e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf817c990 con 0x7f1cf804f0d0 2023-12-16T20:22:06.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.995+0000 7f1cff59e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf817c0c0 con 0x7f1cf804e360 2023-12-16T20:22:06.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.995+0000 7f1cff59e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80db9d0 con 0x7f1cf804cce0 2023-12-16T20:22:06.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.997+0000 7f2d5e526640 1 --2- 172.21.15.87:0/1597875062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d5815b2f0 0x7f2d580c9b60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009d90 tx=0x7f2d5002bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=535d1d34beddec6e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:06.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.997+0000 7fd64259c640 1 -- 172.21.15.87:0/917810874 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd63c046dd0 msgr2=0x7fd63c0d73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:06.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.997+0000 7fd64259c640 1 --2- 172.21.15.87:0/917810874 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd63c046dd0 0x7fd63c0d73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.997+0000 7fd64259c640 1 -- 172.21.15.87:0/917810874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd63c0d8f40 msgr2=0x7fd63c1784f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.997+0000 7fd64259c640 1 --2- 172.21.15.87:0/917810874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd63c0d8f40 0x7fd63c1784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.997+0000 7fd64259c640 1 -- 172.21.15.87:0/917810874 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6380094d0 con 0x7fd63c045810 2023-12-16T20:22:07.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.997+0000 7f7ea959a640 1 -- 172.21.15.87:0/1254136756 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0030840 con 0x7f7eac0cc340 2023-12-16T20:22:07.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.997+0000 7f7ea959a640 1 -- 172.21.15.87:0/1254136756 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea00309a0 con 0x7f7eac0cc340 2023-12-16T20:22:07.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.997+0000 7f7ea959a640 1 -- 172.21.15.87:0/1254136756 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0030d30 con 0x7f7eac0cc340 2023-12-16T20:22:07.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.998+0000 7f7eab59e640 1 -- 172.21.15.87:0/1254136756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac0cc340 msgr2=0x7f7eac15e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.998+0000 7f7eab59e640 1 --2- 172.21.15.87:0/1254136756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac0cc340 0x7f7eac15e270 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009870 tx=0x7f7ea002b980 comp rx=0 tx=0).stop 2023-12-16T20:22:07.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.998+0000 7f7eab59e640 1 -- 172.21.15.87:0/1254136756 shutdown_connections 2023-12-16T20:22:07.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.998+0000 7f7eab59e640 1 --2- 172.21.15.87:0/1254136756 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac0cc340 0x7f7eac15e270 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.998+0000 7f7eab59e640 1 --2- 172.21.15.87:0/1254136756 >> v2:172.21.15.195:3300/0 conn(0x7f7eac157ab0 0x7f7eac06af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.998+0000 7f7eab59e640 1 -- 172.21.15.87:0/1254136756 >> 172.21.15.87:0/1254136756 conn(0x7f7eac071c40 msgr2=0x7f7eac072020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.998+0000 7f7eab59e640 1 -- 172.21.15.87:0/1254136756 shutdown_connections 2023-12-16T20:22:07.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.998+0000 7f7eab59e640 1 -- 172.21.15.87:0/1254136756 wait complete. 2023-12-16T20:22:07.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.998+0000 7feb7510d640 1 -- 172.21.15.87:0/2653516686 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c02e070 con 0x7feb700c9ab0 2023-12-16T20:22:07.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.998+0000 7feb7510d640 1 -- 172.21.15.87:0/2653516686 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c0315a0 con 0x7feb700c9ab0 2023-12-16T20:22:07.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.998+0000 7feb7510d640 1 -- 172.21.15.87:0/2653516686 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c031930 con 0x7feb700c9ab0 2023-12-16T20:22:07.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.998+0000 7f3f56226640 1 --2- 172.21.15.87:0/633377206 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f480d4f90 0x7f3f480d7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.003 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.999+0000 7feb77111640 1 -- 172.21.15.87:0/2653516686 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb700c9ab0 msgr2=0x7feb70161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.003 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.999+0000 7feb77111640 1 --2- 172.21.15.87:0/2653516686 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb700c9ab0 0x7feb70161800 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0097a0 tx=0x7feb6c02b840 comp rx=0 tx=0).stop 2023-12-16T20:22:07.003 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.999+0000 7feb77111640 1 -- 172.21.15.87:0/2653516686 shutdown_connections 2023-12-16T20:22:07.003 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.999+0000 7feb77111640 1 --2- 172.21.15.87:0/2653516686 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb700c9ab0 0x7feb70161800 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.003 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.999+0000 7feb77111640 1 --2- 172.21.15.87:0/2653516686 >> v2:172.21.15.195:3300/0 conn(0x7feb700c72a0 0x7feb700c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.004 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.999+0000 7feb77111640 1 -- 172.21.15.87:0/2653516686 >> 172.21.15.87:0/2653516686 conn(0x7feb7006a500 msgr2=0x7feb7006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.004 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.999+0000 7feb77111640 1 -- 172.21.15.87:0/2653516686 shutdown_connections 2023-12-16T20:22:07.004 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:06.999+0000 7feb77111640 1 -- 172.21.15.87:0/2653516686 wait complete. 2023-12-16T20:22:07.004 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.000+0000 7f7eab59e640 1 Processor -- start 2023-12-16T20:22:07.004 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.000+0000 7f7eab59e640 1 -- start start 2023-12-16T20:22:07.004 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.000+0000 7fe2067fc640 1 -- 172.21.15.87:0/2284346263 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8030840 con 0x7fe208153640 2023-12-16T20:22:07.005 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.000+0000 7feb77111640 1 Processor -- start 2023-12-16T20:22:07.005 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.000+0000 7feb77111640 1 -- start start 2023-12-16T20:22:07.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7f7eab59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7eac0c7870 0x7f7eac1e7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7f7eab59e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7eac0cc340 0x7f7eac1e89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7f7eab59e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac157ab0 0x7f7eac159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7f7eab59e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac1608d0 con 0x7f7eac0c7870 2023-12-16T20:22:07.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7f7eab59e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac15fd70 con 0x7f7eac0cc340 2023-12-16T20:22:07.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7f7eab59e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac160200 con 0x7f7eac157ab0 2023-12-16T20:22:07.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.000+0000 7fe2067fc640 1 -- 172.21.15.87:0/2284346263 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f80309a0 con 0x7fe208153640 2023-12-16T20:22:07.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.000+0000 7fe2067fc640 1 -- 172.21.15.87:0/2284346263 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8030840 con 0x7fe208153640 2023-12-16T20:22:07.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7feb77111640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb700c72a0 0x7feb7015a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7feb77111640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb700c7680 0x7feb70154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7feb77111640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb700c9ab0 0x7feb7015cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7feb77111640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7015c6d0 con 0x7feb700c72a0 2023-12-16T20:22:07.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7fe20da89640 1 -- 172.21.15.87:0/2284346263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe208153640 msgr2=0x7fe208153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7feb77111640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb701f6c50 con 0x7feb700c9ab0 2023-12-16T20:22:07.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7fe20da89640 1 --2- 172.21.15.87:0/2284346263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe208153640 0x7fe208153a20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009870 tx=0x7fe1f802b980 comp rx=0 tx=0).stop 2023-12-16T20:22:07.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7feb77111640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb701f7140 con 0x7feb700c7680 2023-12-16T20:22:07.009 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7fe20da89640 1 -- 172.21.15.87:0/2284346263 shutdown_connections 2023-12-16T20:22:07.009 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7fe20da89640 1 --2- 172.21.15.87:0/2284346263 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2080c4210 0x7fe20815a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.009 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7fe20da89640 1 --2- 172.21.15.87:0/2284346263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe208153640 0x7fe208153a20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.009 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7fe20da89640 1 -- 172.21.15.87:0/2284346263 >> 172.21.15.87:0/2284346263 conn(0x7fe20808b610 msgr2=0x7fe208060f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.009 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.001+0000 7fe20da89640 1 -- 172.21.15.87:0/2284346263 shutdown_connections 2023-12-16T20:22:07.009 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.002+0000 7fe20da89640 1 -- 172.21.15.87:0/2284346263 wait complete. 2023-12-16T20:22:07.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.002+0000 7f3f55a25640 1 -- 172.21.15.87:0/633377206 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f480d4f90 msgr2=0x7f3f480d7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.002+0000 7f3f55a25640 1 --2- 172.21.15.87:0/633377206 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f480d4f90 0x7f3f480d7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.002+0000 7f3f55a25640 1 -- 172.21.15.87:0/633377206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f4804b090 msgr2=0x7f3f480d6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.002+0000 7f3f55a25640 1 --2- 172.21.15.87:0/633377206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f4804b090 0x7f3f480d6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.002+0000 7f3f55a25640 1 -- 172.21.15.87:0/633377206 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f40009400 con 0x7f3f4800e2a0 2023-12-16T20:22:07.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.003+0000 7f1a83fff640 1 --2- 172.21.15.87:0/3560410971 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a840cb480 0x7f1a840ca360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400c400 tx=0x7f1a7400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.003+0000 7fe20da89640 1 Processor -- start 2023-12-16T20:22:07.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.003+0000 7fe20da89640 1 -- start start 2023-12-16T20:22:07.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.004+0000 7fe20da89640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2080c4210 0x7fe20814c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.004+0000 7fe20da89640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2080c4810 0x7fe2080c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.004+0000 7fe20da89640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe208153640 0x7fe2080caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.004+0000 7fe20da89640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe208156b60 con 0x7fe208153640 2023-12-16T20:22:07.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.004+0000 7fe20da89640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe208157090 con 0x7fe2080c4210 2023-12-16T20:22:07.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.004+0000 7fe20da89640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe208154f30 con 0x7fe2080c4810 2023-12-16T20:22:07.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.004+0000 7f7ea9d9b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7eac0cc340 0x7f7eac1e89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.004+0000 7fd64259c640 1 --2- 172.21.15.87:0/917810874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd63c045810 0x7fd63c0d6e80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd63400c430 tx=0x7fd63400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.005+0000 7f7ea9d9b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7eac0cc340 0x7f7eac1e89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:39384/0 (socket says 172.21.15.87:39384) 2023-12-16T20:22:07.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.005+0000 7f7ea9d9b640 1 -- 172.21.15.87:0/3510225925 learned_addr learned my addr 172.21.15.87:0/3510225925 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.006+0000 7f3f55a25640 1 --2- 172.21.15.87:0/633377206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4800e2a0 0x7f3f480dd390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3f50069c10 tx=0x7f3f50068030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.007+0000 7f1cfdd9b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cf804e360 0x7f1cf80d7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.008+0000 7fd632ffd640 1 -- 172.21.15.87:0/917810874 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6340052d0 con 0x7fd63c045810 2023-12-16T20:22:07.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.008+0000 7fd648d3e640 1 -- 172.21.15.87:0/917810874 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63c0d1110 con 0x7fd63c045810 2023-12-16T20:22:07.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.008+0000 7fd648d3e640 1 -- 172.21.15.87:0/917810874 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63c0d2430 con 0x7fd63c045810 2023-12-16T20:22:07.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.008+0000 7f2d5cd23640 1 -- 172.21.15.87:0/1597875062 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5002cd80 con 0x7f2d5815b2f0 2023-12-16T20:22:07.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.008+0000 7f1cfdd9b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cf804e360 0x7f1cf80d7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:39368/0 (socket says 172.21.15.87:39368) 2023-12-16T20:22:07.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.008+0000 7f2d5cd23640 1 -- 172.21.15.87:0/1597875062 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d50034440 con 0x7f2d5815b2f0 2023-12-16T20:22:07.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.008+0000 7f2d5cd23640 1 -- 172.21.15.87:0/1597875062 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d500347d0 con 0x7f2d5815b2f0 2023-12-16T20:22:07.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.008+0000 7f1cfdd9b640 1 -- 172.21.15.87:0/594999470 learned_addr learned my addr 172.21.15.87:0/594999470 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.009+0000 7fd648d3e640 1 -- 172.21.15.87:0/917810874 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd63c033f30 con 0x7fd63c045810 2023-12-16T20:22:07.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.009+0000 7f2d5ed27640 1 -- 172.21.15.87:0/1597875062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d5815b2f0 msgr2=0x7f2d580c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.009+0000 7f2d5ed27640 1 --2- 172.21.15.87:0/1597875062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d5815b2f0 0x7f2d580c9b60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009d90 tx=0x7f2d5002bfd0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.009+0000 7f2d5ed27640 1 -- 172.21.15.87:0/1597875062 shutdown_connections 2023-12-16T20:22:07.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.009+0000 7f2d5ed27640 1 --2- 172.21.15.87:0/1597875062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d5815b2f0 0x7f2d580c9b60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.009+0000 7f2d5ed27640 1 -- 172.21.15.87:0/1597875062 >> 172.21.15.87:0/1597875062 conn(0x7f2d580709d0 msgr2=0x7f2d58070db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.009+0000 7f2d5ed27640 1 -- 172.21.15.87:0/1597875062 shutdown_connections 2023-12-16T20:22:07.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.009+0000 7f2d5ed27640 1 -- 172.21.15.87:0/1597875062 wait complete. 2023-12-16T20:22:07.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.010+0000 7f1cfe59c640 1 --2- 172.21.15.87:0/594999470 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cf804cce0 0x7f1cf80d9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.011+0000 7f2d5ed27640 1 Processor -- start 2023-12-16T20:22:07.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.011+0000 7f2d5ed27640 1 -- start start 2023-12-16T20:22:07.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.011+0000 7f7ea9d9b640 1 -- 172.21.15.87:0/3510225925 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac157ab0 msgr2=0x7f7eac159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.011+0000 7f7ea9d9b640 1 --2- 172.21.15.87:0/3510225925 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7eac157ab0 0x7f7eac159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.011+0000 7f7ea9d9b640 1 -- 172.21.15.87:0/3510225925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7eac0c7870 msgr2=0x7f7eac1e7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.011+0000 7f7ea9d9b640 1 --2- 172.21.15.87:0/3510225925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7eac0c7870 0x7f7eac1e7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.011+0000 7f7ea9d9b640 1 -- 172.21.15.87:0/3510225925 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea00094d0 con 0x7f7eac0cc340 2023-12-16T20:22:07.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.011+0000 7f1cfed9d640 1 --2- 172.21.15.87:0/594999470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cf804f0d0 0x7f1cf80da770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.012+0000 7f2d5ed27640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d580c9710 0x7f2d5806f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.012+0000 7f2d5ed27640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d58151530 0x7f2d580ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.012+0000 7f2d5ed27640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d5815b2f0 0x7f2d58158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.012+0000 7f2d5ed27640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d581ed9d0 con 0x7f2d580c9710 2023-12-16T20:22:07.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.012+0000 7f2d5ed27640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d580cd800 con 0x7f2d58151530 2023-12-16T20:22:07.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.012+0000 7f2d5ed27640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d581ed0a0 con 0x7f2d5815b2f0 2023-12-16T20:22:07.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.012+0000 7fd632ffd640 1 -- 172.21.15.87:0/917810874 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63c033f30 con 0x7fd63c045810 2023-12-16T20:22:07.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.012+0000 7fd632ffd640 1 -- 172.21.15.87:0/917810874 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6340035f0 con 0x7fd63c045810 2023-12-16T20:22:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.013+0000 7f1a817fa640 1 -- 172.21.15.87:0/3560410971 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74011790 con 0x7f1a840cb480 2023-12-16T20:22:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.013+0000 7f1a817fa640 1 -- 172.21.15.87:0/3560410971 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a74011930 con 0x7f1a840cb480 2023-12-16T20:22:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.013+0000 7f1a817fa640 1 -- 172.21.15.87:0/3560410971 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74011ce0 con 0x7f1a840cb480 2023-12-16T20:22:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.013+0000 7f1a8b015640 1 -- 172.21.15.87:0/3560410971 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a840c9240 con 0x7f1a840cb480 2023-12-16T20:22:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.013+0000 7f1a8b015640 1 -- 172.21.15.87:0/3560410971 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a840c9800 con 0x7f1a840cb480 2023-12-16T20:22:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.014+0000 7f1a8b015640 1 -- 172.21.15.87:0/3560410971 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a840c0380 con 0x7f1a840cb480 2023-12-16T20:22:07.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.018+0000 7f1cfe59c640 1 -- 172.21.15.87:0/594999470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cf804e360 msgr2=0x7f1cf80d7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.018+0000 7f1cfe59c640 1 --2- 172.21.15.87:0/594999470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1cf804e360 0x7f1cf80d7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.018+0000 7f1cfe59c640 1 -- 172.21.15.87:0/594999470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cf804f0d0 msgr2=0x7f1cf80da770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.018+0000 7f1cfe59c640 1 --2- 172.21.15.87:0/594999470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cf804f0d0 0x7f1cf80da770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.018+0000 7f1cfe59c640 1 -- 172.21.15.87:0/594999470 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf00094d0 con 0x7f1cf804cce0 2023-12-16T20:22:07.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.020+0000 7f7ea9d9b640 1 --2- 172.21.15.87:0/3510225925 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7eac0cc340 0x7f7eac1e89e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009870 tx=0x7f7ea0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.022+0000 7f2d5d524640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d58151530 0x7f2d580ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.022+0000 7feb76910640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb700c9ab0 0x7feb7015cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.023+0000 7f1cfe59c640 1 --2- 172.21.15.87:0/594999470 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cf804cce0 0x7f1cf80d9920 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0033000 tx=0x7f1cf0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.024+0000 7fe206ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2080c4810 0x7fe2080c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.024+0000 7feb76910640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb700c9ab0 0x7feb7015cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:39390/0 (socket says 172.21.15.87:39390) 2023-12-16T20:22:07.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.024+0000 7feb76910640 1 -- 172.21.15.87:0/446914652 learned_addr learned my addr 172.21.15.87:0/446914652 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.025+0000 7f2d5d524640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d58151530 0x7f2d580ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:39404/0 (socket says 172.21.15.87:39404) 2023-12-16T20:22:07.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.025+0000 7f2d5d524640 1 -- 172.21.15.87:0/1012418677 learned_addr learned my addr 172.21.15.87:0/1012418677 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.025+0000 7fe206ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2080c4810 0x7fe2080c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:35412/0 (socket says 172.21.15.87:35412) 2023-12-16T20:22:07.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.025+0000 7fe206ffd640 1 -- 172.21.15.87:0/3704528001 learned_addr learned my addr 172.21.15.87:0/3704528001 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.026+0000 7fe2077fe640 1 --2- 172.21.15.87:0/3704528001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2080c4210 0x7fe20814c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.028+0000 7f1ceeffd640 1 -- 172.21.15.87:0/594999470 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0039a90 con 0x7f1cf804cce0 2023-12-16T20:22:07.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.028+0000 7f1cff59e640 1 -- 172.21.15.87:0/594999470 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf80084c0 con 0x7f1cf804cce0 2023-12-16T20:22:07.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.028+0000 7f1cff59e640 1 -- 172.21.15.87:0/594999470 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf80da490 con 0x7f1cf804cce0 2023-12-16T20:22:07.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.029+0000 7f1ceeffd640 1 -- 172.21.15.87:0/594999470 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf0039bf0 con 0x7f1cf804cce0 2023-12-16T20:22:07.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.029+0000 7f1ceeffd640 1 -- 172.21.15.87:0/594999470 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf00433f0 con 0x7f1cf804cce0 2023-12-16T20:22:07.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.029+0000 7f1cff59e640 1 -- 172.21.15.87:0/594999470 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1ce4000fc0 con 0x7f1cf804cce0 2023-12-16T20:22:07.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.031+0000 7f2d5d524640 1 -- 172.21.15.87:0/1012418677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d5815b2f0 msgr2=0x7f2d58158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.031+0000 7f2d5d524640 1 --2- 172.21.15.87:0/1012418677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d5815b2f0 0x7f2d58158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.031+0000 7f2d5d524640 1 -- 172.21.15.87:0/1012418677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d580c9710 msgr2=0x7f2d5806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.031+0000 7f2d5d524640 1 --2- 172.21.15.87:0/1012418677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d580c9710 0x7f2d5806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.031+0000 7f2d5d524640 1 -- 172.21.15.87:0/1012418677 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d50009a70 con 0x7f2d58151530 2023-12-16T20:22:07.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.032+0000 7fd632ffd640 1 -- 172.21.15.87:0/917810874 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fd634003750 con 0x7fd63c045810 2023-12-16T20:22:07.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.033+0000 7fd632ffd640 1 --2- 172.21.15.87:0/917810874 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd62406ae70 0x7fd62406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.033+0000 7fd641d9b640 1 --2- 172.21.15.87:0/917810874 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd62406ae70 0x7fd62406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.033+0000 7fd641d9b640 1 --2- 172.21.15.87:0/917810874 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd62406ae70 0x7fd62406d330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd638036000 tx=0x7fd638039040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.035+0000 7fe2077fe640 1 -- 172.21.15.87:0/3704528001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2080c4810 msgr2=0x7fe2080c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.035+0000 7fe2077fe640 1 --2- 172.21.15.87:0/3704528001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2080c4810 0x7fe2080c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.035+0000 7fe2077fe640 1 -- 172.21.15.87:0/3704528001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe208153640 msgr2=0x7fe2080caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.035+0000 7fe2077fe640 1 --2- 172.21.15.87:0/3704528001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe208153640 0x7fe2080caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.035+0000 7fe2077fe640 1 -- 172.21.15.87:0/3704528001 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f80094d0 con 0x7fe2080c4210 2023-12-16T20:22:07.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.037+0000 7f2d5d524640 1 --2- 172.21.15.87:0/1012418677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d58151530 0x7f2d580ccf20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2d4800c480 tx=0x7f2d4800c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.038+0000 7fd632ffd640 1 -- 172.21.15.87:0/917810874 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd634057f80 con 0x7fd63c045810 2023-12-16T20:22:07.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.038+0000 7fd632ffd640 1 --2- 172.21.15.87:0/917810874 >> [v2:172.21.15.195:6816/2911660280,v1:172.21.15.195:6817/2911660280] conn(0x7fd624074330 0x7fd624076770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.038+0000 7fd632ffd640 1 -- 172.21.15.87:0/917810874 --> [v2:172.21.15.195:6816/2911660280,v1:172.21.15.195:6817/2911660280] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd624076e40 con 0x7fd624074330 2023-12-16T20:22:07.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.038+0000 7fd632ffd640 1 -- 172.21.15.87:0/917810874 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6340542c0 con 0x7fd63c045810 2023-12-16T20:22:07.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.038+0000 7fd642d9d640 1 --2- 172.21.15.87:0/917810874 >> [v2:172.21.15.195:6816/2911660280,v1:172.21.15.195:6817/2911660280] conn(0x7fd624074330 0x7fd624076770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.038+0000 7fd642d9d640 1 --2- 172.21.15.87:0/917810874 >> [v2:172.21.15.195:6816/2911660280,v1:172.21.15.195:6817/2911660280] conn(0x7fd624074330 0x7fd624076770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.039+0000 7feb7610f640 1 --2- 172.21.15.87:0/446914652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb700c72a0 0x7feb7015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.040+0000 7fd632ffd640 1 -- 172.21.15.87:0/917810874 <== osd.6 v2:172.21.15.195:6816/2911660280 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd624076e40 con 0x7fd624074330 2023-12-16T20:22:07.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.041+0000 7feb76910640 1 -- 172.21.15.87:0/446914652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb700c7680 msgr2=0x7feb70154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.041+0000 7feb76910640 1 --2- 172.21.15.87:0/446914652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb700c7680 0x7feb70154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.041+0000 7feb76910640 1 -- 172.21.15.87:0/446914652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb700c72a0 msgr2=0x7feb7015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.041+0000 7feb76910640 1 --2- 172.21.15.87:0/446914652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb700c72a0 0x7feb7015a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.041+0000 7feb76910640 1 -- 172.21.15.87:0/446914652 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6c009400 con 0x7feb700c9ab0 2023-12-16T20:22:07.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.042+0000 7f3f467fc640 1 -- 172.21.15.87:0/633377206 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5006cd90 con 0x7f3f4800e2a0 2023-12-16T20:22:07.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.042+0000 7f3f57c89640 1 -- 172.21.15.87:0/633377206 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f480cd510 con 0x7f3f4800e2a0 2023-12-16T20:22:07.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.042+0000 7f3f57c89640 1 -- 172.21.15.87:0/633377206 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f480de130 con 0x7f3f4800e2a0 2023-12-16T20:22:07.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.042+0000 7f3f467fc640 1 -- 172.21.15.87:0/633377206 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5008e070 con 0x7f3f4800e2a0 2023-12-16T20:22:07.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.042+0000 7f3f467fc640 1 -- 172.21.15.87:0/633377206 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5006a740 con 0x7f3f4800e2a0 2023-12-16T20:22:07.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.043+0000 7f3f57c89640 1 -- 172.21.15.87:0/633377206 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3f38000fc0 con 0x7f3f4800e2a0 2023-12-16T20:22:07.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.044+0000 7fe2077fe640 1 --2- 172.21.15.87:0/3704528001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2080c4210 0x7fe20814c3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8033000 tx=0x7fe1f80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.050+0000 7f2d4e7fc640 1 -- 172.21.15.87:0/1012418677 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d480052d0 con 0x7f2d58151530 2023-12-16T20:22:07.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.050+0000 7f2d4e7fc640 1 -- 172.21.15.87:0/1012418677 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d48005430 con 0x7f2d58151530 2023-12-16T20:22:07.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.050+0000 7f2d4e7fc640 1 -- 172.21.15.87:0/1012418677 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48003830 con 0x7f2d58151530 2023-12-16T20:22:07.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.050+0000 7f2d5ed27640 1 -- 172.21.15.87:0/1012418677 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d581ed380 con 0x7f2d58151530 2023-12-16T20:22:07.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.050+0000 7f2d5ed27640 1 -- 172.21.15.87:0/1012418677 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d581ecd90 con 0x7f2d58151530 2023-12-16T20:22:07.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.051+0000 7f2d5ed27640 1 -- 172.21.15.87:0/1012418677 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2d580b0480 con 0x7f2d58151530 2023-12-16T20:22:07.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.052+0000 7feb76910640 1 --2- 172.21.15.87:0/446914652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb700c9ab0 0x7feb7015cb20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feb6800cb70 tx=0x7feb6800a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.053+0000 7f7e9affd640 1 -- 172.21.15.87:0/3510225925 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0039e20 con 0x7f7eac0cc340 2023-12-16T20:22:07.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.053+0000 7f7e9affd640 1 -- 172.21.15.87:0/3510225925 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea0043400 con 0x7f7eac0cc340 2023-12-16T20:22:07.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.053+0000 7f7eab59e640 1 -- 172.21.15.87:0/3510225925 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eac1f3f30 con 0x7f7eac0cc340 2023-12-16T20:22:07.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.053+0000 7f7e9affd640 1 -- 172.21.15.87:0/3510225925 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea00437b0 con 0x7f7eac0cc340 2023-12-16T20:22:07.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.054+0000 7f7eab59e640 1 -- 172.21.15.87:0/3510225925 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eac15f440 con 0x7f7eac0cc340 2023-12-16T20:22:07.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.055+0000 7f7eab59e640 1 -- 172.21.15.87:0/3510225925 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7eac0c7020 con 0x7f7eac0cc340 2023-12-16T20:22:07.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.056+0000 7fd648d3e640 1 -- 172.21.15.87:0/917810874 --> [v2:172.21.15.195:6816/2911660280,v1:172.21.15.195:6817/2911660280] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd63c0062e0 con 0x7fd624074330 2023-12-16T20:22:07.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.057+0000 7fd632ffd640 1 -- 172.21.15.87:0/917810874 <== osd.6 v2:172.21.15.195:6816/2911660280 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd64404ed60 con 0x7fd624074330 2023-12-16T20:22:07.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.057+0000 7fd648d3e640 1 -- 172.21.15.87:0/917810874 >> [v2:172.21.15.195:6816/2911660280,v1:172.21.15.195:6817/2911660280] conn(0x7fd624074330 msgr2=0x7fd624076770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.057+0000 7fd648d3e640 1 --2- 172.21.15.87:0/917810874 >> [v2:172.21.15.195:6816/2911660280,v1:172.21.15.195:6817/2911660280] conn(0x7fd624074330 0x7fd624076770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.057+0000 7fd648d3e640 1 -- 172.21.15.87:0/917810874 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd62406ae70 msgr2=0x7fd62406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.057+0000 7fd648d3e640 1 --2- 172.21.15.87:0/917810874 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd62406ae70 0x7fd62406d330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd638036000 tx=0x7fd638039040 comp rx=0 tx=0).stop 2023-12-16T20:22:07.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.057+0000 7fd648d3e640 1 -- 172.21.15.87:0/917810874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd63c045810 msgr2=0x7fd63c0d6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.057+0000 7fd648d3e640 1 --2- 172.21.15.87:0/917810874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd63c045810 0x7fd63c0d6e80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd63400c430 tx=0x7fd63400c8f0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.057+0000 7fd642d9d640 1 -- 172.21.15.87:0/917810874 reap_dead start 2023-12-16T20:22:07.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.057+0000 7fd648d3e640 1 -- 172.21.15.87:0/917810874 shutdown_connections 2023-12-16T20:22:07.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.057+0000 7fd648d3e640 1 -- 172.21.15.87:0/917810874 >> 172.21.15.87:0/917810874 conn(0x7fd63c0505d0 msgr2=0x7fd63c0d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.057+0000 7fd648d3e640 1 -- 172.21.15.87:0/917810874 shutdown_connections 2023-12-16T20:22:07.060 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.057+0000 7fd648d3e640 1 -- 172.21.15.87:0/917810874 wait complete. 2023-12-16T20:22:07.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.060+0000 7f1ceeffd640 1 -- 172.21.15.87:0/594999470 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f1cf004c3b0 con 0x7f1cf804cce0 2023-12-16T20:22:07.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.060+0000 7f1ceeffd640 1 --2- 172.21.15.87:0/594999470 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1ce006ae90 0x7f1ce006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.061+0000 7f1cfdd9b640 1 --2- 172.21.15.87:0/594999470 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1ce006ae90 0x7f1ce006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.061+0000 7f1cfdd9b640 1 --2- 172.21.15.87:0/594999470 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1ce006ae90 0x7f1ce006d350 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1d00050020 tx=0x7f1d0008c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.064+0000 7f1ceeffd640 1 -- 172.21.15.87:0/594999470 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1cf007b3b0 con 0x7f1cf804cce0 2023-12-16T20:22:07.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.064+0000 7f1ceeffd640 1 --2- 172.21.15.87:0/594999470 >> [v2:172.21.15.87:6810/2135560294,v1:172.21.15.87:6811/2135560294] conn(0x7f1ce00743d0 0x7f1ce0076810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.064+0000 7f1ceeffd640 1 -- 172.21.15.87:0/594999470 --> [v2:172.21.15.87:6810/2135560294,v1:172.21.15.87:6811/2135560294] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1ce0076ee0 con 0x7f1ce00743d0 2023-12-16T20:22:07.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.064+0000 7f1ceeffd640 1 -- 172.21.15.87:0/594999470 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cf0076ff0 con 0x7f1cf804cce0 2023-12-16T20:22:07.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.065+0000 7f1cfed9d640 1 --2- 172.21.15.87:0/594999470 >> [v2:172.21.15.87:6810/2135560294,v1:172.21.15.87:6811/2135560294] conn(0x7f1ce00743d0 0x7f1ce0076810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.065+0000 7f1cfed9d640 1 --2- 172.21.15.87:0/594999470 >> [v2:172.21.15.87:6810/2135560294,v1:172.21.15.87:6811/2135560294] conn(0x7f1ce00743d0 0x7f1ce0076810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.066+0000 7f1ceeffd640 1 -- 172.21.15.87:0/594999470 <== osd.0 v2:172.21.15.87:6810/2135560294 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1ce0076ee0 con 0x7f1ce00743d0 2023-12-16T20:22:07.070 INFO:teuthology.orchestra.run.smithi087.stdout:55834574861 2023-12-16T20:22:07.070 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-16T20:22:07.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.068+0000 7f3f467fc640 1 -- 172.21.15.87:0/633377206 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f3f50072150 con 0x7f3f4800e2a0 2023-12-16T20:22:07.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.069+0000 7f3f467fc640 1 --2- 172.21.15.87:0/633377206 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f3f3406ae90 0x7f3f3406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.069+0000 7f3f55224640 1 --2- 172.21.15.87:0/633377206 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f3f3406ae90 0x7f3f3406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.069+0000 7f3f55224640 1 --2- 172.21.15.87:0/633377206 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f3f3406ae90 0x7f3f3406d350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f40036000 tx=0x7f3f40030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.074+0000 7f3f467fc640 1 -- 172.21.15.87:0/633377206 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3f500d2880 con 0x7f3f4800e2a0 2023-12-16T20:22:07.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.074+0000 7f3f467fc640 1 --2- 172.21.15.87:0/633377206 >> [v2:172.21.15.87:6802/2637031951,v1:172.21.15.87:6803/2637031951] conn(0x7f3f340743d0 0x7f3f34076810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.074+0000 7f3f467fc640 1 -- 172.21.15.87:0/633377206 --> [v2:172.21.15.87:6802/2637031951,v1:172.21.15.87:6803/2637031951] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3f34076ee0 con 0x7f3f340743d0 2023-12-16T20:22:07.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.074+0000 7f3f467fc640 1 -- 172.21.15.87:0/633377206 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f500cebc0 con 0x7f3f4800e2a0 2023-12-16T20:22:07.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.074+0000 7f3f56226640 1 --2- 172.21.15.87:0/633377206 >> [v2:172.21.15.87:6802/2637031951,v1:172.21.15.87:6803/2637031951] conn(0x7f3f340743d0 0x7f3f34076810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.075+0000 7f3f56226640 1 --2- 172.21.15.87:0/633377206 >> [v2:172.21.15.87:6802/2637031951,v1:172.21.15.87:6803/2637031951] conn(0x7f3f340743d0 0x7f3f34076810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.075+0000 7f2d4e7fc640 1 -- 172.21.15.87:0/1012418677 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f2d48003990 con 0x7f2d58151530 2023-12-16T20:22:07.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.076+0000 7f3f467fc640 1 -- 172.21.15.87:0/633377206 <== osd.2 v2:172.21.15.87:6802/2637031951 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3f34076ee0 con 0x7f3f340743d0 2023-12-16T20:22:07.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.076+0000 7f2d4e7fc640 1 --2- 172.21.15.87:0/1012418677 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2d3c06ae40 0x7f2d3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.076+0000 7f2d5dd25640 1 --2- 172.21.15.87:0/1012418677 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2d3c06ae40 0x7f2d3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.078 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.076+0000 7f2d5dd25640 1 --2- 172.21.15.87:0/1012418677 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2d3c06ae40 0x7f2d3c06d300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2d580ca230 tx=0x7f2d54007930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.079+0000 7f2d4e7fc640 1 -- 172.21.15.87:0/1012418677 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2d48058790 con 0x7f2d58151530 2023-12-16T20:22:07.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.079+0000 7f1a817fa640 1 -- 172.21.15.87:0/3560410971 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f1a7401c460 con 0x7f1a840cb480 2023-12-16T20:22:07.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.079+0000 7f2d4e7fc640 1 --2- 172.21.15.87:0/1012418677 >> [v2:172.21.15.195:6808/529094727,v1:172.21.15.195:6809/529094727] conn(0x7f2d3c074300 0x7f2d3c076740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.079+0000 7f2d4e7fc640 1 -- 172.21.15.87:0/1012418677 --> [v2:172.21.15.195:6808/529094727,v1:172.21.15.195:6809/529094727] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d3c076e10 con 0x7f2d3c074300 2023-12-16T20:22:07.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.080+0000 7f2d5e526640 1 --2- 172.21.15.87:0/1012418677 >> [v2:172.21.15.195:6808/529094727,v1:172.21.15.195:6809/529094727] conn(0x7f2d3c074300 0x7f2d3c076740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.080+0000 7f1a817fa640 1 --2- 172.21.15.87:0/3560410971 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1a6406d050 0x7f1a6406f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.080+0000 7f1a88db1640 1 --2- 172.21.15.87:0/3560410971 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1a6406d050 0x7f1a6406f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.080+0000 7f2d5e526640 1 --2- 172.21.15.87:0/1012418677 >> [v2:172.21.15.195:6808/529094727,v1:172.21.15.195:6809/529094727] conn(0x7f2d3c074300 0x7f2d3c076740 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.080+0000 7f1a88db1640 1 --2- 172.21.15.87:0/3560410971 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1a6406d050 0x7f1a6406f510 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c009f20 tx=0x7f1a7c0094d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.081+0000 7f2d4e7fc640 1 -- 172.21.15.87:0/1012418677 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d480011e0 con 0x7f2d58151530 2023-12-16T20:22:07.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.081+0000 7f2d4e7fc640 1 -- 172.21.15.87:0/1012418677 <== osd.7 v2:172.21.15.195:6808/529094727 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2d3c076e10 con 0x7f2d3c074300 2023-12-16T20:22:07.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.081+0000 7f1cff59e640 1 -- 172.21.15.87:0/594999470 --> [v2:172.21.15.87:6810/2135560294,v1:172.21.15.87:6811/2135560294] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1ce4002cb0 con 0x7f1ce00743d0 2023-12-16T20:22:07.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.082+0000 7f1ceeffd640 1 -- 172.21.15.87:0/594999470 <== osd.0 v2:172.21.15.87:6810/2135560294 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1ce4002cb0 con 0x7f1ce00743d0 2023-12-16T20:22:07.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.082+0000 7f1cff59e640 1 -- 172.21.15.87:0/594999470 >> [v2:172.21.15.87:6810/2135560294,v1:172.21.15.87:6811/2135560294] conn(0x7f1ce00743d0 msgr2=0x7f1ce0076810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.082+0000 7f1cff59e640 1 --2- 172.21.15.87:0/594999470 >> [v2:172.21.15.87:6810/2135560294,v1:172.21.15.87:6811/2135560294] conn(0x7f1ce00743d0 0x7f1ce0076810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.082+0000 7f1cff59e640 1 -- 172.21.15.87:0/594999470 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1ce006ae90 msgr2=0x7f1ce006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.082+0000 7f1cff59e640 1 --2- 172.21.15.87:0/594999470 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1ce006ae90 0x7f1ce006d350 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1d00050020 tx=0x7f1d0008c040 comp rx=0 tx=0).stop 2023-12-16T20:22:07.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.082+0000 7f1cff59e640 1 -- 172.21.15.87:0/594999470 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cf804cce0 msgr2=0x7f1cf80d9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.082+0000 7f1cff59e640 1 --2- 172.21.15.87:0/594999470 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1cf804cce0 0x7f1cf80d9920 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0033000 tx=0x7f1cf0004730 comp rx=0 tx=0).stop 2023-12-16T20:22:07.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.082+0000 7f1cfed9d640 1 -- 172.21.15.87:0/594999470 reap_dead start 2023-12-16T20:22:07.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.082+0000 7f1cff59e640 1 -- 172.21.15.87:0/594999470 shutdown_connections 2023-12-16T20:22:07.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.082+0000 7f1cff59e640 1 -- 172.21.15.87:0/594999470 >> 172.21.15.87:0/594999470 conn(0x7f1cf800e090 msgr2=0x7f1cf80484a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.082+0000 7f1cff59e640 1 -- 172.21.15.87:0/594999470 shutdown_connections 2023-12-16T20:22:07.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.083+0000 7f1a817fa640 1 -- 172.21.15.87:0/3560410971 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1a74011e40 con 0x7f1a840cb480 2023-12-16T20:22:07.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.083+0000 7f1cff59e640 1 -- 172.21.15.87:0/594999470 wait complete. 2023-12-16T20:22:07.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.083+0000 7fe1effff640 1 -- 172.21.15.87:0/3704528001 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f803e070 con 0x7fe2080c4210 2023-12-16T20:22:07.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.083+0000 7fe1effff640 1 -- 172.21.15.87:0/3704528001 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f80043f0 con 0x7fe2080c4210 2023-12-16T20:22:07.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.083+0000 7fe1effff640 1 -- 172.21.15.87:0/3704528001 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8003850 con 0x7fe2080c4210 2023-12-16T20:22:07.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.083+0000 7f1a817fa640 1 --2- 172.21.15.87:0/3560410971 >> [v2:172.21.15.87:6818/2356258495,v1:172.21.15.87:6819/2356258495] conn(0x7f1a64077190 0x7f1a64079630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.083+0000 7f1a817fa640 1 -- 172.21.15.87:0/3560410971 --> [v2:172.21.15.87:6818/2356258495,v1:172.21.15.87:6819/2356258495] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a64079d00 con 0x7f1a64077190 2023-12-16T20:22:07.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.083+0000 7f1a895b2640 1 --2- 172.21.15.87:0/3560410971 >> [v2:172.21.15.87:6818/2356258495,v1:172.21.15.87:6819/2356258495] conn(0x7f1a64077190 0x7f1a64079630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.083+0000 7fe20da89640 1 -- 172.21.15.87:0/3704528001 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe208146890 con 0x7fe2080c4210 2023-12-16T20:22:07.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.083+0000 7fe20da89640 1 -- 172.21.15.87:0/3704528001 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe208156db0 con 0x7fe2080c4210 2023-12-16T20:22:07.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.084+0000 7f1a895b2640 1 --2- 172.21.15.87:0/3560410971 >> [v2:172.21.15.87:6818/2356258495,v1:172.21.15.87:6819/2356258495] conn(0x7f1a64077190 0x7f1a64079630 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.084+0000 7f1a817fa640 1 -- 172.21.15.87:0/3560410971 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a74003880 con 0x7f1a840cb480 2023-12-16T20:22:07.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.084+0000 7feb66ffd640 1 -- 172.21.15.87:0/446914652 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6800ad40 con 0x7feb700c9ab0 2023-12-16T20:22:07.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.084+0000 7fe20da89640 1 -- 172.21.15.87:0/3704528001 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2080c54d0 con 0x7fe2080c4210 2023-12-16T20:22:07.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.084+0000 7feb66ffd640 1 -- 172.21.15.87:0/446914652 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb68012400 con 0x7feb700c9ab0 2023-12-16T20:22:07.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.084+0000 7feb66ffd640 1 -- 172.21.15.87:0/446914652 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6800aea0 con 0x7feb700c9ab0 2023-12-16T20:22:07.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.084+0000 7feb77111640 1 -- 172.21.15.87:0/446914652 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7015a9f0 con 0x7feb700c9ab0 2023-12-16T20:22:07.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.084+0000 7feb77111640 1 -- 172.21.15.87:0/446914652 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb701f6e60 con 0x7feb700c9ab0 2023-12-16T20:22:07.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.085+0000 7f1a817fa640 1 -- 172.21.15.87:0/3560410971 <== osd.3 v2:172.21.15.87:6818/2356258495 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1a64079d00 con 0x7f1a64077190 2023-12-16T20:22:07.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.085+0000 7feb77111640 1 -- 172.21.15.87:0/446914652 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feb7015e570 con 0x7feb700c9ab0 2023-12-16T20:22:07.096 INFO:teuthology.orchestra.run.smithi087.stdout:55834574861 2023-12-16T20:22:07.096 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-16T20:22:07.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.099+0000 7f1a8b015640 1 -- 172.21.15.87:0/3560410971 --> [v2:172.21.15.87:6818/2356258495,v1:172.21.15.87:6819/2356258495] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1a840c12e0 con 0x7f1a64077190 2023-12-16T20:22:07.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.100+0000 7f1a817fa640 1 -- 172.21.15.87:0/3560410971 <== osd.3 v2:172.21.15.87:6818/2356258495 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1a6c03f040 con 0x7f1a64077190 2023-12-16T20:22:07.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.100+0000 7f1a8b015640 1 -- 172.21.15.87:0/3560410971 >> [v2:172.21.15.87:6818/2356258495,v1:172.21.15.87:6819/2356258495] conn(0x7f1a64077190 msgr2=0x7f1a64079630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.100+0000 7f1a8b015640 1 --2- 172.21.15.87:0/3560410971 >> [v2:172.21.15.87:6818/2356258495,v1:172.21.15.87:6819/2356258495] conn(0x7f1a64077190 0x7f1a64079630 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.103+0000 7f1a8b015640 1 -- 172.21.15.87:0/3560410971 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1a6406d050 msgr2=0x7f1a6406f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.103+0000 7f1a8b015640 1 --2- 172.21.15.87:0/3560410971 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1a6406d050 0x7f1a6406f510 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c009f20 tx=0x7f1a7c0094d0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.103+0000 7f1a8b015640 1 -- 172.21.15.87:0/3560410971 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a840cb480 msgr2=0x7f1a840ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.103+0000 7f1a8b015640 1 --2- 172.21.15.87:0/3560410971 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a840cb480 0x7f1a840ca360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400c400 tx=0x7f1a7400c8c0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.103+0000 7f1a895b2640 1 -- 172.21.15.87:0/3560410971 reap_dead start 2023-12-16T20:22:07.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.103+0000 7f1a8b015640 1 -- 172.21.15.87:0/3560410971 shutdown_connections 2023-12-16T20:22:07.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.103+0000 7f1a8b015640 1 -- 172.21.15.87:0/3560410971 >> 172.21.15.87:0/3560410971 conn(0x7f1a8406cd60 msgr2=0x7f1a841457a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.103+0000 7f1a8b015640 1 -- 172.21.15.87:0/3560410971 shutdown_connections 2023-12-16T20:22:07.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.103+0000 7f1a8b015640 1 -- 172.21.15.87:0/3560410971 wait complete. 2023-12-16T20:22:07.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.104+0000 7f3f57c89640 1 -- 172.21.15.87:0/633377206 --> [v2:172.21.15.87:6802/2637031951,v1:172.21.15.87:6803/2637031951] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3f38002cb0 con 0x7f3f340743d0 2023-12-16T20:22:07.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.104+0000 7f3f467fc640 1 -- 172.21.15.87:0/633377206 <== osd.2 v2:172.21.15.87:6802/2637031951 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3f38002cb0 con 0x7f3f340743d0 2023-12-16T20:22:07.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.105+0000 7f3f57c89640 1 -- 172.21.15.87:0/633377206 >> [v2:172.21.15.87:6802/2637031951,v1:172.21.15.87:6803/2637031951] conn(0x7f3f340743d0 msgr2=0x7f3f34076810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.105+0000 7f3f57c89640 1 --2- 172.21.15.87:0/633377206 >> [v2:172.21.15.87:6802/2637031951,v1:172.21.15.87:6803/2637031951] conn(0x7f3f340743d0 0x7f3f34076810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.105+0000 7f3f57c89640 1 -- 172.21.15.87:0/633377206 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f3f3406ae90 msgr2=0x7f3f3406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.105+0000 7f3f57c89640 1 --2- 172.21.15.87:0/633377206 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f3f3406ae90 0x7f3f3406d350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f40036000 tx=0x7f3f40030000 comp rx=0 tx=0).stop 2023-12-16T20:22:07.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.105+0000 7f3f57c89640 1 -- 172.21.15.87:0/633377206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4800e2a0 msgr2=0x7f3f480dd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.105+0000 7f3f57c89640 1 --2- 172.21.15.87:0/633377206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f4800e2a0 0x7f3f480dd390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3f50069c10 tx=0x7f3f50068030 comp rx=0 tx=0).stop 2023-12-16T20:22:07.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.105+0000 7f3f56226640 1 -- 172.21.15.87:0/633377206 reap_dead start 2023-12-16T20:22:07.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.105+0000 7f3f57c89640 1 -- 172.21.15.87:0/633377206 shutdown_connections 2023-12-16T20:22:07.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.105+0000 7f3f57c89640 1 -- 172.21.15.87:0/633377206 >> 172.21.15.87:0/633377206 conn(0x7f3f48050180 msgr2=0x7f3f480d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.106+0000 7f7e9affd640 1 -- 172.21.15.87:0/3510225925 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f7ea0043910 con 0x7f7eac0cc340 2023-12-16T20:22:07.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.106+0000 7f7e9affd640 1 --2- 172.21.15.87:0/3510225925 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7e8c06ae90 0x7f7e8c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.107+0000 7f3f57c89640 1 -- 172.21.15.87:0/633377206 shutdown_connections 2023-12-16T20:22:07.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.107+0000 7f3f57c89640 1 -- 172.21.15.87:0/633377206 wait complete. 2023-12-16T20:22:07.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.107+0000 7f7eaa59c640 1 --2- 172.21.15.87:0/3510225925 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7e8c06ae90 0x7f7e8c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.107+0000 7f7eaa59c640 1 --2- 172.21.15.87:0/3510225925 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7e8c06ae90 0x7f7e8c06d350 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009670 tx=0x7f7e9c006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.108+0000 7f7e9affd640 1 -- 172.21.15.87:0/3510225925 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ea003e070 con 0x7f7eac0cc340 2023-12-16T20:22:07.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.108+0000 7f7e9affd640 1 --2- 172.21.15.87:0/3510225925 >> [v2:172.21.15.195:6824/265859371,v1:172.21.15.195:6825/265859371] conn(0x7f7e8c0743d0 0x7f7e8c076810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.108+0000 7f7e9affd640 1 -- 172.21.15.87:0/3510225925 --> [v2:172.21.15.195:6824/265859371,v1:172.21.15.195:6825/265859371] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e8c076ee0 con 0x7f7e8c0743d0 2023-12-16T20:22:07.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.108+0000 7f7eaad9d640 1 --2- 172.21.15.87:0/3510225925 >> [v2:172.21.15.195:6824/265859371,v1:172.21.15.195:6825/265859371] conn(0x7f7e8c0743d0 0x7f7e8c076810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.109+0000 7f7eaad9d640 1 --2- 172.21.15.87:0/3510225925 >> [v2:172.21.15.195:6824/265859371,v1:172.21.15.195:6825/265859371] conn(0x7f7e8c0743d0 0x7f7e8c076810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.110+0000 7f7e9affd640 1 -- 172.21.15.87:0/3510225925 <== osd.4 v2:172.21.15.195:6824/265859371 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7e8c076ee0 con 0x7f7e8c0743d0 2023-12-16T20:22:07.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.111+0000 7f2d5ed27640 1 -- 172.21.15.87:0/1012418677 --> [v2:172.21.15.195:6808/529094727,v1:172.21.15.195:6809/529094727] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2d58157fa0 con 0x7f2d3c074300 2023-12-16T20:22:07.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.111+0000 7f2d4e7fc640 1 -- 172.21.15.87:0/1012418677 <== osd.7 v2:172.21.15.195:6808/529094727 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2d500345b0 con 0x7f2d3c074300 2023-12-16T20:22:07.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.112+0000 7f2d5ed27640 1 -- 172.21.15.87:0/1012418677 >> [v2:172.21.15.195:6808/529094727,v1:172.21.15.195:6809/529094727] conn(0x7f2d3c074300 msgr2=0x7f2d3c076740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.112+0000 7f2d5ed27640 1 --2- 172.21.15.87:0/1012418677 >> [v2:172.21.15.195:6808/529094727,v1:172.21.15.195:6809/529094727] conn(0x7f2d3c074300 0x7f2d3c076740 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.112+0000 7f2d5ed27640 1 -- 172.21.15.87:0/1012418677 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2d3c06ae40 msgr2=0x7f2d3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.112+0000 7f2d5ed27640 1 --2- 172.21.15.87:0/1012418677 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2d3c06ae40 0x7f2d3c06d300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2d580ca230 tx=0x7f2d54007930 comp rx=0 tx=0).stop 2023-12-16T20:22:07.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.112+0000 7f2d5ed27640 1 -- 172.21.15.87:0/1012418677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d58151530 msgr2=0x7f2d580ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.112+0000 7f2d5ed27640 1 --2- 172.21.15.87:0/1012418677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d58151530 0x7f2d580ccf20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2d4800c480 tx=0x7f2d4800c940 comp rx=0 tx=0).stop 2023-12-16T20:22:07.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.112+0000 7f2d5e526640 1 -- 172.21.15.87:0/1012418677 reap_dead start 2023-12-16T20:22:07.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.112+0000 7f2d5ed27640 1 -- 172.21.15.87:0/1012418677 shutdown_connections 2023-12-16T20:22:07.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.112+0000 7f2d5ed27640 1 -- 172.21.15.87:0/1012418677 >> 172.21.15.87:0/1012418677 conn(0x7f2d580709d0 msgr2=0x7f2d58154df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.112+0000 7f2d5ed27640 1 -- 172.21.15.87:0/1012418677 shutdown_connections 2023-12-16T20:22:07.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.112+0000 7f2d5ed27640 1 -- 172.21.15.87:0/1012418677 wait complete. 2023-12-16T20:22:07.119 INFO:teuthology.orchestra.run.smithi087.stdout:55834574861 2023-12-16T20:22:07.119 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-16T20:22:07.127 INFO:teuthology.orchestra.run.smithi087.stdout:55834574861 2023-12-16T20:22:07.128 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-16T20:22:07.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.126+0000 7f7eab59e640 1 -- 172.21.15.87:0/3510225925 --> [v2:172.21.15.195:6824/265859371,v1:172.21.15.195:6825/265859371] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7eac0cc760 con 0x7f7e8c0743d0 2023-12-16T20:22:07.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.126+0000 7f7e9affd640 1 -- 172.21.15.87:0/3510225925 <== osd.4 v2:172.21.15.195:6824/265859371 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7ea4006b10 con 0x7f7e8c0743d0 2023-12-16T20:22:07.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.127+0000 7f7eab59e640 1 -- 172.21.15.87:0/3510225925 >> [v2:172.21.15.195:6824/265859371,v1:172.21.15.195:6825/265859371] conn(0x7f7e8c0743d0 msgr2=0x7f7e8c076810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.127+0000 7f7eab59e640 1 --2- 172.21.15.87:0/3510225925 >> [v2:172.21.15.195:6824/265859371,v1:172.21.15.195:6825/265859371] conn(0x7f7e8c0743d0 0x7f7e8c076810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.127+0000 7f7eab59e640 1 -- 172.21.15.87:0/3510225925 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7e8c06ae90 msgr2=0x7f7e8c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.127+0000 7f7eab59e640 1 --2- 172.21.15.87:0/3510225925 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7e8c06ae90 0x7f7e8c06d350 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009670 tx=0x7f7e9c006bf0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.127+0000 7f7eab59e640 1 -- 172.21.15.87:0/3510225925 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7eac0cc340 msgr2=0x7f7eac1e89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.127+0000 7f7eab59e640 1 --2- 172.21.15.87:0/3510225925 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7eac0cc340 0x7f7eac1e89e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009870 tx=0x7f7ea0004730 comp rx=0 tx=0).stop 2023-12-16T20:22:07.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.127+0000 7f7eaad9d640 1 -- 172.21.15.87:0/3510225925 reap_dead start 2023-12-16T20:22:07.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.127+0000 7f7eab59e640 1 -- 172.21.15.87:0/3510225925 shutdown_connections 2023-12-16T20:22:07.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.127+0000 7f7eab59e640 1 -- 172.21.15.87:0/3510225925 >> 172.21.15.87:0/3510225925 conn(0x7f7eac071c40 msgr2=0x7f7eac0c49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.127+0000 7f7eab59e640 1 -- 172.21.15.87:0/3510225925 shutdown_connections 2023-12-16T20:22:07.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.127+0000 7f7eab59e640 1 -- 172.21.15.87:0/3510225925 wait complete. 2023-12-16T20:22:07.131 INFO:teuthology.orchestra.run.smithi087.stdout:55834574861 2023-12-16T20:22:07.132 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-16T20:22:07.133 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.132+0000 7feb66ffd640 1 -- 172.21.15.87:0/446914652 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7feb68007070 con 0x7feb700c9ab0 2023-12-16T20:22:07.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.132+0000 7feb66ffd640 1 --2- 172.21.15.87:0/446914652 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7feb5406ae90 0x7feb5406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.132+0000 7feb7610f640 1 --2- 172.21.15.87:0/446914652 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7feb5406ae90 0x7feb5406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.133+0000 7feb7610f640 1 --2- 172.21.15.87:0/446914652 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7feb5406ae90 0x7feb5406d350 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feb60009890 tx=0x7feb60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.138+0000 7feb66ffd640 1 -- 172.21.15.87:0/446914652 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feb68059230 con 0x7feb700c9ab0 2023-12-16T20:22:07.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.138+0000 7feb66ffd640 1 --2- 172.21.15.87:0/446914652 >> [v2:172.21.15.87:6826/1090792588,v1:172.21.15.87:6827/1090792588] conn(0x7feb540743d0 0x7feb54076810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.138+0000 7feb66ffd640 1 -- 172.21.15.87:0/446914652 --> [v2:172.21.15.87:6826/1090792588,v1:172.21.15.87:6827/1090792588] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb54076ee0 con 0x7feb540743d0 2023-12-16T20:22:07.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.138+0000 7feb66ffd640 1 -- 172.21.15.87:0/446914652 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb68001c20 con 0x7feb700c9ab0 2023-12-16T20:22:07.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.139+0000 7feb7590e640 1 --2- 172.21.15.87:0/446914652 >> [v2:172.21.15.87:6826/1090792588,v1:172.21.15.87:6827/1090792588] conn(0x7feb540743d0 0x7feb54076810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.139+0000 7feb7590e640 1 --2- 172.21.15.87:0/446914652 >> [v2:172.21.15.87:6826/1090792588,v1:172.21.15.87:6827/1090792588] conn(0x7feb540743d0 0x7feb54076810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.141+0000 7feb66ffd640 1 -- 172.21.15.87:0/446914652 <== osd.1 v2:172.21.15.87:6826/1090792588 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7feb54076ee0 con 0x7feb540743d0 2023-12-16T20:22:07.145 INFO:teuthology.orchestra.run.smithi087.stdout:55834574861 2023-12-16T20:22:07.145 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-16T20:22:07.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.152+0000 7fe1effff640 1 -- 172.21.15.87:0/3704528001 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fe1f8042070 con 0x7fe2080c4210 2023-12-16T20:22:07.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.153+0000 7fe1effff640 1 --2- 172.21.15.87:0/3704528001 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe1f406ae70 0x7fe1f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.153+0000 7fe206ffd640 1 --2- 172.21.15.87:0/3704528001 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe1f406ae70 0x7fe1f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.154+0000 7fe1effff640 1 -- 172.21.15.87:0/3704528001 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe1f807acb0 con 0x7fe2080c4210 2023-12-16T20:22:07.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.154+0000 7fe1effff640 1 --2- 172.21.15.87:0/3704528001 >> [v2:172.21.15.195:6800/264039550,v1:172.21.15.195:6801/264039550] conn(0x7fe1f40743b0 0x7fe1f40767f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.154+0000 7fe1effff640 1 -- 172.21.15.87:0/3704528001 --> [v2:172.21.15.195:6800/264039550,v1:172.21.15.195:6801/264039550] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1f4076ec0 con 0x7fe1f40743b0 2023-12-16T20:22:07.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.155+0000 7fe206ffd640 1 --2- 172.21.15.87:0/3704528001 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe1f406ae70 0x7fe1f406d330 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe208158100 tx=0x7fe1fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.155+0000 7fe1effff640 1 -- 172.21.15.87:0/3704528001 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1f80768f0 con 0x7fe2080c4210 2023-12-16T20:22:07.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.155+0000 7fe207fff640 1 --2- 172.21.15.87:0/3704528001 >> [v2:172.21.15.195:6800/264039550,v1:172.21.15.195:6801/264039550] conn(0x7fe1f40743b0 0x7fe1f40767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.156+0000 7fe207fff640 1 --2- 172.21.15.87:0/3704528001 >> [v2:172.21.15.195:6800/264039550,v1:172.21.15.195:6801/264039550] conn(0x7fe1f40743b0 0x7fe1f40767f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.156+0000 7fe1effff640 1 -- 172.21.15.87:0/3704528001 <== osd.5 v2:172.21.15.195:6800/264039550 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe1f4076ec0 con 0x7fe1f40743b0 2023-12-16T20:22:07.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.162+0000 7feb77111640 1 -- 172.21.15.87:0/446914652 --> [v2:172.21.15.87:6826/1090792588,v1:172.21.15.87:6827/1090792588] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feb70161000 con 0x7feb540743d0 2023-12-16T20:22:07.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.163+0000 7feb66ffd640 1 -- 172.21.15.87:0/446914652 <== osd.1 v2:172.21.15.87:6826/1090792588 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feb6c0319e0 con 0x7feb540743d0 2023-12-16T20:22:07.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.164+0000 7feb77111640 1 -- 172.21.15.87:0/446914652 >> [v2:172.21.15.87:6826/1090792588,v1:172.21.15.87:6827/1090792588] conn(0x7feb540743d0 msgr2=0x7feb54076810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.164+0000 7feb77111640 1 --2- 172.21.15.87:0/446914652 >> [v2:172.21.15.87:6826/1090792588,v1:172.21.15.87:6827/1090792588] conn(0x7feb540743d0 0x7feb54076810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.164+0000 7feb77111640 1 -- 172.21.15.87:0/446914652 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7feb5406ae90 msgr2=0x7feb5406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.164+0000 7feb77111640 1 --2- 172.21.15.87:0/446914652 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7feb5406ae90 0x7feb5406d350 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feb60009890 tx=0x7feb60008040 comp rx=0 tx=0).stop 2023-12-16T20:22:07.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.164+0000 7feb77111640 1 -- 172.21.15.87:0/446914652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb700c9ab0 msgr2=0x7feb7015cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.164+0000 7feb77111640 1 --2- 172.21.15.87:0/446914652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb700c9ab0 0x7feb7015cb20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feb6800cb70 tx=0x7feb6800a430 comp rx=0 tx=0).stop 2023-12-16T20:22:07.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.164+0000 7feb76910640 1 -- 172.21.15.87:0/446914652 reap_dead start 2023-12-16T20:22:07.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.164+0000 7feb77111640 1 -- 172.21.15.87:0/446914652 shutdown_connections 2023-12-16T20:22:07.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.164+0000 7feb77111640 1 -- 172.21.15.87:0/446914652 >> 172.21.15.87:0/446914652 conn(0x7feb7006a500 msgr2=0x7feb7006ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.164+0000 7feb77111640 1 -- 172.21.15.87:0/446914652 shutdown_connections 2023-12-16T20:22:07.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.164+0000 7feb77111640 1 -- 172.21.15.87:0/446914652 wait complete. 2023-12-16T20:22:07.185 INFO:teuthology.orchestra.run.smithi087.stdout:55834574861 2023-12-16T20:22:07.186 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-16T20:22:07.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.185+0000 7fe20da89640 1 -- 172.21.15.87:0/3704528001 --> [v2:172.21.15.195:6800/264039550,v1:172.21.15.195:6801/264039550] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe2080c50e0 con 0x7fe1f40743b0 2023-12-16T20:22:07.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.186+0000 7fe1effff640 1 -- 172.21.15.87:0/3704528001 <== osd.5 v2:172.21.15.195:6800/264039550 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe2080c50e0 con 0x7fe1f40743b0 2023-12-16T20:22:07.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.186+0000 7fe1edffb640 1 -- 172.21.15.87:0/3704528001 >> [v2:172.21.15.195:6800/264039550,v1:172.21.15.195:6801/264039550] conn(0x7fe1f40743b0 msgr2=0x7fe1f40767f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.186+0000 7fe1edffb640 1 --2- 172.21.15.87:0/3704528001 >> [v2:172.21.15.195:6800/264039550,v1:172.21.15.195:6801/264039550] conn(0x7fe1f40743b0 0x7fe1f40767f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.187+0000 7fe1edffb640 1 -- 172.21.15.87:0/3704528001 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe1f406ae70 msgr2=0x7fe1f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.187+0000 7fe1edffb640 1 --2- 172.21.15.87:0/3704528001 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe1f406ae70 0x7fe1f406d330 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe208158100 tx=0x7fe1fc008040 comp rx=0 tx=0).stop 2023-12-16T20:22:07.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.187+0000 7fe1edffb640 1 -- 172.21.15.87:0/3704528001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2080c4210 msgr2=0x7fe20814c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.187+0000 7fe1edffb640 1 --2- 172.21.15.87:0/3704528001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2080c4210 0x7fe20814c3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8033000 tx=0x7fe1f80046c0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.187+0000 7fe207fff640 1 -- 172.21.15.87:0/3704528001 reap_dead start 2023-12-16T20:22:07.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.187+0000 7fe1edffb640 1 -- 172.21.15.87:0/3704528001 shutdown_connections 2023-12-16T20:22:07.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.187+0000 7fe1edffb640 1 -- 172.21.15.87:0/3704528001 >> 172.21.15.87:0/3704528001 conn(0x7fe20808b610 msgr2=0x7fe20814ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.187+0000 7fe1edffb640 1 -- 172.21.15.87:0/3704528001 shutdown_connections 2023-12-16T20:22:07.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.187+0000 7fe1edffb640 1 -- 172.21.15.87:0/3704528001 wait complete. 2023-12-16T20:22:07.207 INFO:teuthology.orchestra.run.smithi087.stdout:55834574861 2023-12-16T20:22:07.208 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-16T20:22:07.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.217+0000 7f7d2860e640 1 Processor -- start 2023-12-16T20:22:07.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.217+0000 7f7d2860e640 1 -- start start 2023-12-16T20:22:07.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.218+0000 7f7d2860e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d20157f10 0x7f7d201619b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.218+0000 7f7d2860e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7d2006d6b0 0x7f7d200c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.219+0000 7f7d2860e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d2006e020 con 0x7f7d2015d9e0 2023-12-16T20:22:07.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.219+0000 7f7d2860e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d200c16f0 con 0x7f7d2006d6b0 2023-12-16T20:22:07.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.219+0000 7f7d2860e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d200c8a40 con 0x7f7d20157f10 2023-12-16T20:22:07.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.219+0000 7f7d25ba9640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f7d2015d9e0 0x7f7d200c91b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:44928/0 (socket says 172.21.15.87:44928) 2023-12-16T20:22:07.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.219+0000 7f7d25ba9640 1 -- 172.21.15.87:0/2990349797 learned_addr learned my addr 172.21.15.87:0/2990349797 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:07.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.219+0000 7f7d263aa640 1 --2- 172.21.15.87:0/2990349797 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d20157f10 0x7f7d201619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.219+0000 7f7d26bab640 1 --2- 172.21.15.87:0/2990349797 >> v2:172.21.15.87:3300/0 conn(0x7f7d2006d6b0 0x7f7d200c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.221+0000 7f7d253a8640 1 -- 172.21.15.87:0/2990349797 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993302082 0 0) 0x7f7d2006e020 con 0x7f7d2015d9e0 2023-12-16T20:22:07.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.221+0000 7f7d253a8640 1 -- 172.21.15.87:0/2990349797 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d0c003520 con 0x7f7d2015d9e0 2023-12-16T20:22:07.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.223+0000 7f7d263aa640 1 -- 172.21.15.87:0/2990349797 >> v2:172.21.15.87:3300/0 conn(0x7f7d2006d6b0 msgr2=0x7f7d200c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:07.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.223+0000 7f7d263aa640 1 --2- 172.21.15.87:0/2990349797 >> v2:172.21.15.87:3300/0 conn(0x7f7d2006d6b0 0x7f7d200c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.223+0000 7f7d263aa640 1 -- 172.21.15.87:0/2990349797 >> v1:172.21.15.195:6789/0 conn(0x7f7d2015d9e0 legacy=0x7f7d200c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.223+0000 7f7d263aa640 1 -- 172.21.15.87:0/2990349797 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d20161ef0 con 0x7f7d20157f10 2023-12-16T20:22:07.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.225+0000 7f7d263aa640 1 --2- 172.21.15.87:0/2990349797 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d20157f10 0x7f7d201619b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7d100097a0 tx=0x7f7d1002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32f06f3b426c5140 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.229+0000 7f7d253a8640 1 -- 172.21.15.87:0/2990349797 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10031830 con 0x7f7d20157f10 2023-12-16T20:22:07.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.229+0000 7f7d253a8640 1 -- 172.21.15.87:0/2990349797 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d10031990 con 0x7f7d20157f10 2023-12-16T20:22:07.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.230+0000 7f7d253a8640 1 -- 172.21.15.87:0/2990349797 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10031830 con 0x7f7d20157f10 2023-12-16T20:22:07.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.230+0000 7f7d2860e640 1 -- 172.21.15.87:0/2990349797 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d20157f10 msgr2=0x7f7d201619b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.230+0000 7f7d2860e640 1 --2- 172.21.15.87:0/2990349797 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d20157f10 0x7f7d201619b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7d100097a0 tx=0x7f7d1002b8d0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.230+0000 7f7d2860e640 1 -- 172.21.15.87:0/2990349797 shutdown_connections 2023-12-16T20:22:07.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.231+0000 7f7d2860e640 1 --2- 172.21.15.87:0/2990349797 >> v2:172.21.15.87:3300/0 conn(0x7f7d2006d6b0 0x7f7d200c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.231+0000 7f7d2860e640 1 --2- 172.21.15.87:0/2990349797 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d20157f10 0x7f7d201619b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.231+0000 7f7d2860e640 1 -- 172.21.15.87:0/2990349797 >> 172.21.15.87:0/2990349797 conn(0x7f7d2006fa90 msgr2=0x7f7d2006fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.231+0000 7f7d2860e640 1 -- 172.21.15.87:0/2990349797 shutdown_connections 2023-12-16T20:22:07.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.231+0000 7f7d2860e640 1 -- 172.21.15.87:0/2990349797 wait complete. 2023-12-16T20:22:07.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.233+0000 7f7d2860e640 1 Processor -- start 2023-12-16T20:22:07.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.233+0000 7f7d2860e640 1 -- start start 2023-12-16T20:22:07.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.234+0000 7f7d2860e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d2006d6b0 0x7f7d200cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.235+0000 7f7d2860e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d20157f10 0x7f7d2015aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.235+0000 7f7d2860e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d2015d9e0 0x7f7d20151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.235+0000 7f7d2860e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d200cc850 con 0x7f7d2015d9e0 2023-12-16T20:22:07.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.235+0000 7f7d2860e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d20158350 con 0x7f7d20157f10 2023-12-16T20:22:07.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.235+0000 7f7d2860e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d200ca5c0 con 0x7f7d2006d6b0 2023-12-16T20:22:07.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.236+0000 7f7d25ba9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d20157f10 0x7f7d2015aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.237+0000 7f7d263aa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d2006d6b0 0x7f7d200cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.237+0000 7f7d26bab640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d2015d9e0 0x7f7d20151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.237+0000 7f7d25ba9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d20157f10 0x7f7d2015aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:39416/0 (socket says 172.21.15.87:39416) 2023-12-16T20:22:07.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.237+0000 7f7d25ba9640 1 -- 172.21.15.87:0/1082240225 learned_addr learned my addr 172.21.15.87:0/1082240225 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.241+0000 7f7d25ba9640 1 -- 172.21.15.87:0/1082240225 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d2006d6b0 msgr2=0x7f7d200cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.242+0000 7f7d25ba9640 1 --2- 172.21.15.87:0/1082240225 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d2006d6b0 0x7f7d200cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.242+0000 7f7d25ba9640 1 -- 172.21.15.87:0/1082240225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d2015d9e0 msgr2=0x7f7d20151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.242+0000 7f7d25ba9640 1 --2- 172.21.15.87:0/1082240225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d2015d9e0 0x7f7d20151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.242+0000 7f7d25ba9640 1 -- 172.21.15.87:0/1082240225 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d10009400 con 0x7f7d20157f10 2023-12-16T20:22:07.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.246+0000 7f7d25ba9640 1 --2- 172.21.15.87:0/1082240225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d20157f10 0x7f7d2015aa20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00c3c0 tx=0x7f7d1c00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.249+0000 7f7d16ffd640 1 -- 172.21.15.87:0/1082240225 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0074e0 con 0x7f7d20157f10 2023-12-16T20:22:07.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.249+0000 7f7d2860e640 1 -- 172.21.15.87:0/1082240225 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d200ca8a0 con 0x7f7d20157f10 2023-12-16T20:22:07.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.249+0000 7f7d2860e640 1 -- 172.21.15.87:0/1082240225 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d2015a220 con 0x7f7d20157f10 2023-12-16T20:22:07.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.251+0000 7f7d16ffd640 1 -- 172.21.15.87:0/1082240225 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1c007660 con 0x7f7d20157f10 2023-12-16T20:22:07.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.252+0000 7f7d16ffd640 1 -- 172.21.15.87:0/1082240225 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c004a20 con 0x7f7d20157f10 2023-12-16T20:22:07.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.253+0000 7f7d2860e640 1 -- 172.21.15.87:0/1082240225 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d08005250 con 0x7f7d20157f10 2023-12-16T20:22:07.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.266+0000 7fa0293b0640 1 Processor -- start 2023-12-16T20:22:07.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.266+0000 7fa0293b0640 1 -- start start 2023-12-16T20:22:07.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.267+0000 7fa0293b0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa024157e40 0x7fa02406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.267+0000 7fa0293b0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0240c7680 con 0x7fa024157a60 2023-12-16T20:22:07.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.267+0000 7fa0293b0640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa024072ae0 con 0x7fa0240c7b10 2023-12-16T20:22:07.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.267+0000 7fa0293b0640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0240c6d70 con 0x7fa024157e40 2023-12-16T20:22:07.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.269+0000 7fa022ffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa024157a60 0x7fa02415e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54986/0 (socket says 172.21.15.87:54986) 2023-12-16T20:22:07.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.269+0000 7fa022ffd640 1 -- 172.21.15.87:0/2501863707 learned_addr learned my addr 172.21.15.87:0/2501863707 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:07.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.269+0000 7fa0227fc640 1 --2- 172.21.15.87:0/2501863707 >> v2:172.21.15.87:3300/0 conn(0x7fa024157e40 0x7fa02406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.274 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.272+0000 7f7d16ffd640 1 -- 172.21.15.87:0/1082240225 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f7d1c004b80 con 0x7f7d20157f10 2023-12-16T20:22:07.274 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.272+0000 7f7d16ffd640 1 --2- 172.21.15.87:0/1082240225 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7d0406ae90 0x7f7d0406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.273+0000 7f7d263aa640 1 --2- 172.21.15.87:0/1082240225 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7d0406ae90 0x7f7d0406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.274+0000 7fa021ffb640 1 -- 172.21.15.87:0/2501863707 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921100780 0 0) 0x7fa0240c7680 con 0x7fa024157a60 2023-12-16T20:22:07.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.274+0000 7fa021ffb640 1 -- 172.21.15.87:0/2501863707 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa00c003520 con 0x7fa024157a60 2023-12-16T20:22:07.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.274+0000 7f7d263aa640 1 --2- 172.21.15.87:0/1082240225 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7d0406ae90 0x7f7d0406d350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7d10036000 tx=0x7f7d1003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.279+0000 7fa0227fc640 1 -- 172.21.15.87:0/2501863707 >> v1:172.21.15.195:6789/0 conn(0x7fa0240c7b10 legacy=0x7fa024071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:07.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.279+0000 7fa0227fc640 1 -- 172.21.15.87:0/2501863707 >> v1:172.21.15.87:6789/0 conn(0x7fa024157a60 legacy=0x7fa02415e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.279+0000 7fa0227fc640 1 -- 172.21.15.87:0/2501863707 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa024071e20 con 0x7fa024157e40 2023-12-16T20:22:07.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.284+0000 7fa0227fc640 1 --2- 172.21.15.87:0/2501863707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa024157e40 0x7fa02406a500 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa0180097a0 tx=0x7fa01802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137d201329955422 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.286+0000 7efff1fc9640 1 Processor -- start 2023-12-16T20:22:07.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.286+0000 7efff1fc9640 1 -- start start 2023-12-16T20:22:07.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.287+0000 7efff1fc9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7effec0c9e20 0x7effec0ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.287+0000 7efff1fc9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effec0caea0 0x7effec0cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.287+0000 7efff1fc9640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec0ca460 con 0x7effec153900 2023-12-16T20:22:07.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.287+0000 7efff1fc9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec0c8960 con 0x7effec0c9e20 2023-12-16T20:22:07.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.287+0000 7efff1fc9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec159a40 con 0x7effec0caea0 2023-12-16T20:22:07.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.288+0000 7effebfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effec0caea0 0x7effec0cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.288+0000 7effebfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effec0caea0 0x7effec0cb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:35456/0 (socket says 172.21.15.87:35456) 2023-12-16T20:22:07.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.288+0000 7effebfff640 1 -- 172.21.15.87:0/2922830336 learned_addr learned my addr 172.21.15.87:0/2922830336 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.289+0000 7f8778a5c640 1 Processor -- start 2023-12-16T20:22:07.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.289+0000 7f8778a5c640 1 -- start start 2023-12-16T20:22:07.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.290+0000 7f8778a5c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f87741537e0 0x7f87740cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.290+0000 7f8778a5c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f87740c7700 0x7f87740c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.290+0000 7f8778a5c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f87740ca0c0 0x7f8774159a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.290+0000 7f8778a5c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8774159600 con 0x7f87740ca0c0 2023-12-16T20:22:07.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.290+0000 7f8778a5c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877406f870 con 0x7f87741537e0 2023-12-16T20:22:07.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.290+0000 7f8778a5c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877415cd90 con 0x7f87740c7700 2023-12-16T20:22:07.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.290+0000 7fa021ffb640 1 -- 172.21.15.87:0/2501863707 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa018030840 con 0x7fa024157e40 2023-12-16T20:22:07.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.290+0000 7fa021ffb640 1 -- 172.21.15.87:0/2501863707 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0180309a0 con 0x7fa024157e40 2023-12-16T20:22:07.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.290+0000 7fa021ffb640 1 -- 172.21.15.87:0/2501863707 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa018030d70 con 0x7fa024157e40 2023-12-16T20:22:07.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.291+0000 7effebfff640 1 -- 172.21.15.87:0/2922830336 >> v2:172.21.15.87:3300/0 conn(0x7effec0c9e20 msgr2=0x7effec0ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:07.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.291+0000 7effebfff640 1 --2- 172.21.15.87:0/2922830336 >> v2:172.21.15.87:3300/0 conn(0x7effec0c9e20 0x7effec0ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.291+0000 7effebfff640 1 -- 172.21.15.87:0/2922830336 >> v1:172.21.15.195:6789/0 conn(0x7effec153900 legacy=0x7effec0c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:07.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.291+0000 7effebfff640 1 -- 172.21.15.87:0/2922830336 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec159d20 con 0x7effec0caea0 2023-12-16T20:22:07.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.291+0000 7fa0293b0640 1 -- 172.21.15.87:0/2501863707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa024157e40 msgr2=0x7fa02406a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.291+0000 7fa0293b0640 1 --2- 172.21.15.87:0/2501863707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa024157e40 0x7fa02406a500 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa0180097a0 tx=0x7fa01802b980 comp rx=0 tx=0).stop 2023-12-16T20:22:07.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.291+0000 7fa0293b0640 1 -- 172.21.15.87:0/2501863707 shutdown_connections 2023-12-16T20:22:07.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.291+0000 7fa0293b0640 1 --2- 172.21.15.87:0/2501863707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa024157e40 0x7fa02406a500 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.291+0000 7fa0293b0640 1 -- 172.21.15.87:0/2501863707 >> 172.21.15.87:0/2501863707 conn(0x7fa0240c80b0 msgr2=0x7fa0240c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.292+0000 7fa0293b0640 1 -- 172.21.15.87:0/2501863707 shutdown_connections 2023-12-16T20:22:07.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.292+0000 7fa0293b0640 1 -- 172.21.15.87:0/2501863707 wait complete. 2023-12-16T20:22:07.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.292+0000 7f876bfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f87740c7700 0x7f87740c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.293+0000 7f876bfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f87740c7700 0x7f87740c9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:35460/0 (socket says 172.21.15.87:35460) 2023-12-16T20:22:07.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.293+0000 7f876bfff640 1 -- 172.21.15.87:0/10290525 learned_addr learned my addr 172.21.15.87:0/10290525 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.293+0000 7fa0293b0640 1 Processor -- start 2023-12-16T20:22:07.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.293+0000 7fa0293b0640 1 -- start start 2023-12-16T20:22:07.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.293+0000 7effebfff640 1 --2- 172.21.15.87:0/2922830336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effec0caea0 0x7effec0cb4a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7effdc009870 tx=0x7effdc02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c08be6e93fc44af server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.294+0000 7fa0293b0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0240c7b10 0x7fa0241f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.294+0000 7fa0293b0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa024157a60 0x7fa024154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.294+0000 7fa0293b0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa02415f490 0x7fa02415f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.294+0000 7fa0293b0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0241616d0 con 0x7fa02415f490 2023-12-16T20:22:07.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.294+0000 7fa0293b0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02415c020 con 0x7fa024157a60 2023-12-16T20:22:07.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.294+0000 7fa0293b0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0241f4880 con 0x7fa0240c7b10 2023-12-16T20:22:07.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.295+0000 7f8772d9d640 1 --2- 172.21.15.87:0/10290525 >> v2:172.21.15.87:3300/0 conn(0x7f87740ca0c0 0x7f8774159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.299 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.298+0000 7f876bfff640 1 -- 172.21.15.87:0/10290525 >> v2:172.21.15.195:3300/0 conn(0x7f87741537e0 msgr2=0x7f87740cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:07.299 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.298+0000 7f876bfff640 1 --2- 172.21.15.87:0/10290525 >> v2:172.21.15.195:3300/0 conn(0x7f87741537e0 0x7f87740cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.299 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.298+0000 7f876bfff640 1 -- 172.21.15.87:0/10290525 >> v2:172.21.15.87:3300/0 conn(0x7f87740ca0c0 msgr2=0x7f8774159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:07.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.298+0000 7f876bfff640 1 --2- 172.21.15.87:0/10290525 >> v2:172.21.15.87:3300/0 conn(0x7f87740ca0c0 0x7f8774159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.298+0000 7f876bfff640 1 -- 172.21.15.87:0/10290525 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877415d070 con 0x7f87740c7700 2023-12-16T20:22:07.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.298+0000 7fa022ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0240c7b10 0x7fa0241f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.299+0000 7fa022ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0240c7b10 0x7fa0241f4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:35472/0 (socket says 172.21.15.87:35472) 2023-12-16T20:22:07.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.299+0000 7fa022ffd640 1 -- 172.21.15.87:0/2419264784 learned_addr learned my addr 172.21.15.87:0/2419264784 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.300+0000 7f0926251640 1 Processor -- start 2023-12-16T20:22:07.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.300+0000 7f0926251640 1 -- start start 2023-12-16T20:22:07.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.301+0000 7f0926251640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f09201516c0 0x7f092015b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.301+0000 7effea7fc640 1 -- 172.21.15.87:0/2922830336 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc0317c0 con 0x7effec0caea0 2023-12-16T20:22:07.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.301+0000 7effea7fc640 1 -- 172.21.15.87:0/2922830336 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc031920 con 0x7effec0caea0 2023-12-16T20:22:07.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.301+0000 7f0926251640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f09200c79f0 0x7f0920070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.301+0000 7f0926251640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0920158440 con 0x7f09200ca280 2023-12-16T20:22:07.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.301+0000 7f0926251640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09200c3c50 con 0x7f09200c79f0 2023-12-16T20:22:07.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.301+0000 7f0926251640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f092015b950 con 0x7f09201516c0 2023-12-16T20:22:07.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.301+0000 7effea7fc640 1 -- 172.21.15.87:0/2922830336 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc031cb0 con 0x7effec0caea0 2023-12-16T20:22:07.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.301+0000 7fa0237fe640 1 --2- 172.21.15.87:0/2419264784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa02415f490 0x7fa02415f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.302+0000 7efff1fc9640 1 -- 172.21.15.87:0/2922830336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effec0caea0 msgr2=0x7effec0cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.302+0000 7efff1fc9640 1 --2- 172.21.15.87:0/2922830336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effec0caea0 0x7effec0cb4a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7effdc009870 tx=0x7effdc02b860 comp rx=0 tx=0).stop 2023-12-16T20:22:07.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.302+0000 7efff1fc9640 1 -- 172.21.15.87:0/2922830336 shutdown_connections 2023-12-16T20:22:07.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.302+0000 7efff1fc9640 1 --2- 172.21.15.87:0/2922830336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effec0caea0 0x7effec0cb4a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.302+0000 7efff1fc9640 1 --2- 172.21.15.87:0/2922830336 >> v2:172.21.15.87:3300/0 conn(0x7effec0c9e20 0x7effec0ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.302+0000 7efff1fc9640 1 -- 172.21.15.87:0/2922830336 >> 172.21.15.87:0/2922830336 conn(0x7effec08afb0 msgr2=0x7effec08b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.302+0000 7efff1fc9640 1 -- 172.21.15.87:0/2922830336 shutdown_connections 2023-12-16T20:22:07.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.302+0000 7efff1fc9640 1 -- 172.21.15.87:0/2922830336 wait complete. 2023-12-16T20:22:07.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.303+0000 7efff1fc9640 1 Processor -- start 2023-12-16T20:22:07.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.304+0000 7efff1fc9640 1 -- start start 2023-12-16T20:22:07.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.305+0000 7fa022ffd640 1 -- 172.21.15.87:0/2419264784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa024157a60 msgr2=0x7fa024154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.305+0000 7fa022ffd640 1 --2- 172.21.15.87:0/2419264784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa024157a60 0x7fa024154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.305+0000 7fa022ffd640 1 -- 172.21.15.87:0/2419264784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa02415f490 msgr2=0x7fa02415f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.305+0000 7fa022ffd640 1 --2- 172.21.15.87:0/2419264784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa02415f490 0x7fa02415f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.305+0000 7fa022ffd640 1 -- 172.21.15.87:0/2419264784 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa018009400 con 0x7fa0240c7b10 2023-12-16T20:22:07.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.305+0000 7efff1fc9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effec0c9e20 0x7effec1f3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.305+0000 7efff1fc9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effec0caea0 0x7effec0cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.305+0000 7efff1fc9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effec153900 0x7effec0c3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.305+0000 7efff1fc9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec0c2a40 con 0x7effec153900 2023-12-16T20:22:07.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.305+0000 7efff1fc9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec0c4e70 con 0x7effec0c9e20 2023-12-16T20:22:07.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.305+0000 7efff1fc9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec0c2ce0 con 0x7effec0caea0 2023-12-16T20:22:07.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.305+0000 7f876bfff640 1 --2- 172.21.15.87:0/10290525 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f87740c7700 0x7f87740c9b80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f87740ca660 tx=0x7f875c02b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff0760a27e98ee4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.308+0000 7ff6b8215640 1 Processor -- start 2023-12-16T20:22:07.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.308+0000 7ff6b8215640 1 -- start start 2023-12-16T20:22:07.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.309+0000 7ff6b8215640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff6b0151630 0x7ff6b006f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.309+0000 7ff6b8215640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff6b00c2000 0x7ff6b00c2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.309+0000 7ff6b8215640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b015b9c0 con 0x7ff6b0157f50 2023-12-16T20:22:07.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.309+0000 7ff6b8215640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b01583c0 con 0x7ff6b0151630 2023-12-16T20:22:07.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.309+0000 7ff6b8215640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b00c2970 con 0x7ff6b00c2000 2023-12-16T20:22:07.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.309+0000 7fa022ffd640 1 --2- 172.21.15.87:0/2419264784 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0240c7b10 0x7fa0241f4340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa01400c3c0 tx=0x7fa01400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.309+0000 7effeaffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effec0caea0 0x7effec0cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.310+0000 7effebfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effec153900 0x7effec0c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.310+0000 7f091effd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f09200c79f0 0x7f0920070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.310+0000 7ff6b5fb1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff6b0151630 0x7ff6b006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.311+0000 7effebfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effec153900 0x7effec0c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55728/0 (socket says 172.21.15.87:55728) 2023-12-16T20:22:07.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.311+0000 7effebfff640 1 -- 172.21.15.87:0/3195200686 learned_addr learned my addr 172.21.15.87:0/3195200686 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.311+0000 7f091effd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f09200c79f0 0x7f0920070b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55722/0 (socket says 172.21.15.87:55722) 2023-12-16T20:22:07.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.311+0000 7f091effd640 1 -- 172.21.15.87:0/3824098998 learned_addr learned my addr 172.21.15.87:0/3824098998 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.311+0000 7ff6b5fb1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff6b0151630 0x7ff6b006f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55742/0 (socket says 172.21.15.87:55742) 2023-12-16T20:22:07.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.311+0000 7ff6b5fb1640 1 -- 172.21.15.87:0/2104789110 learned_addr learned my addr 172.21.15.87:0/2104789110 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.315+0000 7effebfff640 1 -- 172.21.15.87:0/3195200686 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effec0caea0 msgr2=0x7effec0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.315+0000 7effebfff640 1 --2- 172.21.15.87:0/3195200686 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effec0caea0 0x7effec0cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.315+0000 7effebfff640 1 -- 172.21.15.87:0/3195200686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effec0c9e20 msgr2=0x7effec1f3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.315+0000 7effebfff640 1 --2- 172.21.15.87:0/3195200686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effec0c9e20 0x7effec1f3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.315+0000 7effebfff640 1 -- 172.21.15.87:0/3195200686 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effdc0094d0 con 0x7effec153900 2023-12-16T20:22:07.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.317+0000 7f091effd640 1 -- 172.21.15.87:0/3824098998 >> v2:172.21.15.195:3300/0 conn(0x7f09201516c0 msgr2=0x7f092015b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:07.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.317+0000 7f091effd640 1 --2- 172.21.15.87:0/3824098998 >> v2:172.21.15.195:3300/0 conn(0x7f09201516c0 0x7f092015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.317+0000 7f091effd640 1 -- 172.21.15.87:0/3824098998 >> v1:172.21.15.195:6789/0 conn(0x7f09200ca280 legacy=0x7f09200c2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:07.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.317+0000 7f091effd640 1 -- 172.21.15.87:0/3824098998 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0920157550 con 0x7f09200c79f0 2023-12-16T20:22:07.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.319+0000 7f8771d9b640 1 -- 172.21.15.87:0/10290525 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c030850 con 0x7f87740c7700 2023-12-16T20:22:07.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.319+0000 7f8771d9b640 1 -- 172.21.15.87:0/10290525 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c0309b0 con 0x7f87740c7700 2023-12-16T20:22:07.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.319+0000 7f8771d9b640 1 -- 172.21.15.87:0/10290525 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c030d40 con 0x7f87740c7700 2023-12-16T20:22:07.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.320+0000 7fa00b7fe640 1 -- 172.21.15.87:0/2419264784 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa014005ce0 con 0x7fa0240c7b10 2023-12-16T20:22:07.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.320+0000 7ff6b5fb1640 1 -- 172.21.15.87:0/2104789110 >> v2:172.21.15.195:3300/0 conn(0x7ff6b00c2000 msgr2=0x7ff6b00c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:07.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.320+0000 7ff6b5fb1640 1 --2- 172.21.15.87:0/2104789110 >> v2:172.21.15.195:3300/0 conn(0x7ff6b00c2000 0x7ff6b00c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.320+0000 7ff6b5fb1640 1 -- 172.21.15.87:0/2104789110 >> v1:172.21.15.195:6789/0 conn(0x7ff6b0157f50 legacy=0x7ff6b00c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:07.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.320+0000 7f8778a5c640 1 -- 172.21.15.87:0/10290525 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f87740c7700 msgr2=0x7f87740c9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.320+0000 7f8778a5c640 1 --2- 172.21.15.87:0/10290525 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f87740c7700 0x7f87740c9b80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f87740ca660 tx=0x7f875c02b990 comp rx=0 tx=0).stop 2023-12-16T20:22:07.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.320+0000 7ff6b5fb1640 1 -- 172.21.15.87:0/2104789110 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b015ab60 con 0x7ff6b0151630 2023-12-16T20:22:07.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.320+0000 7fa0293b0640 1 -- 172.21.15.87:0/2419264784 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa02415f000 con 0x7fa0240c7b10 2023-12-16T20:22:07.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.320+0000 7f8778a5c640 1 -- 172.21.15.87:0/10290525 shutdown_connections 2023-12-16T20:22:07.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.320+0000 7f8778a5c640 1 --2- 172.21.15.87:0/10290525 >> v2:172.21.15.87:3300/0 conn(0x7f87740ca0c0 0x7f8774159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.320+0000 7f8778a5c640 1 --2- 172.21.15.87:0/10290525 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f87740c7700 0x7f87740c9b80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.320+0000 7f8778a5c640 1 --2- 172.21.15.87:0/10290525 >> v2:172.21.15.195:3300/0 conn(0x7f87741537e0 0x7f87740cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.320+0000 7f8778a5c640 1 -- 172.21.15.87:0/10290525 >> 172.21.15.87:0/10290525 conn(0x7f8774061100 msgr2=0x7f87740614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.320+0000 7fa00b7fe640 1 -- 172.21.15.87:0/2419264784 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa014005e40 con 0x7fa0240c7b10 2023-12-16T20:22:07.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.320+0000 7fa00b7fe640 1 -- 172.21.15.87:0/2419264784 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0140072f0 con 0x7fa0240c7b10 2023-12-16T20:22:07.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.321+0000 7f8778a5c640 1 -- 172.21.15.87:0/10290525 shutdown_connections 2023-12-16T20:22:07.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.321+0000 7fa0293b0640 1 -- 172.21.15.87:0/2419264784 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa024160e30 con 0x7fa0240c7b10 2023-12-16T20:22:07.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.321+0000 7f8778a5c640 1 -- 172.21.15.87:0/10290525 wait complete. 2023-12-16T20:22:07.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.322+0000 7fa0293b0640 1 -- 172.21.15.87:0/2419264784 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0240740e0 con 0x7fa0240c7b10 2023-12-16T20:22:07.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.323+0000 7f8778a5c640 1 Processor -- start 2023-12-16T20:22:07.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.323+0000 7f8778a5c640 1 -- start start 2023-12-16T20:22:07.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.324+0000 7f8778a5c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87740c7700 0x7f87740c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.324+0000 7f8778a5c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f87740ca0c0 0x7f877406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.324+0000 7f8778a5c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87741537e0 0x7f8774148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.324+0000 7f8778a5c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87740c4440 con 0x7f87740c7700 2023-12-16T20:22:07.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.324+0000 7f8778a5c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87741f2e00 con 0x7f87741537e0 2023-12-16T20:22:07.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.324+0000 7f8778a5c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87740c41a0 con 0x7f87740ca0c0 2023-12-16T20:22:07.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.325+0000 7ff6b5fb1640 1 --2- 172.21.15.87:0/2104789110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6b0151630 0x7ff6b006f590 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0070710 tx=0x7ff6ac02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535e9d9003fb97bd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.325+0000 7f091effd640 1 --2- 172.21.15.87:0/3824098998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09200c79f0 0x7f0920070b10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f092006afa0 tx=0x7f091402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175d93e423bb072c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.326+0000 7effebfff640 1 --2- 172.21.15.87:0/3195200686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effec153900 0x7effec0c3170 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7effdc02b8a0 tx=0x7effdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.328+0000 7f876bfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f87740ca0c0 0x7f877406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.333+0000 7f877259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87740c7700 0x7f87740c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.334+0000 7effd3fff640 1 -- 172.21.15.87:0/3195200686 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc032860 con 0x7effec153900 2023-12-16T20:22:07.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.334+0000 7effd3fff640 1 -- 172.21.15.87:0/3195200686 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc0329e0 con 0x7effec153900 2023-12-16T20:22:07.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.334+0000 7effd3fff640 1 -- 172.21.15.87:0/3195200686 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc032d90 con 0x7effec153900 2023-12-16T20:22:07.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.334+0000 7efff1fc9640 1 -- 172.21.15.87:0/3195200686 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effec0c5430 con 0x7effec153900 2023-12-16T20:22:07.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.335+0000 7efff1fc9640 1 -- 172.21.15.87:0/3195200686 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec0c59f0 con 0x7effec153900 2023-12-16T20:22:07.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.335+0000 7f877259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87740c7700 0x7f87740c5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55746/0 (socket says 172.21.15.87:55746) 2023-12-16T20:22:07.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.335+0000 7f877259c640 1 -- 172.21.15.87:0/1985454104 learned_addr learned my addr 172.21.15.87:0/1985454104 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.336+0000 7efff1fc9640 1 -- 172.21.15.87:0/3195200686 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effec0c94d0 con 0x7effec153900 2023-12-16T20:22:07.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.336+0000 7ff6b4faf640 1 -- 172.21.15.87:0/2104789110 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac030860 con 0x7ff6b0151630 2023-12-16T20:22:07.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.336+0000 7ff6b4faf640 1 -- 172.21.15.87:0/2104789110 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac0309c0 con 0x7ff6b0151630 2023-12-16T20:22:07.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.336+0000 7ff6b4faf640 1 -- 172.21.15.87:0/2104789110 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac030d50 con 0x7ff6b0151630 2023-12-16T20:22:07.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.337+0000 7ff6b8215640 1 -- 172.21.15.87:0/2104789110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6b0151630 msgr2=0x7ff6b006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.337+0000 7ff6b8215640 1 --2- 172.21.15.87:0/2104789110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6b0151630 0x7ff6b006f590 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0070710 tx=0x7ff6ac02b9a0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.337+0000 7ff6b8215640 1 -- 172.21.15.87:0/2104789110 shutdown_connections 2023-12-16T20:22:07.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.337+0000 7ff6b8215640 1 --2- 172.21.15.87:0/2104789110 >> v2:172.21.15.195:3300/0 conn(0x7ff6b00c2000 0x7ff6b00c2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.337+0000 7ff6b8215640 1 --2- 172.21.15.87:0/2104789110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6b0151630 0x7ff6b006f590 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.337+0000 7ff6b8215640 1 -- 172.21.15.87:0/2104789110 >> 172.21.15.87:0/2104789110 conn(0x7ff6b0061100 msgr2=0x7ff6b00614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.337+0000 7ff6b8215640 1 -- 172.21.15.87:0/2104789110 shutdown_connections 2023-12-16T20:22:07.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.337+0000 7ff6b8215640 1 -- 172.21.15.87:0/2104789110 wait complete. 2023-12-16T20:22:07.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.339+0000 7ff6b8215640 1 Processor -- start 2023-12-16T20:22:07.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.339+0000 7ff6b8215640 1 -- start start 2023-12-16T20:22:07.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.339+0000 7ff6b8215640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6b00c2000 0x7ff6b01460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.339+0000 7ff6b8215640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6b0151630 0x7ff6b0070d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.339+0000 7ff6b8215640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6b0157f50 0x7ff6b0144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.339+0000 7ff6b8215640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b014eda0 con 0x7ff6b00c2000 2023-12-16T20:22:07.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.339+0000 7ff6b8215640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b01567e0 con 0x7ff6b0151630 2023-12-16T20:22:07.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.339+0000 7ff6b8215640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b014e820 con 0x7ff6b0157f50 2023-12-16T20:22:07.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.342+0000 7fa00b7fe640 1 -- 172.21.15.87:0/2419264784 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fa0140074f0 con 0x7fa0240c7b10 2023-12-16T20:22:07.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.342+0000 7fa00b7fe640 1 --2- 172.21.15.87:0/2419264784 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa01006aec0 0x7fa01006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.342+0000 7fa0227fc640 1 --2- 172.21.15.87:0/2419264784 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa01006aec0 0x7fa01006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.343+0000 7fa0227fc640 1 --2- 172.21.15.87:0/2419264784 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa01006aec0 0x7fa01006d380 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa018036000 tx=0x7fa01803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.344+0000 7fa00b7fe640 1 -- 172.21.15.87:0/2419264784 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa014057ed0 con 0x7fa0240c7b10 2023-12-16T20:22:07.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.353+0000 7f6692c1e640 1 Processor -- start 2023-12-16T20:22:07.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.353+0000 7f6692c1e640 1 -- start start 2023-12-16T20:22:07.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.354+0000 7f6692c1e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f668c14fd70 0x7f668c070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.354+0000 7f6692c1e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f668c071c40 0x7f668c0c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.354+0000 7f6692c1e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f668c0c7eb0 0x7f668c159760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.354+0000 7f6692c1e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668c155b20 con 0x7f668c14fd70 2023-12-16T20:22:07.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.354+0000 7f6692c1e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668c071420 con 0x7f668c071c40 2023-12-16T20:22:07.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.354+0000 7f6692c1e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668c1592d0 con 0x7f668c0c7eb0 2023-12-16T20:22:07.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.374+0000 7fc347651640 1 Processor -- start 2023-12-16T20:22:07.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.375+0000 7fc347651640 1 -- start start 2023-12-16T20:22:07.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.375+0000 7fc347651640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc340150470 0x7fc3400c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.375+0000 7fc347651640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc34006eef0 0x7fc34006e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.375+0000 7fc347651640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3400c2bf0 0x7fc34006e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.375+0000 7fc347651640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3400c8500 con 0x7fc340150470 2023-12-16T20:22:07.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.376+0000 7fc347651640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3400c7f30 con 0x7fc34006eef0 2023-12-16T20:22:07.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.376+0000 7fc347651640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3400c0ea0 con 0x7fc3400c2bf0 2023-12-16T20:22:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.385+0000 7effd3fff640 1 -- 172.21.15.87:0/3195200686 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7effdc04e450 con 0x7effec153900 2023-12-16T20:22:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.386+0000 7effd3fff640 1 --2- 172.21.15.87:0/3195200686 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7effd806ae90 0x7effd806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.386+0000 7effeb7fe640 1 --2- 172.21.15.87:0/3195200686 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7effd806ae90 0x7effd806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.386+0000 7effeb7fe640 1 --2- 172.21.15.87:0/3195200686 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7effd806ae90 0x7effd806d350 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7effe400abb0 tx=0x7effe4009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.388+0000 7f877259c640 1 -- 172.21.15.87:0/1985454104 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f87740ca0c0 msgr2=0x7f877406b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.388+0000 7f877259c640 1 --2- 172.21.15.87:0/1985454104 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f87740ca0c0 0x7f877406b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.388+0000 7f877259c640 1 -- 172.21.15.87:0/1985454104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87741537e0 msgr2=0x7f8774148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.388+0000 7f877259c640 1 --2- 172.21.15.87:0/1985454104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87741537e0 0x7f8774148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.388+0000 7f877259c640 1 -- 172.21.15.87:0/1985454104 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c0094d0 con 0x7f87740c7700 2023-12-16T20:22:07.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.393+0000 7effd3fff640 1 -- 172.21.15.87:0/3195200686 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7effdc030310 con 0x7effec153900 2023-12-16T20:22:07.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.506+0000 7f7d16ffd640 1 -- 172.21.15.87:0/1082240225 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7d1c004e30 con 0x7f7d20157f10 2023-12-16T20:22:07.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.517+0000 7f7d16ffd640 1 -- 172.21.15.87:0/1082240225 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f7d1c054ab0 con 0x7f7d20157f10 2023-12-16T20:22:07.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.525+0000 7fc344bec640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc34006eef0 0x7fc34006e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.525+0000 7fc344bec640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc34006eef0 0x7fc34006e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:39496/0 (socket says 172.21.15.87:39496) 2023-12-16T20:22:07.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.525+0000 7fc344bec640 1 -- 172.21.15.87:0/2580321413 learned_addr learned my addr 172.21.15.87:0/2580321413 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.526+0000 7ff6b57b0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6b0151630 0x7ff6b0070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.527+0000 7ff6b57b0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6b0151630 0x7ff6b0070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:39486/0 (socket says 172.21.15.87:39486) 2023-12-16T20:22:07.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.527+0000 7ff6b57b0640 1 -- 172.21.15.87:0/2272239596 learned_addr learned my addr 172.21.15.87:0/2272239596 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.528+0000 7fc344bec640 1 -- 172.21.15.87:0/2580321413 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3400c2bf0 msgr2=0x7fc34006e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:07.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.528+0000 7fc344bec640 1 --2- 172.21.15.87:0/2580321413 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3400c2bf0 0x7fc34006e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.528+0000 7fc344bec640 1 -- 172.21.15.87:0/2580321413 >> v2:172.21.15.87:3300/0 conn(0x7fc340150470 msgr2=0x7fc3400c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:07.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.528+0000 7fc344bec640 1 --2- 172.21.15.87:0/2580321413 >> v2:172.21.15.87:3300/0 conn(0x7fc340150470 0x7fc3400c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.528+0000 7fc344bec640 1 -- 172.21.15.87:0/2580321413 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3400c16b0 con 0x7fc34006eef0 2023-12-16T20:22:07.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.531+0000 7fc344bec640 1 --2- 172.21.15.87:0/2580321413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc34006eef0 0x7fc34006e190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc3400c1d00 tx=0x7fc33c02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=365341794e92d4a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.533+0000 7f668bfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f668c071c40 0x7f668c0c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.533+0000 7f668bfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f668c071c40 0x7f668c0c7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:39490/0 (socket says 172.21.15.87:39490) 2023-12-16T20:22:07.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.533+0000 7f668bfff640 1 -- 172.21.15.87:0/1324310550 learned_addr learned my addr 172.21.15.87:0/1324310550 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.539 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.538+0000 7ff6b57b0640 1 -- 172.21.15.87:0/2272239596 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6b0157f50 msgr2=0x7ff6b0144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.539 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.538+0000 7ff6b57b0640 1 --2- 172.21.15.87:0/2272239596 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6b0157f50 0x7ff6b0144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.539 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.538+0000 7ff6b57b0640 1 -- 172.21.15.87:0/2272239596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6b00c2000 msgr2=0x7ff6b01460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.539 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.538+0000 7ff6b57b0640 1 --2- 172.21.15.87:0/2272239596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6b00c2000 0x7ff6b01460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.539 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.538+0000 7ff6b57b0640 1 -- 172.21.15.87:0/2272239596 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac0094d0 con 0x7ff6b0151630 2023-12-16T20:22:07.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.542+0000 7f668bfff640 1 -- 172.21.15.87:0/1324310550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f668c0c7eb0 msgr2=0x7f668c159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:07.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.542+0000 7f668bfff640 1 --2- 172.21.15.87:0/1324310550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f668c0c7eb0 0x7f668c159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.542+0000 7f668bfff640 1 -- 172.21.15.87:0/1324310550 >> v2:172.21.15.87:3300/0 conn(0x7f668c14fd70 msgr2=0x7f668c070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:07.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.542+0000 7f668bfff640 1 --2- 172.21.15.87:0/1324310550 >> v2:172.21.15.87:3300/0 conn(0x7f668c14fd70 0x7f668c070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.542+0000 7f668bfff640 1 -- 172.21.15.87:0/1324310550 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c0c65f0 con 0x7f668c071c40 2023-12-16T20:22:07.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.548+0000 7f668bfff640 1 --2- 172.21.15.87:0/1324310550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f668c071c40 0x7f668c0c7970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f668c0b0640 tx=0x7f667802c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62fdd2d78044e694 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.553+0000 7f668b7fe640 1 -- 172.21.15.87:0/1324310550 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678032860 con 0x7f668c071c40 2023-12-16T20:22:07.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.553+0000 7f668b7fe640 1 -- 172.21.15.87:0/1324310550 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66780329c0 con 0x7f668c071c40 2023-12-16T20:22:07.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.553+0000 7f668b7fe640 1 -- 172.21.15.87:0/1324310550 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678032d50 con 0x7f668c071c40 2023-12-16T20:22:07.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.553+0000 7ff6b57b0640 1 --2- 172.21.15.87:0/2272239596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6b0151630 0x7ff6b0070d20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000b3e0 tx=0x7ff6a000b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.554+0000 7f6692c1e640 1 -- 172.21.15.87:0/1324310550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f668c071c40 msgr2=0x7f668c0c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.554+0000 7f6692c1e640 1 --2- 172.21.15.87:0/1324310550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f668c071c40 0x7f668c0c7970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f668c0b0640 tx=0x7f667802c900 comp rx=0 tx=0).stop 2023-12-16T20:22:07.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.554+0000 7f6692c1e640 1 -- 172.21.15.87:0/1324310550 shutdown_connections 2023-12-16T20:22:07.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.554+0000 7f6692c1e640 1 --2- 172.21.15.87:0/1324310550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f668c0c7eb0 0x7f668c159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.554+0000 7f6692c1e640 1 --2- 172.21.15.87:0/1324310550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f668c071c40 0x7f668c0c7970 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.554+0000 7f6692c1e640 1 --2- 172.21.15.87:0/1324310550 >> v2:172.21.15.87:3300/0 conn(0x7f668c14fd70 0x7f668c070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.554+0000 7f6692c1e640 1 -- 172.21.15.87:0/1324310550 >> 172.21.15.87:0/1324310550 conn(0x7f668c06cd60 msgr2=0x7f668c06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.555+0000 7f6692c1e640 1 -- 172.21.15.87:0/1324310550 shutdown_connections 2023-12-16T20:22:07.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.555+0000 7f6692c1e640 1 -- 172.21.15.87:0/1324310550 wait complete. 2023-12-16T20:22:07.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.556+0000 7f6692c1e640 1 Processor -- start 2023-12-16T20:22:07.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.556+0000 7f6692c1e640 1 -- start start 2023-12-16T20:22:07.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.557+0000 7f6692c1e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f668c071c40 0x7f668c1f0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.557+0000 7f6692c1e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f668c0c7eb0 0x7f668c1e2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.557+0000 7f6692c1e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f668c14fd70 0x7f668c14b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.557+0000 7f6692c1e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c14c630 con 0x7f668c0c7eb0 2023-12-16T20:22:07.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.557+0000 7f6692c1e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c1f0540 con 0x7f668c14fd70 2023-12-16T20:22:07.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.557+0000 7f6692c1e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668c14b310 con 0x7f668c071c40 2023-12-16T20:22:07.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.559+0000 7fc337fff640 1 -- 172.21.15.87:0/2580321413 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c031870 con 0x7fc34006eef0 2023-12-16T20:22:07.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.559+0000 7fc337fff640 1 -- 172.21.15.87:0/2580321413 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c0319d0 con 0x7fc34006eef0 2023-12-16T20:22:07.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.559+0000 7fc337fff640 1 -- 172.21.15.87:0/2580321413 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c031d60 con 0x7fc34006eef0 2023-12-16T20:22:07.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.560+0000 7fc347651640 1 -- 172.21.15.87:0/2580321413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc34006eef0 msgr2=0x7fc34006e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.560+0000 7fc347651640 1 --2- 172.21.15.87:0/2580321413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc34006eef0 0x7fc34006e190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc3400c1d00 tx=0x7fc33c02b910 comp rx=0 tx=0).stop 2023-12-16T20:22:07.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.560+0000 7fc347651640 1 -- 172.21.15.87:0/2580321413 shutdown_connections 2023-12-16T20:22:07.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.560+0000 7fc347651640 1 --2- 172.21.15.87:0/2580321413 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3400c2bf0 0x7fc34006e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.560+0000 7fc347651640 1 --2- 172.21.15.87:0/2580321413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc34006eef0 0x7fc34006e190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.560+0000 7fc347651640 1 --2- 172.21.15.87:0/2580321413 >> v2:172.21.15.87:3300/0 conn(0x7fc340150470 0x7fc3400c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.560+0000 7fc347651640 1 -- 172.21.15.87:0/2580321413 >> 172.21.15.87:0/2580321413 conn(0x7fc340072930 msgr2=0x7fc3400cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.560+0000 7fc347651640 1 -- 172.21.15.87:0/2580321413 shutdown_connections 2023-12-16T20:22:07.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.560+0000 7fc347651640 1 -- 172.21.15.87:0/2580321413 wait complete. 2023-12-16T20:22:07.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.561+0000 7fc347651640 1 Processor -- start 2023-12-16T20:22:07.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.561+0000 7fc347651640 1 -- start start 2023-12-16T20:22:07.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.561+0000 7ff6a67fc640 1 -- 172.21.15.87:0/2272239596 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0011830 con 0x7ff6b0151630 2023-12-16T20:22:07.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.561+0000 7ff6a67fc640 1 -- 172.21.15.87:0/2272239596 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a00119b0 con 0x7ff6b0151630 2023-12-16T20:22:07.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.561+0000 7f66911bb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f668c14fd70 0x7f668c14b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.561+0000 7ff6a67fc640 1 -- 172.21.15.87:0/2272239596 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0011d60 con 0x7ff6b0151630 2023-12-16T20:22:07.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.561+0000 7ff6b8215640 1 -- 172.21.15.87:0/2272239596 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b014eac0 con 0x7ff6b0151630 2023-12-16T20:22:07.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.561+0000 7ff6b8215640 1 -- 172.21.15.87:0/2272239596 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b0156470 con 0x7ff6b0151630 2023-12-16T20:22:07.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.562+0000 7f66911bb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f668c14fd70 0x7f668c14b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:39506/0 (socket says 172.21.15.87:39506) 2023-12-16T20:22:07.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.562+0000 7f66911bb640 1 -- 172.21.15.87:0/661040607 learned_addr learned my addr 172.21.15.87:0/661040607 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.562+0000 7fc347651640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc34006eef0 0x7fc3401551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.562+0000 7fc347651640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3400c2bf0 0x7fc340152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.562+0000 7fc347651640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc340150470 0x7fc340155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.562+0000 7fc347651640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3401e2b30 con 0x7fc34006eef0 2023-12-16T20:22:07.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.562+0000 7fc347651640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc340154930 con 0x7fc340150470 2023-12-16T20:22:07.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.562+0000 7fc347651640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3401543b0 con 0x7fc3400c2bf0 2023-12-16T20:22:07.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.563+0000 7ff6b8215640 1 -- 172.21.15.87:0/2272239596 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b0156630 con 0x7ff6b0151630 2023-12-16T20:22:07.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.567+0000 7f66911bb640 1 -- 172.21.15.87:0/661040607 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f668c071c40 msgr2=0x7f668c1f0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.567+0000 7f66911bb640 1 --2- 172.21.15.87:0/661040607 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f668c071c40 0x7f668c1f0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.567+0000 7f66911bb640 1 -- 172.21.15.87:0/661040607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f668c0c7eb0 msgr2=0x7f668c1e2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.567+0000 7f66911bb640 1 --2- 172.21.15.87:0/661040607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f668c0c7eb0 0x7f668c1e2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.567+0000 7f66911bb640 1 -- 172.21.15.87:0/661040607 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66780094d0 con 0x7f668c14fd70 2023-12-16T20:22:07.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.593+0000 7fa00b7fe640 1 -- 172.21.15.87:0/2419264784 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fa014054210 con 0x7fa0240c7b10 2023-12-16T20:22:07.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.598+0000 7fc344bec640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3400c2bf0 0x7fc340152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.599+0000 7fc344bec640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3400c2bf0 0x7fc340152040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:35534/0 (socket says 172.21.15.87:35534) 2023-12-16T20:22:07.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.599+0000 7fc344bec640 1 -- 172.21.15.87:0/2272325234 learned_addr learned my addr 172.21.15.87:0/2272325234 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.600+0000 7f877259c640 1 --2- 172.21.15.87:0/1985454104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87740c7700 0x7f87740c5110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f876400b410 tx=0x7f876400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.603+0000 7fc344bec640 1 -- 172.21.15.87:0/2272325234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc340150470 msgr2=0x7fc340155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.603+0000 7fc344bec640 1 --2- 172.21.15.87:0/2272325234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc340150470 0x7fc340155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.603+0000 7fc344bec640 1 -- 172.21.15.87:0/2272325234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc34006eef0 msgr2=0x7fc3401551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.603+0000 7fc344bec640 1 --2- 172.21.15.87:0/2272325234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc34006eef0 0x7fc3401551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.603+0000 7fc344bec640 1 -- 172.21.15.87:0/2272325234 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33c0094d0 con 0x7fc3400c2bf0 2023-12-16T20:22:07.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.606+0000 7fc344bec640 1 --2- 172.21.15.87:0/2272325234 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3400c2bf0 0x7fc340152040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009960 tx=0x7fc33c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.611+0000 7fc335ffb640 1 -- 172.21.15.87:0/2272325234 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c03adf0 con 0x7fc3400c2bf0 2023-12-16T20:22:07.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.611+0000 7fc335ffb640 1 -- 172.21.15.87:0/2272325234 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c0443f0 con 0x7fc3400c2bf0 2023-12-16T20:22:07.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.611+0000 7fc347651640 1 -- 172.21.15.87:0/2272325234 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3401e2f50 con 0x7fc3400c2bf0 2023-12-16T20:22:07.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.611+0000 7fc335ffb640 1 -- 172.21.15.87:0/2272325234 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c0447a0 con 0x7fc3400c2bf0 2023-12-16T20:22:07.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.611+0000 7fc347651640 1 -- 172.21.15.87:0/2272325234 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3401e2190 con 0x7fc3400c2bf0 2023-12-16T20:22:07.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.612+0000 7fc347651640 1 -- 172.21.15.87:0/2272325234 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3401e2da0 con 0x7fc3400c2bf0 2023-12-16T20:22:07.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.617+0000 7effd3fff640 1 -- 172.21.15.87:0/3195200686 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7effdc076c00 con 0x7effec153900 2023-12-16T20:22:07.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.628+0000 7f091e7fc640 1 -- 172.21.15.87:0/3824098998 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0914031870 con 0x7f09200c79f0 2023-12-16T20:22:07.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.628+0000 7f091e7fc640 1 -- 172.21.15.87:0/3824098998 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09140319d0 con 0x7f09200c79f0 2023-12-16T20:22:07.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.628+0000 7f091e7fc640 1 -- 172.21.15.87:0/3824098998 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0914031d60 con 0x7f09200c79f0 2023-12-16T20:22:07.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.628+0000 7f0926251640 1 -- 172.21.15.87:0/3824098998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09200c79f0 msgr2=0x7f0920070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.628+0000 7f0926251640 1 --2- 172.21.15.87:0/3824098998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09200c79f0 0x7f0920070b10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f092006afa0 tx=0x7f091402b910 comp rx=0 tx=0).stop 2023-12-16T20:22:07.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.628+0000 7f0926251640 1 -- 172.21.15.87:0/3824098998 shutdown_connections 2023-12-16T20:22:07.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.628+0000 7f0926251640 1 --2- 172.21.15.87:0/3824098998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09200c79f0 0x7f0920070b10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.628+0000 7f0926251640 1 --2- 172.21.15.87:0/3824098998 >> v2:172.21.15.195:3300/0 conn(0x7f09201516c0 0x7f092015b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.628+0000 7f0926251640 1 -- 172.21.15.87:0/3824098998 >> 172.21.15.87:0/3824098998 conn(0x7f092006a8f0 msgr2=0x7f092006eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.629+0000 7f0926251640 1 -- 172.21.15.87:0/3824098998 shutdown_connections 2023-12-16T20:22:07.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.629+0000 7f0926251640 1 -- 172.21.15.87:0/3824098998 wait complete. 2023-12-16T20:22:07.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.630+0000 7f0926251640 1 Processor -- start 2023-12-16T20:22:07.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.631+0000 7f0926251640 1 -- start start 2023-12-16T20:22:07.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.632+0000 7f0926251640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09200c79f0 0x7f09201ed9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.632+0000 7f0926251640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09200ca280 0x7f09200b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.632+0000 7f0926251640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09201516c0 0x7f0920159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.632+0000 7f0926251640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0920158840 con 0x7f09201516c0 2023-12-16T20:22:07.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.632+0000 7f0926251640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0920155060 con 0x7f09200ca280 2023-12-16T20:22:07.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.632+0000 7f0926251640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09200c96b0 con 0x7f09200c79f0 2023-12-16T20:22:07.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.636+0000 7f876affd640 1 -- 172.21.15.87:0/1985454104 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8764011830 con 0x7f87740c7700 2023-12-16T20:22:07.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.636+0000 7f876affd640 1 -- 172.21.15.87:0/1985454104 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87640119b0 con 0x7f87740c7700 2023-12-16T20:22:07.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.636+0000 7f8778a5c640 1 -- 172.21.15.87:0/1985454104 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87741f2040 con 0x7f87740c7700 2023-12-16T20:22:07.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.636+0000 7f876affd640 1 -- 172.21.15.87:0/1985454104 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8764011d60 con 0x7f87740c7700 2023-12-16T20:22:07.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.636+0000 7f8778a5c640 1 -- 172.21.15.87:0/1985454104 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87741f2600 con 0x7f87740c7700 2023-12-16T20:22:07.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.637+0000 7f8778a5c640 1 -- 172.21.15.87:0/1985454104 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87740740e0 con 0x7f87740c7700 2023-12-16T20:22:07.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.641+0000 7f091ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09201516c0 0x7f0920159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.642+0000 7f091ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09201516c0 0x7f0920159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55812/0 (socket says 172.21.15.87:55812) 2023-12-16T20:22:07.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.642+0000 7f091ffff640 1 -- 172.21.15.87:0/2481232452 learned_addr learned my addr 172.21.15.87:0/2481232452 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:07.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.728+0000 7f7d2860e640 1 -- 172.21.15.87:0/1082240225 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7d080057d0 con 0x7f7d20157f10 2023-12-16T20:22:07.771 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.769+0000 7fa0293b0640 1 -- 172.21.15.87:0/2419264784 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa02406fb20 con 0x7fa0240c7b10 2023-12-16T20:22:07.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.807+0000 7f66911bb640 1 --2- 172.21.15.87:0/661040607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f668c14fd70 0x7f668c14b7a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f668400b9a0 tx=0x7f668400be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.816+0000 7efff1fc9640 1 -- 172.21.15.87:0/3195200686 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7effec153ce0 con 0x7effec153900 2023-12-16T20:22:07.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.831+0000 7ff6a67fc640 1 -- 172.21.15.87:0/2272239596 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ff6a0023430 con 0x7ff6b0151630 2023-12-16T20:22:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.832+0000 7ff6a67fc640 1 --2- 172.21.15.87:0/2272239596 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff69406ae40 0x7ff69406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.832+0000 7ff6b5fb1640 1 --2- 172.21.15.87:0/2272239596 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff69406ae40 0x7ff69406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.832+0000 7ff6b5fb1640 1 --2- 172.21.15.87:0/2272239596 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff69406ae40 0x7ff69406d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac036000 tx=0x7ff6ac03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.841+0000 7f7d16ffd640 1 -- 172.21.15.87:0/1082240225 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d1c0580d0 con 0x7f7d20157f10 2023-12-16T20:22:07.843 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2023-12-16T20:22:07.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.843+0000 7f7d2860e640 1 -- 172.21.15.87:0/1082240225 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7d0406ae90 msgr2=0x7f7d0406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.843+0000 7f7d2860e640 1 --2- 172.21.15.87:0/1082240225 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7d0406ae90 0x7f7d0406d350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7d10036000 tx=0x7f7d1003d040 comp rx=0 tx=0).stop 2023-12-16T20:22:07.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.843+0000 7f7d2860e640 1 -- 172.21.15.87:0/1082240225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d20157f10 msgr2=0x7f7d2015aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.843+0000 7f7d2860e640 1 --2- 172.21.15.87:0/1082240225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d20157f10 0x7f7d2015aa20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00c3c0 tx=0x7f7d1c00c880 comp rx=0 tx=0).stop 2023-12-16T20:22:07.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.843+0000 7f7d2860e640 1 -- 172.21.15.87:0/1082240225 shutdown_connections 2023-12-16T20:22:07.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.843+0000 7f7d2860e640 1 --2- 172.21.15.87:0/1082240225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d2015d9e0 0x7f7d20151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.843+0000 7f7d2860e640 1 --2- 172.21.15.87:0/1082240225 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7d0406ae90 0x7f7d0406d350 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.843+0000 7f7d2860e640 1 --2- 172.21.15.87:0/1082240225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d20157f10 0x7f7d2015aa20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.843+0000 7f7d2860e640 1 --2- 172.21.15.87:0/1082240225 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d2006d6b0 0x7f7d200cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.843+0000 7f7d2860e640 1 -- 172.21.15.87:0/1082240225 >> 172.21.15.87:0/1082240225 conn(0x7f7d2006fa90 msgr2=0x7f7d200c8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.843+0000 7f7d2860e640 1 -- 172.21.15.87:0/1082240225 shutdown_connections 2023-12-16T20:22:07.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.843+0000 7f7d2860e640 1 -- 172.21.15.87:0/1082240225 wait complete. 2023-12-16T20:22:07.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.849+0000 7ff6a67fc640 1 -- 172.21.15.87:0/2272239596 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff6a0058d00 con 0x7ff6b0151630 2023-12-16T20:22:07.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.6 2023-12-16T20:22:07.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.867+0000 7ff6a67fc640 1 -- 172.21.15.87:0/2272239596 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ff6a0054940 con 0x7ff6b0151630 2023-12-16T20:22:07.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.873+0000 7f66897fa640 1 -- 172.21.15.87:0/661040607 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668400cba0 con 0x7f668c14fd70 2023-12-16T20:22:07.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.873+0000 7f66897fa640 1 -- 172.21.15.87:0/661040607 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668400cd20 con 0x7f668c14fd70 2023-12-16T20:22:07.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.873+0000 7f6692c1e640 1 -- 172.21.15.87:0/661040607 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668c14a9e0 con 0x7f668c14fd70 2023-12-16T20:22:07.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.873+0000 7f66897fa640 1 -- 172.21.15.87:0/661040607 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684014680 con 0x7f668c14fd70 2023-12-16T20:22:07.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.873+0000 7f6692c1e640 1 -- 172.21.15.87:0/661040607 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668c14a700 con 0x7f668c14fd70 2023-12-16T20:22:07.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.873+0000 7f091effd640 1 --2- 172.21.15.87:0/2481232452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09200ca280 0x7f09200b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.874+0000 7f6692c1e640 1 -- 172.21.15.87:0/661040607 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668c0c04c0 con 0x7f668c14fd70 2023-12-16T20:22:07.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.878+0000 7fc335ffb640 1 -- 172.21.15.87:0/2272325234 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fc33c044900 con 0x7fc3400c2bf0 2023-12-16T20:22:07.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.878+0000 7fc335ffb640 1 --2- 172.21.15.87:0/2272325234 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc32406aec0 0x7fc32406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.878+0000 7fc3453ed640 1 --2- 172.21.15.87:0/2272325234 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc32406aec0 0x7fc32406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.879+0000 7fc3453ed640 1 --2- 172.21.15.87:0/2272325234 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc32406aec0 0x7fc32406d380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc330009670 tx=0x7fc330006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.882+0000 7f091effd640 1 -- 172.21.15.87:0/2481232452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09200c79f0 msgr2=0x7f09201ed9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.882+0000 7f091effd640 1 --2- 172.21.15.87:0/2481232452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09200c79f0 0x7f09201ed9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.882+0000 7f091effd640 1 -- 172.21.15.87:0/2481232452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09201516c0 msgr2=0x7f0920159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.882+0000 7f091effd640 1 --2- 172.21.15.87:0/2481232452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09201516c0 0x7f0920159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.882+0000 7f091effd640 1 -- 172.21.15.87:0/2481232452 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09140094d0 con 0x7f09200ca280 2023-12-16T20:22:07.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.883+0000 7fc335ffb640 1 -- 172.21.15.87:0/2272325234 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc33c02d040 con 0x7fc3400c2bf0 2023-12-16T20:22:07.894 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.893+0000 7fc335ffb640 1 -- 172.21.15.87:0/2272325234 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fc33c077380 con 0x7fc3400c2bf0 2023-12-16T20:22:07.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.897+0000 7f876affd640 1 -- 172.21.15.87:0/1985454104 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f876401a400 con 0x7f87740c7700 2023-12-16T20:22:07.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.898+0000 7f876affd640 1 --2- 172.21.15.87:0/1985454104 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f875406ae40 0x7f875406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:07.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.898+0000 7f876bfff640 1 --2- 172.21.15.87:0/1985454104 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f875406ae40 0x7f875406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:07.900 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.899+0000 7f876bfff640 1 --2- 172.21.15.87:0/1985454104 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f875406ae40 0x7f875406d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f875c036000 tx=0x7f875c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:07.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.902+0000 7fa00b7fe640 1 -- 172.21.15.87:0/2419264784 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa02406fb20 con 0x7fa0240c7b10 2023-12-16T20:22:07.904 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2023-12-16T20:22:07.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.905+0000 7fa0293b0640 1 -- 172.21.15.87:0/2419264784 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa01006aec0 msgr2=0x7fa01006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.905+0000 7fa0293b0640 1 --2- 172.21.15.87:0/2419264784 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa01006aec0 0x7fa01006d380 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa018036000 tx=0x7fa01803b040 comp rx=0 tx=0).stop 2023-12-16T20:22:07.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.905+0000 7fa0293b0640 1 -- 172.21.15.87:0/2419264784 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0240c7b10 msgr2=0x7fa0241f4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.905+0000 7fa0293b0640 1 --2- 172.21.15.87:0/2419264784 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0240c7b10 0x7fa0241f4340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa01400c3c0 tx=0x7fa01400c880 comp rx=0 tx=0).stop 2023-12-16T20:22:07.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.905+0000 7fa0293b0640 1 -- 172.21.15.87:0/2419264784 shutdown_connections 2023-12-16T20:22:07.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.905+0000 7fa0293b0640 1 --2- 172.21.15.87:0/2419264784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa02415f490 0x7fa02415f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.905+0000 7fa0293b0640 1 --2- 172.21.15.87:0/2419264784 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa01006aec0 0x7fa01006d380 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.905+0000 7fa0293b0640 1 --2- 172.21.15.87:0/2419264784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa024157a60 0x7fa024154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.905+0000 7fa0293b0640 1 --2- 172.21.15.87:0/2419264784 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0240c7b10 0x7fa0241f4340 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.905+0000 7fa0293b0640 1 -- 172.21.15.87:0/2419264784 >> 172.21.15.87:0/2419264784 conn(0x7fa0240c80b0 msgr2=0x7fa0240ca540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.905+0000 7fa0293b0640 1 -- 172.21.15.87:0/2419264784 shutdown_connections 2023-12-16T20:22:07.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.905+0000 7fa0293b0640 1 -- 172.21.15.87:0/2419264784 wait complete. 2023-12-16T20:22:07.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.914+0000 7f876affd640 1 -- 172.21.15.87:0/1985454104 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f876400f2e0 con 0x7f87740c7700 2023-12-16T20:22:07.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.914+0000 7f876affd640 1 -- 172.21.15.87:0/1985454104 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f87640588b0 con 0x7f87740c7700 2023-12-16T20:22:07.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.0 2023-12-16T20:22:07.929 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.928+0000 7effd3fff640 1 -- 172.21.15.87:0/3195200686 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7effdc07a220 con 0x7effec153900 2023-12-16T20:22:07.929 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2023-12-16T20:22:07.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.931+0000 7efff1fc9640 1 -- 172.21.15.87:0/3195200686 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7effd806ae90 msgr2=0x7effd806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.931+0000 7efff1fc9640 1 --2- 172.21.15.87:0/3195200686 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7effd806ae90 0x7effd806d350 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7effe400abb0 tx=0x7effe4009250 comp rx=0 tx=0).stop 2023-12-16T20:22:07.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.931+0000 7efff1fc9640 1 -- 172.21.15.87:0/3195200686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effec153900 msgr2=0x7effec0c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:07.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.931+0000 7efff1fc9640 1 --2- 172.21.15.87:0/3195200686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effec153900 0x7effec0c3170 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7effdc02b8a0 tx=0x7effdc0046c0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.931+0000 7efff1fc9640 1 -- 172.21.15.87:0/3195200686 shutdown_connections 2023-12-16T20:22:07.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.931+0000 7efff1fc9640 1 --2- 172.21.15.87:0/3195200686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effec153900 0x7effec0c3170 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.931+0000 7efff1fc9640 1 --2- 172.21.15.87:0/3195200686 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7effec0caea0 0x7effec0cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.931+0000 7efff1fc9640 1 --2- 172.21.15.87:0/3195200686 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7effd806ae90 0x7effd806d350 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.931+0000 7efff1fc9640 1 --2- 172.21.15.87:0/3195200686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effec0c9e20 0x7effec1f3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:07.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.931+0000 7efff1fc9640 1 -- 172.21.15.87:0/3195200686 >> 172.21.15.87:0/3195200686 conn(0x7effec08afb0 msgr2=0x7effec08b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:07.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.931+0000 7efff1fc9640 1 -- 172.21.15.87:0/3195200686 shutdown_connections 2023-12-16T20:22:07.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:07.931+0000 7efff1fc9640 1 -- 172.21.15.87:0/3195200686 wait complete. 2023-12-16T20:22:07.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.3 2023-12-16T20:22:08.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.051+0000 7ff6b8215640 1 -- 172.21.15.87:0/2272239596 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff6b00740e0 con 0x7ff6b0151630 2023-12-16T20:22:08.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.084+0000 7fc347651640 1 -- 172.21.15.87:0/2272325234 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc3400740e0 con 0x7fc3400c2bf0 2023-12-16T20:22:08.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.089+0000 7fc335ffb640 1 -- 172.21.15.87:0/2272325234 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc33c052090 con 0x7fc3400c2bf0 2023-12-16T20:22:08.090 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2023-12-16T20:22:08.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.090+0000 7fc347651640 1 -- 172.21.15.87:0/2272325234 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc32406aec0 msgr2=0x7fc32406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:08.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.090+0000 7fc347651640 1 --2- 172.21.15.87:0/2272325234 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc32406aec0 0x7fc32406d380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc330009670 tx=0x7fc330006bf0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.090+0000 7fc347651640 1 -- 172.21.15.87:0/2272325234 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3400c2bf0 msgr2=0x7fc340152040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:08.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.090+0000 7fc347651640 1 --2- 172.21.15.87:0/2272325234 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3400c2bf0 0x7fc340152040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009960 tx=0x7fc33c0046c0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.090+0000 7fc347651640 1 -- 172.21.15.87:0/2272325234 shutdown_connections 2023-12-16T20:22:08.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.090+0000 7fc347651640 1 --2- 172.21.15.87:0/2272325234 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc32406aec0 0x7fc32406d380 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.090+0000 7fc347651640 1 --2- 172.21.15.87:0/2272325234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc340150470 0x7fc340155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.090+0000 7fc347651640 1 --2- 172.21.15.87:0/2272325234 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc3400c2bf0 0x7fc340152040 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.090+0000 7fc347651640 1 --2- 172.21.15.87:0/2272325234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc34006eef0 0x7fc3401551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.091+0000 7fc347651640 1 -- 172.21.15.87:0/2272325234 >> 172.21.15.87:0/2272325234 conn(0x7fc340072930 msgr2=0x7fc34006fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:08.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.091+0000 7fc347651640 1 -- 172.21.15.87:0/2272325234 shutdown_connections 2023-12-16T20:22:08.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.091+0000 7fc347651640 1 -- 172.21.15.87:0/2272325234 wait complete. 2023-12-16T20:22:08.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.5 2023-12-16T20:22:08.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.102+0000 7f8778a5c640 1 -- 172.21.15.87:0/1985454104 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8774152dc0 con 0x7f87740c7700 2023-12-16T20:22:08.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.107+0000 7f876affd640 1 -- 172.21.15.87:0/1985454104 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8764015020 con 0x7f87740c7700 2023-12-16T20:22:08.108 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2023-12-16T20:22:08.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.109+0000 7f8778a5c640 1 -- 172.21.15.87:0/1985454104 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f875406ae40 msgr2=0x7f875406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:08.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.109+0000 7f8778a5c640 1 --2- 172.21.15.87:0/1985454104 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f875406ae40 0x7f875406d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f875c036000 tx=0x7f875c008030 comp rx=0 tx=0).stop 2023-12-16T20:22:08.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.109+0000 7f8778a5c640 1 -- 172.21.15.87:0/1985454104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87740c7700 msgr2=0x7f87740c5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:08.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.109+0000 7f8778a5c640 1 --2- 172.21.15.87:0/1985454104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87740c7700 0x7f87740c5110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f876400b410 tx=0x7f876400b8d0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.109+0000 7f8778a5c640 1 -- 172.21.15.87:0/1985454104 shutdown_connections 2023-12-16T20:22:08.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.109+0000 7f8778a5c640 1 --2- 172.21.15.87:0/1985454104 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f875406ae40 0x7f875406d300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.109+0000 7f8778a5c640 1 --2- 172.21.15.87:0/1985454104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87741537e0 0x7f8774148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.109+0000 7f8778a5c640 1 --2- 172.21.15.87:0/1985454104 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f87740ca0c0 0x7f877406b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.109+0000 7f8778a5c640 1 --2- 172.21.15.87:0/1985454104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87740c7700 0x7f87740c5110 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.109+0000 7f8778a5c640 1 -- 172.21.15.87:0/1985454104 >> 172.21.15.87:0/1985454104 conn(0x7f8774061100 msgr2=0x7f87740614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:08.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.109+0000 7f8778a5c640 1 -- 172.21.15.87:0/1985454104 shutdown_connections 2023-12-16T20:22:08.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.109+0000 7f8778a5c640 1 -- 172.21.15.87:0/1985454104 wait complete. 2023-12-16T20:22:08.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.2 2023-12-16T20:22:08.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.124+0000 7f091effd640 1 --2- 172.21.15.87:0/2481232452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09200ca280 0x7f09200b14c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0914033000 tx=0x7f09140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:08.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.143+0000 7f66897fa640 1 -- 172.21.15.87:0/661040607 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f668401d3b0 con 0x7f668c14fd70 2023-12-16T20:22:08.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.143+0000 7f66897fa640 1 --2- 172.21.15.87:0/661040607 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f667006ae90 0x7f667006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:08.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.144+0000 7f66909ba640 1 --2- 172.21.15.87:0/661040607 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f667006ae90 0x7f667006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:08.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.144+0000 7f66909ba640 1 --2- 172.21.15.87:0/661040607 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f667006ae90 0x7f667006d350 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6680009670 tx=0x7f6680006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:08.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.147+0000 7f66897fa640 1 -- 172.21.15.87:0/661040607 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6684058eb0 con 0x7f668c14fd70 2023-12-16T20:22:08.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.157+0000 7f66897fa640 1 -- 172.21.15.87:0/661040607 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f6684054af0 con 0x7f668c14fd70 2023-12-16T20:22:08.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.204+0000 7ff6a67fc640 1 -- 172.21.15.87:0/2272239596 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff6a0015070 con 0x7ff6b0151630 2023-12-16T20:22:08.206 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2023-12-16T20:22:08.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.207+0000 7ff6b8215640 1 -- 172.21.15.87:0/2272239596 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff69406ae40 msgr2=0x7ff69406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:08.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.207+0000 7ff6b8215640 1 --2- 172.21.15.87:0/2272239596 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff69406ae40 0x7ff69406d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac036000 tx=0x7ff6ac03b040 comp rx=0 tx=0).stop 2023-12-16T20:22:08.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.207+0000 7ff6b8215640 1 -- 172.21.15.87:0/2272239596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6b0151630 msgr2=0x7ff6b0070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:08.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.207+0000 7ff6b8215640 1 --2- 172.21.15.87:0/2272239596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6b0151630 0x7ff6b0070d20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000b3e0 tx=0x7ff6a000b8a0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.207+0000 7ff6b8215640 1 -- 172.21.15.87:0/2272239596 shutdown_connections 2023-12-16T20:22:08.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.207+0000 7ff6b8215640 1 --2- 172.21.15.87:0/2272239596 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6b0157f50 0x7ff6b0144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.207+0000 7ff6b8215640 1 --2- 172.21.15.87:0/2272239596 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff69406ae40 0x7ff69406d300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.207+0000 7ff6b8215640 1 --2- 172.21.15.87:0/2272239596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6b0151630 0x7ff6b0070d20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.207+0000 7ff6b8215640 1 --2- 172.21.15.87:0/2272239596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6b00c2000 0x7ff6b01460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.207+0000 7ff6b8215640 1 -- 172.21.15.87:0/2272239596 >> 172.21.15.87:0/2272239596 conn(0x7ff6b0061100 msgr2=0x7ff6b00614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:08.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.207+0000 7ff6b8215640 1 -- 172.21.15.87:0/2272239596 shutdown_connections 2023-12-16T20:22:08.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.207+0000 7ff6b8215640 1 -- 172.21.15.87:0/2272239596 wait complete. 2023-12-16T20:22:08.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.4 2023-12-16T20:22:08.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.222+0000 7f0907fff640 1 -- 172.21.15.87:0/2481232452 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091403adf0 con 0x7f09200ca280 2023-12-16T20:22:08.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.222+0000 7f0907fff640 1 -- 172.21.15.87:0/2481232452 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09140443f0 con 0x7f09200ca280 2023-12-16T20:22:08.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.222+0000 7f0907fff640 1 -- 172.21.15.87:0/2481232452 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09140447a0 con 0x7f09200ca280 2023-12-16T20:22:08.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.222+0000 7f0926251640 1 -- 172.21.15.87:0/2481232452 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09200c9990 con 0x7f09200ca280 2023-12-16T20:22:08.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.222+0000 7f0926251640 1 -- 172.21.15.87:0/2481232452 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0920158c50 con 0x7f09200ca280 2023-12-16T20:22:08.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.223+0000 7f0926251640 1 -- 172.21.15.87:0/2481232452 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09200ca030 con 0x7f09200ca280 2023-12-16T20:22:08.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.329+0000 7f6692c1e640 1 -- 172.21.15.87:0/661040607 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f668c1565a0 con 0x7f668c14fd70 2023-12-16T20:22:08.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.471+0000 7f0907fff640 1 -- 172.21.15.87:0/2481232452 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f091404d450 con 0x7f09200ca280 2023-12-16T20:22:08.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.472+0000 7f0907fff640 1 --2- 172.21.15.87:0/2481232452 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f090c06ae40 0x7f090c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:08.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.472+0000 7f091f7fe640 1 --2- 172.21.15.87:0/2481232452 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f090c06ae40 0x7f090c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:08.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.472+0000 7f091f7fe640 1 --2- 172.21.15.87:0/2481232452 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f090c06ae40 0x7f090c06d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0910009670 tx=0x7f0910006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:08.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.476+0000 7f0907fff640 1 -- 172.21.15.87:0/2481232452 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f091402d040 con 0x7f09200ca280 2023-12-16T20:22:08.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.495+0000 7f0907fff640 1 -- 172.21.15.87:0/2481232452 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f0914077310 con 0x7f09200ca280 2023-12-16T20:22:08.497 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.496+0000 7f66897fa640 1 -- 172.21.15.87:0/661040607 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6684019070 con 0x7f668c14fd70 2023-12-16T20:22:08.497 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2023-12-16T20:22:08.500 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.498+0000 7f6692c1e640 1 -- 172.21.15.87:0/661040607 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f667006ae90 msgr2=0x7f667006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:08.500 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.498+0000 7f6692c1e640 1 --2- 172.21.15.87:0/661040607 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f667006ae90 0x7f667006d350 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6680009670 tx=0x7f6680006bf0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.500 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.498+0000 7f6692c1e640 1 -- 172.21.15.87:0/661040607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f668c14fd70 msgr2=0x7f668c14b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:08.500 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.498+0000 7f6692c1e640 1 --2- 172.21.15.87:0/661040607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f668c14fd70 0x7f668c14b7a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f668400b9a0 tx=0x7f668400be60 comp rx=0 tx=0).stop 2023-12-16T20:22:08.500 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.498+0000 7f6692c1e640 1 -- 172.21.15.87:0/661040607 shutdown_connections 2023-12-16T20:22:08.500 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.498+0000 7f6692c1e640 1 --2- 172.21.15.87:0/661040607 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f667006ae90 0x7f667006d350 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.500 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.498+0000 7f6692c1e640 1 --2- 172.21.15.87:0/661040607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f668c14fd70 0x7f668c14b7a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.501 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.498+0000 7f6692c1e640 1 --2- 172.21.15.87:0/661040607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f668c0c7eb0 0x7f668c1e2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.501 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.498+0000 7f6692c1e640 1 --2- 172.21.15.87:0/661040607 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f668c071c40 0x7f668c1f0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.501 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.498+0000 7f6692c1e640 1 -- 172.21.15.87:0/661040607 >> 172.21.15.87:0/661040607 conn(0x7f668c06cd60 msgr2=0x7f668c06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:08.501 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.498+0000 7f6692c1e640 1 -- 172.21.15.87:0/661040607 shutdown_connections 2023-12-16T20:22:08.501 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.498+0000 7f6692c1e640 1 -- 172.21.15.87:0/661040607 wait complete. 2023-12-16T20:22:08.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.1 2023-12-16T20:22:08.667 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.665+0000 7f0926251640 1 -- 172.21.15.87:0/2481232452 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f09200740e0 con 0x7f09200ca280 2023-12-16T20:22:08.671 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.670+0000 7f0907fff640 1 -- 172.21.15.87:0/2481232452 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f091407a930 con 0x7f09200ca280 2023-12-16T20:22:08.671 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2023-12-16T20:22:08.673 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.671+0000 7f0926251640 1 -- 172.21.15.87:0/2481232452 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f090c06ae40 msgr2=0x7f090c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:08.673 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.671+0000 7f0926251640 1 --2- 172.21.15.87:0/2481232452 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f090c06ae40 0x7f090c06d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0910009670 tx=0x7f0910006bf0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.673 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.671+0000 7f0926251640 1 -- 172.21.15.87:0/2481232452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09200ca280 msgr2=0x7f09200b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:08.673 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.671+0000 7f0926251640 1 --2- 172.21.15.87:0/2481232452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09200ca280 0x7f09200b14c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0914033000 tx=0x7f09140046c0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.673 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.671+0000 7f0926251640 1 -- 172.21.15.87:0/2481232452 shutdown_connections 2023-12-16T20:22:08.673 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.671+0000 7f0926251640 1 --2- 172.21.15.87:0/2481232452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09201516c0 0x7f0920159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.673 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.671+0000 7f0926251640 1 --2- 172.21.15.87:0/2481232452 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f090c06ae40 0x7f090c06d300 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.673 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.671+0000 7f0926251640 1 --2- 172.21.15.87:0/2481232452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09200ca280 0x7f09200b14c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.673 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.671+0000 7f0926251640 1 --2- 172.21.15.87:0/2481232452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09200c79f0 0x7f09201ed9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.673 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.671+0000 7f0926251640 1 -- 172.21.15.87:0/2481232452 >> 172.21.15.87:0/2481232452 conn(0x7f092006a8f0 msgr2=0x7f092014ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:08.674 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.671+0000 7f0926251640 1 -- 172.21.15.87:0/2481232452 shutdown_connections 2023-12-16T20:22:08.674 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.671+0000 7f0926251640 1 -- 172.21.15.87:0/2481232452 wait complete. 2023-12-16T20:22:08.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.7 2023-12-16T20:22:08.856 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-16T20:22:08.919 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-16T20:22:08.950 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-16T20:22:08.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.960+0000 7fa7ec5a5640 1 Processor -- start 2023-12-16T20:22:08.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.960+0000 7fa7ec5a5640 1 -- start start 2023-12-16T20:22:08.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.961+0000 7fa7ec5a5640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa7e4151760 0x7fa7e415b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:08.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.961+0000 7fa7ec5a5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7e4157320 0x7fa7e40c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:08.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.961+0000 7fa7ec5a5640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e40c5920 con 0x7fa7e406f6e0 2023-12-16T20:22:08.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.961+0000 7fa7ec5a5640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e40c63d0 con 0x7fa7e4151760 2023-12-16T20:22:08.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.961+0000 7fa7ec5a5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e40702a0 con 0x7fa7e4157320 2023-12-16T20:22:08.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.963+0000 7fa7ea341640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa7e4151760 0x7fa7e415b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:08.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.963+0000 7fa7e9b40640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fa7e406f6e0 0x7fa7e40c5cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:44978/0 (socket says 172.21.15.87:44978) 2023-12-16T20:22:08.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.963+0000 7fa7e9b40640 1 -- 172.21.15.87:0/3796437718 learned_addr learned my addr 172.21.15.87:0/3796437718 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:08.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.964+0000 7fa7eab42640 1 --2- 172.21.15.87:0/3796437718 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7e4157320 0x7fa7e40c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:08.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.968+0000 7fa7ea341640 1 -- 172.21.15.87:0/3796437718 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7e4157320 msgr2=0x7fa7e40c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:08.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.968+0000 7fa7ea341640 1 --2- 172.21.15.87:0/3796437718 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7e4157320 0x7fa7e40c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:08.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.968+0000 7fa7ea341640 1 -- 172.21.15.87:0/3796437718 >> v1:172.21.15.195:6789/0 conn(0x7fa7e406f6e0 legacy=0x7fa7e40c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:08.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:08.968+0000 7fa7ea341640 1 -- 172.21.15.87:0/3796437718 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e40c8390 con 0x7fa7e4151760 2023-12-16T20:22:09.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.022+0000 7fa7ea341640 1 --2- 172.21.15.87:0/3796437718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7e4151760 0x7fa7e415b520 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00097a0 tx=0x7fa7e002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fda71bca558a7e5b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.023+0000 7ff5e2378640 1 Processor -- start 2023-12-16T20:22:09.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.023+0000 7ff5e2378640 1 -- start start 2023-12-16T20:22:09.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.023+0000 7ff5e2378640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff5dc1537d0 0x7ff5dc06a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.024+0000 7ff5e2378640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5dc06e0f0 con 0x7ff5dc06f160 2023-12-16T20:22:09.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.024+0000 7ff5e2378640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5dc159710 con 0x7ff5dc0c2e40 2023-12-16T20:22:09.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.024+0000 7ff5e2378640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5dc0c72d0 con 0x7ff5dc1537d0 2023-12-16T20:22:09.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.027+0000 7ff5e0915640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7ff5dc0c2e40 0x7ff5dc163f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:44982/0 (socket says 172.21.15.87:44982) 2023-12-16T20:22:09.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.027+0000 7ff5e0915640 1 -- 172.21.15.87:0/3950741688 learned_addr learned my addr 172.21.15.87:0/3950741688 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:09.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.029+0000 7fa7e933f640 1 -- 172.21.15.87:0/3796437718 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0031830 con 0x7fa7e4151760 2023-12-16T20:22:09.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.029+0000 7fa7e933f640 1 -- 172.21.15.87:0/3796437718 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e0031990 con 0x7fa7e4151760 2023-12-16T20:22:09.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.029+0000 7fa7e933f640 1 -- 172.21.15.87:0/3796437718 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0031d20 con 0x7fa7e4151760 2023-12-16T20:22:09.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.030+0000 7fa7ec5a5640 1 -- 172.21.15.87:0/3796437718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7e4151760 msgr2=0x7fa7e415b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.030+0000 7fa7ec5a5640 1 --2- 172.21.15.87:0/3796437718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7e4151760 0x7fa7e415b520 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00097a0 tx=0x7fa7e002b8d0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.030+0000 7fa7ec5a5640 1 -- 172.21.15.87:0/3796437718 shutdown_connections 2023-12-16T20:22:09.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.030+0000 7fa7ec5a5640 1 --2- 172.21.15.87:0/3796437718 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7e4157320 0x7fa7e40c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.030+0000 7fa7ec5a5640 1 --2- 172.21.15.87:0/3796437718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7e4151760 0x7fa7e415b520 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.030+0000 7fa7ec5a5640 1 -- 172.21.15.87:0/3796437718 >> 172.21.15.87:0/3796437718 conn(0x7fa7e4072930 msgr2=0x7fa7e40cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:09.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.030+0000 7fa7ec5a5640 1 -- 172.21.15.87:0/3796437718 shutdown_connections 2023-12-16T20:22:09.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.030+0000 7fa7ec5a5640 1 -- 172.21.15.87:0/3796437718 wait complete. 2023-12-16T20:22:09.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.031+0000 7fa7ec5a5640 1 Processor -- start 2023-12-16T20:22:09.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.031+0000 7fa7ec5a5640 1 -- start start 2023-12-16T20:22:09.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.032+0000 7fa7ec5a5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7e406f6e0 0x7fa7e41501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.032+0000 7fa7ec5a5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7e4151760 0x7fa7e41e26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.032+0000 7fa7ec5a5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7e4157320 0x7fa7e41e2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.032+0000 7fa7ec5a5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e40cc330 con 0x7fa7e406f6e0 2023-12-16T20:22:09.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.032+0000 7fa7ec5a5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e40c2c70 con 0x7fa7e4157320 2023-12-16T20:22:09.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.032+0000 7fa7ec5a5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e41f28a0 con 0x7fa7e4151760 2023-12-16T20:22:09.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.032+0000 7fa7e9b40640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7e4151760 0x7fa7e41e26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.033+0000 7fa7e9b40640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7e4151760 0x7fa7e41e26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:35566/0 (socket says 172.21.15.87:35566) 2023-12-16T20:22:09.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.033+0000 7fa7e9b40640 1 -- 172.21.15.87:0/76241748 learned_addr learned my addr 172.21.15.87:0/76241748 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:09.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.035+0000 7ff5daffd640 1 -- 172.21.15.87:0/3950741688 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524662605 0 0) 0x7ff5dc159710 con 0x7ff5dc0c2e40 2023-12-16T20:22:09.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.036+0000 7ff5daffd640 1 -- 172.21.15.87:0/3950741688 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5c4003520 con 0x7ff5dc0c2e40 2023-12-16T20:22:09.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.036+0000 7fa7ea341640 1 --2- 172.21.15.87:0/76241748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7e406f6e0 0x7fa7e41501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.037+0000 7fa7e9b40640 1 -- 172.21.15.87:0/76241748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7e4157320 msgr2=0x7fa7e41e2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.037+0000 7fa7e9b40640 1 --2- 172.21.15.87:0/76241748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7e4157320 0x7fa7e41e2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.037+0000 7fa7e9b40640 1 -- 172.21.15.87:0/76241748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7e406f6e0 msgr2=0x7fa7e41501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.037+0000 7fa7e9b40640 1 --2- 172.21.15.87:0/76241748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7e406f6e0 0x7fa7e41501b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.037+0000 7fa7e9b40640 1 -- 172.21.15.87:0/76241748 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0009400 con 0x7fa7e4151760 2023-12-16T20:22:09.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.039+0000 7ff5dbfff640 1 --2- 172.21.15.87:0/3950741688 >> v2:172.21.15.87:3300/0 conn(0x7ff5dc1537d0 0x7ff5dc06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.039+0000 7fa7e9b40640 1 --2- 172.21.15.87:0/76241748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7e4151760 0x7fa7e41e26c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa7d400c370 tx=0x7fa7d400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.042+0000 7ff5daffd640 1 -- 172.21.15.87:0/3950741688 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260596702 0 0) 0x7ff5dc06e0f0 con 0x7ff5dc06f160 2023-12-16T20:22:09.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.042+0000 7ff5daffd640 1 -- 172.21.15.87:0/3950741688 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5dc159710 con 0x7ff5dc06f160 2023-12-16T20:22:09.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.043+0000 7fa7daffd640 1 -- 172.21.15.87:0/76241748 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4005ce0 con 0x7fa7e4151760 2023-12-16T20:22:09.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.043+0000 7fa7daffd640 1 -- 172.21.15.87:0/76241748 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d4005e40 con 0x7fa7e4151760 2023-12-16T20:22:09.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.043+0000 7fa7ec5a5640 1 -- 172.21.15.87:0/76241748 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e41f2b80 con 0x7fa7e4151760 2023-12-16T20:22:09.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.043+0000 7fa7daffd640 1 -- 172.21.15.87:0/76241748 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4007310 con 0x7fa7e4151760 2023-12-16T20:22:09.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.044+0000 7fa7ec5a5640 1 -- 172.21.15.87:0/76241748 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e41f3140 con 0x7fa7e4151760 2023-12-16T20:22:09.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.045+0000 7fa7ec5a5640 1 -- 172.21.15.87:0/76241748 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e40740e0 con 0x7fa7e4151760 2023-12-16T20:22:09.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.046+0000 7ff5dbfff640 1 -- 172.21.15.87:0/3950741688 >> v1:172.21.15.195:6789/0 conn(0x7ff5dc0c2e40 legacy=0x7ff5dc163f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.046+0000 7ff5dbfff640 1 -- 172.21.15.87:0/3950741688 >> v1:172.21.15.87:6789/0 conn(0x7ff5dc06f160 legacy=0x7ff5dc159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.046+0000 7ff5dbfff640 1 -- 172.21.15.87:0/3950741688 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc0c7590 con 0x7ff5dc1537d0 2023-12-16T20:22:09.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.066+0000 7f4caf475640 1 Processor -- start 2023-12-16T20:22:09.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.066+0000 7f4caf475640 1 -- start start 2023-12-16T20:22:09.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.067+0000 7f4caf475640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4ca8151130 0x7f4ca806f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.067+0000 7f4caf475640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ca80b2060 0x7f4ca8157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.067+0000 7f4caf475640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca8157350 con 0x7f4ca8158000 2023-12-16T20:22:09.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.067+0000 7f4caf475640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca81576a0 con 0x7f4ca8151130 2023-12-16T20:22:09.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.067+0000 7f4caf475640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca815a940 con 0x7f4ca80b2060 2023-12-16T20:22:09.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.098+0000 7ff5dbfff640 1 --2- 172.21.15.87:0/3950741688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5dc1537d0 0x7ff5dc06a500 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0097a0 tx=0x7ff5cc02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbf8bd929f13516 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.102+0000 7f4cad211640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4ca8151130 0x7f4ca806f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.102+0000 7f4cada12640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f4ca8158000 0x7f4ca80ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55012/0 (socket says 172.21.15.87:55012) 2023-12-16T20:22:09.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.102+0000 7f4cada12640 1 -- 172.21.15.87:0/3654594940 learned_addr learned my addr 172.21.15.87:0/3654594940 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:09.104 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-16T20:22:09.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.108+0000 7ff5daffd640 1 -- 172.21.15.87:0/3950741688 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc02f810 con 0x7ff5dc1537d0 2023-12-16T20:22:09.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.108+0000 7ff5daffd640 1 -- 172.21.15.87:0/3950741688 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc02f970 con 0x7ff5dc1537d0 2023-12-16T20:22:09.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.108+0000 7ff5daffd640 1 -- 172.21.15.87:0/3950741688 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc02fd00 con 0x7ff5dc1537d0 2023-12-16T20:22:09.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.109+0000 7ff5e2378640 1 -- 172.21.15.87:0/3950741688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5dc1537d0 msgr2=0x7ff5dc06a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.109+0000 7ff5e2378640 1 --2- 172.21.15.87:0/3950741688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5dc1537d0 0x7ff5dc06a500 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0097a0 tx=0x7ff5cc02b9f0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.109+0000 7ff5e2378640 1 -- 172.21.15.87:0/3950741688 shutdown_connections 2023-12-16T20:22:09.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.109+0000 7ff5e2378640 1 --2- 172.21.15.87:0/3950741688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5dc1537d0 0x7ff5dc06a500 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.109+0000 7ff5e2378640 1 -- 172.21.15.87:0/3950741688 >> 172.21.15.87:0/3950741688 conn(0x7ff5dc0cbf60 msgr2=0x7ff5dc0cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:09.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.109+0000 7ff5e2378640 1 -- 172.21.15.87:0/3950741688 shutdown_connections 2023-12-16T20:22:09.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.109+0000 7ff5e2378640 1 -- 172.21.15.87:0/3950741688 wait complete. 2023-12-16T20:22:09.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.110+0000 7f4cad211640 1 -- 172.21.15.87:0/3654594940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ca80b2060 msgr2=0x7f4ca8157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:09.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.110+0000 7f4cad211640 1 --2- 172.21.15.87:0/3654594940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ca80b2060 0x7f4ca8157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.110+0000 7f4cad211640 1 -- 172.21.15.87:0/3654594940 >> v1:172.21.15.87:6789/0 conn(0x7f4ca8158000 legacy=0x7f4ca80ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.110+0000 7f4cad211640 1 -- 172.21.15.87:0/3654594940 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca80c8a20 con 0x7f4ca8151130 2023-12-16T20:22:09.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.110+0000 7ff5e2378640 1 Processor -- start 2023-12-16T20:22:09.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.110+0000 7ff5e2378640 1 -- start start 2023-12-16T20:22:09.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.111+0000 7ff5e2378640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5dc06f160 0x7ff5dc149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.111+0000 7ff5e2378640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5dc0c2e40 0x7ff5dc0c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.111+0000 7ff5e2378640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff5dc1537d0 0x7ff5dc1469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.111+0000 7ff5e2378640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc0c5040 con 0x7ff5dc06f160 2023-12-16T20:22:09.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.111+0000 7ff5e2378640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc15d760 con 0x7ff5dc0c2e40 2023-12-16T20:22:09.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.111+0000 7ff5e2378640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc15da00 con 0x7ff5dc1537d0 2023-12-16T20:22:09.116 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.115+0000 7ff5dbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5dc06f160 0x7ff5dc149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.116 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.115+0000 7f4cad211640 1 --2- 172.21.15.87:0/3654594940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ca8151130 0x7f4ca806f4d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4c980097a0 tx=0x7f4c9802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8321ecb043eecced server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.118+0000 7ff5dbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5dc06f160 0x7ff5dc149510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55854/0 (socket says 172.21.15.87:55854) 2023-12-16T20:22:09.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.118+0000 7ff5dbfff640 1 -- 172.21.15.87:0/3777275336 learned_addr learned my addr 172.21.15.87:0/3777275336 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:09.121 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.119+0000 7f4c9ffff640 1 -- 172.21.15.87:0/3654594940 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98031830 con 0x7f4ca8151130 2023-12-16T20:22:09.121 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.119+0000 7f4c9ffff640 1 -- 172.21.15.87:0/3654594940 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c98031990 con 0x7f4ca8151130 2023-12-16T20:22:09.121 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.120+0000 7f4c9ffff640 1 -- 172.21.15.87:0/3654594940 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98031d20 con 0x7f4ca8151130 2023-12-16T20:22:09.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.120+0000 7f4caf475640 1 -- 172.21.15.87:0/3654594940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ca8151130 msgr2=0x7f4ca806f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.120+0000 7f4caf475640 1 --2- 172.21.15.87:0/3654594940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ca8151130 0x7f4ca806f4d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4c980097a0 tx=0x7f4c9802b8d0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.120+0000 7f4caf475640 1 -- 172.21.15.87:0/3654594940 shutdown_connections 2023-12-16T20:22:09.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.120+0000 7f4caf475640 1 --2- 172.21.15.87:0/3654594940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ca80b2060 0x7f4ca8157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.120+0000 7f4caf475640 1 --2- 172.21.15.87:0/3654594940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ca8151130 0x7f4ca806f4d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.120+0000 7f4caf475640 1 -- 172.21.15.87:0/3654594940 >> 172.21.15.87:0/3654594940 conn(0x7f4ca8061100 msgr2=0x7f4ca80614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:09.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.120+0000 7f4caf475640 1 -- 172.21.15.87:0/3654594940 shutdown_connections 2023-12-16T20:22:09.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.120+0000 7f4caf475640 1 -- 172.21.15.87:0/3654594940 wait complete. 2023-12-16T20:22:09.122 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-16T20:22:09.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.122+0000 7f4caf475640 1 Processor -- start 2023-12-16T20:22:09.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.122+0000 7f4caf475640 1 -- start start 2023-12-16T20:22:09.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.122+0000 7ff5dbfff640 1 -- 172.21.15.87:0/3777275336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff5dc1537d0 msgr2=0x7ff5dc1469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.122+0000 7ff5dbfff640 1 --2- 172.21.15.87:0/3777275336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff5dc1537d0 0x7ff5dc1469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.122+0000 7ff5dbfff640 1 -- 172.21.15.87:0/3777275336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5dc0c2e40 msgr2=0x7ff5dc0c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.122+0000 7ff5dbfff640 1 --2- 172.21.15.87:0/3777275336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5dc0c2e40 0x7ff5dc0c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.122+0000 7ff5dbfff640 1 -- 172.21.15.87:0/3777275336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc009400 con 0x7ff5dc06f160 2023-12-16T20:22:09.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.122+0000 7f4caf475640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca80b2060 0x7f4ca814c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.122+0000 7f4caf475640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ca8151130 0x7f4ca806baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.122+0000 7f4caf475640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ca8158000 0x7f4ca80c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.122+0000 7f4caf475640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca80c4ec0 con 0x7f4ca8158000 2023-12-16T20:22:09.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.122+0000 7f4caf475640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca806d380 con 0x7f4ca80b2060 2023-12-16T20:22:09.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.122+0000 7f4caf475640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca806d0a0 con 0x7f4ca8151130 2023-12-16T20:22:09.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.126+0000 7ff5dbfff640 1 --2- 172.21.15.87:0/3777275336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5dc06f160 0x7ff5dc149510 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0098c0 tx=0x7ff5cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.130+0000 7f4cada12640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ca8158000 0x7f4ca80c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.131+0000 7f4cada12640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ca8158000 0x7f4ca80c6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55862/0 (socket says 172.21.15.87:55862) 2023-12-16T20:22:09.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.131+0000 7f4cada12640 1 -- 172.21.15.87:0/3955237252 learned_addr learned my addr 172.21.15.87:0/3955237252 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:09.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.133+0000 7ff5d8ff9640 1 -- 172.21.15.87:0/3777275336 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc046070 con 0x7ff5dc06f160 2023-12-16T20:22:09.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.133+0000 7ff5d8ff9640 1 -- 172.21.15.87:0/3777275336 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc037610 con 0x7ff5dc06f160 2023-12-16T20:22:09.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.133+0000 7ff5d8ff9640 1 -- 172.21.15.87:0/3777275336 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc03b040 con 0x7ff5dc06f160 2023-12-16T20:22:09.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.133+0000 7ff5e2378640 1 -- 172.21.15.87:0/3777275336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5dc15bed0 con 0x7ff5dc06f160 2023-12-16T20:22:09.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.133+0000 7ff5e2378640 1 -- 172.21.15.87:0/3777275336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5dc15c490 con 0x7ff5dc06f160 2023-12-16T20:22:09.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.134+0000 7ff5e2378640 1 -- 172.21.15.87:0/3777275336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5dc15c620 con 0x7ff5dc06f160 2023-12-16T20:22:09.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.137+0000 7f4cada12640 1 -- 172.21.15.87:0/3955237252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ca8151130 msgr2=0x7f4ca806baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.137+0000 7f4cada12640 1 --2- 172.21.15.87:0/3955237252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ca8151130 0x7f4ca806baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.137+0000 7f4cada12640 1 -- 172.21.15.87:0/3955237252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca80b2060 msgr2=0x7f4ca814c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.137+0000 7f4cada12640 1 --2- 172.21.15.87:0/3955237252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca80b2060 0x7f4ca814c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.137+0000 7f4cada12640 1 -- 172.21.15.87:0/3955237252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c98009400 con 0x7f4ca8158000 2023-12-16T20:22:09.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.139+0000 7f4cada12640 1 --2- 172.21.15.87:0/3955237252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ca8158000 0x7f4ca80c6020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000cbc0 tx=0x7f4ca000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.176+0000 7ff5d8ff9640 1 -- 172.21.15.87:0/3777275336 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ff5cc0379c0 con 0x7ff5dc06f160 2023-12-16T20:22:09.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.176+0000 7ff5d8ff9640 1 --2- 172.21.15.87:0/3777275336 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff5c806ae90 0x7ff5c806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.176+0000 7ff5db7fe640 1 --2- 172.21.15.87:0/3777275336 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff5c806ae90 0x7ff5c806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.177+0000 7ff5db7fe640 1 --2- 172.21.15.87:0/3777275336 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff5c806ae90 0x7ff5c806d350 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00011e0 tx=0x7ff5d00078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.208+0000 7f7be8183640 1 Processor -- start 2023-12-16T20:22:09.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.208+0000 7f7be8183640 1 -- start start 2023-12-16T20:22:09.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.209+0000 7f7be8183640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7be0153890 0x7f7be015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.209+0000 7f7be8183640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7be00ceef0 0x7f7be00cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.209+0000 7f7be8183640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be015a700 con 0x7f7be0153c70 2023-12-16T20:22:09.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.209+0000 7f7be8183640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be00ca870 con 0x7f7be0153890 2023-12-16T20:22:09.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.209+0000 7f7be8183640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be0159af0 con 0x7f7be00ceef0 2023-12-16T20:22:09.220 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-16T20:22:09.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.228+0000 7f7ef99ec640 1 Processor -- start 2023-12-16T20:22:09.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.228+0000 7f7ef99ec640 1 -- start start 2023-12-16T20:22:09.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.228+0000 7f7ef99ec640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7ef40ca280 0x7f7ef40c2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.228+0000 7f7ef99ec640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef4158440 con 0x7f7ef40c79f0 2023-12-16T20:22:09.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.228+0000 7f7ef99ec640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef4157550 con 0x7f7ef41516c0 2023-12-16T20:22:09.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.228+0000 7f7ef99ec640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40c3c50 con 0x7f7ef40ca280 2023-12-16T20:22:09.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.229+0000 7f7ef2ffd640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f7ef41516c0 0x7f7ef415b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:44990/0 (socket says 172.21.15.87:44990) 2023-12-16T20:22:09.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.229+0000 7f7ef2ffd640 1 -- 172.21.15.87:0/4198789434 learned_addr learned my addr 172.21.15.87:0/4198789434 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:09.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.293+0000 7fa7daffd640 1 -- 172.21.15.87:0/76241748 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fa7d4007470 con 0x7fa7e4151760 2023-12-16T20:22:09.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.293+0000 7fa7daffd640 1 --2- 172.21.15.87:0/76241748 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa7c806aec0 0x7fa7c806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.293+0000 7fa7ea341640 1 --2- 172.21.15.87:0/76241748 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa7c806aec0 0x7fa7c806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.294+0000 7fa7ea341640 1 --2- 172.21.15.87:0/76241748 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa7c806aec0 0x7fa7c806d380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0036000 tx=0x7fa7e003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.296+0000 7fa7daffd640 1 -- 172.21.15.87:0/76241748 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa7d4007720 con 0x7fa7e4151760 2023-12-16T20:22:09.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.306+0000 7fa7daffd640 1 -- 172.21.15.87:0/76241748 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fa7d4053ff0 con 0x7fa7e4151760 2023-12-16T20:22:09.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.310+0000 7f7be6720640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7be00ceef0 0x7f7be00cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.310+0000 7f7be6720640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7be00ceef0 0x7f7be00cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:35596/0 (socket says 172.21.15.87:35596) 2023-12-16T20:22:09.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.310+0000 7f7be6720640 1 -- 172.21.15.87:0/2376946337 learned_addr learned my addr 172.21.15.87:0/2376946337 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:09.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.310+0000 7f7ef37fe640 1 --2- 172.21.15.87:0/4198789434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7ef40ca280 0x7f7ef40c2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.314+0000 7f7be6720640 1 -- 172.21.15.87:0/2376946337 >> v2:172.21.15.87:3300/0 conn(0x7f7be0153890 msgr2=0x7f7be015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:09.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.314+0000 7f7be6720640 1 --2- 172.21.15.87:0/2376946337 >> v2:172.21.15.87:3300/0 conn(0x7f7be0153890 0x7f7be015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.314+0000 7f7be6720640 1 -- 172.21.15.87:0/2376946337 >> v1:172.21.15.87:6789/0 conn(0x7f7be0153c70 legacy=0x7f7be00c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:09.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.314+0000 7f7be6720640 1 -- 172.21.15.87:0/2376946337 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be0159dd0 con 0x7f7be00ceef0 2023-12-16T20:22:09.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.319+0000 7f7be6720640 1 --2- 172.21.15.87:0/2376946337 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7be00ceef0 0x7f7be00cf320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8009e50 tx=0x7f7bd802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56c11e2e6645e487 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.321+0000 7f7ef37fe640 1 -- 172.21.15.87:0/4198789434 >> v1:172.21.15.195:6789/0 conn(0x7f7ef41516c0 legacy=0x7f7ef415b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.321+0000 7f7ef37fe640 1 -- 172.21.15.87:0/4198789434 >> v1:172.21.15.87:6789/0 conn(0x7f7ef40c79f0 legacy=0x7f7ef4070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:09.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.321+0000 7f7ef37fe640 1 -- 172.21.15.87:0/4198789434 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef4157830 con 0x7f7ef40ca280 2023-12-16T20:22:09.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.321+0000 7f1bf9e7c640 1 Processor -- start 2023-12-16T20:22:09.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.321+0000 7f1bf9e7c640 1 -- start start 2023-12-16T20:22:09.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.322+0000 7f1bf9e7c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1bf4153890 0x7f1bf415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.322+0000 7f1bf9e7c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bf4153c70 0x7f1bf40c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.322+0000 7f1bf9e7c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf415a700 con 0x7f1bf40ceef0 2023-12-16T20:22:09.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.322+0000 7f1bf9e7c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf40ca870 con 0x7f1bf4153890 2023-12-16T20:22:09.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.322+0000 7f1bf9e7c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf4159af0 con 0x7f1bf4153c70 2023-12-16T20:22:09.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.323+0000 7f1bf3fff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f1bf40ceef0 0x7f1bf415aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:44996/0 (socket says 172.21.15.87:44996) 2023-12-16T20:22:09.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.323+0000 7f1bf3fff640 1 -- 172.21.15.87:0/3768047593 learned_addr learned my addr 172.21.15.87:0/3768047593 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:09.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.369+0000 7f7ef37fe640 1 --2- 172.21.15.87:0/4198789434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7ef40ca280 0x7f7ef40c2280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec02be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a582c659c371f4a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.371+0000 7f7be4f1d640 1 -- 172.21.15.87:0/2376946337 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd802cb00 con 0x7f7be00ceef0 2023-12-16T20:22:09.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.371+0000 7f7be4f1d640 1 -- 172.21.15.87:0/2376946337 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd802cc60 con 0x7f7be00ceef0 2023-12-16T20:22:09.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.371+0000 7f7be4f1d640 1 -- 172.21.15.87:0/2376946337 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd80343f0 con 0x7f7be00ceef0 2023-12-16T20:22:09.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.372+0000 7f7be8183640 1 -- 172.21.15.87:0/2376946337 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7be00ceef0 msgr2=0x7f7be00cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.372+0000 7f7be8183640 1 --2- 172.21.15.87:0/2376946337 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7be00ceef0 0x7f7be00cf320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8009e50 tx=0x7f7bd802bf60 comp rx=0 tx=0).stop 2023-12-16T20:22:09.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.372+0000 7f7be8183640 1 -- 172.21.15.87:0/2376946337 shutdown_connections 2023-12-16T20:22:09.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.372+0000 7f7be8183640 1 --2- 172.21.15.87:0/2376946337 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7be00ceef0 0x7f7be00cf320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.372+0000 7f7be8183640 1 --2- 172.21.15.87:0/2376946337 >> v2:172.21.15.87:3300/0 conn(0x7f7be0153890 0x7f7be015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.372+0000 7f7be8183640 1 -- 172.21.15.87:0/2376946337 >> 172.21.15.87:0/2376946337 conn(0x7f7be006ba00 msgr2=0x7f7be006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:09.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.372+0000 7f7be8183640 1 -- 172.21.15.87:0/2376946337 shutdown_connections 2023-12-16T20:22:09.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.372+0000 7f7be8183640 1 -- 172.21.15.87:0/2376946337 wait complete. 2023-12-16T20:22:09.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.373+0000 7f1bf2ffd640 1 --2- 172.21.15.87:0/3768047593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bf4153c70 0x7f1bf40c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.374+0000 7f7be8183640 1 Processor -- start 2023-12-16T20:22:09.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.374+0000 7f7be8183640 1 -- start start 2023-12-16T20:22:09.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.375+0000 7f7be8183640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7be00ceef0 0x7f7be0155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.376+0000 7f7be8183640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7be0153890 0x7f7be0156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.376+0000 7f7be8183640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7be0153c70 0x7f7be00cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.376+0000 7f7be8183640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be0156fe0 con 0x7f7be00ceef0 2023-12-16T20:22:09.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.376+0000 7f7be8183640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be0156490 con 0x7f7be0153c70 2023-12-16T20:22:09.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.376+0000 7f7be8183640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be0155bd0 con 0x7f7be0153890 2023-12-16T20:22:09.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.376+0000 7f7be6720640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7be0153c70 0x7f7be00cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.376+0000 7f7be6720640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7be0153c70 0x7f7be00cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:39546/0 (socket says 172.21.15.87:39546) 2023-12-16T20:22:09.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.376+0000 7f7be6720640 1 -- 172.21.15.87:0/1020289232 learned_addr learned my addr 172.21.15.87:0/1020289232 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:09.381 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.377+0000 7f7ef1ffb640 1 -- 172.21.15.87:0/4198789434 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec02cc40 con 0x7f7ef40ca280 2023-12-16T20:22:09.381 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.377+0000 7f7ef1ffb640 1 -- 172.21.15.87:0/4198789434 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec02cda0 con 0x7f7ef40ca280 2023-12-16T20:22:09.381 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.377+0000 7f7ef1ffb640 1 -- 172.21.15.87:0/4198789434 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec034660 con 0x7f7ef40ca280 2023-12-16T20:22:09.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.378+0000 7f7ef99ec640 1 -- 172.21.15.87:0/4198789434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7ef40ca280 msgr2=0x7f7ef40c2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.378+0000 7f7ef99ec640 1 --2- 172.21.15.87:0/4198789434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7ef40ca280 0x7f7ef40c2280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009dc0 tx=0x7f7eec02be90 comp rx=0 tx=0).stop 2023-12-16T20:22:09.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.378+0000 7f7ef99ec640 1 -- 172.21.15.87:0/4198789434 shutdown_connections 2023-12-16T20:22:09.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.378+0000 7f7ef99ec640 1 --2- 172.21.15.87:0/4198789434 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7ef40ca280 0x7f7ef40c2280 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.378+0000 7f7ef99ec640 1 -- 172.21.15.87:0/4198789434 >> 172.21.15.87:0/4198789434 conn(0x7f7ef406a8f0 msgr2=0x7f7ef406eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:09.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.378+0000 7f7ef99ec640 1 -- 172.21.15.87:0/4198789434 shutdown_connections 2023-12-16T20:22:09.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.378+0000 7f7ef99ec640 1 -- 172.21.15.87:0/4198789434 wait complete. 2023-12-16T20:22:09.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.379+0000 7f1bf2ffd640 1 -- 172.21.15.87:0/3768047593 >> v2:172.21.15.87:3300/0 conn(0x7f1bf4153890 msgr2=0x7f1bf415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:09.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.379+0000 7f1bf2ffd640 1 --2- 172.21.15.87:0/3768047593 >> v2:172.21.15.87:3300/0 conn(0x7f1bf4153890 0x7f1bf415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.379+0000 7f1bf2ffd640 1 -- 172.21.15.87:0/3768047593 >> v1:172.21.15.195:6789/0 conn(0x7f1bf40ceef0 legacy=0x7f1bf415aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.379+0000 7f1bf2ffd640 1 -- 172.21.15.87:0/3768047593 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf4159dd0 con 0x7f1bf4153c70 2023-12-16T20:22:09.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.380+0000 7f7be6720640 1 -- 172.21.15.87:0/1020289232 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7be0153890 msgr2=0x7f7be0156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.380+0000 7f7be6720640 1 --2- 172.21.15.87:0/1020289232 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7be0153890 0x7f7be0156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.380+0000 7f7be6720640 1 -- 172.21.15.87:0/1020289232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7be00ceef0 msgr2=0x7f7be0155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.380+0000 7f7be6720640 1 --2- 172.21.15.87:0/1020289232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7be00ceef0 0x7f7be0155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.380+0000 7f7be6720640 1 -- 172.21.15.87:0/1020289232 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd8009b30 con 0x7f7be0153c70 2023-12-16T20:22:09.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.380+0000 7f7ef99ec640 1 Processor -- start 2023-12-16T20:22:09.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.380+0000 7f7ef99ec640 1 -- start start 2023-12-16T20:22:09.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.381+0000 7f7ef99ec640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7ef40c79f0 0x7f7ef4158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.381+0000 7f7ef99ec640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ef40ca280 0x7f7ef41edbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.381+0000 7f7ef99ec640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ef41516c0 0x7f7ef4156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.382+0000 7f7ef99ec640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef415a8c0 con 0x7f7ef40ca280 2023-12-16T20:22:09.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.382+0000 7f7ef99ec640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef41ed740 con 0x7f7ef41516c0 2023-12-16T20:22:09.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.382+0000 7f7ef99ec640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef41f1130 con 0x7f7ef40c79f0 2023-12-16T20:22:09.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.382+0000 7f1bf2ffd640 1 --2- 172.21.15.87:0/3768047593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bf4153c70 0x7f1bf40c9fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1be80097a0 tx=0x7f1be802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e14db59fe49b92 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.383+0000 7f7be6720640 1 --2- 172.21.15.87:0/1020289232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7be0153c70 0x7f7be00cdf90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8009e50 tx=0x7f7bd8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.386+0000 7f7ef2ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7ef40c79f0 0x7f7ef4158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.386+0000 7f7ef2ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7ef40c79f0 0x7f7ef4158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:35636/0 (socket says 172.21.15.87:35636) 2023-12-16T20:22:09.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.386+0000 7f7ef2ffd640 1 -- 172.21.15.87:0/1803575396 learned_addr learned my addr 172.21.15.87:0/1803575396 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:09.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.387+0000 7f7ef37fe640 1 --2- 172.21.15.87:0/1803575396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ef41516c0 0x7f7ef4156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.388+0000 7f7bd67fc640 1 -- 172.21.15.87:0/1020289232 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd803e450 con 0x7f7be0153c70 2023-12-16T20:22:09.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.388+0000 7f7bd67fc640 1 -- 172.21.15.87:0/1020289232 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd803e5d0 con 0x7f7be0153c70 2023-12-16T20:22:09.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.388+0000 7f7bd67fc640 1 -- 172.21.15.87:0/1020289232 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd803e980 con 0x7f7be0153c70 2023-12-16T20:22:09.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.388+0000 7f7be8183640 1 -- 172.21.15.87:0/1020289232 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be01541c0 con 0x7f7be0153c70 2023-12-16T20:22:09.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.388+0000 7f7be8183640 1 -- 172.21.15.87:0/1020289232 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be0155e40 con 0x7f7be0153c70 2023-12-16T20:22:09.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.388+0000 7f1bf27fc640 1 -- 172.21.15.87:0/3768047593 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be8030610 con 0x7f1bf4153c70 2023-12-16T20:22:09.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.388+0000 7f1bf27fc640 1 -- 172.21.15.87:0/3768047593 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be8030770 con 0x7f1bf4153c70 2023-12-16T20:22:09.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.388+0000 7f1bf27fc640 1 -- 172.21.15.87:0/3768047593 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be8030b00 con 0x7f1bf4153c70 2023-12-16T20:22:09.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.389+0000 7f7be8183640 1 -- 172.21.15.87:0/1020289232 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be0067500 con 0x7f7be0153c70 2023-12-16T20:22:09.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.389+0000 7f1bf9e7c640 1 -- 172.21.15.87:0/3768047593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bf4153c70 msgr2=0x7f1bf40c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.389+0000 7f1bf9e7c640 1 --2- 172.21.15.87:0/3768047593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bf4153c70 0x7f1bf40c9fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1be80097a0 tx=0x7f1be802b960 comp rx=0 tx=0).stop 2023-12-16T20:22:09.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.389+0000 7f1bf9e7c640 1 -- 172.21.15.87:0/3768047593 shutdown_connections 2023-12-16T20:22:09.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.389+0000 7f1bf9e7c640 1 --2- 172.21.15.87:0/3768047593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bf4153c70 0x7f1bf40c9fe0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.389+0000 7f1bf9e7c640 1 --2- 172.21.15.87:0/3768047593 >> v2:172.21.15.87:3300/0 conn(0x7f1bf4153890 0x7f1bf415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.389+0000 7f1bf9e7c640 1 -- 172.21.15.87:0/3768047593 >> 172.21.15.87:0/3768047593 conn(0x7f1bf406ba00 msgr2=0x7f1bf406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:09.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.389+0000 7f1bf9e7c640 1 -- 172.21.15.87:0/3768047593 shutdown_connections 2023-12-16T20:22:09.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.390+0000 7f1bf9e7c640 1 -- 172.21.15.87:0/3768047593 wait complete. 2023-12-16T20:22:09.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.391+0000 7f1bf9e7c640 1 Processor -- start 2023-12-16T20:22:09.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.391+0000 7f1bf9e7c640 1 -- start start 2023-12-16T20:22:09.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.391+0000 7f1bf9e7c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bf40ceef0 0x7f1bf40cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.391+0000 7f1bf9e7c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bf4153890 0x7f1bf41efcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.391+0000 7f1bf9e7c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bf4153c70 0x7f1bf41f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.391+0000 7f1bf9e7c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf40ccd60 con 0x7f1bf4153c70 2023-12-16T20:22:09.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.391+0000 7f1bf9e7c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf414fed0 con 0x7f1bf4153890 2023-12-16T20:22:09.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.391+0000 7f1bf9e7c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf41ef580 con 0x7f1bf40ceef0 2023-12-16T20:22:09.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.392+0000 7f7ef37fe640 1 -- 172.21.15.87:0/1803575396 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7ef40c79f0 msgr2=0x7f7ef4158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.392+0000 7f7ef37fe640 1 --2- 172.21.15.87:0/1803575396 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7ef40c79f0 0x7f7ef4158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.392+0000 7f7ef37fe640 1 -- 172.21.15.87:0/1803575396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ef40ca280 msgr2=0x7f7ef41edbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.392+0000 7f7ef37fe640 1 --2- 172.21.15.87:0/1803575396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ef40ca280 0x7f7ef41edbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.392+0000 7f7ef37fe640 1 -- 172.21.15.87:0/1803575396 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec009a70 con 0x7f7ef41516c0 2023-12-16T20:22:09.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.396+0000 7f1bf37fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bf40ceef0 0x7f1bf40cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.397+0000 7f1bf37fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bf40ceef0 0x7f1bf40cbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:35644/0 (socket says 172.21.15.87:35644) 2023-12-16T20:22:09.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.397+0000 7f1bf37fe640 1 -- 172.21.15.87:0/1047371945 learned_addr learned my addr 172.21.15.87:0/1047371945 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:09.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.401+0000 7f1bf37fe640 1 -- 172.21.15.87:0/1047371945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bf4153890 msgr2=0x7f1bf41efcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.401+0000 7f1bf37fe640 1 --2- 172.21.15.87:0/1047371945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bf4153890 0x7f1bf41efcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.401+0000 7f1bf37fe640 1 -- 172.21.15.87:0/1047371945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bf4153c70 msgr2=0x7f1bf41f2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.401+0000 7f1bf37fe640 1 --2- 172.21.15.87:0/1047371945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bf4153c70 0x7f1bf41f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.401+0000 7f1bf37fe640 1 -- 172.21.15.87:0/1047371945 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be8009400 con 0x7f1bf40ceef0 2023-12-16T20:22:09.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.403+0000 7f1bf37fe640 1 --2- 172.21.15.87:0/1047371945 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bf40ceef0 0x7f1bf40cbc00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1be400b4a0 tx=0x7f1be400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.408 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.407+0000 7f1bdbfff640 1 -- 172.21.15.87:0/1047371945 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be4010610 con 0x7f1bf40ceef0 2023-12-16T20:22:09.409 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.407+0000 7f1bdbfff640 1 -- 172.21.15.87:0/1047371945 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be4010770 con 0x7f1bf40ceef0 2023-12-16T20:22:09.409 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.407+0000 7f1bf9e7c640 1 -- 172.21.15.87:0/1047371945 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf40cc6f0 con 0x7f1bf40ceef0 2023-12-16T20:22:09.409 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.407+0000 7f1bdbfff640 1 -- 172.21.15.87:0/1047371945 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be4010b20 con 0x7f1bf40ceef0 2023-12-16T20:22:09.409 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.407+0000 7f1bf9e7c640 1 -- 172.21.15.87:0/1047371945 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf414fbf0 con 0x7f1bf40ceef0 2023-12-16T20:22:09.409 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.408+0000 7f1bf9e7c640 1 -- 172.21.15.87:0/1047371945 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf41571c0 con 0x7f1bf40ceef0 2023-12-16T20:22:09.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.414+0000 7ff5d8ff9640 1 -- 172.21.15.87:0/3777275336 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff5cc04a370 con 0x7ff5dc06f160 2023-12-16T20:22:09.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.415+0000 7ff5d8ff9640 1 -- 172.21.15.87:0/3777275336 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ff5cc077790 con 0x7ff5dc06f160 2023-12-16T20:22:09.420 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.419+0000 7f4c9dffb640 1 -- 172.21.15.87:0/3955237252 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca000ad40 con 0x7f4ca8158000 2023-12-16T20:22:09.420 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.419+0000 7f4c9dffb640 1 -- 172.21.15.87:0/3955237252 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca0012400 con 0x7f4ca8158000 2023-12-16T20:22:09.420 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.419+0000 7f4caf475640 1 -- 172.21.15.87:0/3955237252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca806c760 con 0x7f4ca8158000 2023-12-16T20:22:09.420 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.419+0000 7f4c9dffb640 1 -- 172.21.15.87:0/3955237252 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca000aea0 con 0x7f4ca8158000 2023-12-16T20:22:09.420 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.419+0000 7f4caf475640 1 -- 172.21.15.87:0/3955237252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca806ca50 con 0x7f4ca8158000 2023-12-16T20:22:09.421 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.420+0000 7f4caf475640 1 -- 172.21.15.87:0/3955237252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca80740e0 con 0x7f4ca8158000 2023-12-16T20:22:09.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.426+0000 7f1bdbfff640 1 -- 172.21.15.87:0/1047371945 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f1be4010c80 con 0x7f1bf40ceef0 2023-12-16T20:22:09.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.427+0000 7f1bdbfff640 1 --2- 172.21.15.87:0/1047371945 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1be006ae90 0x7f1be006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.427+0000 7f1bf2ffd640 1 --2- 172.21.15.87:0/1047371945 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1be006ae90 0x7f1be006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.427+0000 7f1bf2ffd640 1 --2- 172.21.15.87:0/1047371945 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1be006ae90 0x7f1be006d350 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1be8036000 tx=0x7f1be8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.488+0000 7fa7ec5a5640 1 -- 172.21.15.87:0/76241748 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa7e41582c0 con 0x7fa7e4151760 2023-12-16T20:22:09.511 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-16T20:22:09.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.592+0000 7ff5e2378640 1 -- 172.21.15.87:0/3777275336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff5dc067500 con 0x7ff5dc06f160 2023-12-16T20:22:09.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.611+0000 7f178427c640 1 Processor -- start 2023-12-16T20:22:09.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.611+0000 7f178427c640 1 -- start start 2023-12-16T20:22:09.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.612+0000 7f178427c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c153b20 0x7f177c0c7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.612+0000 7f178427c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f177c15d870 0x7f177c0c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.612+0000 7f178427c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177c15ccd0 con 0x7f177c0c2d60 2023-12-16T20:22:09.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.612+0000 7f178427c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177c0c8680 con 0x7f177c15d870 2023-12-16T20:22:09.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.612+0000 7f178427c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c06f810 con 0x7f177c153b20 2023-12-16T20:22:09.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.633+0000 7f7ef37fe640 1 --2- 172.21.15.87:0/1803575396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ef41516c0 0x7f7ef4156c40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7eec033000 tx=0x7f7eec004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.636+0000 7f1782819640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f177c15d870 0x7f177c0c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.648+0000 7f1782819640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f177c15d870 0x7f177c0c7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:39570/0 (socket says 172.21.15.87:39570) 2023-12-16T20:22:09.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.648+0000 7f1782819640 1 -- 172.21.15.87:0/4077902229 learned_addr learned my addr 172.21.15.87:0/4077902229 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:09.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.648+0000 7f7bd67fc640 1 -- 172.21.15.87:0/1020289232 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f7bd803eae0 con 0x7f7be0153c70 2023-12-16T20:22:09.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.648+0000 7f7bd67fc640 1 --2- 172.21.15.87:0/1020289232 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7bc406ae70 0x7f7bc406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.649+0000 7f7be5f1f640 1 --2- 172.21.15.87:0/1020289232 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7bc406ae70 0x7f7bc406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.649+0000 7f7be5f1f640 1 --2- 172.21.15.87:0/1020289232 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7bc406ae70 0x7f7bc406d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009710 tx=0x7f7bdc006c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.654+0000 7f1782819640 1 -- 172.21.15.87:0/4077902229 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c153b20 msgr2=0x7f177c0c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:09.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.654+0000 7f1782819640 1 --2- 172.21.15.87:0/4077902229 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c153b20 0x7f177c0c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.654+0000 7f1782819640 1 -- 172.21.15.87:0/4077902229 >> v1:172.21.15.195:6789/0 conn(0x7f177c0c2d60 legacy=0x7f177c15d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:09.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.654+0000 7f1782819640 1 -- 172.21.15.87:0/4077902229 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c06faf0 con 0x7f177c15d870 2023-12-16T20:22:09.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.657+0000 7f7bd67fc640 1 -- 172.21.15.87:0/1020289232 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7bd807bf10 con 0x7f7be0153c70 2023-12-16T20:22:09.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.659+0000 7f7edbfff640 1 -- 172.21.15.87:0/1803575396 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec03f420 con 0x7f7ef41516c0 2023-12-16T20:22:09.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.659+0000 7f7edbfff640 1 -- 172.21.15.87:0/1803575396 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec03f580 con 0x7f7ef41516c0 2023-12-16T20:22:09.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.659+0000 7f7ef99ec640 1 -- 172.21.15.87:0/1803575396 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef41ed110 con 0x7f7ef41516c0 2023-12-16T20:22:09.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.659+0000 7f7edbfff640 1 -- 172.21.15.87:0/1803575396 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec03f950 con 0x7f7ef41516c0 2023-12-16T20:22:09.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.660+0000 7f7ef99ec640 1 -- 172.21.15.87:0/1803575396 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef41ed3d0 con 0x7f7ef41516c0 2023-12-16T20:22:09.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.660+0000 7f7ef99ec640 1 -- 172.21.15.87:0/1803575396 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef40740e0 con 0x7f7ef41516c0 2023-12-16T20:22:09.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.663+0000 7f1bdbfff640 1 -- 172.21.15.87:0/1047371945 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1be4058ad0 con 0x7f1bf40ceef0 2023-12-16T20:22:09.671 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.670+0000 7f7bd67fc640 1 -- 172.21.15.87:0/1020289232 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f7bd8077b50 con 0x7f7be0153c70 2023-12-16T20:22:09.675 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.674+0000 7f1bdbfff640 1 -- 172.21.15.87:0/1047371945 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f1be4054710 con 0x7f1bf40ceef0 2023-12-16T20:22:09.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.677+0000 7f4c9dffb640 1 -- 172.21.15.87:0/3955237252 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f4ca0007070 con 0x7f4ca8158000 2023-12-16T20:22:09.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.677+0000 7f4c9dffb640 1 --2- 172.21.15.87:0/3955237252 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f4c8c06aec0 0x7f4c8c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.677+0000 7f4cad211640 1 --2- 172.21.15.87:0/3955237252 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f4c8c06aec0 0x7f4c8c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.678+0000 7f4cad211640 1 --2- 172.21.15.87:0/3955237252 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f4c8c06aec0 0x7f4c8c06d380 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4c98036000 tx=0x7f4c98030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.680+0000 7fa7daffd640 1 -- 172.21.15.87:0/76241748 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa7d4017020 con 0x7fa7e4151760 2023-12-16T20:22:09.681 INFO:teuthology.orchestra.run.smithi087.stdout:55834574861 2023-12-16T20:22:09.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.682+0000 7fa7ec5a5640 1 -- 172.21.15.87:0/76241748 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa7c806aec0 msgr2=0x7fa7c806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.682+0000 7fa7ec5a5640 1 --2- 172.21.15.87:0/76241748 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa7c806aec0 0x7fa7c806d380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0036000 tx=0x7fa7e003c040 comp rx=0 tx=0).stop 2023-12-16T20:22:09.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.682+0000 7fa7ec5a5640 1 -- 172.21.15.87:0/76241748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7e4151760 msgr2=0x7fa7e41e26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.682+0000 7fa7ec5a5640 1 --2- 172.21.15.87:0/76241748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7e4151760 0x7fa7e41e26c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa7d400c370 tx=0x7fa7d400c830 comp rx=0 tx=0).stop 2023-12-16T20:22:09.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.682+0000 7fa7ec5a5640 1 -- 172.21.15.87:0/76241748 shutdown_connections 2023-12-16T20:22:09.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.682+0000 7fa7ec5a5640 1 --2- 172.21.15.87:0/76241748 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa7c806aec0 0x7fa7c806d380 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.682+0000 7fa7ec5a5640 1 --2- 172.21.15.87:0/76241748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7e4157320 0x7fa7e41e2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.682+0000 7fa7ec5a5640 1 --2- 172.21.15.87:0/76241748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7e4151760 0x7fa7e41e26c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.682+0000 7fa7ec5a5640 1 --2- 172.21.15.87:0/76241748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7e406f6e0 0x7fa7e41501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.682+0000 7fa7ec5a5640 1 -- 172.21.15.87:0/76241748 >> 172.21.15.87:0/76241748 conn(0x7fa7e4072930 msgr2=0x7fa7e4146900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:09.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.682+0000 7fa7ec5a5640 1 -- 172.21.15.87:0/76241748 shutdown_connections 2023-12-16T20:22:09.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.682+0000 7fa7ec5a5640 1 -- 172.21.15.87:0/76241748 wait complete. 2023-12-16T20:22:09.685 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-16T20:22:09.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.692+0000 7f4c9dffb640 1 -- 172.21.15.87:0/3955237252 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4ca0058800 con 0x7f4ca8158000 2023-12-16T20:22:09.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.692+0000 7f4c9dffb640 1 -- 172.21.15.87:0/3955237252 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f4ca0054b40 con 0x7f4ca8158000 2023-12-16T20:22:09.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.6 2023-12-16T20:22:09.695 DEBUG:teuthology.parallel:result is None 2023-12-16T20:22:09.773 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.771+0000 7ff5d8ff9640 1 -- 172.21.15.87:0/3777275336 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff5cc07adb0 con 0x7ff5dc06f160 2023-12-16T20:22:09.773 INFO:teuthology.orchestra.run.smithi087.stdout:55834574861 2023-12-16T20:22:09.775 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.774+0000 7ff5e2378640 1 -- 172.21.15.87:0/3777275336 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff5c806ae90 msgr2=0x7ff5c806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.775 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.774+0000 7ff5e2378640 1 --2- 172.21.15.87:0/3777275336 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff5c806ae90 0x7ff5c806d350 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00011e0 tx=0x7ff5d00078f0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.775 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.774+0000 7ff5e2378640 1 -- 172.21.15.87:0/3777275336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5dc06f160 msgr2=0x7ff5dc149510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.775 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.774+0000 7ff5e2378640 1 --2- 172.21.15.87:0/3777275336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5dc06f160 0x7ff5dc149510 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0098c0 tx=0x7ff5cc0046c0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.774+0000 7ff5e2378640 1 -- 172.21.15.87:0/3777275336 shutdown_connections 2023-12-16T20:22:09.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.774+0000 7ff5e2378640 1 --2- 172.21.15.87:0/3777275336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff5dc1537d0 0x7ff5dc1469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.774+0000 7ff5e2378640 1 --2- 172.21.15.87:0/3777275336 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff5c806ae90 0x7ff5c806d350 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.774+0000 7ff5e2378640 1 --2- 172.21.15.87:0/3777275336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5dc0c2e40 0x7ff5dc0c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.774+0000 7ff5e2378640 1 --2- 172.21.15.87:0/3777275336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5dc06f160 0x7ff5dc149510 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.774+0000 7ff5e2378640 1 -- 172.21.15.87:0/3777275336 >> 172.21.15.87:0/3777275336 conn(0x7ff5dc0cbf60 msgr2=0x7ff5dc0cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:09.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.774+0000 7ff5e2378640 1 -- 172.21.15.87:0/3777275336 shutdown_connections 2023-12-16T20:22:09.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.774+0000 7ff5e2378640 1 -- 172.21.15.87:0/3777275336 wait complete. 2023-12-16T20:22:09.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.0 2023-12-16T20:22:09.791 DEBUG:teuthology.parallel:result is None 2023-12-16T20:22:09.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.800+0000 7f1a3c27c640 1 Processor -- start 2023-12-16T20:22:09.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.800+0000 7f1a3c27c640 1 -- start start 2023-12-16T20:22:09.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.801+0000 7f1a3c27c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a3415d950 0x7f1a3415aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.801+0000 7f1a3c27c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a3415a700 con 0x7f1a34153c70 2023-12-16T20:22:09.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.801+0000 7f1a3c27c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a340ca870 con 0x7f1a34153890 2023-12-16T20:22:09.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.801+0000 7f1a3c27c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3415dd80 con 0x7f1a3415d950 2023-12-16T20:22:09.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.802+0000 7f1a39817640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f1a34153c70 0x7f1a340ceef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55034/0 (socket says 172.21.15.87:55034) 2023-12-16T20:22:09.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.802+0000 7f1a39817640 1 -- 172.21.15.87:0/3449062705 learned_addr learned my addr 172.21.15.87:0/3449062705 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:09.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.805+0000 7f1a39016640 1 -- 172.21.15.87:0/3449062705 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96980234 0 0) 0x7f1a3415a700 con 0x7f1a34153c70 2023-12-16T20:22:09.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.805+0000 7f1a39016640 1 -- 172.21.15.87:0/3449062705 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a20003520 con 0x7f1a34153c70 2023-12-16T20:22:09.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.807+0000 7f1a3a819640 1 --2- 172.21.15.87:0/3449062705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a3415d950 0x7f1a3415aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.810+0000 7f1a3a819640 1 -- 172.21.15.87:0/3449062705 >> v1:172.21.15.195:6789/0 conn(0x7f1a34153890 legacy=0x7f1a340c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:09.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.810+0000 7f1a3a819640 1 -- 172.21.15.87:0/3449062705 >> v1:172.21.15.87:6789/0 conn(0x7f1a34153c70 legacy=0x7f1a340ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.810+0000 7f1a3a819640 1 -- 172.21.15.87:0/3449062705 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a34159af0 con 0x7f1a3415d950 2023-12-16T20:22:09.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.812+0000 7f1a3a819640 1 --2- 172.21.15.87:0/3449062705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a3415d950 0x7f1a3415aed0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009dc0 tx=0x7f1a2c02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8dcf79cc2985952 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.815+0000 7f1a39016640 1 -- 172.21.15.87:0/3449062705 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c02ccd0 con 0x7f1a3415d950 2023-12-16T20:22:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.815+0000 7f1a39016640 1 -- 172.21.15.87:0/3449062705 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c02ce30 con 0x7f1a3415d950 2023-12-16T20:22:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.815+0000 7f1a39016640 1 -- 172.21.15.87:0/3449062705 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c034660 con 0x7f1a3415d950 2023-12-16T20:22:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.816+0000 7f1a3c27c640 1 -- 172.21.15.87:0/3449062705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a3415d950 msgr2=0x7f1a3415aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.816+0000 7f1a3c27c640 1 --2- 172.21.15.87:0/3449062705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a3415d950 0x7f1a3415aed0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009dc0 tx=0x7f1a2c02bf20 comp rx=0 tx=0).stop 2023-12-16T20:22:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.816+0000 7f1a3c27c640 1 -- 172.21.15.87:0/3449062705 shutdown_connections 2023-12-16T20:22:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.816+0000 7f1a3c27c640 1 --2- 172.21.15.87:0/3449062705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a3415d950 0x7f1a3415aed0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.816+0000 7f1a3c27c640 1 -- 172.21.15.87:0/3449062705 >> 172.21.15.87:0/3449062705 conn(0x7f1a3406ba00 msgr2=0x7f1a3406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.816+0000 7f1a3c27c640 1 -- 172.21.15.87:0/3449062705 shutdown_connections 2023-12-16T20:22:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.816+0000 7f1a3c27c640 1 -- 172.21.15.87:0/3449062705 wait complete. 2023-12-16T20:22:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.817+0000 7f1a3c27c640 1 Processor -- start 2023-12-16T20:22:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.817+0000 7f1a3c27c640 1 -- start start 2023-12-16T20:22:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.818+0000 7f1a3c27c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a34153890 0x7f1a3414f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.818+0000 7f1a3c27c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a34153c70 0x7f1a34152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.818+0000 7f1a3c27c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a3415d950 0x7f1a34151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.818+0000 7f1a3c27c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a340cf010 con 0x7f1a34153890 2023-12-16T20:22:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.818+0000 7f1a3c27c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a340c6a30 con 0x7f1a3415d950 2023-12-16T20:22:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.818+0000 7f1a3c27c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a34154f00 con 0x7f1a34153c70 2023-12-16T20:22:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.819+0000 7f1a39817640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a34153c70 0x7f1a34152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.819+0000 7f1a3a018640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a34153890 0x7f1a3414f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.819+0000 7f1a39817640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a34153c70 0x7f1a34152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:35664/0 (socket says 172.21.15.87:35664) 2023-12-16T20:22:09.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.819+0000 7f1a39817640 1 -- 172.21.15.87:0/2610442209 learned_addr learned my addr 172.21.15.87:0/2610442209 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:09.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.822+0000 7f1a39817640 1 -- 172.21.15.87:0/2610442209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a3415d950 msgr2=0x7f1a34151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.822+0000 7f1a39817640 1 --2- 172.21.15.87:0/2610442209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a3415d950 0x7f1a34151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.822+0000 7f1a39817640 1 -- 172.21.15.87:0/2610442209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a34153890 msgr2=0x7f1a3414f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.822+0000 7f1a39817640 1 --2- 172.21.15.87:0/2610442209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a34153890 0x7f1a3414f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.822+0000 7f1a39817640 1 -- 172.21.15.87:0/2610442209 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c009a70 con 0x7f1a34153c70 2023-12-16T20:22:09.825 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.824+0000 7f1a39817640 1 --2- 172.21.15.87:0/2610442209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a34153c70 0x7f1a34152b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400c460 tx=0x7f1a2400c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.827+0000 7f1a2affd640 1 -- 172.21.15.87:0/2610442209 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a24005ce0 con 0x7f1a34153c70 2023-12-16T20:22:09.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.827+0000 7f1a2affd640 1 -- 172.21.15.87:0/2610442209 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a24005e40 con 0x7f1a34153c70 2023-12-16T20:22:09.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.827+0000 7f1a3c27c640 1 -- 172.21.15.87:0/2610442209 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a34154940 con 0x7f1a34153c70 2023-12-16T20:22:09.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.827+0000 7f1a2affd640 1 -- 172.21.15.87:0/2610442209 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a240072f0 con 0x7f1a34153c70 2023-12-16T20:22:09.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.827+0000 7f1a3c27c640 1 -- 172.21.15.87:0/2610442209 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a341507a0 con 0x7f1a34153c70 2023-12-16T20:22:09.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.828+0000 7f1a3c27c640 1 -- 172.21.15.87:0/2610442209 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a34157500 con 0x7f1a34153c70 2023-12-16T20:22:09.890 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.889+0000 7f4caf475640 1 -- 172.21.15.87:0/3955237252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4ca8150570 con 0x7f4ca8158000 2023-12-16T20:22:09.894 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.893+0000 7f4c9dffb640 1 -- 172.21.15.87:0/3955237252 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ca0017090 con 0x7f4ca8158000 2023-12-16T20:22:09.894 INFO:teuthology.orchestra.run.smithi087.stdout:55834574861 2023-12-16T20:22:09.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.895+0000 7f4caf475640 1 -- 172.21.15.87:0/3955237252 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f4c8c06aec0 msgr2=0x7f4c8c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.895+0000 7f4caf475640 1 --2- 172.21.15.87:0/3955237252 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f4c8c06aec0 0x7f4c8c06d380 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4c98036000 tx=0x7f4c98030000 comp rx=0 tx=0).stop 2023-12-16T20:22:09.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.895+0000 7f4caf475640 1 -- 172.21.15.87:0/3955237252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ca8158000 msgr2=0x7f4ca80c6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.895+0000 7f4caf475640 1 --2- 172.21.15.87:0/3955237252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ca8158000 0x7f4ca80c6020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000cbc0 tx=0x7f4ca000a430 comp rx=0 tx=0).stop 2023-12-16T20:22:09.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.895+0000 7f4caf475640 1 -- 172.21.15.87:0/3955237252 shutdown_connections 2023-12-16T20:22:09.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.895+0000 7f4caf475640 1 --2- 172.21.15.87:0/3955237252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ca8158000 0x7f4ca80c6020 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.895+0000 7f4caf475640 1 --2- 172.21.15.87:0/3955237252 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ca8151130 0x7f4ca806baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.895+0000 7f4caf475640 1 --2- 172.21.15.87:0/3955237252 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f4c8c06aec0 0x7f4c8c06d380 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.895+0000 7f4caf475640 1 --2- 172.21.15.87:0/3955237252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca80b2060 0x7f4ca814c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.895+0000 7f4caf475640 1 -- 172.21.15.87:0/3955237252 >> 172.21.15.87:0/3955237252 conn(0x7f4ca8061100 msgr2=0x7f4ca80c2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:09.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.895+0000 7f4caf475640 1 -- 172.21.15.87:0/3955237252 shutdown_connections 2023-12-16T20:22:09.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.895+0000 7f4caf475640 1 -- 172.21.15.87:0/3955237252 wait complete. 2023-12-16T20:22:09.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.3 2023-12-16T20:22:09.911 DEBUG:teuthology.parallel:result is None 2023-12-16T20:22:09.926 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.925+0000 7f1782819640 1 --2- 172.21.15.87:0/4077902229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f177c15d870 0x7f177c0c7c60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1778009870 tx=0x7f177802b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e736ff98fab4ec88 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.927 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.925+0000 7f7edbfff640 1 -- 172.21.15.87:0/1803575396 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f7eec03fab0 con 0x7f7ef41516c0 2023-12-16T20:22:09.927 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.926+0000 7f7edbfff640 1 --2- 172.21.15.87:0/1803575396 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7ee006ae90 0x7f7ee006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.927 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.926+0000 7f7ef2ffd640 1 --2- 172.21.15.87:0/1803575396 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7ee006ae90 0x7f7ee006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.928 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.927+0000 7f7ef2ffd640 1 --2- 172.21.15.87:0/1803575396 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7ee006ae90 0x7f7ee006d350 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4004e40 tx=0x7f7ee4007f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.930 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.929+0000 7f7edbfff640 1 -- 172.21.15.87:0/1803575396 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7eec053e20 con 0x7f7ef41516c0 2023-12-16T20:22:09.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.942+0000 7f7edbfff640 1 -- 172.21.15.87:0/1803575396 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f7eec0776c0 con 0x7f7ef41516c0 2023-12-16T20:22:09.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.942+0000 7f1781016640 1 -- 172.21.15.87:0/4077902229 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778031740 con 0x7f177c15d870 2023-12-16T20:22:09.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.942+0000 7f1781016640 1 -- 172.21.15.87:0/4077902229 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17780318a0 con 0x7f177c15d870 2023-12-16T20:22:09.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.942+0000 7f1781016640 1 -- 172.21.15.87:0/4077902229 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778031c30 con 0x7f177c15d870 2023-12-16T20:22:09.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.943+0000 7f178427c640 1 -- 172.21.15.87:0/4077902229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f177c15d870 msgr2=0x7f177c0c7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.943+0000 7f178427c640 1 --2- 172.21.15.87:0/4077902229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f177c15d870 0x7f177c0c7c60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1778009870 tx=0x7f177802b7e0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.943+0000 7f178427c640 1 -- 172.21.15.87:0/4077902229 shutdown_connections 2023-12-16T20:22:09.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.943+0000 7f178427c640 1 --2- 172.21.15.87:0/4077902229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f177c15d870 0x7f177c0c7c60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.943+0000 7f178427c640 1 --2- 172.21.15.87:0/4077902229 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c153b20 0x7f177c0c7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.943+0000 7f178427c640 1 -- 172.21.15.87:0/4077902229 >> 172.21.15.87:0/4077902229 conn(0x7f177c072930 msgr2=0x7f177c0cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:09.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.943+0000 7f178427c640 1 -- 172.21.15.87:0/4077902229 shutdown_connections 2023-12-16T20:22:09.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.943+0000 7f178427c640 1 -- 172.21.15.87:0/4077902229 wait complete. 2023-12-16T20:22:09.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.945+0000 7f178427c640 1 Processor -- start 2023-12-16T20:22:09.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.945+0000 7f178427c640 1 -- start start 2023-12-16T20:22:09.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.945+0000 7f178427c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c0c2d60 0x7f177c0c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.945+0000 7f178427c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f177c153b20 0x7f177c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.945+0000 7f178427c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f177c15d870 0x7f177c0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.945+0000 7f178427c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c0adde0 con 0x7f177c15d870 2023-12-16T20:22:09.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.945+0000 7f178427c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c0ad2a0 con 0x7f177c153b20 2023-12-16T20:22:09.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.945+0000 7f178427c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c0ad540 con 0x7f177c0c2d60 2023-12-16T20:22:09.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.946+0000 7f1782819640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f177c15d870 0x7f177c0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.946+0000 7f1782819640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f177c15d870 0x7f177c0aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55926/0 (socket says 172.21.15.87:55926) 2023-12-16T20:22:09.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.946+0000 7f1782819640 1 -- 172.21.15.87:0/1242419356 learned_addr learned my addr 172.21.15.87:0/1242419356 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:09.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.950+0000 7f1782819640 1 -- 172.21.15.87:0/1242419356 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c0c2d60 msgr2=0x7f177c0c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.950+0000 7f1782819640 1 --2- 172.21.15.87:0/1242419356 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c0c2d60 0x7f177c0c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.950+0000 7f1782819640 1 -- 172.21.15.87:0/1242419356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f177c153b20 msgr2=0x7f177c0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:09.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.950+0000 7f1782819640 1 --2- 172.21.15.87:0/1242419356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f177c153b20 0x7f177c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:09.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.950+0000 7f1782819640 1 -- 172.21.15.87:0/1242419356 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17780094d0 con 0x7f177c15d870 2023-12-16T20:22:09.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.954+0000 7f1782819640 1 --2- 172.21.15.87:0/1242419356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f177c15d870 0x7f177c0aeb80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1778009870 tx=0x7f17780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.958+0000 7f7be8183640 1 -- 172.21.15.87:0/1020289232 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7be0159770 con 0x7f7be0153c70 2023-12-16T20:22:09.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.961+0000 7f1772ffd640 1 -- 172.21.15.87:0/1242419356 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778033b70 con 0x7f177c15d870 2023-12-16T20:22:09.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.961+0000 7f1772ffd640 1 -- 172.21.15.87:0/1242419356 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1778033cf0 con 0x7f177c15d870 2023-12-16T20:22:09.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.961+0000 7f1772ffd640 1 -- 172.21.15.87:0/1242419356 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177803e6c0 con 0x7f177c15d870 2023-12-16T20:22:09.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.961+0000 7f178427c640 1 -- 172.21.15.87:0/1242419356 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177c0c6cb0 con 0x7f177c15d870 2023-12-16T20:22:09.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.961+0000 7f178427c640 1 -- 172.21.15.87:0/1242419356 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177c0adb00 con 0x7f177c15d870 2023-12-16T20:22:09.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.962+0000 7f178427c640 1 -- 172.21.15.87:0/1242419356 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f177c0c6af0 con 0x7f177c15d870 2023-12-16T20:22:09.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.972+0000 7f1bf9e7c640 1 -- 172.21.15.87:0/1047371945 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1bf415b350 con 0x7f1bf40ceef0 2023-12-16T20:22:09.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.982+0000 7f1772ffd640 1 -- 172.21.15.87:0/1242419356 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f177803a040 con 0x7f177c15d870 2023-12-16T20:22:09.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.982+0000 7f1772ffd640 1 --2- 172.21.15.87:0/1242419356 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f176006ae90 0x7f176006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:09.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.982+0000 7f1782018640 1 --2- 172.21.15.87:0/1242419356 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f176006ae90 0x7f176006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:09.985 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.983+0000 7f1782018640 1 --2- 172.21.15.87:0/1242419356 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f176006ae90 0x7f176006d350 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f177400ab90 tx=0x7f1774009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:09.986 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:09.985+0000 7f1772ffd640 1 -- 172.21.15.87:0/1242419356 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f177807b150 con 0x7f177c15d870 2023-12-16T20:22:10.005 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.004+0000 7f7bd67fc640 1 -- 172.21.15.87:0/1020289232 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7bd807b170 con 0x7f7be0153c70 2023-12-16T20:22:10.005 INFO:teuthology.orchestra.run.smithi087.stdout:55834574861 2023-12-16T20:22:10.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.006+0000 7f7be8183640 1 -- 172.21.15.87:0/1020289232 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7bc406ae70 msgr2=0x7f7bc406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:10.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.006+0000 7f7be8183640 1 --2- 172.21.15.87:0/1020289232 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7bc406ae70 0x7f7bc406d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009710 tx=0x7f7bdc006c90 comp rx=0 tx=0).stop 2023-12-16T20:22:10.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.006+0000 7f7be8183640 1 -- 172.21.15.87:0/1020289232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7be0153c70 msgr2=0x7f7be00cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:10.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.006+0000 7f7be8183640 1 --2- 172.21.15.87:0/1020289232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7be0153c70 0x7f7be00cdf90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8009e50 tx=0x7f7bd8004a40 comp rx=0 tx=0).stop 2023-12-16T20:22:10.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.006+0000 7f7be8183640 1 -- 172.21.15.87:0/1020289232 shutdown_connections 2023-12-16T20:22:10.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.006+0000 7f7be8183640 1 --2- 172.21.15.87:0/1020289232 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7bc406ae70 0x7f7bc406d330 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.006+0000 7f7be8183640 1 --2- 172.21.15.87:0/1020289232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7be0153c70 0x7f7be00cdf90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.006+0000 7f7be8183640 1 --2- 172.21.15.87:0/1020289232 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7be0153890 0x7f7be0156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.006+0000 7f7be8183640 1 --2- 172.21.15.87:0/1020289232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7be00ceef0 0x7f7be0155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.006+0000 7f7be8183640 1 -- 172.21.15.87:0/1020289232 >> 172.21.15.87:0/1020289232 conn(0x7f7be006ba00 msgr2=0x7f7be0073850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:10.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.006+0000 7f7be8183640 1 -- 172.21.15.87:0/1020289232 shutdown_connections 2023-12-16T20:22:10.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.006+0000 7f7be8183640 1 -- 172.21.15.87:0/1020289232 wait complete. 2023-12-16T20:22:10.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.5 2023-12-16T20:22:10.018 DEBUG:teuthology.parallel:result is None 2023-12-16T20:22:10.079 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.077+0000 7f1a2affd640 1 -- 172.21.15.87:0/2610442209 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f1a24007450 con 0x7f1a34153c70 2023-12-16T20:22:10.079 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.078+0000 7f1a2affd640 1 --2- 172.21.15.87:0/2610442209 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1a1806ae90 0x7f1a1806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:10.079 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.078+0000 7f1a3a018640 1 --2- 172.21.15.87:0/2610442209 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1a1806ae90 0x7f1a1806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:10.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.078+0000 7f1a3a018640 1 --2- 172.21.15.87:0/2610442209 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1a1806ae90 0x7f1a1806d350 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1a300017f0 tx=0x7f1a30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:10.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.084+0000 7f1a2affd640 1 -- 172.21.15.87:0/2610442209 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1a24057e50 con 0x7f1a34153c70 2023-12-16T20:22:10.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.093+0000 7f1a2affd640 1 -- 172.21.15.87:0/2610442209 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f1a24054190 con 0x7f1a34153c70 2023-12-16T20:22:10.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.095+0000 7f1bdbfff640 1 -- 172.21.15.87:0/1047371945 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1be401e020 con 0x7f1bf40ceef0 2023-12-16T20:22:10.096 INFO:teuthology.orchestra.run.smithi087.stdout:55834574861 2023-12-16T20:22:10.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.098+0000 7f1bf9e7c640 1 -- 172.21.15.87:0/1047371945 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1be006ae90 msgr2=0x7f1be006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:10.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.098+0000 7f1bf9e7c640 1 --2- 172.21.15.87:0/1047371945 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1be006ae90 0x7f1be006d350 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1be8036000 tx=0x7f1be8030000 comp rx=0 tx=0).stop 2023-12-16T20:22:10.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.098+0000 7f1bf9e7c640 1 -- 172.21.15.87:0/1047371945 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bf40ceef0 msgr2=0x7f1bf40cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:10.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.098+0000 7f1bf9e7c640 1 --2- 172.21.15.87:0/1047371945 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bf40ceef0 0x7f1bf40cbc00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1be400b4a0 tx=0x7f1be400b960 comp rx=0 tx=0).stop 2023-12-16T20:22:10.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.098+0000 7f1bf9e7c640 1 -- 172.21.15.87:0/1047371945 shutdown_connections 2023-12-16T20:22:10.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.098+0000 7f1bf9e7c640 1 --2- 172.21.15.87:0/1047371945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bf4153c70 0x7f1bf41f2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.098+0000 7f1bf9e7c640 1 --2- 172.21.15.87:0/1047371945 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1be006ae90 0x7f1be006d350 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.098+0000 7f1bf9e7c640 1 --2- 172.21.15.87:0/1047371945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bf4153890 0x7f1bf41efcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.098+0000 7f1bf9e7c640 1 --2- 172.21.15.87:0/1047371945 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bf40ceef0 0x7f1bf40cbc00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.098+0000 7f1bf9e7c640 1 -- 172.21.15.87:0/1047371945 >> 172.21.15.87:0/1047371945 conn(0x7f1bf406ba00 msgr2=0x7f1bf415c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:10.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.098+0000 7f1bf9e7c640 1 -- 172.21.15.87:0/1047371945 shutdown_connections 2023-12-16T20:22:10.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.098+0000 7f1bf9e7c640 1 -- 172.21.15.87:0/1047371945 wait complete. 2023-12-16T20:22:10.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.4 2023-12-16T20:22:10.111 DEBUG:teuthology.parallel:result is None 2023-12-16T20:22:10.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.121+0000 7f7ef99ec640 1 -- 172.21.15.87:0/1803575396 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7ef41ed880 con 0x7f7ef41516c0 2023-12-16T20:22:10.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.125+0000 7f7edbfff640 1 -- 172.21.15.87:0/1803575396 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7eec04d090 con 0x7f7ef41516c0 2023-12-16T20:22:10.126 INFO:teuthology.orchestra.run.smithi087.stdout:55834574861 2023-12-16T20:22:10.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.128+0000 7f7ef99ec640 1 -- 172.21.15.87:0/1803575396 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7ee006ae90 msgr2=0x7f7ee006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:10.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.128+0000 7f7ef99ec640 1 --2- 172.21.15.87:0/1803575396 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7ee006ae90 0x7f7ee006d350 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4004e40 tx=0x7f7ee4007f10 comp rx=0 tx=0).stop 2023-12-16T20:22:10.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.128+0000 7f7ef99ec640 1 -- 172.21.15.87:0/1803575396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ef41516c0 msgr2=0x7f7ef4156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:10.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.128+0000 7f7ef99ec640 1 --2- 172.21.15.87:0/1803575396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ef41516c0 0x7f7ef4156c40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7eec033000 tx=0x7f7eec004a40 comp rx=0 tx=0).stop 2023-12-16T20:22:10.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.128+0000 7f7ef99ec640 1 -- 172.21.15.87:0/1803575396 shutdown_connections 2023-12-16T20:22:10.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.128+0000 7f7ef99ec640 1 --2- 172.21.15.87:0/1803575396 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7ee006ae90 0x7f7ee006d350 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.128+0000 7f7ef99ec640 1 --2- 172.21.15.87:0/1803575396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ef41516c0 0x7f7ef4156c40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.128+0000 7f7ef99ec640 1 --2- 172.21.15.87:0/1803575396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ef40ca280 0x7f7ef41edbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.128+0000 7f7ef99ec640 1 --2- 172.21.15.87:0/1803575396 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7ef40c79f0 0x7f7ef4158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.128+0000 7f7ef99ec640 1 -- 172.21.15.87:0/1803575396 >> 172.21.15.87:0/1803575396 conn(0x7f7ef406a8f0 msgr2=0x7f7ef40c8970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:10.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.128+0000 7f7ef99ec640 1 -- 172.21.15.87:0/1803575396 shutdown_connections 2023-12-16T20:22:10.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.128+0000 7f7ef99ec640 1 -- 172.21.15.87:0/1803575396 wait complete. 2023-12-16T20:22:10.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.2 2023-12-16T20:22:10.145 DEBUG:teuthology.parallel:result is None 2023-12-16T20:22:10.274 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.272+0000 7f1772ffd640 1 -- 172.21.15.87:0/1242419356 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f1778076d90 con 0x7f177c15d870 2023-12-16T20:22:10.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.305+0000 7f1a3c27c640 1 -- 172.21.15.87:0/2610442209 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1a34067500 con 0x7f1a34153c70 2023-12-16T20:22:10.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.308+0000 7f1a2affd640 1 -- 172.21.15.87:0/2610442209 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a24017090 con 0x7f1a34153c70 2023-12-16T20:22:10.310 INFO:teuthology.orchestra.run.smithi087.stdout:55834574861 2023-12-16T20:22:10.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.310+0000 7f1a3c27c640 1 -- 172.21.15.87:0/2610442209 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1a1806ae90 msgr2=0x7f1a1806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:10.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.310+0000 7f1a3c27c640 1 --2- 172.21.15.87:0/2610442209 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1a1806ae90 0x7f1a1806d350 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1a300017f0 tx=0x7f1a30009040 comp rx=0 tx=0).stop 2023-12-16T20:22:10.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.310+0000 7f1a3c27c640 1 -- 172.21.15.87:0/2610442209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a34153c70 msgr2=0x7f1a34152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:10.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.310+0000 7f1a3c27c640 1 --2- 172.21.15.87:0/2610442209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a34153c70 0x7f1a34152b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400c460 tx=0x7f1a2400c920 comp rx=0 tx=0).stop 2023-12-16T20:22:10.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.310+0000 7f1a3c27c640 1 -- 172.21.15.87:0/2610442209 shutdown_connections 2023-12-16T20:22:10.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.310+0000 7f1a3c27c640 1 --2- 172.21.15.87:0/2610442209 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1a1806ae90 0x7f1a1806d350 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.310+0000 7f1a3c27c640 1 --2- 172.21.15.87:0/2610442209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a3415d950 0x7f1a34151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.310+0000 7f1a3c27c640 1 --2- 172.21.15.87:0/2610442209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1a34153c70 0x7f1a34152b50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.310+0000 7f1a3c27c640 1 --2- 172.21.15.87:0/2610442209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a34153890 0x7f1a3414f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.311+0000 7f1a3c27c640 1 -- 172.21.15.87:0/2610442209 >> 172.21.15.87:0/2610442209 conn(0x7f1a3406ba00 msgr2=0x7f1a340cb990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:10.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.311+0000 7f1a3c27c640 1 -- 172.21.15.87:0/2610442209 shutdown_connections 2023-12-16T20:22:10.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.311+0000 7f1a3c27c640 1 -- 172.21.15.87:0/2610442209 wait complete. 2023-12-16T20:22:10.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.7 2023-12-16T20:22:10.324 DEBUG:teuthology.parallel:result is None 2023-12-16T20:22:10.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.462+0000 7f178427c640 1 -- 172.21.15.87:0/1242419356 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f177c0740e0 con 0x7f177c15d870 2023-12-16T20:22:10.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.467+0000 7f1772ffd640 1 -- 172.21.15.87:0/1242419356 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f177802f090 con 0x7f177c15d870 2023-12-16T20:22:10.469 INFO:teuthology.orchestra.run.smithi087.stdout:55834574861 2023-12-16T20:22:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.469+0000 7f178427c640 1 -- 172.21.15.87:0/1242419356 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f176006ae90 msgr2=0x7f176006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.469+0000 7f178427c640 1 --2- 172.21.15.87:0/1242419356 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f176006ae90 0x7f176006d350 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f177400ab90 tx=0x7f1774009250 comp rx=0 tx=0).stop 2023-12-16T20:22:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.469+0000 7f178427c640 1 -- 172.21.15.87:0/1242419356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f177c15d870 msgr2=0x7f177c0aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.469+0000 7f178427c640 1 --2- 172.21.15.87:0/1242419356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f177c15d870 0x7f177c0aeb80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1778009870 tx=0x7f17780046c0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.469+0000 7f178427c640 1 -- 172.21.15.87:0/1242419356 shutdown_connections 2023-12-16T20:22:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.469+0000 7f178427c640 1 --2- 172.21.15.87:0/1242419356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f177c15d870 0x7f177c0aeb80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.469+0000 7f178427c640 1 --2- 172.21.15.87:0/1242419356 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f176006ae90 0x7f176006d350 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.469+0000 7f178427c640 1 --2- 172.21.15.87:0/1242419356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f177c153b20 0x7f177c0ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.469+0000 7f178427c640 1 --2- 172.21.15.87:0/1242419356 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f177c0c2d60 0x7f177c0c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.469+0000 7f178427c640 1 -- 172.21.15.87:0/1242419356 >> 172.21.15.87:0/1242419356 conn(0x7f177c072930 msgr2=0x7f177c0c8910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:10.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.469+0000 7f178427c640 1 -- 172.21.15.87:0/1242419356 shutdown_connections 2023-12-16T20:22:10.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.469+0000 7f178427c640 1 -- 172.21.15.87:0/1242419356 wait complete. 2023-12-16T20:22:10.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.1 2023-12-16T20:22:10.482 DEBUG:teuthology.parallel:result is None 2023-12-16T20:22:10.482 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-16T20:22:10.482 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T20:22:10.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.584+0000 7fcbcae09640 1 Processor -- start 2023-12-16T20:22:10.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.584+0000 7fcbcae09640 1 -- start start 2023-12-16T20:22:10.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.585+0000 7fcbcae09640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbc4151720 0x7fcbc406b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:10.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.585+0000 7fcbcae09640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcbc415af60 0x7fcbc415b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:10.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.585+0000 7fcbcae09640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc4151b00 con 0x7fcbc40c68f0 2023-12-16T20:22:10.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.585+0000 7fcbcae09640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc41582b0 con 0x7fcbc415af60 2023-12-16T20:22:10.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.585+0000 7fcbcae09640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc4157730 con 0x7fcbc4151720 2023-12-16T20:22:10.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.585+0000 7fcbc3fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fcbc40c68f0 0x7fcbc406f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60042/0 (socket says 172.21.15.87:60042) 2023-12-16T20:22:10.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.585+0000 7fcbc3fff640 1 -- 172.21.15.87:0/2292205009 learned_addr learned my addr 172.21.15.87:0/2292205009 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:10.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.585+0000 7fcbc8ba5640 1 --2- 172.21.15.87:0/2292205009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbc4151720 0x7fcbc406b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:10.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.585+0000 7fcbc93a6640 1 --2- 172.21.15.87:0/2292205009 >> v2:172.21.15.195:3300/0 conn(0x7fcbc415af60 0x7fcbc415b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:10.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.588+0000 7fcbc8ba5640 1 -- 172.21.15.87:0/2292205009 >> v2:172.21.15.195:3300/0 conn(0x7fcbc415af60 msgr2=0x7fcbc415b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:10.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.588+0000 7fcbc8ba5640 1 --2- 172.21.15.87:0/2292205009 >> v2:172.21.15.195:3300/0 conn(0x7fcbc415af60 0x7fcbc415b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.588+0000 7fcbc8ba5640 1 -- 172.21.15.87:0/2292205009 >> v1:172.21.15.87:6789/0 conn(0x7fcbc40c68f0 legacy=0x7fcbc406f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:10.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.588+0000 7fcbc8ba5640 1 -- 172.21.15.87:0/2292205009 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc4157a10 con 0x7fcbc4151720 2023-12-16T20:22:10.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.590+0000 7fcbc8ba5640 1 --2- 172.21.15.87:0/2292205009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbc4151720 0x7fcbc406b840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80097a0 tx=0x7fcbb802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae223eacdbfb64d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:10.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.593+0000 7fcbc37fe640 1 -- 172.21.15.87:0/2292205009 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb802e070 con 0x7fcbc4151720 2023-12-16T20:22:10.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.594+0000 7fcbc37fe640 1 -- 172.21.15.87:0/2292205009 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb80315a0 con 0x7fcbc4151720 2023-12-16T20:22:10.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.594+0000 7fcbc37fe640 1 -- 172.21.15.87:0/2292205009 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8031930 con 0x7fcbc4151720 2023-12-16T20:22:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.594+0000 7fcbcae09640 1 -- 172.21.15.87:0/2292205009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbc4151720 msgr2=0x7fcbc406b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.594+0000 7fcbcae09640 1 --2- 172.21.15.87:0/2292205009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbc4151720 0x7fcbc406b840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80097a0 tx=0x7fcbb802b840 comp rx=0 tx=0).stop 2023-12-16T20:22:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.594+0000 7fcbcae09640 1 -- 172.21.15.87:0/2292205009 shutdown_connections 2023-12-16T20:22:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.594+0000 7fcbcae09640 1 --2- 172.21.15.87:0/2292205009 >> v2:172.21.15.195:3300/0 conn(0x7fcbc415af60 0x7fcbc415b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.594+0000 7fcbcae09640 1 --2- 172.21.15.87:0/2292205009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbc4151720 0x7fcbc406b840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.594+0000 7fcbcae09640 1 -- 172.21.15.87:0/2292205009 >> 172.21.15.87:0/2292205009 conn(0x7fcbc40cbef0 msgr2=0x7fcbc40cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.594+0000 7fcbcae09640 1 -- 172.21.15.87:0/2292205009 shutdown_connections 2023-12-16T20:22:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.594+0000 7fcbcae09640 1 -- 172.21.15.87:0/2292205009 wait complete. 2023-12-16T20:22:10.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.596+0000 7fcbcae09640 1 Processor -- start 2023-12-16T20:22:10.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.596+0000 7fcbcae09640 1 -- start start 2023-12-16T20:22:10.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.597+0000 7fcbcae09640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbc40c68f0 0x7fcbc4147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:10.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.597+0000 7fcbcae09640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbc4151720 0x7fcbc4147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:10.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.597+0000 7fcbcae09640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbc415af60 0x7fcbc40c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:10.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.597+0000 7fcbcae09640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40c7d60 con 0x7fcbc4151720 2023-12-16T20:22:10.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.597+0000 7fcbcae09640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40c6160 con 0x7fcbc40c68f0 2023-12-16T20:22:10.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.597+0000 7fcbcae09640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40c4a60 con 0x7fcbc415af60 2023-12-16T20:22:10.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.597+0000 7fcbc3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbc4151720 0x7fcbc4147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:10.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.597+0000 7fcbc93a6640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbc415af60 0x7fcbc40c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:10.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.597+0000 7fcbc3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbc4151720 0x7fcbc4147c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46732/0 (socket says 172.21.15.87:46732) 2023-12-16T20:22:10.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.597+0000 7fcbc3fff640 1 -- 172.21.15.87:0/2653769940 learned_addr learned my addr 172.21.15.87:0/2653769940 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:10.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.598+0000 7fcbc8ba5640 1 --2- 172.21.15.87:0/2653769940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbc40c68f0 0x7fcbc4147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:10.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.601+0000 7fcbc3fff640 1 -- 172.21.15.87:0/2653769940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbc415af60 msgr2=0x7fcbc40c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:10.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.601+0000 7fcbc3fff640 1 --2- 172.21.15.87:0/2653769940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbc415af60 0x7fcbc40c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.601+0000 7fcbc3fff640 1 -- 172.21.15.87:0/2653769940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbc40c68f0 msgr2=0x7fcbc4147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:10.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.601+0000 7fcbc3fff640 1 --2- 172.21.15.87:0/2653769940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbc40c68f0 0x7fcbc4147750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:10.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.601+0000 7fcbc3fff640 1 -- 172.21.15.87:0/2653769940 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb8009400 con 0x7fcbc4151720 2023-12-16T20:22:10.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.603+0000 7fcbc3fff640 1 --2- 172.21.15.87:0/2653769940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbc4151720 0x7fcbc4147c90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000c400 tx=0x7fcbb000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:10.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.607+0000 7fcbc17fa640 1 -- 172.21.15.87:0/2653769940 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0005ce0 con 0x7fcbc4151720 2023-12-16T20:22:10.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.607+0000 7fcbc17fa640 1 -- 172.21.15.87:0/2653769940 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb0005e40 con 0x7fcbc4151720 2023-12-16T20:22:10.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.607+0000 7fcbcae09640 1 -- 172.21.15.87:0/2653769940 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc40c4d40 con 0x7fcbc4151720 2023-12-16T20:22:10.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.607+0000 7fcbc17fa640 1 -- 172.21.15.87:0/2653769940 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb00072f0 con 0x7fcbc4151720 2023-12-16T20:22:10.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.607+0000 7fcbcae09640 1 -- 172.21.15.87:0/2653769940 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc40c5020 con 0x7fcbc4151720 2023-12-16T20:22:10.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.608+0000 7fcbcae09640 1 -- 172.21.15.87:0/2653769940 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc40cce50 con 0x7fcbc4151720 2023-12-16T20:22:10.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.636+0000 7fcbc17fa640 1 -- 172.21.15.87:0/2653769940 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fcbb0007510 con 0x7fcbc4151720 2023-12-16T20:22:10.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.637+0000 7fcbc17fa640 1 --2- 172.21.15.87:0/2653769940 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fcba806ae90 0x7fcba806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:10.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.637+0000 7fcbc8ba5640 1 --2- 172.21.15.87:0/2653769940 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fcba806ae90 0x7fcba806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:10.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.637+0000 7fcbc8ba5640 1 --2- 172.21.15.87:0/2653769940 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fcba806ae90 0x7fcba806d350 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8036000 tx=0x7fcbb803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:10.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.896+0000 7fcbc17fa640 1 -- 172.21.15.87:0/2653769940 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcbb0057e30 con 0x7fcbc4151720 2023-12-16T20:22:10.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:10.896+0000 7fcbc17fa640 1 -- 172.21.15.87:0/2653769940 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fcbb0054170 con 0x7fcbc4151720 2023-12-16T20:22:11.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.069+0000 7fcbcae09640 1 -- 172.21.15.87:0/2653769940 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcbc4067ba0 con 0x7fcba806ae90 2023-12-16T20:22:11.078 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.077+0000 7fcbc17fa640 1 -- 172.21.15.87:0/2653769940 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345314 (secure 0 0 0) 0x7fcbc4067ba0 con 0x7fcba806ae90 2023-12-16T20:22:11.082 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:22:11.084 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-12-16T20:22:11.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.081+0000 7fcbcae09640 1 -- 172.21.15.87:0/2653769940 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fcba806ae90 msgr2=0x7fcba806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:11.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.081+0000 7fcbcae09640 1 --2- 172.21.15.87:0/2653769940 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fcba806ae90 0x7fcba806d350 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8036000 tx=0x7fcbb803d040 comp rx=0 tx=0).stop 2023-12-16T20:22:11.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.081+0000 7fcbcae09640 1 -- 172.21.15.87:0/2653769940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbc4151720 msgr2=0x7fcbc4147c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:11.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.081+0000 7fcbcae09640 1 --2- 172.21.15.87:0/2653769940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbc4151720 0x7fcbc4147c90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000c400 tx=0x7fcbb000c8c0 comp rx=0 tx=0).stop 2023-12-16T20:22:11.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.081+0000 7fcbcae09640 1 -- 172.21.15.87:0/2653769940 shutdown_connections 2023-12-16T20:22:11.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.081+0000 7fcbcae09640 1 --2- 172.21.15.87:0/2653769940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbc415af60 0x7fcbc40c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:11.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.081+0000 7fcbcae09640 1 --2- 172.21.15.87:0/2653769940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbc4151720 0x7fcbc4147c90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:11.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.081+0000 7fcbcae09640 1 --2- 172.21.15.87:0/2653769940 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fcba806ae90 0x7fcba806d350 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:11.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.081+0000 7fcbcae09640 1 --2- 172.21.15.87:0/2653769940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbc40c68f0 0x7fcbc4147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:11.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.081+0000 7fcbcae09640 1 -- 172.21.15.87:0/2653769940 >> 172.21.15.87:0/2653769940 conn(0x7fcbc40cbef0 msgr2=0x7fcbc414c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:11.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.081+0000 7fcbcae09640 1 -- 172.21.15.87:0/2653769940 shutdown_connections 2023-12-16T20:22:11.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.081+0000 7fcbcae09640 1 -- 172.21.15.87:0/2653769940 wait complete. 2023-12-16T20:22:11.094 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2023-12-16T20:22:10.285934+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595006,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222592,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754752128,"statfs":{"total":773094113280,"available":772866179072,"internally_reserved":0,"allocated":2326528,"data_stored":2025716,"data_compressed":65176,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002979"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738410+0000","last_change":"2023-12-16T20:21:35.413343+0000","last_active":"2023-12-16T20:21:40.738410+0000","last_peered":"2023-12-16T20:21:40.738410+0000","last_clean":"2023-12-16T20:21:40.738410+0000","last_became_active":"2023-12-16T20:21:35.413075+0000","last_became_peered":"2023-12-16T20:21:35.413075+0000","last_unstale":"2023-12-16T20:21:40.738410+0000","last_undegraded":"2023-12-16T20:21:40.738410+0000","last_fullsized":"2023-12-16T20:21:40.738410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672090+0000","last_change":"2023-12-16T20:21:36.542907+0000","last_active":"2023-12-16T20:21:40.672090+0000","last_peered":"2023-12-16T20:21:40.672090+0000","last_clean":"2023-12-16T20:21:40.672090+0000","last_became_active":"2023-12-16T20:21:36.542667+0000","last_became_peered":"2023-12-16T20:21:36.542667+0000","last_unstale":"2023-12-16T20:21:40.672090+0000","last_undegraded":"2023-12-16T20:21:40.672090+0000","last_fullsized":"2023-12-16T20:21:40.672090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.876874+0000","last_change":"2023-12-16T20:21:41.216466+0000","last_active":"2023-12-16T20:21:41.876874+0000","last_peered":"2023-12-16T20:21:41.876874+0000","last_clean":"2023-12-16T20:21:41.876874+0000","last_became_active":"2023-12-16T20:21:41.216062+0000","last_became_peered":"2023-12-16T20:21:41.216062+0000","last_unstale":"2023-12-16T20:21:41.876874+0000","last_undegraded":"2023-12-16T20:21:41.876874+0000","last_fullsized":"2023-12-16T20:21:41.876874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:33:01.663841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672276+0000","last_change":"2023-12-16T20:21:35.420038+0000","last_active":"2023-12-16T20:21:40.672276+0000","last_peered":"2023-12-16T20:21:40.672276+0000","last_clean":"2023-12-16T20:21:40.672276+0000","last_became_active":"2023-12-16T20:21:35.419745+0000","last_became_peered":"2023-12-16T20:21:35.419745+0000","last_unstale":"2023-12-16T20:21:40.672276+0000","last_undegraded":"2023-12-16T20:21:40.672276+0000","last_fullsized":"2023-12-16T20:21:40.672276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738303+0000","last_change":"2023-12-16T20:21:36.552916+0000","last_active":"2023-12-16T20:21:40.738303+0000","last_peered":"2023-12-16T20:21:40.738303+0000","last_clean":"2023-12-16T20:21:40.738303+0000","last_became_active":"2023-12-16T20:21:36.552621+0000","last_became_peered":"2023-12-16T20:21:36.552621+0000","last_unstale":"2023-12-16T20:21:40.738303+0000","last_undegraded":"2023-12-16T20:21:40.738303+0000","last_fullsized":"2023-12-16T20:21:40.738303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877621+0000","last_change":"2023-12-16T20:21:40.754959+0000","last_active":"2023-12-16T20:21:41.877621+0000","last_peered":"2023-12-16T20:21:41.877621+0000","last_clean":"2023-12-16T20:21:41.877621+0000","last_became_active":"2023-12-16T20:21:40.754509+0000","last_became_peered":"2023-12-16T20:21:40.754509+0000","last_unstale":"2023-12-16T20:21:41.877621+0000","last_undegraded":"2023-12-16T20:21:41.877621+0000","last_fullsized":"2023-12-16T20:21:41.877621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:21.787809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211739+0000","last_change":"2023-12-16T20:21:35.427622+0000","last_active":"2023-12-16T20:21:41.211739+0000","last_peered":"2023-12-16T20:21:41.211739+0000","last_clean":"2023-12-16T20:21:41.211739+0000","last_became_active":"2023-12-16T20:21:35.427317+0000","last_became_peered":"2023-12-16T20:21:35.427317+0000","last_unstale":"2023-12-16T20:21:41.211739+0000","last_undegraded":"2023-12-16T20:21:41.211739+0000","last_fullsized":"2023-12-16T20:21:41.211739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791265+0000","last_change":"2023-12-16T20:21:36.551723+0000","last_active":"2023-12-16T20:21:40.791265+0000","last_peered":"2023-12-16T20:21:40.791265+0000","last_clean":"2023-12-16T20:21:40.791265+0000","last_became_active":"2023-12-16T20:21:36.551475+0000","last_became_peered":"2023-12-16T20:21:36.551475+0000","last_unstale":"2023-12-16T20:21:40.791265+0000","last_undegraded":"2023-12-16T20:21:40.791265+0000","last_fullsized":"2023-12-16T20:21:40.791265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877788+0000","last_change":"2023-12-16T20:21:40.753693+0000","last_active":"2023-12-16T20:21:41.877788+0000","last_peered":"2023-12-16T20:21:41.877788+0000","last_clean":"2023-12-16T20:21:41.877788+0000","last_became_active":"2023-12-16T20:21:40.753268+0000","last_became_peered":"2023-12-16T20:21:40.753268+0000","last_unstale":"2023-12-16T20:21:41.877788+0000","last_undegraded":"2023-12-16T20:21:41.877788+0000","last_fullsized":"2023-12-16T20:21:41.877788+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:39.757419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211396+0000","last_change":"2023-12-16T20:21:35.413521+0000","last_active":"2023-12-16T20:21:41.211396+0000","last_peered":"2023-12-16T20:21:41.211396+0000","last_clean":"2023-12-16T20:21:41.211396+0000","last_became_active":"2023-12-16T20:21:35.413234+0000","last_became_peered":"2023-12-16T20:21:35.413234+0000","last_unstale":"2023-12-16T20:21:41.211396+0000","last_undegraded":"2023-12-16T20:21:41.211396+0000","last_fullsized":"2023-12-16T20:21:41.211396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791426+0000","last_change":"2023-12-16T20:21:36.554419+0000","last_active":"2023-12-16T20:21:40.791426+0000","last_peered":"2023-12-16T20:21:40.791426+0000","last_clean":"2023-12-16T20:21:40.791426+0000","last_became_active":"2023-12-16T20:21:36.554014+0000","last_became_peered":"2023-12-16T20:21:36.554014+0000","last_unstale":"2023-12-16T20:21:40.791426+0000","last_undegraded":"2023-12-16T20:21:40.791426+0000","last_fullsized":"2023-12-16T20:21:40.791426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:03.543973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877746+0000","last_change":"2023-12-16T20:21:40.794852+0000","last_active":"2023-12-16T20:21:41.877746+0000","last_peered":"2023-12-16T20:21:41.877746+0000","last_clean":"2023-12-16T20:21:41.877746+0000","last_became_active":"2023-12-16T20:21:40.794471+0000","last_became_peered":"2023-12-16T20:21:40.794471+0000","last_unstale":"2023-12-16T20:21:41.877746+0000","last_undegraded":"2023-12-16T20:21:41.877746+0000","last_fullsized":"2023-12-16T20:21:41.877746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:25.004850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752195+0000","last_change":"2023-12-16T20:21:36.542450+0000","last_active":"2023-12-16T20:21:40.752195+0000","last_peered":"2023-12-16T20:21:40.752195+0000","last_clean":"2023-12-16T20:21:40.752195+0000","last_became_active":"2023-12-16T20:21:36.542157+0000","last_became_peered":"2023-12-16T20:21:36.542157+0000","last_unstale":"2023-12-16T20:21:40.752195+0000","last_undegraded":"2023-12-16T20:21:40.752195+0000","last_fullsized":"2023-12-16T20:21:40.752195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211548+0000","last_change":"2023-12-16T20:21:35.413681+0000","last_active":"2023-12-16T20:21:41.211548+0000","last_peered":"2023-12-16T20:21:41.211548+0000","last_clean":"2023-12-16T20:21:41.211548+0000","last_became_active":"2023-12-16T20:21:35.413400+0000","last_became_peered":"2023-12-16T20:21:35.413400+0000","last_unstale":"2023-12-16T20:21:41.211548+0000","last_undegraded":"2023-12-16T20:21:41.211548+0000","last_fullsized":"2023-12-16T20:21:41.211548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:27.767422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.878229+0000","last_change":"2023-12-16T20:21:40.745971+0000","last_active":"2023-12-16T20:21:41.878229+0000","last_peered":"2023-12-16T20:21:41.878229+0000","last_clean":"2023-12-16T20:21:41.878229+0000","last_became_active":"2023-12-16T20:21:40.745544+0000","last_became_peered":"2023-12-16T20:21:40.745544+0000","last_unstale":"2023-12-16T20:21:41.878229+0000","last_undegraded":"2023-12-16T20:21:41.878229+0000","last_fullsized":"2023-12-16T20:21:41.878229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:18.981353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672085+0000","last_change":"2023-12-16T20:21:36.526277+0000","last_active":"2023-12-16T20:21:40.672085+0000","last_peered":"2023-12-16T20:21:40.672085+0000","last_clean":"2023-12-16T20:21:40.672085+0000","last_became_active":"2023-12-16T20:21:36.525983+0000","last_became_peered":"2023-12-16T20:21:36.525983+0000","last_unstale":"2023-12-16T20:21:40.672085+0000","last_undegraded":"2023-12-16T20:21:40.672085+0000","last_fullsized":"2023-12-16T20:21:40.672085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743603+0000","last_change":"2023-12-16T20:21:35.420017+0000","last_active":"2023-12-16T20:21:40.743603+0000","last_peered":"2023-12-16T20:21:40.743603+0000","last_clean":"2023-12-16T20:21:40.743603+0000","last_became_active":"2023-12-16T20:21:35.419731+0000","last_became_peered":"2023-12-16T20:21:35.419731+0000","last_unstale":"2023-12-16T20:21:40.743603+0000","last_undegraded":"2023-12-16T20:21:40.743603+0000","last_fullsized":"2023-12-16T20:21:40.743603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:29.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.878175+0000","last_change":"2023-12-16T20:21:40.755335+0000","last_active":"2023-12-16T20:21:41.878175+0000","last_peered":"2023-12-16T20:21:41.878175+0000","last_clean":"2023-12-16T20:21:41.878175+0000","last_became_active":"2023-12-16T20:21:40.754829+0000","last_became_peered":"2023-12-16T20:21:40.754829+0000","last_unstale":"2023-12-16T20:21:41.878175+0000","last_undegraded":"2023-12-16T20:21:41.878175+0000","last_fullsized":"2023-12-16T20:21:41.878175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.673227+0000","last_change":"2023-12-16T20:21:36.518939+0000","last_active":"2023-12-16T20:21:40.673227+0000","last_peered":"2023-12-16T20:21:40.673227+0000","last_clean":"2023-12-16T20:21:40.673227+0000","last_became_active":"2023-12-16T20:21:36.518686+0000","last_became_peered":"2023-12-16T20:21:36.518686+0000","last_unstale":"2023-12-16T20:21:40.673227+0000","last_undegraded":"2023-12-16T20:21:40.673227+0000","last_fullsized":"2023-12-16T20:21:40.673227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742823+0000","last_change":"2023-12-16T20:21:35.416372+0000","last_active":"2023-12-16T20:21:40.742823+0000","last_peered":"2023-12-16T20:21:40.742823+0000","last_clean":"2023-12-16T20:21:40.742823+0000","last_became_active":"2023-12-16T20:21:35.416067+0000","last_became_peered":"2023-12-16T20:21:35.416067+0000","last_unstale":"2023-12-16T20:21:40.742823+0000","last_undegraded":"2023-12-16T20:21:40.742823+0000","last_fullsized":"2023-12-16T20:21:40.742823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:37.215505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.432342+0000","last_change":"2023-12-16T20:21:41.215250+0000","last_active":"2023-12-16T20:21:43.432342+0000","last_peered":"2023-12-16T20:21:43.432342+0000","last_clean":"2023-12-16T20:21:43.432342+0000","last_became_active":"2023-12-16T20:21:41.214198+0000","last_became_peered":"2023-12-16T20:21:41.214198+0000","last_unstale":"2023-12-16T20:21:43.432342+0000","last_undegraded":"2023-12-16T20:21:43.432342+0000","last_fullsized":"2023-12-16T20:21:43.432342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:41.263768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726299+0000","last_change":"2023-12-16T20:21:36.536797+0000","last_active":"2023-12-16T20:21:40.726299+0000","last_peered":"2023-12-16T20:21:40.726299+0000","last_clean":"2023-12-16T20:21:40.726299+0000","last_became_active":"2023-12-16T20:21:36.536321+0000","last_became_peered":"2023-12-16T20:21:36.536321+0000","last_unstale":"2023-12-16T20:21:40.726299+0000","last_undegraded":"2023-12-16T20:21:40.726299+0000","last_fullsized":"2023-12-16T20:21:40.726299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:55:55.607439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211371+0000","last_change":"2023-12-16T20:21:35.425939+0000","last_active":"2023-12-16T20:21:41.211371+0000","last_peered":"2023-12-16T20:21:41.211371+0000","last_clean":"2023-12-16T20:21:41.211371+0000","last_became_active":"2023-12-16T20:21:35.420547+0000","last_became_peered":"2023-12-16T20:21:35.420547+0000","last_unstale":"2023-12-16T20:21:41.211371+0000","last_undegraded":"2023-12-16T20:21:41.211371+0000","last_fullsized":"2023-12-16T20:21:41.211371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:58:31.980302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.878401+0000","last_change":"2023-12-16T20:21:40.757445+0000","last_active":"2023-12-16T20:21:41.878401+0000","last_peered":"2023-12-16T20:21:41.878401+0000","last_clean":"2023-12-16T20:21:41.878401+0000","last_became_active":"2023-12-16T20:21:40.756997+0000","last_became_peered":"2023-12-16T20:21:40.756997+0000","last_unstale":"2023-12-16T20:21:41.878401+0000","last_undegraded":"2023-12-16T20:21:41.878401+0000","last_fullsized":"2023-12-16T20:21:41.878401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:32.702839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738149+0000","last_change":"2023-12-16T20:21:36.524943+0000","last_active":"2023-12-16T20:21:40.738149+0000","last_peered":"2023-12-16T20:21:40.738149+0000","last_clean":"2023-12-16T20:21:40.738149+0000","last_became_active":"2023-12-16T20:21:36.524703+0000","last_became_peered":"2023-12-16T20:21:36.524703+0000","last_unstale":"2023-12-16T20:21:40.738149+0000","last_undegraded":"2023-12-16T20:21:40.738149+0000","last_fullsized":"2023-12-16T20:21:40.738149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.753645+0000","last_change":"2023-12-16T20:21:35.428736+0000","last_active":"2023-12-16T20:21:40.753645+0000","last_peered":"2023-12-16T20:21:40.753645+0000","last_clean":"2023-12-16T20:21:40.753645+0000","last_became_active":"2023-12-16T20:21:35.428465+0000","last_became_peered":"2023-12-16T20:21:35.428465+0000","last_unstale":"2023-12-16T20:21:40.753645+0000","last_undegraded":"2023-12-16T20:21:40.753645+0000","last_fullsized":"2023-12-16T20:21:40.753645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877780+0000","last_change":"2023-12-16T20:21:41.213330+0000","last_active":"2023-12-16T20:21:41.877780+0000","last_peered":"2023-12-16T20:21:41.877780+0000","last_clean":"2023-12-16T20:21:41.877780+0000","last_became_active":"2023-12-16T20:21:41.212976+0000","last_became_peered":"2023-12-16T20:21:41.212976+0000","last_unstale":"2023-12-16T20:21:41.877780+0000","last_undegraded":"2023-12-16T20:21:41.877780+0000","last_fullsized":"2023-12-16T20:21:41.877780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:32:02.178544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672371+0000","last_change":"2023-12-16T20:21:36.518956+0000","last_active":"2023-12-16T20:21:40.672371+0000","last_peered":"2023-12-16T20:21:40.672371+0000","last_clean":"2023-12-16T20:21:40.672371+0000","last_became_active":"2023-12-16T20:21:36.518673+0000","last_became_peered":"2023-12-16T20:21:36.518673+0000","last_unstale":"2023-12-16T20:21:40.672371+0000","last_undegraded":"2023-12-16T20:21:40.672371+0000","last_fullsized":"2023-12-16T20:21:40.672371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743808+0000","last_change":"2023-12-16T20:21:35.423292+0000","last_active":"2023-12-16T20:21:40.743808+0000","last_peered":"2023-12-16T20:21:40.743808+0000","last_clean":"2023-12-16T20:21:40.743808+0000","last_became_active":"2023-12-16T20:21:35.423045+0000","last_became_peered":"2023-12-16T20:21:35.423045+0000","last_unstale":"2023-12-16T20:21:40.743808+0000","last_undegraded":"2023-12-16T20:21:40.743808+0000","last_fullsized":"2023-12-16T20:21:40.743808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.876800+0000","last_change":"2023-12-16T20:21:41.216113+0000","last_active":"2023-12-16T20:21:41.876800+0000","last_peered":"2023-12-16T20:21:41.876800+0000","last_clean":"2023-12-16T20:21:41.876800+0000","last_became_active":"2023-12-16T20:21:41.215747+0000","last_became_peered":"2023-12-16T20:21:41.215747+0000","last_unstale":"2023-12-16T20:21:41.876800+0000","last_undegraded":"2023-12-16T20:21:41.876800+0000","last_fullsized":"2023-12-16T20:21:41.876800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:10:17.859148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742993+0000","last_change":"2023-12-16T20:21:36.451660+0000","last_active":"2023-12-16T20:21:40.742993+0000","last_peered":"2023-12-16T20:21:40.742993+0000","last_clean":"2023-12-16T20:21:40.742993+0000","last_became_active":"2023-12-16T20:21:36.451404+0000","last_became_peered":"2023-12-16T20:21:36.451404+0000","last_unstale":"2023-12-16T20:21:40.742993+0000","last_undegraded":"2023-12-16T20:21:40.742993+0000","last_fullsized":"2023-12-16T20:21:40.742993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211871+0000","last_change":"2023-12-16T20:21:35.420184+0000","last_active":"2023-12-16T20:21:41.211871+0000","last_peered":"2023-12-16T20:21:41.211871+0000","last_clean":"2023-12-16T20:21:41.211871+0000","last_became_active":"2023-12-16T20:21:35.419917+0000","last_became_peered":"2023-12-16T20:21:35.419917+0000","last_unstale":"2023-12-16T20:21:41.211871+0000","last_undegraded":"2023-12-16T20:21:41.211871+0000","last_fullsized":"2023-12-16T20:21:41.211871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:19.491578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.135002+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:21:44.135002+0000","last_peered":"2023-12-16T20:21:44.135002+0000","last_clean":"2023-12-16T20:21:44.135002+0000","last_became_active":"2023-12-16T20:21:41.212704+0000","last_became_peered":"2023-12-16T20:21:41.212704+0000","last_unstale":"2023-12-16T20:21:44.135002+0000","last_undegraded":"2023-12-16T20:21:44.135002+0000","last_fullsized":"2023-12-16T20:21:44.135002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:11.201128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791502+0000","last_change":"2023-12-16T20:21:36.555288+0000","last_active":"2023-12-16T20:21:40.791502+0000","last_peered":"2023-12-16T20:21:40.791502+0000","last_clean":"2023-12-16T20:21:40.791502+0000","last_became_active":"2023-12-16T20:21:36.555011+0000","last_became_peered":"2023-12-16T20:21:36.555011+0000","last_unstale":"2023-12-16T20:21:40.791502+0000","last_undegraded":"2023-12-16T20:21:40.791502+0000","last_fullsized":"2023-12-16T20:21:40.791502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:06.805922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743003+0000","last_change":"2023-12-16T20:21:35.417945+0000","last_active":"2023-12-16T20:21:40.743003+0000","last_peered":"2023-12-16T20:21:40.743003+0000","last_clean":"2023-12-16T20:21:40.743003+0000","last_became_active":"2023-12-16T20:21:35.417683+0000","last_became_peered":"2023-12-16T20:21:35.417683+0000","last_unstale":"2023-12-16T20:21:40.743003+0000","last_undegraded":"2023-12-16T20:21:40.743003+0000","last_fullsized":"2023-12-16T20:21:40.743003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:18.427670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.431936+0000","last_change":"2023-12-16T20:21:40.794299+0000","last_active":"2023-12-16T20:21:43.431936+0000","last_peered":"2023-12-16T20:21:43.431936+0000","last_clean":"2023-12-16T20:21:43.431936+0000","last_became_active":"2023-12-16T20:21:40.793754+0000","last_became_peered":"2023-12-16T20:21:40.793754+0000","last_unstale":"2023-12-16T20:21:43.431936+0000","last_undegraded":"2023-12-16T20:21:43.431936+0000","last_fullsized":"2023-12-16T20:21:43.431936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:10.036962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726356+0000","last_change":"2023-12-16T20:21:36.534278+0000","last_active":"2023-12-16T20:21:40.726356+0000","last_peered":"2023-12-16T20:21:40.726356+0000","last_clean":"2023-12-16T20:21:40.726356+0000","last_became_active":"2023-12-16T20:21:36.533651+0000","last_became_peered":"2023-12-16T20:21:36.533651+0000","last_unstale":"2023-12-16T20:21:40.726356+0000","last_undegraded":"2023-12-16T20:21:40.726356+0000","last_fullsized":"2023-12-16T20:21:40.726356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:58:33.098369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.792221+0000","last_change":"2023-12-16T20:21:35.422128+0000","last_active":"2023-12-16T20:21:40.792221+0000","last_peered":"2023-12-16T20:21:40.792221+0000","last_clean":"2023-12-16T20:21:40.792221+0000","last_became_active":"2023-12-16T20:21:35.421875+0000","last_became_peered":"2023-12-16T20:21:35.421875+0000","last_unstale":"2023-12-16T20:21:40.792221+0000","last_undegraded":"2023-12-16T20:21:40.792221+0000","last_fullsized":"2023-12-16T20:21:40.792221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:24.569380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.432241+0000","last_change":"2023-12-16T20:21:40.754363+0000","last_active":"2023-12-16T20:21:43.432241+0000","last_peered":"2023-12-16T20:21:43.432241+0000","last_clean":"2023-12-16T20:21:43.432241+0000","last_became_active":"2023-12-16T20:21:40.753994+0000","last_became_peered":"2023-12-16T20:21:40.753994+0000","last_unstale":"2023-12-16T20:21:43.432241+0000","last_undegraded":"2023-12-16T20:21:43.432241+0000","last_fullsized":"2023-12-16T20:21:43.432241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:07.939178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742945+0000","last_change":"2023-12-16T20:21:36.451488+0000","last_active":"2023-12-16T20:21:40.742945+0000","last_peered":"2023-12-16T20:21:40.742945+0000","last_clean":"2023-12-16T20:21:40.742945+0000","last_became_active":"2023-12-16T20:21:36.451231+0000","last_became_peered":"2023-12-16T20:21:36.451231+0000","last_unstale":"2023-12-16T20:21:40.742945+0000","last_undegraded":"2023-12-16T20:21:40.742945+0000","last_fullsized":"2023-12-16T20:21:40.742945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725582+0000","last_change":"2023-12-16T20:21:35.420494+0000","last_active":"2023-12-16T20:21:40.725582+0000","last_peered":"2023-12-16T20:21:40.725582+0000","last_clean":"2023-12-16T20:21:40.725582+0000","last_became_active":"2023-12-16T20:21:35.420236+0000","last_became_peered":"2023-12-16T20:21:35.420236+0000","last_unstale":"2023-12-16T20:21:40.725582+0000","last_undegraded":"2023-12-16T20:21:40.725582+0000","last_fullsized":"2023-12-16T20:21:40.725582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:55:54.489373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.432363+0000","last_change":"2023-12-16T20:21:40.794400+0000","last_active":"2023-12-16T20:21:43.432363+0000","last_peered":"2023-12-16T20:21:43.432363+0000","last_clean":"2023-12-16T20:21:43.432363+0000","last_became_active":"2023-12-16T20:21:40.793947+0000","last_became_peered":"2023-12-16T20:21:40.793947+0000","last_unstale":"2023-12-16T20:21:43.432363+0000","last_undegraded":"2023-12-16T20:21:43.432363+0000","last_fullsized":"2023-12-16T20:21:43.432363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:16.656597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.737925+0000","last_change":"2023-12-16T20:21:36.535835+0000","last_active":"2023-12-16T20:21:40.737925+0000","last_peered":"2023-12-16T20:21:40.737925+0000","last_clean":"2023-12-16T20:21:40.737925+0000","last_became_active":"2023-12-16T20:21:36.535571+0000","last_became_peered":"2023-12-16T20:21:36.535571+0000","last_unstale":"2023-12-16T20:21:40.737925+0000","last_undegraded":"2023-12-16T20:21:40.737925+0000","last_fullsized":"2023-12-16T20:21:40.737925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:54.719426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211381+0000","last_change":"2023-12-16T20:21:35.418993+0000","last_active":"2023-12-16T20:21:41.211381+0000","last_peered":"2023-12-16T20:21:41.211381+0000","last_clean":"2023-12-16T20:21:41.211381+0000","last_became_active":"2023-12-16T20:21:35.418751+0000","last_became_peered":"2023-12-16T20:21:35.418751+0000","last_unstale":"2023-12-16T20:21:41.211381+0000","last_undegraded":"2023-12-16T20:21:41.211381+0000","last_fullsized":"2023-12-16T20:21:41.211381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:18.391557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.135405+0000","last_change":"2023-12-16T20:21:41.214405+0000","last_active":"2023-12-16T20:21:44.135405+0000","last_peered":"2023-12-16T20:21:44.135405+0000","last_clean":"2023-12-16T20:21:44.135405+0000","last_became_active":"2023-12-16T20:21:41.213977+0000","last_became_peered":"2023-12-16T20:21:41.213977+0000","last_unstale":"2023-12-16T20:21:44.135405+0000","last_undegraded":"2023-12-16T20:21:44.135405+0000","last_fullsized":"2023-12-16T20:21:44.135405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:16.656597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.671919+0000","last_change":"2023-12-16T20:21:36.551240+0000","last_active":"2023-12-16T20:21:40.671919+0000","last_peered":"2023-12-16T20:21:40.671919+0000","last_clean":"2023-12-16T20:21:40.671919+0000","last_became_active":"2023-12-16T20:21:36.550997+0000","last_became_peered":"2023-12-16T20:21:36.550997+0000","last_unstale":"2023-12-16T20:21:40.671919+0000","last_undegraded":"2023-12-16T20:21:40.671919+0000","last_fullsized":"2023-12-16T20:21:40.671919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791233+0000","last_change":"2023-12-16T20:21:35.416258+0000","last_active":"2023-12-16T20:21:40.791233+0000","last_peered":"2023-12-16T20:21:40.791233+0000","last_clean":"2023-12-16T20:21:40.791233+0000","last_became_active":"2023-12-16T20:21:35.415984+0000","last_became_peered":"2023-12-16T20:21:35.415984+0000","last_unstale":"2023-12-16T20:21:40.791233+0000","last_undegraded":"2023-12-16T20:21:40.791233+0000","last_fullsized":"2023-12-16T20:21:40.791233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:06.872220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211463+0000","last_change":"2023-12-16T20:21:25.196796+0000","last_active":"2023-12-16T20:21:41.211463+0000","last_peered":"2023-12-16T20:21:41.211463+0000","last_clean":"2023-12-16T20:21:41.211463+0000","last_became_active":"2023-12-16T20:21:25.195675+0000","last_became_peered":"2023-12-16T20:21:25.195675+0000","last_unstale":"2023-12-16T20:21:41.211463+0000","last_undegraded":"2023-12-16T20:21:41.211463+0000","last_fullsized":"2023-12-16T20:21:41.211463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:23.008820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:23.008820+0000","last_clean_scrub_stamp":"2023-12-16T20:21:23.008820+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:46:02.232774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.184671+0000","last_change":"2023-12-16T20:21:41.214322+0000","last_active":"2023-12-16T20:21:44.184671+0000","last_peered":"2023-12-16T20:21:44.184671+0000","last_clean":"2023-12-16T20:21:44.184671+0000","last_became_active":"2023-12-16T20:21:41.214012+0000","last_became_peered":"2023-12-16T20:21:41.214012+0000","last_unstale":"2023-12-16T20:21:44.184671+0000","last_undegraded":"2023-12-16T20:21:44.184671+0000","last_fullsized":"2023-12-16T20:21:44.184671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:18.981353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211688+0000","last_change":"2023-12-16T20:21:36.552920+0000","last_active":"2023-12-16T20:21:41.211688+0000","last_peered":"2023-12-16T20:21:41.211688+0000","last_clean":"2023-12-16T20:21:41.211688+0000","last_became_active":"2023-12-16T20:21:36.552619+0000","last_became_peered":"2023-12-16T20:21:36.552619+0000","last_unstale":"2023-12-16T20:21:41.211688+0000","last_undegraded":"2023-12-16T20:21:41.211688+0000","last_fullsized":"2023-12-16T20:21:41.211688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:14.586148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725929+0000","last_change":"2023-12-16T20:21:35.413597+0000","last_active":"2023-12-16T20:21:40.725929+0000","last_peered":"2023-12-16T20:21:40.725929+0000","last_clean":"2023-12-16T20:21:40.725929+0000","last_became_active":"2023-12-16T20:21:35.413308+0000","last_became_peered":"2023-12-16T20:21:35.413308+0000","last_unstale":"2023-12-16T20:21:40.725929+0000","last_undegraded":"2023-12-16T20:21:40.725929+0000","last_fullsized":"2023-12-16T20:21:40.725929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:55:39.544748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.184449+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:21:44.184449+0000","last_peered":"2023-12-16T20:21:44.184449+0000","last_clean":"2023-12-16T20:21:44.184449+0000","last_became_active":"2023-12-16T20:21:41.212608+0000","last_became_peered":"2023-12-16T20:21:41.212608+0000","last_unstale":"2023-12-16T20:21:44.184449+0000","last_undegraded":"2023-12-16T20:21:44.184449+0000","last_fullsized":"2023-12-16T20:21:44.184449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791343+0000","last_change":"2023-12-16T20:21:36.555870+0000","last_active":"2023-12-16T20:21:40.791343+0000","last_peered":"2023-12-16T20:21:40.791343+0000","last_clean":"2023-12-16T20:21:40.791343+0000","last_became_active":"2023-12-16T20:21:36.555631+0000","last_became_peered":"2023-12-16T20:21:36.555631+0000","last_unstale":"2023-12-16T20:21:40.791343+0000","last_undegraded":"2023-12-16T20:21:40.791343+0000","last_fullsized":"2023-12-16T20:21:40.791343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:10.421516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743686+0000","last_change":"2023-12-16T20:21:35.416140+0000","last_active":"2023-12-16T20:21:40.743686+0000","last_peered":"2023-12-16T20:21:40.743686+0000","last_clean":"2023-12-16T20:21:40.743686+0000","last_became_active":"2023-12-16T20:21:35.415810+0000","last_became_peered":"2023-12-16T20:21:35.415810+0000","last_unstale":"2023-12-16T20:21:40.743686+0000","last_undegraded":"2023-12-16T20:21:40.743686+0000","last_fullsized":"2023-12-16T20:21:40.743686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.135131+0000","last_change":"2023-12-16T20:21:40.794366+0000","last_active":"2023-12-16T20:21:44.135131+0000","last_peered":"2023-12-16T20:21:44.135131+0000","last_clean":"2023-12-16T20:21:44.135131+0000","last_became_active":"2023-12-16T20:21:40.793989+0000","last_became_peered":"2023-12-16T20:21:40.793989+0000","last_unstale":"2023-12-16T20:21:44.135131+0000","last_undegraded":"2023-12-16T20:21:44.135131+0000","last_fullsized":"2023-12-16T20:21:44.135131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:41.263768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211819+0000","last_change":"2023-12-16T20:21:36.536346+0000","last_active":"2023-12-16T20:21:41.211819+0000","last_peered":"2023-12-16T20:21:41.211819+0000","last_clean":"2023-12-16T20:21:41.211819+0000","last_became_active":"2023-12-16T20:21:36.536093+0000","last_became_peered":"2023-12-16T20:21:36.536093+0000","last_unstale":"2023-12-16T20:21:41.211819+0000","last_undegraded":"2023-12-16T20:21:41.211819+0000","last_fullsized":"2023-12-16T20:21:41.211819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:12.261391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725494+0000","last_change":"2023-12-16T20:21:35.420314+0000","last_active":"2023-12-16T20:21:40.725494+0000","last_peered":"2023-12-16T20:21:40.725494+0000","last_clean":"2023-12-16T20:21:40.725494+0000","last_became_active":"2023-12-16T20:21:35.420074+0000","last_became_peered":"2023-12-16T20:21:35.420074+0000","last_unstale":"2023-12-16T20:21:40.725494+0000","last_undegraded":"2023-12-16T20:21:40.725494+0000","last_fullsized":"2023-12-16T20:21:40.725494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:29.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.109595+0000","last_change":"2023-12-16T20:21:41.215282+0000","last_active":"2023-12-16T20:21:44.109595+0000","last_peered":"2023-12-16T20:21:44.109595+0000","last_clean":"2023-12-16T20:21:44.109595+0000","last_became_active":"2023-12-16T20:21:41.214939+0000","last_became_peered":"2023-12-16T20:21:41.214939+0000","last_unstale":"2023-12-16T20:21:44.109595+0000","last_undegraded":"2023-12-16T20:21:44.109595+0000","last_fullsized":"2023-12-16T20:21:44.109595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:06:12.245089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211732+0000","last_change":"2023-12-16T20:21:36.534345+0000","last_active":"2023-12-16T20:21:41.211732+0000","last_peered":"2023-12-16T20:21:41.211732+0000","last_clean":"2023-12-16T20:21:41.211732+0000","last_became_active":"2023-12-16T20:21:36.534064+0000","last_became_peered":"2023-12-16T20:21:36.534064+0000","last_unstale":"2023-12-16T20:21:41.211732+0000","last_undegraded":"2023-12-16T20:21:41.211732+0000","last_fullsized":"2023-12-16T20:21:41.211732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:05.641757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725865+0000","last_change":"2023-12-16T20:21:35.390941+0000","last_active":"2023-12-16T20:21:40.725865+0000","last_peered":"2023-12-16T20:21:40.725865+0000","last_clean":"2023-12-16T20:21:40.725865+0000","last_became_active":"2023-12-16T20:21:35.390740+0000","last_became_peered":"2023-12-16T20:21:35.390740+0000","last_unstale":"2023-12-16T20:21:40.725865+0000","last_undegraded":"2023-12-16T20:21:40.725865+0000","last_fullsized":"2023-12-16T20:21:40.725865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:00:44.009248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877589+0000","last_change":"2023-12-16T20:21:40.754355+0000","last_active":"2023-12-16T20:21:41.877589+0000","last_peered":"2023-12-16T20:21:41.877589+0000","last_clean":"2023-12-16T20:21:41.877589+0000","last_became_active":"2023-12-16T20:21:40.753981+0000","last_became_peered":"2023-12-16T20:21:40.753981+0000","last_unstale":"2023-12-16T20:21:41.877589+0000","last_undegraded":"2023-12-16T20:21:41.877589+0000","last_fullsized":"2023-12-16T20:21:41.877589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:09.125671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211363+0000","last_change":"2023-12-16T20:21:36.537080+0000","last_active":"2023-12-16T20:21:41.211363+0000","last_peered":"2023-12-16T20:21:41.211363+0000","last_clean":"2023-12-16T20:21:41.211363+0000","last_became_active":"2023-12-16T20:21:36.536822+0000","last_became_peered":"2023-12-16T20:21:36.536822+0000","last_unstale":"2023-12-16T20:21:41.211363+0000","last_undegraded":"2023-12-16T20:21:41.211363+0000","last_fullsized":"2023-12-16T20:21:41.211363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725357+0000","last_change":"2023-12-16T20:21:35.417113+0000","last_active":"2023-12-16T20:21:40.725357+0000","last_peered":"2023-12-16T20:21:40.725357+0000","last_clean":"2023-12-16T20:21:40.725357+0000","last_became_active":"2023-12-16T20:21:35.416850+0000","last_became_peered":"2023-12-16T20:21:35.416850+0000","last_unstale":"2023-12-16T20:21:40.725357+0000","last_undegraded":"2023-12-16T20:21:40.725357+0000","last_fullsized":"2023-12-16T20:21:40.725357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:00:44.009248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.135099+0000","last_change":"2023-12-16T20:21:40.755436+0000","last_active":"2023-12-16T20:21:44.135099+0000","last_peered":"2023-12-16T20:21:44.135099+0000","last_clean":"2023-12-16T20:21:44.135099+0000","last_became_active":"2023-12-16T20:21:40.755041+0000","last_became_peered":"2023-12-16T20:21:40.755041+0000","last_unstale":"2023-12-16T20:21:44.135099+0000","last_undegraded":"2023-12-16T20:21:44.135099+0000","last_fullsized":"2023-12-16T20:21:44.135099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:07.939178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752017+0000","last_change":"2023-12-16T20:21:36.541160+0000","last_active":"2023-12-16T20:21:40.752017+0000","last_peered":"2023-12-16T20:21:40.752017+0000","last_clean":"2023-12-16T20:21:40.752017+0000","last_became_active":"2023-12-16T20:21:36.540861+0000","last_became_peered":"2023-12-16T20:21:36.540861+0000","last_unstale":"2023-12-16T20:21:40.752017+0000","last_undegraded":"2023-12-16T20:21:40.752017+0000","last_fullsized":"2023-12-16T20:21:40.752017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.751989+0000","last_change":"2023-12-16T20:21:35.425071+0000","last_active":"2023-12-16T20:21:40.751989+0000","last_peered":"2023-12-16T20:21:40.751989+0000","last_clean":"2023-12-16T20:21:40.751989+0000","last_became_active":"2023-12-16T20:21:35.424822+0000","last_became_peered":"2023-12-16T20:21:35.424822+0000","last_unstale":"2023-12-16T20:21:40.751989+0000","last_undegraded":"2023-12-16T20:21:40.751989+0000","last_fullsized":"2023-12-16T20:21:40.751989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877590+0000","last_change":"2023-12-16T20:21:41.215346+0000","last_active":"2023-12-16T20:21:41.877590+0000","last_peered":"2023-12-16T20:21:41.877590+0000","last_clean":"2023-12-16T20:21:41.877590+0000","last_became_active":"2023-12-16T20:21:41.215002+0000","last_became_peered":"2023-12-16T20:21:41.215002+0000","last_unstale":"2023-12-16T20:21:41.877590+0000","last_undegraded":"2023-12-16T20:21:41.877590+0000","last_fullsized":"2023-12-16T20:21:41.877590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:10:42.982067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211447+0000","last_change":"2023-12-16T20:21:36.535791+0000","last_active":"2023-12-16T20:21:41.211447+0000","last_peered":"2023-12-16T20:21:41.211447+0000","last_clean":"2023-12-16T20:21:41.211447+0000","last_became_active":"2023-12-16T20:21:36.535447+0000","last_became_peered":"2023-12-16T20:21:36.535447+0000","last_unstale":"2023-12-16T20:21:41.211447+0000","last_undegraded":"2023-12-16T20:21:41.211447+0000","last_fullsized":"2023-12-16T20:21:41.211447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:28.307634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.792143+0000","last_change":"2023-12-16T20:21:35.423533+0000","last_active":"2023-12-16T20:21:40.792143+0000","last_peered":"2023-12-16T20:21:40.792143+0000","last_clean":"2023-12-16T20:21:40.792143+0000","last_became_active":"2023-12-16T20:21:35.423275+0000","last_became_peered":"2023-12-16T20:21:35.423275+0000","last_unstale":"2023-12-16T20:21:40.792143+0000","last_undegraded":"2023-12-16T20:21:40.792143+0000","last_fullsized":"2023-12-16T20:21:40.792143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:27.767422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877232+0000","last_change":"2023-12-16T20:21:41.213083+0000","last_active":"2023-12-16T20:21:41.877232+0000","last_peered":"2023-12-16T20:21:41.877232+0000","last_clean":"2023-12-16T20:21:41.877232+0000","last_became_active":"2023-12-16T20:21:41.212699+0000","last_became_peered":"2023-12-16T20:21:41.212699+0000","last_unstale":"2023-12-16T20:21:41.877232+0000","last_undegraded":"2023-12-16T20:21:41.877232+0000","last_fullsized":"2023-12-16T20:21:41.877232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:14:45.966119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.737960+0000","last_change":"2023-12-16T20:21:36.523928+0000","last_active":"2023-12-16T20:21:40.737960+0000","last_peered":"2023-12-16T20:21:40.737960+0000","last_clean":"2023-12-16T20:21:40.737960+0000","last_became_active":"2023-12-16T20:21:36.523649+0000","last_became_peered":"2023-12-16T20:21:36.523649+0000","last_unstale":"2023-12-16T20:21:40.737960+0000","last_undegraded":"2023-12-16T20:21:40.737960+0000","last_fullsized":"2023-12-16T20:21:40.737960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:33.657782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738298+0000","last_change":"2023-12-16T20:21:35.388611+0000","last_active":"2023-12-16T20:21:40.738298+0000","last_peered":"2023-12-16T20:21:40.738298+0000","last_clean":"2023-12-16T20:21:40.738298+0000","last_became_active":"2023-12-16T20:21:35.388392+0000","last_became_peered":"2023-12-16T20:21:35.388392+0000","last_unstale":"2023-12-16T20:21:40.738298+0000","last_undegraded":"2023-12-16T20:21:40.738298+0000","last_fullsized":"2023-12-16T20:21:40.738298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.110162+0000","last_change":"2023-12-16T20:21:41.213106+0000","last_active":"2023-12-16T20:21:44.110162+0000","last_peered":"2023-12-16T20:21:44.110162+0000","last_clean":"2023-12-16T20:21:44.110162+0000","last_became_active":"2023-12-16T20:21:41.212721+0000","last_became_peered":"2023-12-16T20:21:41.212721+0000","last_unstale":"2023-12-16T20:21:44.110162+0000","last_undegraded":"2023-12-16T20:21:44.110162+0000","last_fullsized":"2023-12-16T20:21:44.110162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:47:15.750172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211594+0000","last_change":"2023-12-16T20:21:36.519774+0000","last_active":"2023-12-16T20:21:41.211594+0000","last_peered":"2023-12-16T20:21:41.211594+0000","last_clean":"2023-12-16T20:21:41.211594+0000","last_became_active":"2023-12-16T20:21:36.519561+0000","last_became_peered":"2023-12-16T20:21:36.519561+0000","last_unstale":"2023-12-16T20:21:41.211594+0000","last_undegraded":"2023-12-16T20:21:41.211594+0000","last_fullsized":"2023-12-16T20:21:41.211594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:10.421516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:57.487368+0000","last_change":"2023-12-16T20:21:35.426168+0000","last_active":"2023-12-16T20:21:57.487368+0000","last_peered":"2023-12-16T20:21:57.487368+0000","last_clean":"2023-12-16T20:21:57.487368+0000","last_became_active":"2023-12-16T20:21:35.425929+0000","last_became_peered":"2023-12-16T20:21:35.425929+0000","last_unstale":"2023-12-16T20:21:57.487368+0000","last_undegraded":"2023-12-16T20:21:57.487368+0000","last_fullsized":"2023-12-16T20:21:57.487368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3840,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.431983+0000","last_change":"2023-12-16T20:21:40.754204+0000","last_active":"2023-12-16T20:21:43.431983+0000","last_peered":"2023-12-16T20:21:43.431983+0000","last_clean":"2023-12-16T20:21:43.431983+0000","last_became_active":"2023-12-16T20:21:40.753624+0000","last_became_peered":"2023-12-16T20:21:40.753624+0000","last_unstale":"2023-12-16T20:21:43.431983+0000","last_undegraded":"2023-12-16T20:21:43.431983+0000","last_fullsized":"2023-12-16T20:21:43.431983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:11.201128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726787+0000","last_change":"2023-12-16T20:21:36.534827+0000","last_active":"2023-12-16T20:21:40.726787+0000","last_peered":"2023-12-16T20:21:40.726787+0000","last_clean":"2023-12-16T20:21:40.726787+0000","last_became_active":"2023-12-16T20:21:36.533790+0000","last_became_peered":"2023-12-16T20:21:36.533790+0000","last_unstale":"2023-12-16T20:21:40.726787+0000","last_undegraded":"2023-12-16T20:21:40.726787+0000","last_fullsized":"2023-12-16T20:21:40.726787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:19.545737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743602+0000","last_change":"2023-12-16T20:21:35.416050+0000","last_active":"2023-12-16T20:21:40.743602+0000","last_peered":"2023-12-16T20:21:40.743602+0000","last_clean":"2023-12-16T20:21:40.743602+0000","last_became_active":"2023-12-16T20:21:35.415790+0000","last_became_peered":"2023-12-16T20:21:35.415790+0000","last_unstale":"2023-12-16T20:21:40.743602+0000","last_undegraded":"2023-12-16T20:21:40.743602+0000","last_fullsized":"2023-12-16T20:21:40.743602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.878018+0000","last_change":"2023-12-16T20:21:40.795197+0000","last_active":"2023-12-16T20:21:41.878018+0000","last_peered":"2023-12-16T20:21:41.878018+0000","last_clean":"2023-12-16T20:21:41.878018+0000","last_became_active":"2023-12-16T20:21:40.793667+0000","last_became_peered":"2023-12-16T20:21:40.793667+0000","last_unstale":"2023-12-16T20:21:41.878018+0000","last_undegraded":"2023-12-16T20:21:41.878018+0000","last_fullsized":"2023-12-16T20:21:41.878018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:32.304405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738312+0000","last_change":"2023-12-16T20:21:36.552680+0000","last_active":"2023-12-16T20:21:40.738312+0000","last_peered":"2023-12-16T20:21:40.738312+0000","last_clean":"2023-12-16T20:21:40.738312+0000","last_became_active":"2023-12-16T20:21:36.552482+0000","last_became_peered":"2023-12-16T20:21:36.552482+0000","last_unstale":"2023-12-16T20:21:40.738312+0000","last_undegraded":"2023-12-16T20:21:40.738312+0000","last_fullsized":"2023-12-16T20:21:40.738312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791458+0000","last_change":"2023-12-16T20:21:35.428379+0000","last_active":"2023-12-16T20:21:40.791458+0000","last_peered":"2023-12-16T20:21:40.791458+0000","last_clean":"2023-12-16T20:21:40.791458+0000","last_became_active":"2023-12-16T20:21:35.428100+0000","last_became_peered":"2023-12-16T20:21:35.428100+0000","last_unstale":"2023-12-16T20:21:40.791458+0000","last_undegraded":"2023-12-16T20:21:40.791458+0000","last_fullsized":"2023-12-16T20:21:40.791458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:44.330608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.876983+0000","last_change":"2023-12-16T20:21:40.753333+0000","last_active":"2023-12-16T20:21:41.876983+0000","last_peered":"2023-12-16T20:21:41.876983+0000","last_clean":"2023-12-16T20:21:41.876983+0000","last_became_active":"2023-12-16T20:21:40.752957+0000","last_became_peered":"2023-12-16T20:21:40.752957+0000","last_unstale":"2023-12-16T20:21:41.876983+0000","last_undegraded":"2023-12-16T20:21:41.876983+0000","last_fullsized":"2023-12-16T20:21:41.876983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:47:15.750172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791368+0000","last_change":"2023-12-16T20:21:36.552227+0000","last_active":"2023-12-16T20:21:40.791368+0000","last_peered":"2023-12-16T20:21:40.791368+0000","last_clean":"2023-12-16T20:21:40.791368+0000","last_became_active":"2023-12-16T20:21:36.551953+0000","last_became_peered":"2023-12-16T20:21:36.551953+0000","last_unstale":"2023-12-16T20:21:40.791368+0000","last_undegraded":"2023-12-16T20:21:40.791368+0000","last_fullsized":"2023-12-16T20:21:40.791368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:14.586148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.753542+0000","last_change":"2023-12-16T20:21:35.430197+0000","last_active":"2023-12-16T20:21:40.753542+0000","last_peered":"2023-12-16T20:21:40.753542+0000","last_clean":"2023-12-16T20:21:40.753542+0000","last_became_active":"2023-12-16T20:21:35.429940+0000","last_became_peered":"2023-12-16T20:21:35.429940+0000","last_unstale":"2023-12-16T20:21:40.753542+0000","last_undegraded":"2023-12-16T20:21:40.753542+0000","last_fullsized":"2023-12-16T20:21:40.753542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.876977+0000","last_change":"2023-12-16T20:21:41.216238+0000","last_active":"2023-12-16T20:21:41.876977+0000","last_peered":"2023-12-16T20:21:41.876977+0000","last_clean":"2023-12-16T20:21:41.876977+0000","last_became_active":"2023-12-16T20:21:41.215893+0000","last_became_peered":"2023-12-16T20:21:41.215893+0000","last_unstale":"2023-12-16T20:21:41.876977+0000","last_undegraded":"2023-12-16T20:21:41.876977+0000","last_fullsized":"2023-12-16T20:21:41.876977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:06:12.245089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.134901+0000","last_change":"2023-12-16T20:21:41.215277+0000","last_active":"2023-12-16T20:21:44.134901+0000","last_peered":"2023-12-16T20:21:44.134901+0000","last_clean":"2023-12-16T20:21:44.134901+0000","last_became_active":"2023-12-16T20:21:41.214950+0000","last_became_peered":"2023-12-16T20:21:41.214950+0000","last_unstale":"2023-12-16T20:21:44.134901+0000","last_undegraded":"2023-12-16T20:21:44.134901+0000","last_fullsized":"2023-12-16T20:21:44.134901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:10.036962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742636+0000","last_change":"2023-12-16T20:21:36.519789+0000","last_active":"2023-12-16T20:21:40.742636+0000","last_peered":"2023-12-16T20:21:40.742636+0000","last_clean":"2023-12-16T20:21:40.742636+0000","last_became_active":"2023-12-16T20:21:36.519476+0000","last_became_peered":"2023-12-16T20:21:36.519476+0000","last_unstale":"2023-12-16T20:21:40.742636+0000","last_undegraded":"2023-12-16T20:21:40.742636+0000","last_fullsized":"2023-12-16T20:21:40.742636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791067+0000","last_change":"2023-12-16T20:21:35.415150+0000","last_active":"2023-12-16T20:21:40.791067+0000","last_peered":"2023-12-16T20:21:40.791067+0000","last_clean":"2023-12-16T20:21:40.791067+0000","last_became_active":"2023-12-16T20:21:35.414846+0000","last_became_peered":"2023-12-16T20:21:35.414846+0000","last_unstale":"2023-12-16T20:21:40.791067+0000","last_undegraded":"2023-12-16T20:21:40.791067+0000","last_fullsized":"2023-12-16T20:21:40.791067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:37.215505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.184929+0000","last_change":"2023-12-16T20:21:40.794438+0000","last_active":"2023-12-16T20:21:44.184929+0000","last_peered":"2023-12-16T20:21:44.184929+0000","last_clean":"2023-12-16T20:21:44.184929+0000","last_became_active":"2023-12-16T20:21:40.794073+0000","last_became_peered":"2023-12-16T20:21:40.794073+0000","last_unstale":"2023-12-16T20:21:44.184929+0000","last_undegraded":"2023-12-16T20:21:44.184929+0000","last_fullsized":"2023-12-16T20:21:44.184929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:32.702839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.673163+0000","last_change":"2023-12-16T20:21:36.524670+0000","last_active":"2023-12-16T20:21:40.673163+0000","last_peered":"2023-12-16T20:21:40.673163+0000","last_clean":"2023-12-16T20:21:40.673163+0000","last_became_active":"2023-12-16T20:21:36.523837+0000","last_became_peered":"2023-12-16T20:21:36.523837+0000","last_unstale":"2023-12-16T20:21:40.673163+0000","last_undegraded":"2023-12-16T20:21:40.673163+0000","last_fullsized":"2023-12-16T20:21:40.673163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672390+0000","last_change":"2023-12-16T20:21:35.422176+0000","last_active":"2023-12-16T20:21:40.672390+0000","last_peered":"2023-12-16T20:21:40.672390+0000","last_clean":"2023-12-16T20:21:40.672390+0000","last_became_active":"2023-12-16T20:21:35.421982+0000","last_became_peered":"2023-12-16T20:21:35.421982+0000","last_unstale":"2023-12-16T20:21:40.672390+0000","last_undegraded":"2023-12-16T20:21:40.672390+0000","last_fullsized":"2023-12-16T20:21:40.672390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752314+0000","last_change":"2023-12-16T20:21:35.424509+0000","last_active":"2023-12-16T20:21:40.752314+0000","last_peered":"2023-12-16T20:21:40.752314+0000","last_clean":"2023-12-16T20:21:40.752314+0000","last_became_active":"2023-12-16T20:21:35.424254+0000","last_became_peered":"2023-12-16T20:21:35.424254+0000","last_unstale":"2023-12-16T20:21:40.752314+0000","last_undegraded":"2023-12-16T20:21:40.752314+0000","last_fullsized":"2023-12-16T20:21:40.752314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738189+0000","last_change":"2023-12-16T20:21:36.533903+0000","last_active":"2023-12-16T20:21:40.738189+0000","last_peered":"2023-12-16T20:21:40.738189+0000","last_clean":"2023-12-16T20:21:40.738189+0000","last_became_active":"2023-12-16T20:21:36.533574+0000","last_became_peered":"2023-12-16T20:21:36.533574+0000","last_unstale":"2023-12-16T20:21:40.738189+0000","last_undegraded":"2023-12-16T20:21:40.738189+0000","last_fullsized":"2023-12-16T20:21:40.738189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.874054+0000","last_change":"2023-12-16T20:21:40.794426+0000","last_active":"2023-12-16T20:21:41.874054+0000","last_peered":"2023-12-16T20:21:41.874054+0000","last_clean":"2023-12-16T20:21:41.874054+0000","last_became_active":"2023-12-16T20:21:40.794082+0000","last_became_peered":"2023-12-16T20:21:40.794082+0000","last_unstale":"2023-12-16T20:21:41.874054+0000","last_undegraded":"2023-12-16T20:21:41.874054+0000","last_fullsized":"2023-12-16T20:21:41.874054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:39:04.889495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672682+0000","last_change":"2023-12-16T20:21:35.419910+0000","last_active":"2023-12-16T20:21:40.672682+0000","last_peered":"2023-12-16T20:21:40.672682+0000","last_clean":"2023-12-16T20:21:40.672682+0000","last_became_active":"2023-12-16T20:21:35.419409+0000","last_became_peered":"2023-12-16T20:21:35.419409+0000","last_unstale":"2023-12-16T20:21:40.672682+0000","last_undegraded":"2023-12-16T20:21:40.672682+0000","last_fullsized":"2023-12-16T20:21:40.672682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726492+0000","last_change":"2023-12-16T20:21:36.533684+0000","last_active":"2023-12-16T20:21:40.726492+0000","last_peered":"2023-12-16T20:21:40.726492+0000","last_clean":"2023-12-16T20:21:40.726492+0000","last_became_active":"2023-12-16T20:21:36.533325+0000","last_became_peered":"2023-12-16T20:21:36.533325+0000","last_unstale":"2023-12-16T20:21:40.726492+0000","last_undegraded":"2023-12-16T20:21:40.726492+0000","last_fullsized":"2023-12-16T20:21:40.726492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:30.795818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877493+0000","last_change":"2023-12-16T20:21:40.745455+0000","last_active":"2023-12-16T20:21:41.877493+0000","last_peered":"2023-12-16T20:21:41.877493+0000","last_clean":"2023-12-16T20:21:41.877493+0000","last_became_active":"2023-12-16T20:21:40.744731+0000","last_became_peered":"2023-12-16T20:21:40.744731+0000","last_unstale":"2023-12-16T20:21:41.877493+0000","last_undegraded":"2023-12-16T20:21:41.877493+0000","last_fullsized":"2023-12-16T20:21:41.877493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:17:56.583460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.751939+0000","last_change":"2023-12-16T20:21:36.542529+0000","last_active":"2023-12-16T20:21:40.751939+0000","last_peered":"2023-12-16T20:21:40.751939+0000","last_clean":"2023-12-16T20:21:40.751939+0000","last_became_active":"2023-12-16T20:21:36.542287+0000","last_became_peered":"2023-12-16T20:21:36.542287+0000","last_unstale":"2023-12-16T20:21:40.751939+0000","last_undegraded":"2023-12-16T20:21:40.751939+0000","last_fullsized":"2023-12-16T20:21:40.751939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725563+0000","last_change":"2023-12-16T20:21:36.551193+0000","last_active":"2023-12-16T20:21:40.725563+0000","last_peered":"2023-12-16T20:21:40.725563+0000","last_clean":"2023-12-16T20:21:40.725563+0000","last_became_active":"2023-12-16T20:21:36.550911+0000","last_became_peered":"2023-12-16T20:21:36.550911+0000","last_unstale":"2023-12-16T20:21:40.725563+0000","last_undegraded":"2023-12-16T20:21:40.725563+0000","last_fullsized":"2023-12-16T20:21:40.725563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:19.545737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.792258+0000","last_change":"2023-12-16T20:21:36.556390+0000","last_active":"2023-12-16T20:21:40.792258+0000","last_peered":"2023-12-16T20:21:40.792258+0000","last_clean":"2023-12-16T20:21:40.792258+0000","last_became_active":"2023-12-16T20:21:36.555822+0000","last_became_peered":"2023-12-16T20:21:36.555822+0000","last_unstale":"2023-12-16T20:21:40.792258+0000","last_undegraded":"2023-12-16T20:21:40.792258+0000","last_fullsized":"2023-12-16T20:21:40.792258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:28.307634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738168+0000","last_change":"2023-12-16T20:21:36.525171+0000","last_active":"2023-12-16T20:21:40.738168+0000","last_peered":"2023-12-16T20:21:40.738168+0000","last_clean":"2023-12-16T20:21:40.738168+0000","last_became_active":"2023-12-16T20:21:36.524747+0000","last_became_peered":"2023-12-16T20:21:36.524747+0000","last_unstale":"2023-12-16T20:21:40.738168+0000","last_undegraded":"2023-12-16T20:21:40.738168+0000","last_fullsized":"2023-12-16T20:21:40.738168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672419+0000","last_change":"2023-12-16T20:21:36.533944+0000","last_active":"2023-12-16T20:21:40.672419+0000","last_peered":"2023-12-16T20:21:40.672419+0000","last_clean":"2023-12-16T20:21:40.672419+0000","last_became_active":"2023-12-16T20:21:36.533682+0000","last_became_peered":"2023-12-16T20:21:36.533682+0000","last_unstale":"2023-12-16T20:21:40.672419+0000","last_undegraded":"2023-12-16T20:21:40.672419+0000","last_fullsized":"2023-12-16T20:21:40.672419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:20.609645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742898+0000","last_change":"2023-12-16T20:21:36.519818+0000","last_active":"2023-12-16T20:21:40.742898+0000","last_peered":"2023-12-16T20:21:40.742898+0000","last_clean":"2023-12-16T20:21:40.742898+0000","last_became_active":"2023-12-16T20:21:36.519545+0000","last_became_peered":"2023-12-16T20:21:36.519545+0000","last_unstale":"2023-12-16T20:21:40.742898+0000","last_undegraded":"2023-12-16T20:21:40.742898+0000","last_fullsized":"2023-12-16T20:21:40.742898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.753739+0000","last_change":"2023-12-16T20:21:36.542706+0000","last_active":"2023-12-16T20:21:40.753739+0000","last_peered":"2023-12-16T20:21:40.753739+0000","last_clean":"2023-12-16T20:21:40.753739+0000","last_became_active":"2023-12-16T20:21:36.542184+0000","last_became_peered":"2023-12-16T20:21:36.542184+0000","last_unstale":"2023-12-16T20:21:40.753739+0000","last_undegraded":"2023-12-16T20:21:40.753739+0000","last_fullsized":"2023-12-16T20:21:40.753739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672194+0000","last_change":"2023-12-16T20:21:36.536726+0000","last_active":"2023-12-16T20:21:40.672194+0000","last_peered":"2023-12-16T20:21:40.672194+0000","last_clean":"2023-12-16T20:21:40.672194+0000","last_became_active":"2023-12-16T20:21:36.536439+0000","last_became_peered":"2023-12-16T20:21:36.536439+0000","last_unstale":"2023-12-16T20:21:40.672194+0000","last_undegraded":"2023-12-16T20:21:40.672194+0000","last_fullsized":"2023-12-16T20:21:40.672194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.790945+0000","last_change":"2023-12-16T20:21:36.555521+0000","last_active":"2023-12-16T20:21:40.790945+0000","last_peered":"2023-12-16T20:21:40.790945+0000","last_clean":"2023-12-16T20:21:40.790945+0000","last_became_active":"2023-12-16T20:21:36.555100+0000","last_became_peered":"2023-12-16T20:21:36.555100+0000","last_unstale":"2023-12-16T20:21:40.790945+0000","last_undegraded":"2023-12-16T20:21:40.790945+0000","last_fullsized":"2023-12-16T20:21:40.790945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672520+0000","last_change":"2023-12-16T20:21:36.535856+0000","last_active":"2023-12-16T20:21:40.672520+0000","last_peered":"2023-12-16T20:21:40.672520+0000","last_clean":"2023-12-16T20:21:40.672520+0000","last_became_active":"2023-12-16T20:21:36.535600+0000","last_became_peered":"2023-12-16T20:21:36.535600+0000","last_unstale":"2023-12-16T20:21:40.672520+0000","last_undegraded":"2023-12-16T20:21:40.672520+0000","last_fullsized":"2023-12-16T20:21:40.672520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791686+0000","last_change":"2023-12-16T20:21:36.553376+0000","last_active":"2023-12-16T20:21:40.791686+0000","last_peered":"2023-12-16T20:21:40.791686+0000","last_clean":"2023-12-16T20:21:40.791686+0000","last_became_active":"2023-12-16T20:21:36.553155+0000","last_became_peered":"2023-12-16T20:21:36.553155+0000","last_unstale":"2023-12-16T20:21:40.791686+0000","last_undegraded":"2023-12-16T20:21:40.791686+0000","last_fullsized":"2023-12-16T20:21:40.791686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738115+0000","last_change":"2023-12-16T20:21:36.524517+0000","last_active":"2023-12-16T20:21:40.738115+0000","last_peered":"2023-12-16T20:21:40.738115+0000","last_clean":"2023-12-16T20:21:40.738115+0000","last_became_active":"2023-12-16T20:21:36.524166+0000","last_became_peered":"2023-12-16T20:21:36.524166+0000","last_unstale":"2023-12-16T20:21:40.738115+0000","last_undegraded":"2023-12-16T20:21:40.738115+0000","last_fullsized":"2023-12-16T20:21:40.738115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752601+0000","last_change":"2023-12-16T20:21:36.542513+0000","last_active":"2023-12-16T20:21:40.752601+0000","last_peered":"2023-12-16T20:21:40.752601+0000","last_clean":"2023-12-16T20:21:40.752601+0000","last_became_active":"2023-12-16T20:21:36.542191+0000","last_became_peered":"2023-12-16T20:21:36.542191+0000","last_unstale":"2023-12-16T20:21:40.752601+0000","last_undegraded":"2023-12-16T20:21:40.752601+0000","last_fullsized":"2023-12-16T20:21:40.752601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211817+0000","last_change":"2023-12-16T20:21:36.518582+0000","last_active":"2023-12-16T20:21:41.211817+0000","last_peered":"2023-12-16T20:21:41.211817+0000","last_clean":"2023-12-16T20:21:41.211817+0000","last_became_active":"2023-12-16T20:21:36.518348+0000","last_became_peered":"2023-12-16T20:21:36.518348+0000","last_unstale":"2023-12-16T20:21:41.211817+0000","last_undegraded":"2023-12-16T20:21:41.211817+0000","last_fullsized":"2023-12-16T20:21:41.211817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:06.805922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725472+0000","last_change":"2023-12-16T20:21:36.544461+0000","last_active":"2023-12-16T20:21:40.725472+0000","last_peered":"2023-12-16T20:21:40.725472+0000","last_clean":"2023-12-16T20:21:40.725472+0000","last_became_active":"2023-12-16T20:21:36.544225+0000","last_became_peered":"2023-12-16T20:21:36.544225+0000","last_unstale":"2023-12-16T20:21:40.725472+0000","last_undegraded":"2023-12-16T20:21:40.725472+0000","last_fullsized":"2023-12-16T20:21:40.725472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:45:02.439240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791694+0000","last_change":"2023-12-16T20:21:36.554370+0000","last_active":"2023-12-16T20:21:40.791694+0000","last_peered":"2023-12-16T20:21:40.791694+0000","last_clean":"2023-12-16T20:21:40.791694+0000","last_became_active":"2023-12-16T20:21:36.554130+0000","last_became_peered":"2023-12-16T20:21:36.554130+0000","last_unstale":"2023-12-16T20:21:40.791694+0000","last_undegraded":"2023-12-16T20:21:40.791694+0000","last_fullsized":"2023-12-16T20:21:40.791694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:05.641757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.790872+0000","last_change":"2023-12-16T20:21:36.555346+0000","last_active":"2023-12-16T20:21:40.790872+0000","last_peered":"2023-12-16T20:21:40.790872+0000","last_clean":"2023-12-16T20:21:40.790872+0000","last_became_active":"2023-12-16T20:21:36.554772+0000","last_became_peered":"2023-12-16T20:21:36.554772+0000","last_unstale":"2023-12-16T20:21:40.790872+0000","last_undegraded":"2023-12-16T20:21:40.790872+0000","last_fullsized":"2023-12-16T20:21:40.790872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742743+0000","last_change":"2023-12-16T20:21:36.534502+0000","last_active":"2023-12-16T20:21:40.742743+0000","last_peered":"2023-12-16T20:21:40.742743+0000","last_clean":"2023-12-16T20:21:40.742743+0000","last_became_active":"2023-12-16T20:21:36.534307+0000","last_became_peered":"2023-12-16T20:21:36.534307+0000","last_unstale":"2023-12-16T20:21:40.742743+0000","last_undegraded":"2023-12-16T20:21:40.742743+0000","last_fullsized":"2023-12-16T20:21:40.742743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.737870+0000","last_change":"2023-12-16T20:21:36.525661+0000","last_active":"2023-12-16T20:21:40.737870+0000","last_peered":"2023-12-16T20:21:40.737870+0000","last_clean":"2023-12-16T20:21:40.737870+0000","last_became_active":"2023-12-16T20:21:36.525427+0000","last_became_peered":"2023-12-16T20:21:36.525427+0000","last_unstale":"2023-12-16T20:21:40.737870+0000","last_undegraded":"2023-12-16T20:21:40.737870+0000","last_fullsized":"2023-12-16T20:21:40.737870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:39:00.494290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672421+0000","last_change":"2023-12-16T20:21:36.542756+0000","last_active":"2023-12-16T20:21:40.672421+0000","last_peered":"2023-12-16T20:21:40.672421+0000","last_clean":"2023-12-16T20:21:40.672421+0000","last_became_active":"2023-12-16T20:21:36.542513+0000","last_became_peered":"2023-12-16T20:21:36.542513+0000","last_unstale":"2023-12-16T20:21:40.672421+0000","last_undegraded":"2023-12-16T20:21:40.672421+0000","last_fullsized":"2023-12-16T20:21:40.672421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726700+0000","last_change":"2023-12-16T20:21:36.544754+0000","last_active":"2023-12-16T20:21:40.726700+0000","last_peered":"2023-12-16T20:21:40.726700+0000","last_clean":"2023-12-16T20:21:40.726700+0000","last_became_active":"2023-12-16T20:21:36.544492+0000","last_became_peered":"2023-12-16T20:21:36.544492+0000","last_unstale":"2023-12-16T20:21:40.726700+0000","last_undegraded":"2023-12-16T20:21:40.726700+0000","last_fullsized":"2023-12-16T20:21:40.726700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:19.509623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752407+0000","last_change":"2023-12-16T20:21:36.552022+0000","last_active":"2023-12-16T20:21:40.752407+0000","last_peered":"2023-12-16T20:21:40.752407+0000","last_clean":"2023-12-16T20:21:40.752407+0000","last_became_active":"2023-12-16T20:21:36.551775+0000","last_became_peered":"2023-12-16T20:21:36.551775+0000","last_unstale":"2023-12-16T20:21:40.752407+0000","last_undegraded":"2023-12-16T20:21:40.752407+0000","last_fullsized":"2023-12-16T20:21:40.752407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.753663+0000","last_change":"2023-12-16T20:21:36.551107+0000","last_active":"2023-12-16T20:21:40.753663+0000","last_peered":"2023-12-16T20:21:40.753663+0000","last_clean":"2023-12-16T20:21:40.753663+0000","last_became_active":"2023-12-16T20:21:36.550815+0000","last_became_peered":"2023-12-16T20:21:36.550815+0000","last_unstale":"2023-12-16T20:21:40.753663+0000","last_undegraded":"2023-12-16T20:21:40.753663+0000","last_fullsized":"2023-12-16T20:21:40.753663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211809+0000","last_change":"2023-12-16T20:21:36.554041+0000","last_active":"2023-12-16T20:21:41.211809+0000","last_peered":"2023-12-16T20:21:41.211809+0000","last_clean":"2023-12-16T20:21:41.211809+0000","last_became_active":"2023-12-16T20:21:36.553708+0000","last_became_peered":"2023-12-16T20:21:36.553708+0000","last_unstale":"2023-12-16T20:21:41.211809+0000","last_undegraded":"2023-12-16T20:21:41.211809+0000","last_fullsized":"2023-12-16T20:21:41.211809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:36.868562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.671819+0000","last_change":"2023-12-16T20:21:36.551348+0000","last_active":"2023-12-16T20:21:40.671819+0000","last_peered":"2023-12-16T20:21:40.671819+0000","last_clean":"2023-12-16T20:21:40.671819+0000","last_became_active":"2023-12-16T20:21:36.551066+0000","last_became_peered":"2023-12-16T20:21:36.551066+0000","last_unstale":"2023-12-16T20:21:40.671819+0000","last_undegraded":"2023-12-16T20:21:40.671819+0000","last_fullsized":"2023-12-16T20:21:40.671819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211281+0000","last_change":"2023-12-16T20:21:36.523828+0000","last_active":"2023-12-16T20:21:41.211281+0000","last_peered":"2023-12-16T20:21:41.211281+0000","last_clean":"2023-12-16T20:21:41.211281+0000","last_became_active":"2023-12-16T20:21:36.523604+0000","last_became_peered":"2023-12-16T20:21:36.523604+0000","last_unstale":"2023-12-16T20:21:41.211281+0000","last_undegraded":"2023-12-16T20:21:41.211281+0000","last_fullsized":"2023-12-16T20:21:41.211281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791600+0000","last_change":"2023-12-16T20:21:36.556286+0000","last_active":"2023-12-16T20:21:40.791600+0000","last_peered":"2023-12-16T20:21:40.791600+0000","last_clean":"2023-12-16T20:21:40.791600+0000","last_became_active":"2023-12-16T20:21:36.556041+0000","last_became_peered":"2023-12-16T20:21:36.556041+0000","last_unstale":"2023-12-16T20:21:40.791600+0000","last_undegraded":"2023-12-16T20:21:40.791600+0000","last_fullsized":"2023-12-16T20:21:40.791600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211340+0000","last_change":"2023-12-16T20:21:36.518408+0000","last_active":"2023-12-16T20:21:41.211340+0000","last_peered":"2023-12-16T20:21:41.211340+0000","last_clean":"2023-12-16T20:21:41.211340+0000","last_became_active":"2023-12-16T20:21:36.518138+0000","last_became_peered":"2023-12-16T20:21:36.518138+0000","last_unstale":"2023-12-16T20:21:41.211340+0000","last_undegraded":"2023-12-16T20:21:41.211340+0000","last_fullsized":"2023-12-16T20:21:41.211340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791179+0000","last_change":"2023-12-16T20:21:36.555311+0000","last_active":"2023-12-16T20:21:40.791179+0000","last_peered":"2023-12-16T20:21:40.791179+0000","last_clean":"2023-12-16T20:21:40.791179+0000","last_became_active":"2023-12-16T20:21:36.555041+0000","last_became_peered":"2023-12-16T20:21:36.555041+0000","last_unstale":"2023-12-16T20:21:40.791179+0000","last_undegraded":"2023-12-16T20:21:40.791179+0000","last_fullsized":"2023-12-16T20:21:40.791179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:20.609645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738053+0000","last_change":"2023-12-16T20:21:36.524036+0000","last_active":"2023-12-16T20:21:40.738053+0000","last_peered":"2023-12-16T20:21:40.738053+0000","last_clean":"2023-12-16T20:21:40.738053+0000","last_became_active":"2023-12-16T20:21:36.523784+0000","last_became_peered":"2023-12-16T20:21:36.523784+0000","last_unstale":"2023-12-16T20:21:40.738053+0000","last_undegraded":"2023-12-16T20:21:40.738053+0000","last_fullsized":"2023-12-16T20:21:40.738053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743757+0000","last_change":"2023-12-16T20:21:36.526391+0000","last_active":"2023-12-16T20:21:40.743757+0000","last_peered":"2023-12-16T20:21:40.743757+0000","last_clean":"2023-12-16T20:21:40.743757+0000","last_became_active":"2023-12-16T20:21:36.526151+0000","last_became_peered":"2023-12-16T20:21:36.526151+0000","last_unstale":"2023-12-16T20:21:40.743757+0000","last_undegraded":"2023-12-16T20:21:40.743757+0000","last_fullsized":"2023-12-16T20:21:40.743757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211659+0000","last_change":"2023-12-16T20:21:36.543566+0000","last_active":"2023-12-16T20:21:41.211659+0000","last_peered":"2023-12-16T20:21:41.211659+0000","last_clean":"2023-12-16T20:21:41.211659+0000","last_became_active":"2023-12-16T20:21:36.543306+0000","last_became_peered":"2023-12-16T20:21:36.543306+0000","last_unstale":"2023-12-16T20:21:41.211659+0000","last_undegraded":"2023-12-16T20:21:41.211659+0000","last_fullsized":"2023-12-16T20:21:41.211659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:03.543973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4638,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65176,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":695413,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":104589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":104623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":695469,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T20:22:11.099 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T20:22:11.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.235+0000 7f20b6743640 1 Processor -- start 2023-12-16T20:22:11.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.235+0000 7f20b6743640 1 -- start start 2023-12-16T20:22:11.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.236+0000 7f20b6743640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20b0153890 0x7f20b015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:11.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.236+0000 7f20b6743640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f20b00ceef0 0x7f20b00cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:11.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.236+0000 7f20b6743640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b015a700 con 0x7f20b0153c70 2023-12-16T20:22:11.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.236+0000 7f20b6743640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b00ca870 con 0x7f20b00ceef0 2023-12-16T20:22:11.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.236+0000 7f20b6743640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0159af0 con 0x7f20b0153890 2023-12-16T20:22:11.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.237+0000 7f20b4ce0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f20b00ceef0 0x7f20b00cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:11.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.237+0000 7f20affff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20b0153890 0x7f20b015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:11.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.237+0000 7f20af7fe640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f20b0153c70 0x7f20b00c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:51776/0 (socket says 172.21.15.87:51776) 2023-12-16T20:22:11.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.237+0000 7f20af7fe640 1 -- 172.21.15.87:0/2071770413 learned_addr learned my addr 172.21.15.87:0/2071770413 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:11.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.239+0000 7f20aeffd640 1 -- 172.21.15.87:0/2071770413 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396662616 0 0) 0x7f20b015a700 con 0x7f20b0153c70 2023-12-16T20:22:11.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.239+0000 7f20aeffd640 1 -- 172.21.15.87:0/2071770413 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2098003520 con 0x7f20b0153c70 2023-12-16T20:22:11.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.239+0000 7f20b4ce0640 1 -- 172.21.15.87:0/2071770413 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20b0153890 msgr2=0x7f20b015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:11.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.239+0000 7f20b4ce0640 1 --2- 172.21.15.87:0/2071770413 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20b0153890 0x7f20b015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:11.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.239+0000 7f20b4ce0640 1 -- 172.21.15.87:0/2071770413 >> v1:172.21.15.195:6789/0 conn(0x7f20b0153c70 legacy=0x7f20b00c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:11.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.239+0000 7f20b4ce0640 1 -- 172.21.15.87:0/2071770413 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b0159dd0 con 0x7f20b00ceef0 2023-12-16T20:22:11.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.241+0000 7f20b4ce0640 1 --2- 172.21.15.87:0/2071770413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20b00ceef0 0x7f20b00cf340 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009d90 tx=0x7f20a802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acceaa86b502dcd3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:11.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.246+0000 7f20aeffd640 1 -- 172.21.15.87:0/2071770413 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a802cce0 con 0x7f20b00ceef0 2023-12-16T20:22:11.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.246+0000 7f20aeffd640 1 -- 172.21.15.87:0/2071770413 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a802ce40 con 0x7f20b00ceef0 2023-12-16T20:22:11.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.246+0000 7f20aeffd640 1 -- 172.21.15.87:0/2071770413 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a8034660 con 0x7f20b00ceef0 2023-12-16T20:22:11.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.246+0000 7f20b6743640 1 -- 172.21.15.87:0/2071770413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20b00ceef0 msgr2=0x7f20b00cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:11.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.246+0000 7f20b6743640 1 --2- 172.21.15.87:0/2071770413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20b00ceef0 0x7f20b00cf340 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009d90 tx=0x7f20a802bf30 comp rx=0 tx=0).stop 2023-12-16T20:22:11.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.246+0000 7f20b6743640 1 -- 172.21.15.87:0/2071770413 shutdown_connections 2023-12-16T20:22:11.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.246+0000 7f20b6743640 1 --2- 172.21.15.87:0/2071770413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20b00ceef0 0x7f20b00cf340 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:11.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.246+0000 7f20b6743640 1 --2- 172.21.15.87:0/2071770413 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20b0153890 0x7f20b015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:11.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.246+0000 7f20b6743640 1 -- 172.21.15.87:0/2071770413 >> 172.21.15.87:0/2071770413 conn(0x7f20b006ba00 msgr2=0x7f20b006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:11.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.247+0000 7f20b6743640 1 -- 172.21.15.87:0/2071770413 shutdown_connections 2023-12-16T20:22:11.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.247+0000 7f20b6743640 1 -- 172.21.15.87:0/2071770413 wait complete. 2023-12-16T20:22:11.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.248+0000 7f20b6743640 1 Processor -- start 2023-12-16T20:22:11.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.248+0000 7f20b6743640 1 -- start start 2023-12-16T20:22:11.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.249+0000 7f20b6743640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20b00ceef0 0x7f20b00b4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:11.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.249+0000 7f20b6743640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20b0153890 0x7f20b014f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:11.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.249+0000 7f20b6743640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20b0153c70 0x7f20b014fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:11.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.249+0000 7f20b6743640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b01f0190 con 0x7f20b0153c70 2023-12-16T20:22:11.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.249+0000 7f20b6743640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b01ef330 con 0x7f20b00ceef0 2023-12-16T20:22:11.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.249+0000 7f20b6743640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b01ef610 con 0x7f20b0153890 2023-12-16T20:22:11.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.249+0000 7f20b4ce0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20b0153c70 0x7f20b014fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:11.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.249+0000 7f20af7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20b0153890 0x7f20b014f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:11.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.249+0000 7f20affff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20b00ceef0 0x7f20b00b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:11.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.250+0000 7f20af7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20b0153890 0x7f20b014f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:49574/0 (socket says 172.21.15.87:49574) 2023-12-16T20:22:11.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.250+0000 7f20af7fe640 1 -- 172.21.15.87:0/903541726 learned_addr learned my addr 172.21.15.87:0/903541726 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:11.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.253+0000 7f20affff640 1 -- 172.21.15.87:0/903541726 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20b0153890 msgr2=0x7f20b014f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:11.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.253+0000 7f20affff640 1 --2- 172.21.15.87:0/903541726 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20b0153890 0x7f20b014f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:11.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.253+0000 7f20affff640 1 -- 172.21.15.87:0/903541726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20b0153c70 msgr2=0x7f20b014fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:11.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.253+0000 7f20affff640 1 --2- 172.21.15.87:0/903541726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20b0153c70 0x7f20b014fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:11.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.253+0000 7f20affff640 1 -- 172.21.15.87:0/903541726 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a8009a70 con 0x7f20b00ceef0 2023-12-16T20:22:11.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.255+0000 7f20affff640 1 --2- 172.21.15.87:0/903541726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20b00ceef0 0x7f20b00b4840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f20a400e880 tx=0x7f20a400ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:11.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.258+0000 7f20acff9640 1 -- 172.21.15.87:0/903541726 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a400c940 con 0x7f20b00ceef0 2023-12-16T20:22:11.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.258+0000 7f20acff9640 1 -- 172.21.15.87:0/903541726 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a400caa0 con 0x7f20b00ceef0 2023-12-16T20:22:11.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.258+0000 7f20b6743640 1 -- 172.21.15.87:0/903541726 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b01ef8f0 con 0x7f20b00ceef0 2023-12-16T20:22:11.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.258+0000 7f20acff9640 1 -- 172.21.15.87:0/903541726 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a400ce50 con 0x7f20b00ceef0 2023-12-16T20:22:11.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.258+0000 7f20b6743640 1 -- 172.21.15.87:0/903541726 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b01efeb0 con 0x7f20b00ceef0 2023-12-16T20:22:11.261 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.260+0000 7f20b6743640 1 -- 172.21.15.87:0/903541726 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b0067500 con 0x7f20b00ceef0 2023-12-16T20:22:11.505 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.503+0000 7f20acff9640 1 -- 172.21.15.87:0/903541726 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f20a4013470 con 0x7f20b00ceef0 2023-12-16T20:22:11.505 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.504+0000 7f20acff9640 1 --2- 172.21.15.87:0/903541726 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f209c06ae90 0x7f209c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:11.505 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.504+0000 7f20af7fe640 1 --2- 172.21.15.87:0/903541726 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f209c06ae90 0x7f209c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:11.506 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.504+0000 7f20af7fe640 1 --2- 172.21.15.87:0/903541726 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f209c06ae90 0x7f209c06d350 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f20b00b5260 tx=0x7f20a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:11.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.506+0000 7f20acff9640 1 -- 172.21.15.87:0/903541726 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f20a4058cd0 con 0x7f20b00ceef0 2023-12-16T20:22:11.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.516+0000 7f20acff9640 1 -- 172.21.15.87:0/903541726 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f20a4055010 con 0x7f20b00ceef0 2023-12-16T20:22:11.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.680+0000 7f20b6743640 1 -- 172.21.15.87:0/903541726 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20b00b2a40 con 0x7f209c06ae90 2023-12-16T20:22:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.688+0000 7f20acff9640 1 -- 172.21.15.87:0/903541726 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345314 (secure 0 0 0) 0x7f20b00b2a40 con 0x7f209c06ae90 2023-12-16T20:22:11.692 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:22:11.694 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-12-16T20:22:11.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.691+0000 7f20b6743640 1 -- 172.21.15.87:0/903541726 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f209c06ae90 msgr2=0x7f209c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:11.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.691+0000 7f20b6743640 1 --2- 172.21.15.87:0/903541726 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f209c06ae90 0x7f209c06d350 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f20b00b5260 tx=0x7f20a0009040 comp rx=0 tx=0).stop 2023-12-16T20:22:11.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.691+0000 7f20b6743640 1 -- 172.21.15.87:0/903541726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20b00ceef0 msgr2=0x7f20b00b4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:11.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.691+0000 7f20b6743640 1 --2- 172.21.15.87:0/903541726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20b00ceef0 0x7f20b00b4840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f20a400e880 tx=0x7f20a400ed40 comp rx=0 tx=0).stop 2023-12-16T20:22:11.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.691+0000 7f20b6743640 1 -- 172.21.15.87:0/903541726 shutdown_connections 2023-12-16T20:22:11.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.691+0000 7f20b6743640 1 --2- 172.21.15.87:0/903541726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20b0153c70 0x7f20b014fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:11.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.691+0000 7f20b6743640 1 --2- 172.21.15.87:0/903541726 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20b0153890 0x7f20b014f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:11.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.691+0000 7f20b6743640 1 --2- 172.21.15.87:0/903541726 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f209c06ae90 0x7f209c06d350 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:11.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.691+0000 7f20b6743640 1 --2- 172.21.15.87:0/903541726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20b00ceef0 0x7f20b00b4840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:11.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.691+0000 7f20b6743640 1 -- 172.21.15.87:0/903541726 >> 172.21.15.87:0/903541726 conn(0x7f20b006ba00 msgr2=0x7f20b015d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:11.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.691+0000 7f20b6743640 1 -- 172.21.15.87:0/903541726 shutdown_connections 2023-12-16T20:22:11.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.691+0000 7f20b6743640 1 -- 172.21.15.87:0/903541726 wait complete. 2023-12-16T20:22:11.703 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2023-12-16T20:22:10.285934+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595006,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222592,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754752128,"statfs":{"total":773094113280,"available":772866179072,"internally_reserved":0,"allocated":2326528,"data_stored":2025716,"data_compressed":65176,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002979"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738410+0000","last_change":"2023-12-16T20:21:35.413343+0000","last_active":"2023-12-16T20:21:40.738410+0000","last_peered":"2023-12-16T20:21:40.738410+0000","last_clean":"2023-12-16T20:21:40.738410+0000","last_became_active":"2023-12-16T20:21:35.413075+0000","last_became_peered":"2023-12-16T20:21:35.413075+0000","last_unstale":"2023-12-16T20:21:40.738410+0000","last_undegraded":"2023-12-16T20:21:40.738410+0000","last_fullsized":"2023-12-16T20:21:40.738410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672090+0000","last_change":"2023-12-16T20:21:36.542907+0000","last_active":"2023-12-16T20:21:40.672090+0000","last_peered":"2023-12-16T20:21:40.672090+0000","last_clean":"2023-12-16T20:21:40.672090+0000","last_became_active":"2023-12-16T20:21:36.542667+0000","last_became_peered":"2023-12-16T20:21:36.542667+0000","last_unstale":"2023-12-16T20:21:40.672090+0000","last_undegraded":"2023-12-16T20:21:40.672090+0000","last_fullsized":"2023-12-16T20:21:40.672090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.876874+0000","last_change":"2023-12-16T20:21:41.216466+0000","last_active":"2023-12-16T20:21:41.876874+0000","last_peered":"2023-12-16T20:21:41.876874+0000","last_clean":"2023-12-16T20:21:41.876874+0000","last_became_active":"2023-12-16T20:21:41.216062+0000","last_became_peered":"2023-12-16T20:21:41.216062+0000","last_unstale":"2023-12-16T20:21:41.876874+0000","last_undegraded":"2023-12-16T20:21:41.876874+0000","last_fullsized":"2023-12-16T20:21:41.876874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:33:01.663841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672276+0000","last_change":"2023-12-16T20:21:35.420038+0000","last_active":"2023-12-16T20:21:40.672276+0000","last_peered":"2023-12-16T20:21:40.672276+0000","last_clean":"2023-12-16T20:21:40.672276+0000","last_became_active":"2023-12-16T20:21:35.419745+0000","last_became_peered":"2023-12-16T20:21:35.419745+0000","last_unstale":"2023-12-16T20:21:40.672276+0000","last_undegraded":"2023-12-16T20:21:40.672276+0000","last_fullsized":"2023-12-16T20:21:40.672276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738303+0000","last_change":"2023-12-16T20:21:36.552916+0000","last_active":"2023-12-16T20:21:40.738303+0000","last_peered":"2023-12-16T20:21:40.738303+0000","last_clean":"2023-12-16T20:21:40.738303+0000","last_became_active":"2023-12-16T20:21:36.552621+0000","last_became_peered":"2023-12-16T20:21:36.552621+0000","last_unstale":"2023-12-16T20:21:40.738303+0000","last_undegraded":"2023-12-16T20:21:40.738303+0000","last_fullsized":"2023-12-16T20:21:40.738303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877621+0000","last_change":"2023-12-16T20:21:40.754959+0000","last_active":"2023-12-16T20:21:41.877621+0000","last_peered":"2023-12-16T20:21:41.877621+0000","last_clean":"2023-12-16T20:21:41.877621+0000","last_became_active":"2023-12-16T20:21:40.754509+0000","last_became_peered":"2023-12-16T20:21:40.754509+0000","last_unstale":"2023-12-16T20:21:41.877621+0000","last_undegraded":"2023-12-16T20:21:41.877621+0000","last_fullsized":"2023-12-16T20:21:41.877621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:21.787809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211739+0000","last_change":"2023-12-16T20:21:35.427622+0000","last_active":"2023-12-16T20:21:41.211739+0000","last_peered":"2023-12-16T20:21:41.211739+0000","last_clean":"2023-12-16T20:21:41.211739+0000","last_became_active":"2023-12-16T20:21:35.427317+0000","last_became_peered":"2023-12-16T20:21:35.427317+0000","last_unstale":"2023-12-16T20:21:41.211739+0000","last_undegraded":"2023-12-16T20:21:41.211739+0000","last_fullsized":"2023-12-16T20:21:41.211739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791265+0000","last_change":"2023-12-16T20:21:36.551723+0000","last_active":"2023-12-16T20:21:40.791265+0000","last_peered":"2023-12-16T20:21:40.791265+0000","last_clean":"2023-12-16T20:21:40.791265+0000","last_became_active":"2023-12-16T20:21:36.551475+0000","last_became_peered":"2023-12-16T20:21:36.551475+0000","last_unstale":"2023-12-16T20:21:40.791265+0000","last_undegraded":"2023-12-16T20:21:40.791265+0000","last_fullsized":"2023-12-16T20:21:40.791265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877788+0000","last_change":"2023-12-16T20:21:40.753693+0000","last_active":"2023-12-16T20:21:41.877788+0000","last_peered":"2023-12-16T20:21:41.877788+0000","last_clean":"2023-12-16T20:21:41.877788+0000","last_became_active":"2023-12-16T20:21:40.753268+0000","last_became_peered":"2023-12-16T20:21:40.753268+0000","last_unstale":"2023-12-16T20:21:41.877788+0000","last_undegraded":"2023-12-16T20:21:41.877788+0000","last_fullsized":"2023-12-16T20:21:41.877788+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:39.757419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211396+0000","last_change":"2023-12-16T20:21:35.413521+0000","last_active":"2023-12-16T20:21:41.211396+0000","last_peered":"2023-12-16T20:21:41.211396+0000","last_clean":"2023-12-16T20:21:41.211396+0000","last_became_active":"2023-12-16T20:21:35.413234+0000","last_became_peered":"2023-12-16T20:21:35.413234+0000","last_unstale":"2023-12-16T20:21:41.211396+0000","last_undegraded":"2023-12-16T20:21:41.211396+0000","last_fullsized":"2023-12-16T20:21:41.211396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791426+0000","last_change":"2023-12-16T20:21:36.554419+0000","last_active":"2023-12-16T20:21:40.791426+0000","last_peered":"2023-12-16T20:21:40.791426+0000","last_clean":"2023-12-16T20:21:40.791426+0000","last_became_active":"2023-12-16T20:21:36.554014+0000","last_became_peered":"2023-12-16T20:21:36.554014+0000","last_unstale":"2023-12-16T20:21:40.791426+0000","last_undegraded":"2023-12-16T20:21:40.791426+0000","last_fullsized":"2023-12-16T20:21:40.791426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:03.543973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877746+0000","last_change":"2023-12-16T20:21:40.794852+0000","last_active":"2023-12-16T20:21:41.877746+0000","last_peered":"2023-12-16T20:21:41.877746+0000","last_clean":"2023-12-16T20:21:41.877746+0000","last_became_active":"2023-12-16T20:21:40.794471+0000","last_became_peered":"2023-12-16T20:21:40.794471+0000","last_unstale":"2023-12-16T20:21:41.877746+0000","last_undegraded":"2023-12-16T20:21:41.877746+0000","last_fullsized":"2023-12-16T20:21:41.877746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:25.004850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752195+0000","last_change":"2023-12-16T20:21:36.542450+0000","last_active":"2023-12-16T20:21:40.752195+0000","last_peered":"2023-12-16T20:21:40.752195+0000","last_clean":"2023-12-16T20:21:40.752195+0000","last_became_active":"2023-12-16T20:21:36.542157+0000","last_became_peered":"2023-12-16T20:21:36.542157+0000","last_unstale":"2023-12-16T20:21:40.752195+0000","last_undegraded":"2023-12-16T20:21:40.752195+0000","last_fullsized":"2023-12-16T20:21:40.752195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211548+0000","last_change":"2023-12-16T20:21:35.413681+0000","last_active":"2023-12-16T20:21:41.211548+0000","last_peered":"2023-12-16T20:21:41.211548+0000","last_clean":"2023-12-16T20:21:41.211548+0000","last_became_active":"2023-12-16T20:21:35.413400+0000","last_became_peered":"2023-12-16T20:21:35.413400+0000","last_unstale":"2023-12-16T20:21:41.211548+0000","last_undegraded":"2023-12-16T20:21:41.211548+0000","last_fullsized":"2023-12-16T20:21:41.211548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:27.767422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.878229+0000","last_change":"2023-12-16T20:21:40.745971+0000","last_active":"2023-12-16T20:21:41.878229+0000","last_peered":"2023-12-16T20:21:41.878229+0000","last_clean":"2023-12-16T20:21:41.878229+0000","last_became_active":"2023-12-16T20:21:40.745544+0000","last_became_peered":"2023-12-16T20:21:40.745544+0000","last_unstale":"2023-12-16T20:21:41.878229+0000","last_undegraded":"2023-12-16T20:21:41.878229+0000","last_fullsized":"2023-12-16T20:21:41.878229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:18.981353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672085+0000","last_change":"2023-12-16T20:21:36.526277+0000","last_active":"2023-12-16T20:21:40.672085+0000","last_peered":"2023-12-16T20:21:40.672085+0000","last_clean":"2023-12-16T20:21:40.672085+0000","last_became_active":"2023-12-16T20:21:36.525983+0000","last_became_peered":"2023-12-16T20:21:36.525983+0000","last_unstale":"2023-12-16T20:21:40.672085+0000","last_undegraded":"2023-12-16T20:21:40.672085+0000","last_fullsized":"2023-12-16T20:21:40.672085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743603+0000","last_change":"2023-12-16T20:21:35.420017+0000","last_active":"2023-12-16T20:21:40.743603+0000","last_peered":"2023-12-16T20:21:40.743603+0000","last_clean":"2023-12-16T20:21:40.743603+0000","last_became_active":"2023-12-16T20:21:35.419731+0000","last_became_peered":"2023-12-16T20:21:35.419731+0000","last_unstale":"2023-12-16T20:21:40.743603+0000","last_undegraded":"2023-12-16T20:21:40.743603+0000","last_fullsized":"2023-12-16T20:21:40.743603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:29.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.878175+0000","last_change":"2023-12-16T20:21:40.755335+0000","last_active":"2023-12-16T20:21:41.878175+0000","last_peered":"2023-12-16T20:21:41.878175+0000","last_clean":"2023-12-16T20:21:41.878175+0000","last_became_active":"2023-12-16T20:21:40.754829+0000","last_became_peered":"2023-12-16T20:21:40.754829+0000","last_unstale":"2023-12-16T20:21:41.878175+0000","last_undegraded":"2023-12-16T20:21:41.878175+0000","last_fullsized":"2023-12-16T20:21:41.878175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.673227+0000","last_change":"2023-12-16T20:21:36.518939+0000","last_active":"2023-12-16T20:21:40.673227+0000","last_peered":"2023-12-16T20:21:40.673227+0000","last_clean":"2023-12-16T20:21:40.673227+0000","last_became_active":"2023-12-16T20:21:36.518686+0000","last_became_peered":"2023-12-16T20:21:36.518686+0000","last_unstale":"2023-12-16T20:21:40.673227+0000","last_undegraded":"2023-12-16T20:21:40.673227+0000","last_fullsized":"2023-12-16T20:21:40.673227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742823+0000","last_change":"2023-12-16T20:21:35.416372+0000","last_active":"2023-12-16T20:21:40.742823+0000","last_peered":"2023-12-16T20:21:40.742823+0000","last_clean":"2023-12-16T20:21:40.742823+0000","last_became_active":"2023-12-16T20:21:35.416067+0000","last_became_peered":"2023-12-16T20:21:35.416067+0000","last_unstale":"2023-12-16T20:21:40.742823+0000","last_undegraded":"2023-12-16T20:21:40.742823+0000","last_fullsized":"2023-12-16T20:21:40.742823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:37.215505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.432342+0000","last_change":"2023-12-16T20:21:41.215250+0000","last_active":"2023-12-16T20:21:43.432342+0000","last_peered":"2023-12-16T20:21:43.432342+0000","last_clean":"2023-12-16T20:21:43.432342+0000","last_became_active":"2023-12-16T20:21:41.214198+0000","last_became_peered":"2023-12-16T20:21:41.214198+0000","last_unstale":"2023-12-16T20:21:43.432342+0000","last_undegraded":"2023-12-16T20:21:43.432342+0000","last_fullsized":"2023-12-16T20:21:43.432342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:41.263768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726299+0000","last_change":"2023-12-16T20:21:36.536797+0000","last_active":"2023-12-16T20:21:40.726299+0000","last_peered":"2023-12-16T20:21:40.726299+0000","last_clean":"2023-12-16T20:21:40.726299+0000","last_became_active":"2023-12-16T20:21:36.536321+0000","last_became_peered":"2023-12-16T20:21:36.536321+0000","last_unstale":"2023-12-16T20:21:40.726299+0000","last_undegraded":"2023-12-16T20:21:40.726299+0000","last_fullsized":"2023-12-16T20:21:40.726299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:55:55.607439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211371+0000","last_change":"2023-12-16T20:21:35.425939+0000","last_active":"2023-12-16T20:21:41.211371+0000","last_peered":"2023-12-16T20:21:41.211371+0000","last_clean":"2023-12-16T20:21:41.211371+0000","last_became_active":"2023-12-16T20:21:35.420547+0000","last_became_peered":"2023-12-16T20:21:35.420547+0000","last_unstale":"2023-12-16T20:21:41.211371+0000","last_undegraded":"2023-12-16T20:21:41.211371+0000","last_fullsized":"2023-12-16T20:21:41.211371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:58:31.980302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.878401+0000","last_change":"2023-12-16T20:21:40.757445+0000","last_active":"2023-12-16T20:21:41.878401+0000","last_peered":"2023-12-16T20:21:41.878401+0000","last_clean":"2023-12-16T20:21:41.878401+0000","last_became_active":"2023-12-16T20:21:40.756997+0000","last_became_peered":"2023-12-16T20:21:40.756997+0000","last_unstale":"2023-12-16T20:21:41.878401+0000","last_undegraded":"2023-12-16T20:21:41.878401+0000","last_fullsized":"2023-12-16T20:21:41.878401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:32.702839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738149+0000","last_change":"2023-12-16T20:21:36.524943+0000","last_active":"2023-12-16T20:21:40.738149+0000","last_peered":"2023-12-16T20:21:40.738149+0000","last_clean":"2023-12-16T20:21:40.738149+0000","last_became_active":"2023-12-16T20:21:36.524703+0000","last_became_peered":"2023-12-16T20:21:36.524703+0000","last_unstale":"2023-12-16T20:21:40.738149+0000","last_undegraded":"2023-12-16T20:21:40.738149+0000","last_fullsized":"2023-12-16T20:21:40.738149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.753645+0000","last_change":"2023-12-16T20:21:35.428736+0000","last_active":"2023-12-16T20:21:40.753645+0000","last_peered":"2023-12-16T20:21:40.753645+0000","last_clean":"2023-12-16T20:21:40.753645+0000","last_became_active":"2023-12-16T20:21:35.428465+0000","last_became_peered":"2023-12-16T20:21:35.428465+0000","last_unstale":"2023-12-16T20:21:40.753645+0000","last_undegraded":"2023-12-16T20:21:40.753645+0000","last_fullsized":"2023-12-16T20:21:40.753645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877780+0000","last_change":"2023-12-16T20:21:41.213330+0000","last_active":"2023-12-16T20:21:41.877780+0000","last_peered":"2023-12-16T20:21:41.877780+0000","last_clean":"2023-12-16T20:21:41.877780+0000","last_became_active":"2023-12-16T20:21:41.212976+0000","last_became_peered":"2023-12-16T20:21:41.212976+0000","last_unstale":"2023-12-16T20:21:41.877780+0000","last_undegraded":"2023-12-16T20:21:41.877780+0000","last_fullsized":"2023-12-16T20:21:41.877780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:32:02.178544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672371+0000","last_change":"2023-12-16T20:21:36.518956+0000","last_active":"2023-12-16T20:21:40.672371+0000","last_peered":"2023-12-16T20:21:40.672371+0000","last_clean":"2023-12-16T20:21:40.672371+0000","last_became_active":"2023-12-16T20:21:36.518673+0000","last_became_peered":"2023-12-16T20:21:36.518673+0000","last_unstale":"2023-12-16T20:21:40.672371+0000","last_undegraded":"2023-12-16T20:21:40.672371+0000","last_fullsized":"2023-12-16T20:21:40.672371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743808+0000","last_change":"2023-12-16T20:21:35.423292+0000","last_active":"2023-12-16T20:21:40.743808+0000","last_peered":"2023-12-16T20:21:40.743808+0000","last_clean":"2023-12-16T20:21:40.743808+0000","last_became_active":"2023-12-16T20:21:35.423045+0000","last_became_peered":"2023-12-16T20:21:35.423045+0000","last_unstale":"2023-12-16T20:21:40.743808+0000","last_undegraded":"2023-12-16T20:21:40.743808+0000","last_fullsized":"2023-12-16T20:21:40.743808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.876800+0000","last_change":"2023-12-16T20:21:41.216113+0000","last_active":"2023-12-16T20:21:41.876800+0000","last_peered":"2023-12-16T20:21:41.876800+0000","last_clean":"2023-12-16T20:21:41.876800+0000","last_became_active":"2023-12-16T20:21:41.215747+0000","last_became_peered":"2023-12-16T20:21:41.215747+0000","last_unstale":"2023-12-16T20:21:41.876800+0000","last_undegraded":"2023-12-16T20:21:41.876800+0000","last_fullsized":"2023-12-16T20:21:41.876800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:10:17.859148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742993+0000","last_change":"2023-12-16T20:21:36.451660+0000","last_active":"2023-12-16T20:21:40.742993+0000","last_peered":"2023-12-16T20:21:40.742993+0000","last_clean":"2023-12-16T20:21:40.742993+0000","last_became_active":"2023-12-16T20:21:36.451404+0000","last_became_peered":"2023-12-16T20:21:36.451404+0000","last_unstale":"2023-12-16T20:21:40.742993+0000","last_undegraded":"2023-12-16T20:21:40.742993+0000","last_fullsized":"2023-12-16T20:21:40.742993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211871+0000","last_change":"2023-12-16T20:21:35.420184+0000","last_active":"2023-12-16T20:21:41.211871+0000","last_peered":"2023-12-16T20:21:41.211871+0000","last_clean":"2023-12-16T20:21:41.211871+0000","last_became_active":"2023-12-16T20:21:35.419917+0000","last_became_peered":"2023-12-16T20:21:35.419917+0000","last_unstale":"2023-12-16T20:21:41.211871+0000","last_undegraded":"2023-12-16T20:21:41.211871+0000","last_fullsized":"2023-12-16T20:21:41.211871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:19.491578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.135002+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:21:44.135002+0000","last_peered":"2023-12-16T20:21:44.135002+0000","last_clean":"2023-12-16T20:21:44.135002+0000","last_became_active":"2023-12-16T20:21:41.212704+0000","last_became_peered":"2023-12-16T20:21:41.212704+0000","last_unstale":"2023-12-16T20:21:44.135002+0000","last_undegraded":"2023-12-16T20:21:44.135002+0000","last_fullsized":"2023-12-16T20:21:44.135002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:11.201128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791502+0000","last_change":"2023-12-16T20:21:36.555288+0000","last_active":"2023-12-16T20:21:40.791502+0000","last_peered":"2023-12-16T20:21:40.791502+0000","last_clean":"2023-12-16T20:21:40.791502+0000","last_became_active":"2023-12-16T20:21:36.555011+0000","last_became_peered":"2023-12-16T20:21:36.555011+0000","last_unstale":"2023-12-16T20:21:40.791502+0000","last_undegraded":"2023-12-16T20:21:40.791502+0000","last_fullsized":"2023-12-16T20:21:40.791502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:06.805922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743003+0000","last_change":"2023-12-16T20:21:35.417945+0000","last_active":"2023-12-16T20:21:40.743003+0000","last_peered":"2023-12-16T20:21:40.743003+0000","last_clean":"2023-12-16T20:21:40.743003+0000","last_became_active":"2023-12-16T20:21:35.417683+0000","last_became_peered":"2023-12-16T20:21:35.417683+0000","last_unstale":"2023-12-16T20:21:40.743003+0000","last_undegraded":"2023-12-16T20:21:40.743003+0000","last_fullsized":"2023-12-16T20:21:40.743003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:18.427670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.431936+0000","last_change":"2023-12-16T20:21:40.794299+0000","last_active":"2023-12-16T20:21:43.431936+0000","last_peered":"2023-12-16T20:21:43.431936+0000","last_clean":"2023-12-16T20:21:43.431936+0000","last_became_active":"2023-12-16T20:21:40.793754+0000","last_became_peered":"2023-12-16T20:21:40.793754+0000","last_unstale":"2023-12-16T20:21:43.431936+0000","last_undegraded":"2023-12-16T20:21:43.431936+0000","last_fullsized":"2023-12-16T20:21:43.431936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:10.036962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726356+0000","last_change":"2023-12-16T20:21:36.534278+0000","last_active":"2023-12-16T20:21:40.726356+0000","last_peered":"2023-12-16T20:21:40.726356+0000","last_clean":"2023-12-16T20:21:40.726356+0000","last_became_active":"2023-12-16T20:21:36.533651+0000","last_became_peered":"2023-12-16T20:21:36.533651+0000","last_unstale":"2023-12-16T20:21:40.726356+0000","last_undegraded":"2023-12-16T20:21:40.726356+0000","last_fullsized":"2023-12-16T20:21:40.726356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:58:33.098369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.792221+0000","last_change":"2023-12-16T20:21:35.422128+0000","last_active":"2023-12-16T20:21:40.792221+0000","last_peered":"2023-12-16T20:21:40.792221+0000","last_clean":"2023-12-16T20:21:40.792221+0000","last_became_active":"2023-12-16T20:21:35.421875+0000","last_became_peered":"2023-12-16T20:21:35.421875+0000","last_unstale":"2023-12-16T20:21:40.792221+0000","last_undegraded":"2023-12-16T20:21:40.792221+0000","last_fullsized":"2023-12-16T20:21:40.792221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:24.569380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.432241+0000","last_change":"2023-12-16T20:21:40.754363+0000","last_active":"2023-12-16T20:21:43.432241+0000","last_peered":"2023-12-16T20:21:43.432241+0000","last_clean":"2023-12-16T20:21:43.432241+0000","last_became_active":"2023-12-16T20:21:40.753994+0000","last_became_peered":"2023-12-16T20:21:40.753994+0000","last_unstale":"2023-12-16T20:21:43.432241+0000","last_undegraded":"2023-12-16T20:21:43.432241+0000","last_fullsized":"2023-12-16T20:21:43.432241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:07.939178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742945+0000","last_change":"2023-12-16T20:21:36.451488+0000","last_active":"2023-12-16T20:21:40.742945+0000","last_peered":"2023-12-16T20:21:40.742945+0000","last_clean":"2023-12-16T20:21:40.742945+0000","last_became_active":"2023-12-16T20:21:36.451231+0000","last_became_peered":"2023-12-16T20:21:36.451231+0000","last_unstale":"2023-12-16T20:21:40.742945+0000","last_undegraded":"2023-12-16T20:21:40.742945+0000","last_fullsized":"2023-12-16T20:21:40.742945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725582+0000","last_change":"2023-12-16T20:21:35.420494+0000","last_active":"2023-12-16T20:21:40.725582+0000","last_peered":"2023-12-16T20:21:40.725582+0000","last_clean":"2023-12-16T20:21:40.725582+0000","last_became_active":"2023-12-16T20:21:35.420236+0000","last_became_peered":"2023-12-16T20:21:35.420236+0000","last_unstale":"2023-12-16T20:21:40.725582+0000","last_undegraded":"2023-12-16T20:21:40.725582+0000","last_fullsized":"2023-12-16T20:21:40.725582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:55:54.489373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.432363+0000","last_change":"2023-12-16T20:21:40.794400+0000","last_active":"2023-12-16T20:21:43.432363+0000","last_peered":"2023-12-16T20:21:43.432363+0000","last_clean":"2023-12-16T20:21:43.432363+0000","last_became_active":"2023-12-16T20:21:40.793947+0000","last_became_peered":"2023-12-16T20:21:40.793947+0000","last_unstale":"2023-12-16T20:21:43.432363+0000","last_undegraded":"2023-12-16T20:21:43.432363+0000","last_fullsized":"2023-12-16T20:21:43.432363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:16.656597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.737925+0000","last_change":"2023-12-16T20:21:36.535835+0000","last_active":"2023-12-16T20:21:40.737925+0000","last_peered":"2023-12-16T20:21:40.737925+0000","last_clean":"2023-12-16T20:21:40.737925+0000","last_became_active":"2023-12-16T20:21:36.535571+0000","last_became_peered":"2023-12-16T20:21:36.535571+0000","last_unstale":"2023-12-16T20:21:40.737925+0000","last_undegraded":"2023-12-16T20:21:40.737925+0000","last_fullsized":"2023-12-16T20:21:40.737925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:54.719426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211381+0000","last_change":"2023-12-16T20:21:35.418993+0000","last_active":"2023-12-16T20:21:41.211381+0000","last_peered":"2023-12-16T20:21:41.211381+0000","last_clean":"2023-12-16T20:21:41.211381+0000","last_became_active":"2023-12-16T20:21:35.418751+0000","last_became_peered":"2023-12-16T20:21:35.418751+0000","last_unstale":"2023-12-16T20:21:41.211381+0000","last_undegraded":"2023-12-16T20:21:41.211381+0000","last_fullsized":"2023-12-16T20:21:41.211381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:18.391557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.135405+0000","last_change":"2023-12-16T20:21:41.214405+0000","last_active":"2023-12-16T20:21:44.135405+0000","last_peered":"2023-12-16T20:21:44.135405+0000","last_clean":"2023-12-16T20:21:44.135405+0000","last_became_active":"2023-12-16T20:21:41.213977+0000","last_became_peered":"2023-12-16T20:21:41.213977+0000","last_unstale":"2023-12-16T20:21:44.135405+0000","last_undegraded":"2023-12-16T20:21:44.135405+0000","last_fullsized":"2023-12-16T20:21:44.135405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:16.656597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.671919+0000","last_change":"2023-12-16T20:21:36.551240+0000","last_active":"2023-12-16T20:21:40.671919+0000","last_peered":"2023-12-16T20:21:40.671919+0000","last_clean":"2023-12-16T20:21:40.671919+0000","last_became_active":"2023-12-16T20:21:36.550997+0000","last_became_peered":"2023-12-16T20:21:36.550997+0000","last_unstale":"2023-12-16T20:21:40.671919+0000","last_undegraded":"2023-12-16T20:21:40.671919+0000","last_fullsized":"2023-12-16T20:21:40.671919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791233+0000","last_change":"2023-12-16T20:21:35.416258+0000","last_active":"2023-12-16T20:21:40.791233+0000","last_peered":"2023-12-16T20:21:40.791233+0000","last_clean":"2023-12-16T20:21:40.791233+0000","last_became_active":"2023-12-16T20:21:35.415984+0000","last_became_peered":"2023-12-16T20:21:35.415984+0000","last_unstale":"2023-12-16T20:21:40.791233+0000","last_undegraded":"2023-12-16T20:21:40.791233+0000","last_fullsized":"2023-12-16T20:21:40.791233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:06.872220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211463+0000","last_change":"2023-12-16T20:21:25.196796+0000","last_active":"2023-12-16T20:21:41.211463+0000","last_peered":"2023-12-16T20:21:41.211463+0000","last_clean":"2023-12-16T20:21:41.211463+0000","last_became_active":"2023-12-16T20:21:25.195675+0000","last_became_peered":"2023-12-16T20:21:25.195675+0000","last_unstale":"2023-12-16T20:21:41.211463+0000","last_undegraded":"2023-12-16T20:21:41.211463+0000","last_fullsized":"2023-12-16T20:21:41.211463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:23.008820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:23.008820+0000","last_clean_scrub_stamp":"2023-12-16T20:21:23.008820+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:46:02.232774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.184671+0000","last_change":"2023-12-16T20:21:41.214322+0000","last_active":"2023-12-16T20:21:44.184671+0000","last_peered":"2023-12-16T20:21:44.184671+0000","last_clean":"2023-12-16T20:21:44.184671+0000","last_became_active":"2023-12-16T20:21:41.214012+0000","last_became_peered":"2023-12-16T20:21:41.214012+0000","last_unstale":"2023-12-16T20:21:44.184671+0000","last_undegraded":"2023-12-16T20:21:44.184671+0000","last_fullsized":"2023-12-16T20:21:44.184671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:18.981353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211688+0000","last_change":"2023-12-16T20:21:36.552920+0000","last_active":"2023-12-16T20:21:41.211688+0000","last_peered":"2023-12-16T20:21:41.211688+0000","last_clean":"2023-12-16T20:21:41.211688+0000","last_became_active":"2023-12-16T20:21:36.552619+0000","last_became_peered":"2023-12-16T20:21:36.552619+0000","last_unstale":"2023-12-16T20:21:41.211688+0000","last_undegraded":"2023-12-16T20:21:41.211688+0000","last_fullsized":"2023-12-16T20:21:41.211688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:14.586148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725929+0000","last_change":"2023-12-16T20:21:35.413597+0000","last_active":"2023-12-16T20:21:40.725929+0000","last_peered":"2023-12-16T20:21:40.725929+0000","last_clean":"2023-12-16T20:21:40.725929+0000","last_became_active":"2023-12-16T20:21:35.413308+0000","last_became_peered":"2023-12-16T20:21:35.413308+0000","last_unstale":"2023-12-16T20:21:40.725929+0000","last_undegraded":"2023-12-16T20:21:40.725929+0000","last_fullsized":"2023-12-16T20:21:40.725929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:55:39.544748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.184449+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:21:44.184449+0000","last_peered":"2023-12-16T20:21:44.184449+0000","last_clean":"2023-12-16T20:21:44.184449+0000","last_became_active":"2023-12-16T20:21:41.212608+0000","last_became_peered":"2023-12-16T20:21:41.212608+0000","last_unstale":"2023-12-16T20:21:44.184449+0000","last_undegraded":"2023-12-16T20:21:44.184449+0000","last_fullsized":"2023-12-16T20:21:44.184449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791343+0000","last_change":"2023-12-16T20:21:36.555870+0000","last_active":"2023-12-16T20:21:40.791343+0000","last_peered":"2023-12-16T20:21:40.791343+0000","last_clean":"2023-12-16T20:21:40.791343+0000","last_became_active":"2023-12-16T20:21:36.555631+0000","last_became_peered":"2023-12-16T20:21:36.555631+0000","last_unstale":"2023-12-16T20:21:40.791343+0000","last_undegraded":"2023-12-16T20:21:40.791343+0000","last_fullsized":"2023-12-16T20:21:40.791343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:10.421516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743686+0000","last_change":"2023-12-16T20:21:35.416140+0000","last_active":"2023-12-16T20:21:40.743686+0000","last_peered":"2023-12-16T20:21:40.743686+0000","last_clean":"2023-12-16T20:21:40.743686+0000","last_became_active":"2023-12-16T20:21:35.415810+0000","last_became_peered":"2023-12-16T20:21:35.415810+0000","last_unstale":"2023-12-16T20:21:40.743686+0000","last_undegraded":"2023-12-16T20:21:40.743686+0000","last_fullsized":"2023-12-16T20:21:40.743686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.135131+0000","last_change":"2023-12-16T20:21:40.794366+0000","last_active":"2023-12-16T20:21:44.135131+0000","last_peered":"2023-12-16T20:21:44.135131+0000","last_clean":"2023-12-16T20:21:44.135131+0000","last_became_active":"2023-12-16T20:21:40.793989+0000","last_became_peered":"2023-12-16T20:21:40.793989+0000","last_unstale":"2023-12-16T20:21:44.135131+0000","last_undegraded":"2023-12-16T20:21:44.135131+0000","last_fullsized":"2023-12-16T20:21:44.135131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:41.263768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211819+0000","last_change":"2023-12-16T20:21:36.536346+0000","last_active":"2023-12-16T20:21:41.211819+0000","last_peered":"2023-12-16T20:21:41.211819+0000","last_clean":"2023-12-16T20:21:41.211819+0000","last_became_active":"2023-12-16T20:21:36.536093+0000","last_became_peered":"2023-12-16T20:21:36.536093+0000","last_unstale":"2023-12-16T20:21:41.211819+0000","last_undegraded":"2023-12-16T20:21:41.211819+0000","last_fullsized":"2023-12-16T20:21:41.211819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:12.261391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725494+0000","last_change":"2023-12-16T20:21:35.420314+0000","last_active":"2023-12-16T20:21:40.725494+0000","last_peered":"2023-12-16T20:21:40.725494+0000","last_clean":"2023-12-16T20:21:40.725494+0000","last_became_active":"2023-12-16T20:21:35.420074+0000","last_became_peered":"2023-12-16T20:21:35.420074+0000","last_unstale":"2023-12-16T20:21:40.725494+0000","last_undegraded":"2023-12-16T20:21:40.725494+0000","last_fullsized":"2023-12-16T20:21:40.725494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:29.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.109595+0000","last_change":"2023-12-16T20:21:41.215282+0000","last_active":"2023-12-16T20:21:44.109595+0000","last_peered":"2023-12-16T20:21:44.109595+0000","last_clean":"2023-12-16T20:21:44.109595+0000","last_became_active":"2023-12-16T20:21:41.214939+0000","last_became_peered":"2023-12-16T20:21:41.214939+0000","last_unstale":"2023-12-16T20:21:44.109595+0000","last_undegraded":"2023-12-16T20:21:44.109595+0000","last_fullsized":"2023-12-16T20:21:44.109595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:06:12.245089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211732+0000","last_change":"2023-12-16T20:21:36.534345+0000","last_active":"2023-12-16T20:21:41.211732+0000","last_peered":"2023-12-16T20:21:41.211732+0000","last_clean":"2023-12-16T20:21:41.211732+0000","last_became_active":"2023-12-16T20:21:36.534064+0000","last_became_peered":"2023-12-16T20:21:36.534064+0000","last_unstale":"2023-12-16T20:21:41.211732+0000","last_undegraded":"2023-12-16T20:21:41.211732+0000","last_fullsized":"2023-12-16T20:21:41.211732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:05.641757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725865+0000","last_change":"2023-12-16T20:21:35.390941+0000","last_active":"2023-12-16T20:21:40.725865+0000","last_peered":"2023-12-16T20:21:40.725865+0000","last_clean":"2023-12-16T20:21:40.725865+0000","last_became_active":"2023-12-16T20:21:35.390740+0000","last_became_peered":"2023-12-16T20:21:35.390740+0000","last_unstale":"2023-12-16T20:21:40.725865+0000","last_undegraded":"2023-12-16T20:21:40.725865+0000","last_fullsized":"2023-12-16T20:21:40.725865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:00:44.009248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877589+0000","last_change":"2023-12-16T20:21:40.754355+0000","last_active":"2023-12-16T20:21:41.877589+0000","last_peered":"2023-12-16T20:21:41.877589+0000","last_clean":"2023-12-16T20:21:41.877589+0000","last_became_active":"2023-12-16T20:21:40.753981+0000","last_became_peered":"2023-12-16T20:21:40.753981+0000","last_unstale":"2023-12-16T20:21:41.877589+0000","last_undegraded":"2023-12-16T20:21:41.877589+0000","last_fullsized":"2023-12-16T20:21:41.877589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:09.125671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211363+0000","last_change":"2023-12-16T20:21:36.537080+0000","last_active":"2023-12-16T20:21:41.211363+0000","last_peered":"2023-12-16T20:21:41.211363+0000","last_clean":"2023-12-16T20:21:41.211363+0000","last_became_active":"2023-12-16T20:21:36.536822+0000","last_became_peered":"2023-12-16T20:21:36.536822+0000","last_unstale":"2023-12-16T20:21:41.211363+0000","last_undegraded":"2023-12-16T20:21:41.211363+0000","last_fullsized":"2023-12-16T20:21:41.211363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725357+0000","last_change":"2023-12-16T20:21:35.417113+0000","last_active":"2023-12-16T20:21:40.725357+0000","last_peered":"2023-12-16T20:21:40.725357+0000","last_clean":"2023-12-16T20:21:40.725357+0000","last_became_active":"2023-12-16T20:21:35.416850+0000","last_became_peered":"2023-12-16T20:21:35.416850+0000","last_unstale":"2023-12-16T20:21:40.725357+0000","last_undegraded":"2023-12-16T20:21:40.725357+0000","last_fullsized":"2023-12-16T20:21:40.725357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:00:44.009248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.135099+0000","last_change":"2023-12-16T20:21:40.755436+0000","last_active":"2023-12-16T20:21:44.135099+0000","last_peered":"2023-12-16T20:21:44.135099+0000","last_clean":"2023-12-16T20:21:44.135099+0000","last_became_active":"2023-12-16T20:21:40.755041+0000","last_became_peered":"2023-12-16T20:21:40.755041+0000","last_unstale":"2023-12-16T20:21:44.135099+0000","last_undegraded":"2023-12-16T20:21:44.135099+0000","last_fullsized":"2023-12-16T20:21:44.135099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:07.939178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752017+0000","last_change":"2023-12-16T20:21:36.541160+0000","last_active":"2023-12-16T20:21:40.752017+0000","last_peered":"2023-12-16T20:21:40.752017+0000","last_clean":"2023-12-16T20:21:40.752017+0000","last_became_active":"2023-12-16T20:21:36.540861+0000","last_became_peered":"2023-12-16T20:21:36.540861+0000","last_unstale":"2023-12-16T20:21:40.752017+0000","last_undegraded":"2023-12-16T20:21:40.752017+0000","last_fullsized":"2023-12-16T20:21:40.752017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.751989+0000","last_change":"2023-12-16T20:21:35.425071+0000","last_active":"2023-12-16T20:21:40.751989+0000","last_peered":"2023-12-16T20:21:40.751989+0000","last_clean":"2023-12-16T20:21:40.751989+0000","last_became_active":"2023-12-16T20:21:35.424822+0000","last_became_peered":"2023-12-16T20:21:35.424822+0000","last_unstale":"2023-12-16T20:21:40.751989+0000","last_undegraded":"2023-12-16T20:21:40.751989+0000","last_fullsized":"2023-12-16T20:21:40.751989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877590+0000","last_change":"2023-12-16T20:21:41.215346+0000","last_active":"2023-12-16T20:21:41.877590+0000","last_peered":"2023-12-16T20:21:41.877590+0000","last_clean":"2023-12-16T20:21:41.877590+0000","last_became_active":"2023-12-16T20:21:41.215002+0000","last_became_peered":"2023-12-16T20:21:41.215002+0000","last_unstale":"2023-12-16T20:21:41.877590+0000","last_undegraded":"2023-12-16T20:21:41.877590+0000","last_fullsized":"2023-12-16T20:21:41.877590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:10:42.982067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211447+0000","last_change":"2023-12-16T20:21:36.535791+0000","last_active":"2023-12-16T20:21:41.211447+0000","last_peered":"2023-12-16T20:21:41.211447+0000","last_clean":"2023-12-16T20:21:41.211447+0000","last_became_active":"2023-12-16T20:21:36.535447+0000","last_became_peered":"2023-12-16T20:21:36.535447+0000","last_unstale":"2023-12-16T20:21:41.211447+0000","last_undegraded":"2023-12-16T20:21:41.211447+0000","last_fullsized":"2023-12-16T20:21:41.211447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:28.307634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.792143+0000","last_change":"2023-12-16T20:21:35.423533+0000","last_active":"2023-12-16T20:21:40.792143+0000","last_peered":"2023-12-16T20:21:40.792143+0000","last_clean":"2023-12-16T20:21:40.792143+0000","last_became_active":"2023-12-16T20:21:35.423275+0000","last_became_peered":"2023-12-16T20:21:35.423275+0000","last_unstale":"2023-12-16T20:21:40.792143+0000","last_undegraded":"2023-12-16T20:21:40.792143+0000","last_fullsized":"2023-12-16T20:21:40.792143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:27.767422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877232+0000","last_change":"2023-12-16T20:21:41.213083+0000","last_active":"2023-12-16T20:21:41.877232+0000","last_peered":"2023-12-16T20:21:41.877232+0000","last_clean":"2023-12-16T20:21:41.877232+0000","last_became_active":"2023-12-16T20:21:41.212699+0000","last_became_peered":"2023-12-16T20:21:41.212699+0000","last_unstale":"2023-12-16T20:21:41.877232+0000","last_undegraded":"2023-12-16T20:21:41.877232+0000","last_fullsized":"2023-12-16T20:21:41.877232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:14:45.966119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.737960+0000","last_change":"2023-12-16T20:21:36.523928+0000","last_active":"2023-12-16T20:21:40.737960+0000","last_peered":"2023-12-16T20:21:40.737960+0000","last_clean":"2023-12-16T20:21:40.737960+0000","last_became_active":"2023-12-16T20:21:36.523649+0000","last_became_peered":"2023-12-16T20:21:36.523649+0000","last_unstale":"2023-12-16T20:21:40.737960+0000","last_undegraded":"2023-12-16T20:21:40.737960+0000","last_fullsized":"2023-12-16T20:21:40.737960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:33.657782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738298+0000","last_change":"2023-12-16T20:21:35.388611+0000","last_active":"2023-12-16T20:21:40.738298+0000","last_peered":"2023-12-16T20:21:40.738298+0000","last_clean":"2023-12-16T20:21:40.738298+0000","last_became_active":"2023-12-16T20:21:35.388392+0000","last_became_peered":"2023-12-16T20:21:35.388392+0000","last_unstale":"2023-12-16T20:21:40.738298+0000","last_undegraded":"2023-12-16T20:21:40.738298+0000","last_fullsized":"2023-12-16T20:21:40.738298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.110162+0000","last_change":"2023-12-16T20:21:41.213106+0000","last_active":"2023-12-16T20:21:44.110162+0000","last_peered":"2023-12-16T20:21:44.110162+0000","last_clean":"2023-12-16T20:21:44.110162+0000","last_became_active":"2023-12-16T20:21:41.212721+0000","last_became_peered":"2023-12-16T20:21:41.212721+0000","last_unstale":"2023-12-16T20:21:44.110162+0000","last_undegraded":"2023-12-16T20:21:44.110162+0000","last_fullsized":"2023-12-16T20:21:44.110162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:47:15.750172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211594+0000","last_change":"2023-12-16T20:21:36.519774+0000","last_active":"2023-12-16T20:21:41.211594+0000","last_peered":"2023-12-16T20:21:41.211594+0000","last_clean":"2023-12-16T20:21:41.211594+0000","last_became_active":"2023-12-16T20:21:36.519561+0000","last_became_peered":"2023-12-16T20:21:36.519561+0000","last_unstale":"2023-12-16T20:21:41.211594+0000","last_undegraded":"2023-12-16T20:21:41.211594+0000","last_fullsized":"2023-12-16T20:21:41.211594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:10.421516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:57.487368+0000","last_change":"2023-12-16T20:21:35.426168+0000","last_active":"2023-12-16T20:21:57.487368+0000","last_peered":"2023-12-16T20:21:57.487368+0000","last_clean":"2023-12-16T20:21:57.487368+0000","last_became_active":"2023-12-16T20:21:35.425929+0000","last_became_peered":"2023-12-16T20:21:35.425929+0000","last_unstale":"2023-12-16T20:21:57.487368+0000","last_undegraded":"2023-12-16T20:21:57.487368+0000","last_fullsized":"2023-12-16T20:21:57.487368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3840,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:43.431983+0000","last_change":"2023-12-16T20:21:40.754204+0000","last_active":"2023-12-16T20:21:43.431983+0000","last_peered":"2023-12-16T20:21:43.431983+0000","last_clean":"2023-12-16T20:21:43.431983+0000","last_became_active":"2023-12-16T20:21:40.753624+0000","last_became_peered":"2023-12-16T20:21:40.753624+0000","last_unstale":"2023-12-16T20:21:43.431983+0000","last_undegraded":"2023-12-16T20:21:43.431983+0000","last_fullsized":"2023-12-16T20:21:43.431983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:11.201128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726787+0000","last_change":"2023-12-16T20:21:36.534827+0000","last_active":"2023-12-16T20:21:40.726787+0000","last_peered":"2023-12-16T20:21:40.726787+0000","last_clean":"2023-12-16T20:21:40.726787+0000","last_became_active":"2023-12-16T20:21:36.533790+0000","last_became_peered":"2023-12-16T20:21:36.533790+0000","last_unstale":"2023-12-16T20:21:40.726787+0000","last_undegraded":"2023-12-16T20:21:40.726787+0000","last_fullsized":"2023-12-16T20:21:40.726787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:19.545737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743602+0000","last_change":"2023-12-16T20:21:35.416050+0000","last_active":"2023-12-16T20:21:40.743602+0000","last_peered":"2023-12-16T20:21:40.743602+0000","last_clean":"2023-12-16T20:21:40.743602+0000","last_became_active":"2023-12-16T20:21:35.415790+0000","last_became_peered":"2023-12-16T20:21:35.415790+0000","last_unstale":"2023-12-16T20:21:40.743602+0000","last_undegraded":"2023-12-16T20:21:40.743602+0000","last_fullsized":"2023-12-16T20:21:40.743602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.878018+0000","last_change":"2023-12-16T20:21:40.795197+0000","last_active":"2023-12-16T20:21:41.878018+0000","last_peered":"2023-12-16T20:21:41.878018+0000","last_clean":"2023-12-16T20:21:41.878018+0000","last_became_active":"2023-12-16T20:21:40.793667+0000","last_became_peered":"2023-12-16T20:21:40.793667+0000","last_unstale":"2023-12-16T20:21:41.878018+0000","last_undegraded":"2023-12-16T20:21:41.878018+0000","last_fullsized":"2023-12-16T20:21:41.878018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:32.304405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738312+0000","last_change":"2023-12-16T20:21:36.552680+0000","last_active":"2023-12-16T20:21:40.738312+0000","last_peered":"2023-12-16T20:21:40.738312+0000","last_clean":"2023-12-16T20:21:40.738312+0000","last_became_active":"2023-12-16T20:21:36.552482+0000","last_became_peered":"2023-12-16T20:21:36.552482+0000","last_unstale":"2023-12-16T20:21:40.738312+0000","last_undegraded":"2023-12-16T20:21:40.738312+0000","last_fullsized":"2023-12-16T20:21:40.738312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791458+0000","last_change":"2023-12-16T20:21:35.428379+0000","last_active":"2023-12-16T20:21:40.791458+0000","last_peered":"2023-12-16T20:21:40.791458+0000","last_clean":"2023-12-16T20:21:40.791458+0000","last_became_active":"2023-12-16T20:21:35.428100+0000","last_became_peered":"2023-12-16T20:21:35.428100+0000","last_unstale":"2023-12-16T20:21:40.791458+0000","last_undegraded":"2023-12-16T20:21:40.791458+0000","last_fullsized":"2023-12-16T20:21:40.791458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:44.330608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.876983+0000","last_change":"2023-12-16T20:21:40.753333+0000","last_active":"2023-12-16T20:21:41.876983+0000","last_peered":"2023-12-16T20:21:41.876983+0000","last_clean":"2023-12-16T20:21:41.876983+0000","last_became_active":"2023-12-16T20:21:40.752957+0000","last_became_peered":"2023-12-16T20:21:40.752957+0000","last_unstale":"2023-12-16T20:21:41.876983+0000","last_undegraded":"2023-12-16T20:21:41.876983+0000","last_fullsized":"2023-12-16T20:21:41.876983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:47:15.750172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791368+0000","last_change":"2023-12-16T20:21:36.552227+0000","last_active":"2023-12-16T20:21:40.791368+0000","last_peered":"2023-12-16T20:21:40.791368+0000","last_clean":"2023-12-16T20:21:40.791368+0000","last_became_active":"2023-12-16T20:21:36.551953+0000","last_became_peered":"2023-12-16T20:21:36.551953+0000","last_unstale":"2023-12-16T20:21:40.791368+0000","last_undegraded":"2023-12-16T20:21:40.791368+0000","last_fullsized":"2023-12-16T20:21:40.791368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:14.586148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.753542+0000","last_change":"2023-12-16T20:21:35.430197+0000","last_active":"2023-12-16T20:21:40.753542+0000","last_peered":"2023-12-16T20:21:40.753542+0000","last_clean":"2023-12-16T20:21:40.753542+0000","last_became_active":"2023-12-16T20:21:35.429940+0000","last_became_peered":"2023-12-16T20:21:35.429940+0000","last_unstale":"2023-12-16T20:21:40.753542+0000","last_undegraded":"2023-12-16T20:21:40.753542+0000","last_fullsized":"2023-12-16T20:21:40.753542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.876977+0000","last_change":"2023-12-16T20:21:41.216238+0000","last_active":"2023-12-16T20:21:41.876977+0000","last_peered":"2023-12-16T20:21:41.876977+0000","last_clean":"2023-12-16T20:21:41.876977+0000","last_became_active":"2023-12-16T20:21:41.215893+0000","last_became_peered":"2023-12-16T20:21:41.215893+0000","last_unstale":"2023-12-16T20:21:41.876977+0000","last_undegraded":"2023-12-16T20:21:41.876977+0000","last_fullsized":"2023-12-16T20:21:41.876977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:06:12.245089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.134901+0000","last_change":"2023-12-16T20:21:41.215277+0000","last_active":"2023-12-16T20:21:44.134901+0000","last_peered":"2023-12-16T20:21:44.134901+0000","last_clean":"2023-12-16T20:21:44.134901+0000","last_became_active":"2023-12-16T20:21:41.214950+0000","last_became_peered":"2023-12-16T20:21:41.214950+0000","last_unstale":"2023-12-16T20:21:44.134901+0000","last_undegraded":"2023-12-16T20:21:44.134901+0000","last_fullsized":"2023-12-16T20:21:44.134901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:10.036962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742636+0000","last_change":"2023-12-16T20:21:36.519789+0000","last_active":"2023-12-16T20:21:40.742636+0000","last_peered":"2023-12-16T20:21:40.742636+0000","last_clean":"2023-12-16T20:21:40.742636+0000","last_became_active":"2023-12-16T20:21:36.519476+0000","last_became_peered":"2023-12-16T20:21:36.519476+0000","last_unstale":"2023-12-16T20:21:40.742636+0000","last_undegraded":"2023-12-16T20:21:40.742636+0000","last_fullsized":"2023-12-16T20:21:40.742636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791067+0000","last_change":"2023-12-16T20:21:35.415150+0000","last_active":"2023-12-16T20:21:40.791067+0000","last_peered":"2023-12-16T20:21:40.791067+0000","last_clean":"2023-12-16T20:21:40.791067+0000","last_became_active":"2023-12-16T20:21:35.414846+0000","last_became_peered":"2023-12-16T20:21:35.414846+0000","last_unstale":"2023-12-16T20:21:40.791067+0000","last_undegraded":"2023-12-16T20:21:40.791067+0000","last_fullsized":"2023-12-16T20:21:40.791067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:37.215505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:44.184929+0000","last_change":"2023-12-16T20:21:40.794438+0000","last_active":"2023-12-16T20:21:44.184929+0000","last_peered":"2023-12-16T20:21:44.184929+0000","last_clean":"2023-12-16T20:21:44.184929+0000","last_became_active":"2023-12-16T20:21:40.794073+0000","last_became_peered":"2023-12-16T20:21:40.794073+0000","last_unstale":"2023-12-16T20:21:44.184929+0000","last_undegraded":"2023-12-16T20:21:44.184929+0000","last_fullsized":"2023-12-16T20:21:44.184929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:32.702839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.673163+0000","last_change":"2023-12-16T20:21:36.524670+0000","last_active":"2023-12-16T20:21:40.673163+0000","last_peered":"2023-12-16T20:21:40.673163+0000","last_clean":"2023-12-16T20:21:40.673163+0000","last_became_active":"2023-12-16T20:21:36.523837+0000","last_became_peered":"2023-12-16T20:21:36.523837+0000","last_unstale":"2023-12-16T20:21:40.673163+0000","last_undegraded":"2023-12-16T20:21:40.673163+0000","last_fullsized":"2023-12-16T20:21:40.673163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672390+0000","last_change":"2023-12-16T20:21:35.422176+0000","last_active":"2023-12-16T20:21:40.672390+0000","last_peered":"2023-12-16T20:21:40.672390+0000","last_clean":"2023-12-16T20:21:40.672390+0000","last_became_active":"2023-12-16T20:21:35.421982+0000","last_became_peered":"2023-12-16T20:21:35.421982+0000","last_unstale":"2023-12-16T20:21:40.672390+0000","last_undegraded":"2023-12-16T20:21:40.672390+0000","last_fullsized":"2023-12-16T20:21:40.672390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752314+0000","last_change":"2023-12-16T20:21:35.424509+0000","last_active":"2023-12-16T20:21:40.752314+0000","last_peered":"2023-12-16T20:21:40.752314+0000","last_clean":"2023-12-16T20:21:40.752314+0000","last_became_active":"2023-12-16T20:21:35.424254+0000","last_became_peered":"2023-12-16T20:21:35.424254+0000","last_unstale":"2023-12-16T20:21:40.752314+0000","last_undegraded":"2023-12-16T20:21:40.752314+0000","last_fullsized":"2023-12-16T20:21:40.752314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738189+0000","last_change":"2023-12-16T20:21:36.533903+0000","last_active":"2023-12-16T20:21:40.738189+0000","last_peered":"2023-12-16T20:21:40.738189+0000","last_clean":"2023-12-16T20:21:40.738189+0000","last_became_active":"2023-12-16T20:21:36.533574+0000","last_became_peered":"2023-12-16T20:21:36.533574+0000","last_unstale":"2023-12-16T20:21:40.738189+0000","last_undegraded":"2023-12-16T20:21:40.738189+0000","last_fullsized":"2023-12-16T20:21:40.738189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.874054+0000","last_change":"2023-12-16T20:21:40.794426+0000","last_active":"2023-12-16T20:21:41.874054+0000","last_peered":"2023-12-16T20:21:41.874054+0000","last_clean":"2023-12-16T20:21:41.874054+0000","last_became_active":"2023-12-16T20:21:40.794082+0000","last_became_peered":"2023-12-16T20:21:40.794082+0000","last_unstale":"2023-12-16T20:21:41.874054+0000","last_undegraded":"2023-12-16T20:21:41.874054+0000","last_fullsized":"2023-12-16T20:21:41.874054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:39:04.889495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672682+0000","last_change":"2023-12-16T20:21:35.419910+0000","last_active":"2023-12-16T20:21:40.672682+0000","last_peered":"2023-12-16T20:21:40.672682+0000","last_clean":"2023-12-16T20:21:40.672682+0000","last_became_active":"2023-12-16T20:21:35.419409+0000","last_became_peered":"2023-12-16T20:21:35.419409+0000","last_unstale":"2023-12-16T20:21:40.672682+0000","last_undegraded":"2023-12-16T20:21:40.672682+0000","last_fullsized":"2023-12-16T20:21:40.672682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726492+0000","last_change":"2023-12-16T20:21:36.533684+0000","last_active":"2023-12-16T20:21:40.726492+0000","last_peered":"2023-12-16T20:21:40.726492+0000","last_clean":"2023-12-16T20:21:40.726492+0000","last_became_active":"2023-12-16T20:21:36.533325+0000","last_became_peered":"2023-12-16T20:21:36.533325+0000","last_unstale":"2023-12-16T20:21:40.726492+0000","last_undegraded":"2023-12-16T20:21:40.726492+0000","last_fullsized":"2023-12-16T20:21:40.726492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:30.795818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.877493+0000","last_change":"2023-12-16T20:21:40.745455+0000","last_active":"2023-12-16T20:21:41.877493+0000","last_peered":"2023-12-16T20:21:41.877493+0000","last_clean":"2023-12-16T20:21:41.877493+0000","last_became_active":"2023-12-16T20:21:40.744731+0000","last_became_peered":"2023-12-16T20:21:40.744731+0000","last_unstale":"2023-12-16T20:21:41.877493+0000","last_undegraded":"2023-12-16T20:21:41.877493+0000","last_fullsized":"2023-12-16T20:21:41.877493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:17:56.583460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.751939+0000","last_change":"2023-12-16T20:21:36.542529+0000","last_active":"2023-12-16T20:21:40.751939+0000","last_peered":"2023-12-16T20:21:40.751939+0000","last_clean":"2023-12-16T20:21:40.751939+0000","last_became_active":"2023-12-16T20:21:36.542287+0000","last_became_peered":"2023-12-16T20:21:36.542287+0000","last_unstale":"2023-12-16T20:21:40.751939+0000","last_undegraded":"2023-12-16T20:21:40.751939+0000","last_fullsized":"2023-12-16T20:21:40.751939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725563+0000","last_change":"2023-12-16T20:21:36.551193+0000","last_active":"2023-12-16T20:21:40.725563+0000","last_peered":"2023-12-16T20:21:40.725563+0000","last_clean":"2023-12-16T20:21:40.725563+0000","last_became_active":"2023-12-16T20:21:36.550911+0000","last_became_peered":"2023-12-16T20:21:36.550911+0000","last_unstale":"2023-12-16T20:21:40.725563+0000","last_undegraded":"2023-12-16T20:21:40.725563+0000","last_fullsized":"2023-12-16T20:21:40.725563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:19.545737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.792258+0000","last_change":"2023-12-16T20:21:36.556390+0000","last_active":"2023-12-16T20:21:40.792258+0000","last_peered":"2023-12-16T20:21:40.792258+0000","last_clean":"2023-12-16T20:21:40.792258+0000","last_became_active":"2023-12-16T20:21:36.555822+0000","last_became_peered":"2023-12-16T20:21:36.555822+0000","last_unstale":"2023-12-16T20:21:40.792258+0000","last_undegraded":"2023-12-16T20:21:40.792258+0000","last_fullsized":"2023-12-16T20:21:40.792258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:28.307634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738168+0000","last_change":"2023-12-16T20:21:36.525171+0000","last_active":"2023-12-16T20:21:40.738168+0000","last_peered":"2023-12-16T20:21:40.738168+0000","last_clean":"2023-12-16T20:21:40.738168+0000","last_became_active":"2023-12-16T20:21:36.524747+0000","last_became_peered":"2023-12-16T20:21:36.524747+0000","last_unstale":"2023-12-16T20:21:40.738168+0000","last_undegraded":"2023-12-16T20:21:40.738168+0000","last_fullsized":"2023-12-16T20:21:40.738168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672419+0000","last_change":"2023-12-16T20:21:36.533944+0000","last_active":"2023-12-16T20:21:40.672419+0000","last_peered":"2023-12-16T20:21:40.672419+0000","last_clean":"2023-12-16T20:21:40.672419+0000","last_became_active":"2023-12-16T20:21:36.533682+0000","last_became_peered":"2023-12-16T20:21:36.533682+0000","last_unstale":"2023-12-16T20:21:40.672419+0000","last_undegraded":"2023-12-16T20:21:40.672419+0000","last_fullsized":"2023-12-16T20:21:40.672419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:20.609645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742898+0000","last_change":"2023-12-16T20:21:36.519818+0000","last_active":"2023-12-16T20:21:40.742898+0000","last_peered":"2023-12-16T20:21:40.742898+0000","last_clean":"2023-12-16T20:21:40.742898+0000","last_became_active":"2023-12-16T20:21:36.519545+0000","last_became_peered":"2023-12-16T20:21:36.519545+0000","last_unstale":"2023-12-16T20:21:40.742898+0000","last_undegraded":"2023-12-16T20:21:40.742898+0000","last_fullsized":"2023-12-16T20:21:40.742898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.753739+0000","last_change":"2023-12-16T20:21:36.542706+0000","last_active":"2023-12-16T20:21:40.753739+0000","last_peered":"2023-12-16T20:21:40.753739+0000","last_clean":"2023-12-16T20:21:40.753739+0000","last_became_active":"2023-12-16T20:21:36.542184+0000","last_became_peered":"2023-12-16T20:21:36.542184+0000","last_unstale":"2023-12-16T20:21:40.753739+0000","last_undegraded":"2023-12-16T20:21:40.753739+0000","last_fullsized":"2023-12-16T20:21:40.753739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672194+0000","last_change":"2023-12-16T20:21:36.536726+0000","last_active":"2023-12-16T20:21:40.672194+0000","last_peered":"2023-12-16T20:21:40.672194+0000","last_clean":"2023-12-16T20:21:40.672194+0000","last_became_active":"2023-12-16T20:21:36.536439+0000","last_became_peered":"2023-12-16T20:21:36.536439+0000","last_unstale":"2023-12-16T20:21:40.672194+0000","last_undegraded":"2023-12-16T20:21:40.672194+0000","last_fullsized":"2023-12-16T20:21:40.672194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.790945+0000","last_change":"2023-12-16T20:21:36.555521+0000","last_active":"2023-12-16T20:21:40.790945+0000","last_peered":"2023-12-16T20:21:40.790945+0000","last_clean":"2023-12-16T20:21:40.790945+0000","last_became_active":"2023-12-16T20:21:36.555100+0000","last_became_peered":"2023-12-16T20:21:36.555100+0000","last_unstale":"2023-12-16T20:21:40.790945+0000","last_undegraded":"2023-12-16T20:21:40.790945+0000","last_fullsized":"2023-12-16T20:21:40.790945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672520+0000","last_change":"2023-12-16T20:21:36.535856+0000","last_active":"2023-12-16T20:21:40.672520+0000","last_peered":"2023-12-16T20:21:40.672520+0000","last_clean":"2023-12-16T20:21:40.672520+0000","last_became_active":"2023-12-16T20:21:36.535600+0000","last_became_peered":"2023-12-16T20:21:36.535600+0000","last_unstale":"2023-12-16T20:21:40.672520+0000","last_undegraded":"2023-12-16T20:21:40.672520+0000","last_fullsized":"2023-12-16T20:21:40.672520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791686+0000","last_change":"2023-12-16T20:21:36.553376+0000","last_active":"2023-12-16T20:21:40.791686+0000","last_peered":"2023-12-16T20:21:40.791686+0000","last_clean":"2023-12-16T20:21:40.791686+0000","last_became_active":"2023-12-16T20:21:36.553155+0000","last_became_peered":"2023-12-16T20:21:36.553155+0000","last_unstale":"2023-12-16T20:21:40.791686+0000","last_undegraded":"2023-12-16T20:21:40.791686+0000","last_fullsized":"2023-12-16T20:21:40.791686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738115+0000","last_change":"2023-12-16T20:21:36.524517+0000","last_active":"2023-12-16T20:21:40.738115+0000","last_peered":"2023-12-16T20:21:40.738115+0000","last_clean":"2023-12-16T20:21:40.738115+0000","last_became_active":"2023-12-16T20:21:36.524166+0000","last_became_peered":"2023-12-16T20:21:36.524166+0000","last_unstale":"2023-12-16T20:21:40.738115+0000","last_undegraded":"2023-12-16T20:21:40.738115+0000","last_fullsized":"2023-12-16T20:21:40.738115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752601+0000","last_change":"2023-12-16T20:21:36.542513+0000","last_active":"2023-12-16T20:21:40.752601+0000","last_peered":"2023-12-16T20:21:40.752601+0000","last_clean":"2023-12-16T20:21:40.752601+0000","last_became_active":"2023-12-16T20:21:36.542191+0000","last_became_peered":"2023-12-16T20:21:36.542191+0000","last_unstale":"2023-12-16T20:21:40.752601+0000","last_undegraded":"2023-12-16T20:21:40.752601+0000","last_fullsized":"2023-12-16T20:21:40.752601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211817+0000","last_change":"2023-12-16T20:21:36.518582+0000","last_active":"2023-12-16T20:21:41.211817+0000","last_peered":"2023-12-16T20:21:41.211817+0000","last_clean":"2023-12-16T20:21:41.211817+0000","last_became_active":"2023-12-16T20:21:36.518348+0000","last_became_peered":"2023-12-16T20:21:36.518348+0000","last_unstale":"2023-12-16T20:21:41.211817+0000","last_undegraded":"2023-12-16T20:21:41.211817+0000","last_fullsized":"2023-12-16T20:21:41.211817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:06.805922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.725472+0000","last_change":"2023-12-16T20:21:36.544461+0000","last_active":"2023-12-16T20:21:40.725472+0000","last_peered":"2023-12-16T20:21:40.725472+0000","last_clean":"2023-12-16T20:21:40.725472+0000","last_became_active":"2023-12-16T20:21:36.544225+0000","last_became_peered":"2023-12-16T20:21:36.544225+0000","last_unstale":"2023-12-16T20:21:40.725472+0000","last_undegraded":"2023-12-16T20:21:40.725472+0000","last_fullsized":"2023-12-16T20:21:40.725472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:45:02.439240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791694+0000","last_change":"2023-12-16T20:21:36.554370+0000","last_active":"2023-12-16T20:21:40.791694+0000","last_peered":"2023-12-16T20:21:40.791694+0000","last_clean":"2023-12-16T20:21:40.791694+0000","last_became_active":"2023-12-16T20:21:36.554130+0000","last_became_peered":"2023-12-16T20:21:36.554130+0000","last_unstale":"2023-12-16T20:21:40.791694+0000","last_undegraded":"2023-12-16T20:21:40.791694+0000","last_fullsized":"2023-12-16T20:21:40.791694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:05.641757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.790872+0000","last_change":"2023-12-16T20:21:36.555346+0000","last_active":"2023-12-16T20:21:40.790872+0000","last_peered":"2023-12-16T20:21:40.790872+0000","last_clean":"2023-12-16T20:21:40.790872+0000","last_became_active":"2023-12-16T20:21:36.554772+0000","last_became_peered":"2023-12-16T20:21:36.554772+0000","last_unstale":"2023-12-16T20:21:40.790872+0000","last_undegraded":"2023-12-16T20:21:40.790872+0000","last_fullsized":"2023-12-16T20:21:40.790872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.742743+0000","last_change":"2023-12-16T20:21:36.534502+0000","last_active":"2023-12-16T20:21:40.742743+0000","last_peered":"2023-12-16T20:21:40.742743+0000","last_clean":"2023-12-16T20:21:40.742743+0000","last_became_active":"2023-12-16T20:21:36.534307+0000","last_became_peered":"2023-12-16T20:21:36.534307+0000","last_unstale":"2023-12-16T20:21:40.742743+0000","last_undegraded":"2023-12-16T20:21:40.742743+0000","last_fullsized":"2023-12-16T20:21:40.742743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.737870+0000","last_change":"2023-12-16T20:21:36.525661+0000","last_active":"2023-12-16T20:21:40.737870+0000","last_peered":"2023-12-16T20:21:40.737870+0000","last_clean":"2023-12-16T20:21:40.737870+0000","last_became_active":"2023-12-16T20:21:36.525427+0000","last_became_peered":"2023-12-16T20:21:36.525427+0000","last_unstale":"2023-12-16T20:21:40.737870+0000","last_undegraded":"2023-12-16T20:21:40.737870+0000","last_fullsized":"2023-12-16T20:21:40.737870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:39:00.494290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.672421+0000","last_change":"2023-12-16T20:21:36.542756+0000","last_active":"2023-12-16T20:21:40.672421+0000","last_peered":"2023-12-16T20:21:40.672421+0000","last_clean":"2023-12-16T20:21:40.672421+0000","last_became_active":"2023-12-16T20:21:36.542513+0000","last_became_peered":"2023-12-16T20:21:36.542513+0000","last_unstale":"2023-12-16T20:21:40.672421+0000","last_undegraded":"2023-12-16T20:21:40.672421+0000","last_fullsized":"2023-12-16T20:21:40.672421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.726700+0000","last_change":"2023-12-16T20:21:36.544754+0000","last_active":"2023-12-16T20:21:40.726700+0000","last_peered":"2023-12-16T20:21:40.726700+0000","last_clean":"2023-12-16T20:21:40.726700+0000","last_became_active":"2023-12-16T20:21:36.544492+0000","last_became_peered":"2023-12-16T20:21:36.544492+0000","last_unstale":"2023-12-16T20:21:40.726700+0000","last_undegraded":"2023-12-16T20:21:40.726700+0000","last_fullsized":"2023-12-16T20:21:40.726700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:19.509623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.752407+0000","last_change":"2023-12-16T20:21:36.552022+0000","last_active":"2023-12-16T20:21:40.752407+0000","last_peered":"2023-12-16T20:21:40.752407+0000","last_clean":"2023-12-16T20:21:40.752407+0000","last_became_active":"2023-12-16T20:21:36.551775+0000","last_became_peered":"2023-12-16T20:21:36.551775+0000","last_unstale":"2023-12-16T20:21:40.752407+0000","last_undegraded":"2023-12-16T20:21:40.752407+0000","last_fullsized":"2023-12-16T20:21:40.752407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.753663+0000","last_change":"2023-12-16T20:21:36.551107+0000","last_active":"2023-12-16T20:21:40.753663+0000","last_peered":"2023-12-16T20:21:40.753663+0000","last_clean":"2023-12-16T20:21:40.753663+0000","last_became_active":"2023-12-16T20:21:36.550815+0000","last_became_peered":"2023-12-16T20:21:36.550815+0000","last_unstale":"2023-12-16T20:21:40.753663+0000","last_undegraded":"2023-12-16T20:21:40.753663+0000","last_fullsized":"2023-12-16T20:21:40.753663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211809+0000","last_change":"2023-12-16T20:21:36.554041+0000","last_active":"2023-12-16T20:21:41.211809+0000","last_peered":"2023-12-16T20:21:41.211809+0000","last_clean":"2023-12-16T20:21:41.211809+0000","last_became_active":"2023-12-16T20:21:36.553708+0000","last_became_peered":"2023-12-16T20:21:36.553708+0000","last_unstale":"2023-12-16T20:21:41.211809+0000","last_undegraded":"2023-12-16T20:21:41.211809+0000","last_fullsized":"2023-12-16T20:21:41.211809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:36.868562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.671819+0000","last_change":"2023-12-16T20:21:36.551348+0000","last_active":"2023-12-16T20:21:40.671819+0000","last_peered":"2023-12-16T20:21:40.671819+0000","last_clean":"2023-12-16T20:21:40.671819+0000","last_became_active":"2023-12-16T20:21:36.551066+0000","last_became_peered":"2023-12-16T20:21:36.551066+0000","last_unstale":"2023-12-16T20:21:40.671819+0000","last_undegraded":"2023-12-16T20:21:40.671819+0000","last_fullsized":"2023-12-16T20:21:40.671819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211281+0000","last_change":"2023-12-16T20:21:36.523828+0000","last_active":"2023-12-16T20:21:41.211281+0000","last_peered":"2023-12-16T20:21:41.211281+0000","last_clean":"2023-12-16T20:21:41.211281+0000","last_became_active":"2023-12-16T20:21:36.523604+0000","last_became_peered":"2023-12-16T20:21:36.523604+0000","last_unstale":"2023-12-16T20:21:41.211281+0000","last_undegraded":"2023-12-16T20:21:41.211281+0000","last_fullsized":"2023-12-16T20:21:41.211281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791600+0000","last_change":"2023-12-16T20:21:36.556286+0000","last_active":"2023-12-16T20:21:40.791600+0000","last_peered":"2023-12-16T20:21:40.791600+0000","last_clean":"2023-12-16T20:21:40.791600+0000","last_became_active":"2023-12-16T20:21:36.556041+0000","last_became_peered":"2023-12-16T20:21:36.556041+0000","last_unstale":"2023-12-16T20:21:40.791600+0000","last_undegraded":"2023-12-16T20:21:40.791600+0000","last_fullsized":"2023-12-16T20:21:40.791600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211340+0000","last_change":"2023-12-16T20:21:36.518408+0000","last_active":"2023-12-16T20:21:41.211340+0000","last_peered":"2023-12-16T20:21:41.211340+0000","last_clean":"2023-12-16T20:21:41.211340+0000","last_became_active":"2023-12-16T20:21:36.518138+0000","last_became_peered":"2023-12-16T20:21:36.518138+0000","last_unstale":"2023-12-16T20:21:41.211340+0000","last_undegraded":"2023-12-16T20:21:41.211340+0000","last_fullsized":"2023-12-16T20:21:41.211340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.791179+0000","last_change":"2023-12-16T20:21:36.555311+0000","last_active":"2023-12-16T20:21:40.791179+0000","last_peered":"2023-12-16T20:21:40.791179+0000","last_clean":"2023-12-16T20:21:40.791179+0000","last_became_active":"2023-12-16T20:21:36.555041+0000","last_became_peered":"2023-12-16T20:21:36.555041+0000","last_unstale":"2023-12-16T20:21:40.791179+0000","last_undegraded":"2023-12-16T20:21:40.791179+0000","last_fullsized":"2023-12-16T20:21:40.791179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:20.609645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.738053+0000","last_change":"2023-12-16T20:21:36.524036+0000","last_active":"2023-12-16T20:21:40.738053+0000","last_peered":"2023-12-16T20:21:40.738053+0000","last_clean":"2023-12-16T20:21:40.738053+0000","last_became_active":"2023-12-16T20:21:36.523784+0000","last_became_peered":"2023-12-16T20:21:36.523784+0000","last_unstale":"2023-12-16T20:21:40.738053+0000","last_undegraded":"2023-12-16T20:21:40.738053+0000","last_fullsized":"2023-12-16T20:21:40.738053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:40.743757+0000","last_change":"2023-12-16T20:21:36.526391+0000","last_active":"2023-12-16T20:21:40.743757+0000","last_peered":"2023-12-16T20:21:40.743757+0000","last_clean":"2023-12-16T20:21:40.743757+0000","last_became_active":"2023-12-16T20:21:36.526151+0000","last_became_peered":"2023-12-16T20:21:36.526151+0000","last_unstale":"2023-12-16T20:21:40.743757+0000","last_undegraded":"2023-12-16T20:21:40.743757+0000","last_fullsized":"2023-12-16T20:21:40.743757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-16T20:21:41.211659+0000","last_change":"2023-12-16T20:21:36.543566+0000","last_active":"2023-12-16T20:21:41.211659+0000","last_peered":"2023-12-16T20:21:41.211659+0000","last_clean":"2023-12-16T20:21:41.211659+0000","last_became_active":"2023-12-16T20:21:36.543306+0000","last_became_peered":"2023-12-16T20:21:36.543306+0000","last_unstale":"2023-12-16T20:21:41.211659+0000","last_undegraded":"2023-12-16T20:21:41.211659+0000","last_fullsized":"2023-12-16T20:21:41.211659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:03.543973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4638,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65176,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":695413,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":104553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":104589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":104623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":695469,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T20:22:11.709 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-16T20:22:11.709 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-16T20:22:11.709 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-16T20:22:11.709 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-16T20:22:11.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.840+0000 7f0d98901640 1 Processor -- start 2023-12-16T20:22:11.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.840+0000 7f0d98901640 1 -- start start 2023-12-16T20:22:11.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.841+0000 7f0d98901640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d94159860 0x7f0d94156e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:11.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.841+0000 7f0d98901640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d94072b60 con 0x7f0d941501c0 2023-12-16T20:22:11.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.841+0000 7f0d98901640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d940c1a90 con 0x7f0d940bff00 2023-12-16T20:22:11.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.841+0000 7f0d98901640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d94159c80 con 0x7f0d94159860 2023-12-16T20:22:11.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.842+0000 7f0d9259c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f0d941501c0 0x7f0d94072450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60046/0 (socket says 172.21.15.87:60046) 2023-12-16T20:22:11.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.842+0000 7f0d9259c640 1 -- 172.21.15.87:0/1330454788 learned_addr learned my addr 172.21.15.87:0/1330454788 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:11.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.842+0000 7f0d92d9d640 1 --2- 172.21.15.87:0/1330454788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d94159860 0x7f0d94156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:11.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.844+0000 7f0d9159a640 1 -- 172.21.15.87:0/1330454788 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3452740376 0 0) 0x7f0d94072b60 con 0x7f0d941501c0 2023-12-16T20:22:11.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.844+0000 7f0d9159a640 1 -- 172.21.15.87:0/1330454788 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d7c003520 con 0x7f0d941501c0 2023-12-16T20:22:11.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.844+0000 7f0d9159a640 1 -- 172.21.15.87:0/1330454788 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3404960236 0 0) 0x7f0d940c1a90 con 0x7f0d940bff00 2023-12-16T20:22:11.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.844+0000 7f0d9159a640 1 -- 172.21.15.87:0/1330454788 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d94072b60 con 0x7f0d940bff00 2023-12-16T20:22:11.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.844+0000 7f0d92d9d640 1 -- 172.21.15.87:0/1330454788 >> v1:172.21.15.195:6789/0 conn(0x7f0d940bff00 legacy=0x7f0d94071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:11.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.844+0000 7f0d92d9d640 1 -- 172.21.15.87:0/1330454788 >> v1:172.21.15.87:6789/0 conn(0x7f0d941501c0 legacy=0x7f0d94072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:11.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.844+0000 7f0d92d9d640 1 -- 172.21.15.87:0/1330454788 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d940c1d30 con 0x7f0d94159860 2023-12-16T20:22:11.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.846+0000 7f0d92d9d640 1 --2- 172.21.15.87:0/1330454788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d94159860 0x7f0d94156e60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0d840097d0 tx=0x7f0d8402b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cc14ff23bcb9957 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:11.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.850+0000 7f0d9159a640 1 -- 172.21.15.87:0/1330454788 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d84030880 con 0x7f0d94159860 2023-12-16T20:22:11.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.850+0000 7f0d9159a640 1 -- 172.21.15.87:0/1330454788 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d840309e0 con 0x7f0d94159860 2023-12-16T20:22:11.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.850+0000 7f0d9159a640 1 -- 172.21.15.87:0/1330454788 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d84030d70 con 0x7f0d94159860 2023-12-16T20:22:11.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.851+0000 7f0d98901640 1 -- 172.21.15.87:0/1330454788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d94159860 msgr2=0x7f0d94156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:11.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.851+0000 7f0d98901640 1 --2- 172.21.15.87:0/1330454788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d94159860 0x7f0d94156e60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0d840097d0 tx=0x7f0d8402b9c0 comp rx=0 tx=0).stop 2023-12-16T20:22:11.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.851+0000 7f0d98901640 1 -- 172.21.15.87:0/1330454788 shutdown_connections 2023-12-16T20:22:11.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.851+0000 7f0d98901640 1 --2- 172.21.15.87:0/1330454788 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d94159860 0x7f0d94156e60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:11.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.851+0000 7f0d98901640 1 -- 172.21.15.87:0/1330454788 >> 172.21.15.87:0/1330454788 conn(0x7f0d9406cd60 msgr2=0x7f0d9406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:11.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.851+0000 7f0d98901640 1 -- 172.21.15.87:0/1330454788 shutdown_connections 2023-12-16T20:22:11.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.851+0000 7f0d98901640 1 -- 172.21.15.87:0/1330454788 wait complete. 2023-12-16T20:22:11.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.852+0000 7f0d98901640 1 Processor -- start 2023-12-16T20:22:11.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.852+0000 7f0d98901640 1 -- start start 2023-12-16T20:22:11.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.853+0000 7f0d98901640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d940bff00 0x7f0d941edb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:11.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.853+0000 7f0d98901640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d941501c0 0x7f0d9414acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:11.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.853+0000 7f0d98901640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d94159860 0x7f0d940c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:11.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.853+0000 7f0d98901640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d941ee080 con 0x7f0d94159860 2023-12-16T20:22:11.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.853+0000 7f0d98901640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d94152180 con 0x7f0d940bff00 2023-12-16T20:22:11.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.853+0000 7f0d98901640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d940c8de0 con 0x7f0d941501c0 2023-12-16T20:22:11.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.854+0000 7f0d92d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d94159860 0x7f0d940c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:11.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.854+0000 7f0d9259c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d940bff00 0x7f0d941edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:11.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.854+0000 7f0d92d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d94159860 0x7f0d940c9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46754/0 (socket says 172.21.15.87:46754) 2023-12-16T20:22:11.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.854+0000 7f0d92d9d640 1 -- 172.21.15.87:0/1238842291 learned_addr learned my addr 172.21.15.87:0/1238842291 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:11.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.854+0000 7f0d91d9b640 1 --2- 172.21.15.87:0/1238842291 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d941501c0 0x7f0d9414acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:11.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.857+0000 7f0d92d9d640 1 -- 172.21.15.87:0/1238842291 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d941501c0 msgr2=0x7f0d9414acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:11.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.857+0000 7f0d92d9d640 1 --2- 172.21.15.87:0/1238842291 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d941501c0 0x7f0d9414acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:11.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.857+0000 7f0d92d9d640 1 -- 172.21.15.87:0/1238842291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d940bff00 msgr2=0x7f0d941edb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:11.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.857+0000 7f0d92d9d640 1 --2- 172.21.15.87:0/1238842291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d940bff00 0x7f0d941edb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:11.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.857+0000 7f0d92d9d640 1 -- 172.21.15.87:0/1238842291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d84009400 con 0x7f0d94159860 2023-12-16T20:22:11.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.859+0000 7f0d92d9d640 1 --2- 172.21.15.87:0/1238842291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d94159860 0x7f0d940c9550 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0d840097d0 tx=0x7f0d84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:11.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.863+0000 7f0d82ffd640 1 -- 172.21.15.87:0/1238842291 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8403e040 con 0x7f0d94159860 2023-12-16T20:22:11.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.863+0000 7f0d82ffd640 1 -- 172.21.15.87:0/1238842291 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d84039c50 con 0x7f0d94159860 2023-12-16T20:22:11.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.863+0000 7f0d98901640 1 -- 172.21.15.87:0/1238842291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d940ca440 con 0x7f0d94159860 2023-12-16T20:22:11.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.863+0000 7f0d82ffd640 1 -- 172.21.15.87:0/1238842291 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d840443f0 con 0x7f0d94159860 2023-12-16T20:22:11.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.863+0000 7f0d98901640 1 -- 172.21.15.87:0/1238842291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d940ca6e0 con 0x7f0d94159860 2023-12-16T20:22:11.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.864+0000 7f0d98901640 1 -- 172.21.15.87:0/1238842291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d940c77e0 con 0x7f0d94159860 2023-12-16T20:22:11.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.883+0000 7f0d82ffd640 1 -- 172.21.15.87:0/1238842291 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f0d8402f3d0 con 0x7f0d94159860 2023-12-16T20:22:11.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.883+0000 7f0d82ffd640 1 --2- 172.21.15.87:0/1238842291 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0d7406ae70 0x7f0d7406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:11.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.883+0000 7f0d9259c640 1 --2- 172.21.15.87:0/1238842291 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0d7406ae70 0x7f0d7406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:11.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:11.884+0000 7f0d9259c640 1 --2- 172.21.15.87:0/1238842291 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0d7406ae70 0x7f0d7406d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c000f60 tx=0x7f0d8c007d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:12.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.117+0000 7f0d82ffd640 1 -- 172.21.15.87:0/1238842291 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0d8407af80 con 0x7f0d94159860 2023-12-16T20:22:12.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.117+0000 7f0d82ffd640 1 -- 172.21.15.87:0/1238842291 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f0d840772c0 con 0x7f0d94159860 2023-12-16T20:22:12.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.333+0000 7f0d98901640 1 -- 172.21.15.87:0/1238842291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0d94067500 con 0x7f0d94159860 2023-12-16T20:22:12.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.338+0000 7f0d82ffd640 1 -- 172.21.15.87:0/1238842291 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f0d84049080 con 0x7f0d94159860 2023-12-16T20:22:12.340 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:22:12.340 INFO:teuthology.orchestra.run.smithi087.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-16T20:22:12.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.341+0000 7f0d98901640 1 -- 172.21.15.87:0/1238842291 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0d7406ae70 msgr2=0x7f0d7406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:12.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.341+0000 7f0d98901640 1 --2- 172.21.15.87:0/1238842291 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0d7406ae70 0x7f0d7406d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c000f60 tx=0x7f0d8c007d70 comp rx=0 tx=0).stop 2023-12-16T20:22:12.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.341+0000 7f0d98901640 1 -- 172.21.15.87:0/1238842291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d94159860 msgr2=0x7f0d940c9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:12.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.341+0000 7f0d98901640 1 --2- 172.21.15.87:0/1238842291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d94159860 0x7f0d940c9550 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0d840097d0 tx=0x7f0d84004730 comp rx=0 tx=0).stop 2023-12-16T20:22:12.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.341+0000 7f0d98901640 1 -- 172.21.15.87:0/1238842291 shutdown_connections 2023-12-16T20:22:12.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.341+0000 7f0d98901640 1 --2- 172.21.15.87:0/1238842291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d94159860 0x7f0d940c9550 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:12.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.341+0000 7f0d98901640 1 --2- 172.21.15.87:0/1238842291 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d941501c0 0x7f0d9414acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:12.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.341+0000 7f0d98901640 1 --2- 172.21.15.87:0/1238842291 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0d7406ae70 0x7f0d7406d330 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:12.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.341+0000 7f0d98901640 1 --2- 172.21.15.87:0/1238842291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d940bff00 0x7f0d941edb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:12.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.341+0000 7f0d98901640 1 -- 172.21.15.87:0/1238842291 >> 172.21.15.87:0/1238842291 conn(0x7f0d9406cd60 msgr2=0x7f0d940c64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:12.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.341+0000 7f0d98901640 1 -- 172.21.15.87:0/1238842291 shutdown_connections 2023-12-16T20:22:12.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.341+0000 7f0d98901640 1 -- 172.21.15.87:0/1238842291 wait complete. 2023-12-16T20:22:12.353 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-16T20:22:12.354 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:22:12.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.452+0000 7f7687844640 1 Processor -- start 2023-12-16T20:22:12.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.453+0000 7f7687844640 1 -- start start 2023-12-16T20:22:12.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.453+0000 7f7687844640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f768015d950 0x7f768015aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:12.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.453+0000 7f7687844640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768015a700 con 0x7f7680153c70 2023-12-16T20:22:12.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.453+0000 7f7687844640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76800ca870 con 0x7f7680153890 2023-12-16T20:22:12.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.453+0000 7f7687844640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f768015dd60 con 0x7f768015d950 2023-12-16T20:22:12.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.454+0000 7f7684ddf640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7680153c70 0x7f76800ceef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60054/0 (socket says 172.21.15.87:60054) 2023-12-16T20:22:12.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.454+0000 7f7684ddf640 1 -- 172.21.15.87:0/962367819 learned_addr learned my addr 172.21.15.87:0/962367819 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:12.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.454+0000 7f7685de1640 1 --2- 172.21.15.87:0/962367819 >> v2:172.21.15.195:3300/0 conn(0x7f768015d950 0x7f768015aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.456+0000 7f7677fff640 1 -- 172.21.15.87:0/962367819 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608226037 0 0) 0x7f768015a700 con 0x7f7680153c70 2023-12-16T20:22:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.456+0000 7f7677fff640 1 -- 172.21.15.87:0/962367819 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f766c003520 con 0x7f7680153c70 2023-12-16T20:22:12.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.458+0000 7f7685de1640 1 -- 172.21.15.87:0/962367819 >> v1:172.21.15.195:6789/0 conn(0x7f7680153890 legacy=0x7f76800c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:12.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.458+0000 7f7685de1640 1 -- 172.21.15.87:0/962367819 >> v1:172.21.15.87:6789/0 conn(0x7f7680153c70 legacy=0x7f76800ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:12.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.458+0000 7f7685de1640 1 -- 172.21.15.87:0/962367819 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7680159af0 con 0x7f768015d950 2023-12-16T20:22:12.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.462+0000 7f7685de1640 1 --2- 172.21.15.87:0/962367819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f768015d950 0x7f768015aed0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f767c0097a0 tx=0x7f767c02b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51e2c1113458dc81 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:12.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.466+0000 7f7677fff640 1 -- 172.21.15.87:0/962367819 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c02f810 con 0x7f768015d950 2023-12-16T20:22:12.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.466+0000 7f7677fff640 1 -- 172.21.15.87:0/962367819 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c02f970 con 0x7f768015d950 2023-12-16T20:22:12.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.466+0000 7f7677fff640 1 -- 172.21.15.87:0/962367819 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c02fd00 con 0x7f768015d950 2023-12-16T20:22:12.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.467+0000 7f7687844640 1 -- 172.21.15.87:0/962367819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f768015d950 msgr2=0x7f768015aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:12.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.467+0000 7f7687844640 1 --2- 172.21.15.87:0/962367819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f768015d950 0x7f768015aed0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f767c0097a0 tx=0x7f767c02b9f0 comp rx=0 tx=0).stop 2023-12-16T20:22:12.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.467+0000 7f7687844640 1 -- 172.21.15.87:0/962367819 shutdown_connections 2023-12-16T20:22:12.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.467+0000 7f7687844640 1 --2- 172.21.15.87:0/962367819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f768015d950 0x7f768015aed0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:12.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.467+0000 7f7687844640 1 -- 172.21.15.87:0/962367819 >> 172.21.15.87:0/962367819 conn(0x7f768006ba00 msgr2=0x7f768006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:12.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.467+0000 7f7687844640 1 -- 172.21.15.87:0/962367819 shutdown_connections 2023-12-16T20:22:12.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.467+0000 7f7687844640 1 -- 172.21.15.87:0/962367819 wait complete. 2023-12-16T20:22:12.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.468+0000 7f7687844640 1 Processor -- start 2023-12-16T20:22:12.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.468+0000 7f7687844640 1 -- start start 2023-12-16T20:22:12.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.469+0000 7f7687844640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7680153890 0x7f7680152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:12.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.469+0000 7f7687844640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7680153c70 0x7f76800cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:12.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.469+0000 7f7687844640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f768015d950 0x7f7680151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:12.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.469+0000 7f7687844640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76800ccf70 con 0x7f768015d950 2023-12-16T20:22:12.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.469+0000 7f7687844640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7680151360 con 0x7f7680153c70 2023-12-16T20:22:12.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.469+0000 7f7687844640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76801f0100 con 0x7f7680153890 2023-12-16T20:22:12.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.469+0000 7f7685de1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f768015d950 0x7f7680151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:12.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.469+0000 7f7685de1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f768015d950 0x7f7680151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46758/0 (socket says 172.21.15.87:46758) 2023-12-16T20:22:12.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.469+0000 7f7685de1640 1 -- 172.21.15.87:0/836602080 learned_addr learned my addr 172.21.15.87:0/836602080 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:12.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.469+0000 7f7684ddf640 1 --2- 172.21.15.87:0/836602080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7680153c70 0x7f76800cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:12.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.469+0000 7f76855e0640 1 --2- 172.21.15.87:0/836602080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7680153890 0x7f7680152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:12.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.472+0000 7f7685de1640 1 -- 172.21.15.87:0/836602080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7680153890 msgr2=0x7f7680152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:12.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.472+0000 7f7685de1640 1 --2- 172.21.15.87:0/836602080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7680153890 0x7f7680152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:12.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.472+0000 7f7685de1640 1 -- 172.21.15.87:0/836602080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7680153c70 msgr2=0x7f76800cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:12.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.472+0000 7f7685de1640 1 --2- 172.21.15.87:0/836602080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7680153c70 0x7f76800cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:12.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.473+0000 7f7685de1640 1 -- 172.21.15.87:0/836602080 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c009400 con 0x7f768015d950 2023-12-16T20:22:12.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.475+0000 7f7685de1640 1 --2- 172.21.15.87:0/836602080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f768015d950 0x7f7680151ad0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f767c02c000 tx=0x7f767c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:12.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.478+0000 7f7675ffb640 1 -- 172.21.15.87:0/836602080 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c03c040 con 0x7f768015d950 2023-12-16T20:22:12.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.478+0000 7f7675ffb640 1 -- 172.21.15.87:0/836602080 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c037810 con 0x7f768015d950 2023-12-16T20:22:12.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.478+0000 7f7675ffb640 1 -- 172.21.15.87:0/836602080 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c037bc0 con 0x7f768015d950 2023-12-16T20:22:12.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.478+0000 7f7687844640 1 -- 172.21.15.87:0/836602080 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76800cd1c0 con 0x7f768015d950 2023-12-16T20:22:12.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.478+0000 7f7687844640 1 -- 172.21.15.87:0/836602080 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76800cd4a0 con 0x7f768015d950 2023-12-16T20:22:12.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.479+0000 7f7687844640 1 -- 172.21.15.87:0/836602080 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7680067500 con 0x7f768015d950 2023-12-16T20:22:12.731 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.730+0000 7f7675ffb640 1 -- 172.21.15.87:0/836602080 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f767c0403e0 con 0x7f768015d950 2023-12-16T20:22:12.732 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.730+0000 7f7675ffb640 1 --2- 172.21.15.87:0/836602080 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f766406ae90 0x7f766406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:12.732 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.730+0000 7f76855e0640 1 --2- 172.21.15.87:0/836602080 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f766406ae90 0x7f766406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:12.732 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.731+0000 7f76855e0640 1 --2- 172.21.15.87:0/836602080 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f766406ae90 0x7f766406d350 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f76780012e0 tx=0x7f7678009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:12.763 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.762+0000 7f7675ffb640 1 -- 172.21.15.87:0/836602080 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f767c07a5b0 con 0x7f768015d950 2023-12-16T20:22:12.763 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.762+0000 7f7675ffb640 1 -- 172.21.15.87:0/836602080 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f767c0a9e60 con 0x7f768015d950 2023-12-16T20:22:12.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.957+0000 7f7687844640 1 -- 172.21.15.87:0/836602080 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76801571c0 con 0x7f768015d950 2023-12-16T20:22:12.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.993+0000 7f7675ffb640 1 -- 172.21.15.87:0/836602080 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f767c046030 con 0x7f768015d950 2023-12-16T20:22:12.996 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:22:12.996 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:21:41.431615+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:21:22.654341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T20:21:33.728787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T20:21:34.846119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T20:21:38.657738+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:22:12.997 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.995+0000 7f7687844640 1 -- 172.21.15.87:0/836602080 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f766406ae90 msgr2=0x7f766406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:12.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.995+0000 7f7687844640 1 --2- 172.21.15.87:0/836602080 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f766406ae90 0x7f766406d350 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f76780012e0 tx=0x7f7678009040 comp rx=0 tx=0).stop 2023-12-16T20:22:12.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.995+0000 7f7687844640 1 -- 172.21.15.87:0/836602080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f768015d950 msgr2=0x7f7680151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:12.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.995+0000 7f7687844640 1 --2- 172.21.15.87:0/836602080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f768015d950 0x7f7680151ad0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f767c02c000 tx=0x7f767c004730 comp rx=0 tx=0).stop 2023-12-16T20:22:12.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.995+0000 7f7687844640 1 -- 172.21.15.87:0/836602080 shutdown_connections 2023-12-16T20:22:12.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.995+0000 7f7687844640 1 --2- 172.21.15.87:0/836602080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f768015d950 0x7f7680151ad0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:12.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.995+0000 7f7687844640 1 --2- 172.21.15.87:0/836602080 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f766406ae90 0x7f766406d350 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:12.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.995+0000 7f7687844640 1 --2- 172.21.15.87:0/836602080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7680153c70 0x7f76800cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:12.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.995+0000 7f7687844640 1 --2- 172.21.15.87:0/836602080 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7680153890 0x7f7680152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:12.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.996+0000 7f7687844640 1 -- 172.21.15.87:0/836602080 >> 172.21.15.87:0/836602080 conn(0x7f768006ba00 msgr2=0x7f7680157e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:12.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.996+0000 7f7687844640 1 -- 172.21.15.87:0/836602080 shutdown_connections 2023-12-16T20:22:12.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:12.996+0000 7f7687844640 1 -- 172.21.15.87:0/836602080 wait complete. 2023-12-16T20:22:13.008 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T20:21:22.654341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T20:21:33.728787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T20:21:34.846119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-16T20:21:38.657738+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-16T20:22:13.009 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T20:22:13.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.110+0000 7fe36826b640 1 Processor -- start 2023-12-16T20:22:13.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.110+0000 7fe36826b640 1 -- start start 2023-12-16T20:22:13.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.111+0000 7fe36826b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe360151630 0x7fe36006f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:13.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.111+0000 7fe36826b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3600c2000 0x7fe3600c2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:13.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.111+0000 7fe36826b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3600c29b0 con 0x7fe360157f50 2023-12-16T20:22:13.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.111+0000 7fe36826b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36015b9c0 con 0x7fe360151630 2023-12-16T20:22:13.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.111+0000 7fe36826b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3601583c0 con 0x7fe3600c2000 2023-12-16T20:22:13.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.112+0000 7fe366808640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3600c2000 0x7fe3600c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:13.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.112+0000 7fe366007640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe360151630 0x7fe36006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:13.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.112+0000 7fe365806640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe360157f50 0x7fe3600c9bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60060/0 (socket says 172.21.15.87:60060) 2023-12-16T20:22:13.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.112+0000 7fe365806640 1 -- 172.21.15.87:0/3210691244 learned_addr learned my addr 172.21.15.87:0/3210691244 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:13.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.114+0000 7fe366808640 1 -- 172.21.15.87:0/3210691244 >> v2:172.21.15.87:3300/0 conn(0x7fe360151630 msgr2=0x7fe36006f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:13.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.114+0000 7fe366808640 1 --2- 172.21.15.87:0/3210691244 >> v2:172.21.15.87:3300/0 conn(0x7fe360151630 0x7fe36006f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:13.116 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.114+0000 7fe366808640 1 -- 172.21.15.87:0/3210691244 >> v1:172.21.15.87:6789/0 conn(0x7fe360157f50 legacy=0x7fe3600c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:13.116 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.114+0000 7fe366808640 1 -- 172.21.15.87:0/3210691244 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36015ab60 con 0x7fe3600c2000 2023-12-16T20:22:13.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.117+0000 7fe366808640 1 --2- 172.21.15.87:0/3210691244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3600c2000 0x7fe3600c2470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe3580097a0 tx=0x7fe35802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a530ae9fa9731e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:13.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.120+0000 7fe365005640 1 -- 172.21.15.87:0/3210691244 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe358030610 con 0x7fe3600c2000 2023-12-16T20:22:13.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.120+0000 7fe365005640 1 -- 172.21.15.87:0/3210691244 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe358030770 con 0x7fe3600c2000 2023-12-16T20:22:13.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.120+0000 7fe365005640 1 -- 172.21.15.87:0/3210691244 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe358030b00 con 0x7fe3600c2000 2023-12-16T20:22:13.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.121+0000 7fe36826b640 1 -- 172.21.15.87:0/3210691244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3600c2000 msgr2=0x7fe3600c2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:13.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.121+0000 7fe36826b640 1 --2- 172.21.15.87:0/3210691244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3600c2000 0x7fe3600c2470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe3580097a0 tx=0x7fe35802b960 comp rx=0 tx=0).stop 2023-12-16T20:22:13.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.121+0000 7fe36826b640 1 -- 172.21.15.87:0/3210691244 shutdown_connections 2023-12-16T20:22:13.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.121+0000 7fe36826b640 1 --2- 172.21.15.87:0/3210691244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3600c2000 0x7fe3600c2470 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:13.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.121+0000 7fe36826b640 1 --2- 172.21.15.87:0/3210691244 >> v2:172.21.15.87:3300/0 conn(0x7fe360151630 0x7fe36006f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:13.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.121+0000 7fe36826b640 1 -- 172.21.15.87:0/3210691244 >> 172.21.15.87:0/3210691244 conn(0x7fe360061100 msgr2=0x7fe3600614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:13.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.121+0000 7fe36826b640 1 -- 172.21.15.87:0/3210691244 shutdown_connections 2023-12-16T20:22:13.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.121+0000 7fe36826b640 1 -- 172.21.15.87:0/3210691244 wait complete. 2023-12-16T20:22:13.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.122+0000 7fe36826b640 1 Processor -- start 2023-12-16T20:22:13.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.122+0000 7fe36826b640 1 -- start start 2023-12-16T20:22:13.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.123+0000 7fe36826b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3600c2000 0x7fe360146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:13.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.123+0000 7fe36826b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe360151630 0x7fe3600c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:13.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.123+0000 7fe36826b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe360157f50 0x7fe3600c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:13.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.123+0000 7fe36826b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3600c7f60 con 0x7fe360151630 2023-12-16T20:22:13.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.123+0000 7fe36826b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36014c660 con 0x7fe360157f50 2023-12-16T20:22:13.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.123+0000 7fe36826b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3601eed80 con 0x7fe3600c2000 2023-12-16T20:22:13.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.124+0000 7fe365806640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe360151630 0x7fe3600c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:13.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.124+0000 7fe366808640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe360157f50 0x7fe3600c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:13.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.124+0000 7fe366007640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3600c2000 0x7fe360146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:13.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.125+0000 7fe366007640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3600c2000 0x7fe360146b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:49616/0 (socket says 172.21.15.87:49616) 2023-12-16T20:22:13.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.125+0000 7fe366007640 1 -- 172.21.15.87:0/1866100499 learned_addr learned my addr 172.21.15.87:0/1866100499 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:13.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.128+0000 7fe366007640 1 -- 172.21.15.87:0/1866100499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe360157f50 msgr2=0x7fe3600c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:13.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.128+0000 7fe366007640 1 --2- 172.21.15.87:0/1866100499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe360157f50 0x7fe3600c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:13.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.128+0000 7fe366007640 1 -- 172.21.15.87:0/1866100499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe360151630 msgr2=0x7fe3600c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:13.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.128+0000 7fe366007640 1 --2- 172.21.15.87:0/1866100499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe360151630 0x7fe3600c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:13.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.128+0000 7fe366007640 1 -- 172.21.15.87:0/1866100499 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe358009400 con 0x7fe3600c2000 2023-12-16T20:22:13.133 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.131+0000 7fe366007640 1 --2- 172.21.15.87:0/1866100499 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3600c2000 0x7fe360146b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe350009db0 tx=0x7fe35000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:13.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.134+0000 7fe35effd640 1 -- 172.21.15.87:0/1866100499 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe350014480 con 0x7fe3600c2000 2023-12-16T20:22:13.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.134+0000 7fe35effd640 1 -- 172.21.15.87:0/1866100499 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35000f040 con 0x7fe3600c2000 2023-12-16T20:22:13.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.134+0000 7fe36826b640 1 -- 172.21.15.87:0/1866100499 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36015a340 con 0x7fe3600c2000 2023-12-16T20:22:13.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.134+0000 7fe35effd640 1 -- 172.21.15.87:0/1866100499 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe350014800 con 0x7fe3600c2000 2023-12-16T20:22:13.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.134+0000 7fe36826b640 1 -- 172.21.15.87:0/1866100499 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe360159aa0 con 0x7fe3600c2000 2023-12-16T20:22:13.137 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.136+0000 7fe36826b640 1 -- 172.21.15.87:0/1866100499 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3600740e0 con 0x7fe3600c2000 2023-12-16T20:22:13.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.154+0000 7fe35effd640 1 -- 172.21.15.87:0/1866100499 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fe350014960 con 0x7fe3600c2000 2023-12-16T20:22:13.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.154+0000 7fe35effd640 1 --2- 172.21.15.87:0/1866100499 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe34c06aec0 0x7fe34c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:13.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.154+0000 7fe365806640 1 --2- 172.21.15.87:0/1866100499 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe34c06aec0 0x7fe34c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:13.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.155+0000 7fe365806640 1 --2- 172.21.15.87:0/1866100499 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe34c06aec0 0x7fe34c06d380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe360157460 tx=0x7fe354009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:13.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.381+0000 7fe35effd640 1 -- 172.21.15.87:0/1866100499 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe350059720 con 0x7fe3600c2000 2023-12-16T20:22:13.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.392+0000 7fe35effd640 1 -- 172.21.15.87:0/1866100499 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fe350055a60 con 0x7fe3600c2000 2023-12-16T20:22:13.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.567+0000 7fe36826b640 1 -- 172.21.15.87:0/1866100499 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe36014a430 con 0x7fe3600c2000 2023-12-16T20:22:13.666 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.665+0000 7fe35effd640 1 -- 172.21.15.87:0/1866100499 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe350059080 con 0x7fe3600c2000 2023-12-16T20:22:13.666 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-12-16T20:22:13.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.667+0000 7fe36826b640 1 -- 172.21.15.87:0/1866100499 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe34c06aec0 msgr2=0x7fe34c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:13.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.667+0000 7fe36826b640 1 --2- 172.21.15.87:0/1866100499 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe34c06aec0 0x7fe34c06d380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe360157460 tx=0x7fe354009040 comp rx=0 tx=0).stop 2023-12-16T20:22:13.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.667+0000 7fe36826b640 1 -- 172.21.15.87:0/1866100499 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3600c2000 msgr2=0x7fe360146b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:13.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.667+0000 7fe36826b640 1 --2- 172.21.15.87:0/1866100499 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3600c2000 0x7fe360146b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe350009db0 tx=0x7fe35000c490 comp rx=0 tx=0).stop 2023-12-16T20:22:13.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.667+0000 7fe36826b640 1 -- 172.21.15.87:0/1866100499 shutdown_connections 2023-12-16T20:22:13.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.667+0000 7fe36826b640 1 --2- 172.21.15.87:0/1866100499 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe34c06aec0 0x7fe34c06d380 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:13.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.667+0000 7fe36826b640 1 --2- 172.21.15.87:0/1866100499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe360157f50 0x7fe3600c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:13.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.667+0000 7fe36826b640 1 --2- 172.21.15.87:0/1866100499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe360151630 0x7fe3600c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:13.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.667+0000 7fe36826b640 1 --2- 172.21.15.87:0/1866100499 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3600c2000 0x7fe360146b60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:13.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.667+0000 7fe36826b640 1 -- 172.21.15.87:0/1866100499 >> 172.21.15.87:0/1866100499 conn(0x7fe360061100 msgr2=0x7fe3600c3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:13.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.667+0000 7fe36826b640 1 -- 172.21.15.87:0/1866100499 shutdown_connections 2023-12-16T20:22:13.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.667+0000 7fe36826b640 1 -- 172.21.15.87:0/1866100499 wait complete. 2023-12-16T20:22:13.679 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T20:22:13.782 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.780+0000 7fae0a43d640 1 Processor -- start 2023-12-16T20:22:13.782 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.780+0000 7fae0a43d640 1 -- start start 2023-12-16T20:22:13.782 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.781+0000 7fae0a43d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fae040cb480 0x7fae0415d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:13.782 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.781+0000 7fae0a43d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae04071170 con 0x7fae0415a240 2023-12-16T20:22:13.783 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.781+0000 7fae0a43d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae04071450 con 0x7fae040cb0a0 2023-12-16T20:22:13.783 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.781+0000 7fae0a43d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae04071730 con 0x7fae040cb480 2023-12-16T20:22:13.783 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.782+0000 7fae03fff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fae040cb0a0 0x7fae0406f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:51806/0 (socket says 172.21.15.87:51806) 2023-12-16T20:22:13.783 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.782+0000 7fae03fff640 1 -- 172.21.15.87:0/2317335214 learned_addr learned my addr 172.21.15.87:0/2317335214 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:13.783 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.782+0000 7fae037fe640 1 --2- 172.21.15.87:0/2317335214 >> v2:172.21.15.87:3300/0 conn(0x7fae040cb480 0x7fae0415d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:13.785 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.784+0000 7fae02ffd640 1 -- 172.21.15.87:0/2317335214 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820107923 0 0) 0x7fae04071450 con 0x7fae040cb0a0 2023-12-16T20:22:13.785 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.784+0000 7fae02ffd640 1 -- 172.21.15.87:0/2317335214 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadec003520 con 0x7fae040cb0a0 2023-12-16T20:22:13.786 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.785+0000 7fae037fe640 1 -- 172.21.15.87:0/2317335214 >> v1:172.21.15.195:6789/0 conn(0x7fae040cb0a0 legacy=0x7fae0406f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:13.786 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.785+0000 7fae037fe640 1 -- 172.21.15.87:0/2317335214 >> v1:172.21.15.87:6789/0 conn(0x7fae0415a240 legacy=0x7fae04153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:13.786 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.785+0000 7fae037fe640 1 -- 172.21.15.87:0/2317335214 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae04071a10 con 0x7fae040cb480 2023-12-16T20:22:13.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.790+0000 7fae037fe640 1 --2- 172.21.15.87:0/2317335214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae040cb480 0x7fae0415d170 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fadf80097a0 tx=0x7fadf802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9761ae1cbe579235 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:13.794 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.793+0000 7fae02ffd640 1 -- 172.21.15.87:0/2317335214 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8030610 con 0x7fae040cb480 2023-12-16T20:22:13.794 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.793+0000 7fae02ffd640 1 -- 172.21.15.87:0/2317335214 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf8030770 con 0x7fae040cb480 2023-12-16T20:22:13.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.793+0000 7fae02ffd640 1 -- 172.21.15.87:0/2317335214 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8030b00 con 0x7fae040cb480 2023-12-16T20:22:13.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.794+0000 7fae0a43d640 1 -- 172.21.15.87:0/2317335214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae040cb480 msgr2=0x7fae0415d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:13.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.794+0000 7fae0a43d640 1 --2- 172.21.15.87:0/2317335214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae040cb480 0x7fae0415d170 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fadf80097a0 tx=0x7fadf802b960 comp rx=0 tx=0).stop 2023-12-16T20:22:13.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.794+0000 7fae0a43d640 1 -- 172.21.15.87:0/2317335214 shutdown_connections 2023-12-16T20:22:13.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.794+0000 7fae0a43d640 1 --2- 172.21.15.87:0/2317335214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae040cb480 0x7fae0415d170 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:13.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.794+0000 7fae0a43d640 1 -- 172.21.15.87:0/2317335214 >> 172.21.15.87:0/2317335214 conn(0x7fae0406cd60 msgr2=0x7fae0406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:13.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.794+0000 7fae0a43d640 1 -- 172.21.15.87:0/2317335214 shutdown_connections 2023-12-16T20:22:13.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.794+0000 7fae0a43d640 1 -- 172.21.15.87:0/2317335214 wait complete. 2023-12-16T20:22:13.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.795+0000 7fae0a43d640 1 Processor -- start 2023-12-16T20:22:13.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.795+0000 7fae0a43d640 1 -- start start 2023-12-16T20:22:13.797 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.796+0000 7fae0a43d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae040cb0a0 0x7fae0414d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:13.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.796+0000 7fae0a43d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae040cb480 0x7fae04158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:13.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.796+0000 7fae0a43d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae0415a240 0x7fae0414ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:13.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.796+0000 7fae0a43d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0414d500 con 0x7fae040cb0a0 2023-12-16T20:22:13.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.796+0000 7fae0a43d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae040c98c0 con 0x7fae0415a240 2023-12-16T20:22:13.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.796+0000 7fae0a43d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae040c8d80 con 0x7fae040cb480 2023-12-16T20:22:13.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.797+0000 7fae03fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae040cb0a0 0x7fae0414d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:13.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.797+0000 7fae089da640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae0415a240 0x7fae0414ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:13.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.797+0000 7fae03fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae040cb0a0 0x7fae0414d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46790/0 (socket says 172.21.15.87:46790) 2023-12-16T20:22:13.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.797+0000 7fae03fff640 1 -- 172.21.15.87:0/3595502767 learned_addr learned my addr 172.21.15.87:0/3595502767 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:13.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.797+0000 7fae037fe640 1 --2- 172.21.15.87:0/3595502767 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae040cb480 0x7fae04158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:13.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.800+0000 7fae03fff640 1 -- 172.21.15.87:0/3595502767 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae040cb480 msgr2=0x7fae04158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:13.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.800+0000 7fae03fff640 1 --2- 172.21.15.87:0/3595502767 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae040cb480 0x7fae04158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:13.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.800+0000 7fae03fff640 1 -- 172.21.15.87:0/3595502767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae0415a240 msgr2=0x7fae0414ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:13.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.800+0000 7fae03fff640 1 --2- 172.21.15.87:0/3595502767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae0415a240 0x7fae0414ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:13.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.800+0000 7fae03fff640 1 -- 172.21.15.87:0/3595502767 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf8009400 con 0x7fae040cb0a0 2023-12-16T20:22:13.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.802+0000 7fae03fff640 1 --2- 172.21.15.87:0/3595502767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae040cb0a0 0x7fae0414d950 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fadf400c530 tx=0x7fadf400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:13.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.806+0000 7fae00ff9640 1 -- 172.21.15.87:0/3595502767 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf4005ce0 con 0x7fae040cb0a0 2023-12-16T20:22:13.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.806+0000 7fae00ff9640 1 -- 172.21.15.87:0/3595502767 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf4005e40 con 0x7fae040cb0a0 2023-12-16T20:22:13.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.806+0000 7fae0a43d640 1 -- 172.21.15.87:0/3595502767 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0414de90 con 0x7fae040cb0a0 2023-12-16T20:22:13.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.806+0000 7fae00ff9640 1 -- 172.21.15.87:0/3595502767 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf40072b0 con 0x7fae040cb0a0 2023-12-16T20:22:13.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.806+0000 7fae0a43d640 1 -- 172.21.15.87:0/3595502767 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae040c9300 con 0x7fae040cb0a0 2023-12-16T20:22:13.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.807+0000 7fae0a43d640 1 -- 172.21.15.87:0/3595502767 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae04070e10 con 0x7fae040cb0a0 2023-12-16T20:22:13.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.824+0000 7fae00ff9640 1 -- 172.21.15.87:0/3595502767 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fadf4007410 con 0x7fae040cb0a0 2023-12-16T20:22:13.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.825+0000 7fae00ff9640 1 --2- 172.21.15.87:0/3595502767 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fadf006ae90 0x7fadf006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:13.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.825+0000 7fae037fe640 1 --2- 172.21.15.87:0/3595502767 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fadf006ae90 0x7fadf006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:13.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.825+0000 7fae037fe640 1 --2- 172.21.15.87:0/3595502767 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fadf006ae90 0x7fadf006d350 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fadf8036000 tx=0x7fadf8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:13.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:13.828+0000 7fae00ff9640 1 -- 172.21.15.87:0/3595502767 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fadf4057d50 con 0x7fae040cb0a0 2023-12-16T20:22:14.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.060+0000 7fae00ff9640 1 -- 172.21.15.87:0/3595502767 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fadf4054090 con 0x7fae040cb0a0 2023-12-16T20:22:14.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.248+0000 7fae0a43d640 1 -- 172.21.15.87:0/3595502767 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae04070e10 con 0x7fae040cb0a0 2023-12-16T20:22:14.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.253+0000 7fae00ff9640 1 -- 172.21.15.87:0/3595502767 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae04070e10 con 0x7fae040cb0a0 2023-12-16T20:22:14.255 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-12-16T20:22:14.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.256+0000 7fae0a43d640 1 -- 172.21.15.87:0/3595502767 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fadf006ae90 msgr2=0x7fadf006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:14.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.256+0000 7fae0a43d640 1 --2- 172.21.15.87:0/3595502767 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fadf006ae90 0x7fadf006d350 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fadf8036000 tx=0x7fadf8008030 comp rx=0 tx=0).stop 2023-12-16T20:22:14.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.256+0000 7fae0a43d640 1 -- 172.21.15.87:0/3595502767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae040cb0a0 msgr2=0x7fae0414d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:14.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.256+0000 7fae0a43d640 1 --2- 172.21.15.87:0/3595502767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae040cb0a0 0x7fae0414d950 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fadf400c530 tx=0x7fadf400c9f0 comp rx=0 tx=0).stop 2023-12-16T20:22:14.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.256+0000 7fae0a43d640 1 -- 172.21.15.87:0/3595502767 shutdown_connections 2023-12-16T20:22:14.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.256+0000 7fae0a43d640 1 --2- 172.21.15.87:0/3595502767 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fadf006ae90 0x7fadf006d350 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:14.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.256+0000 7fae0a43d640 1 --2- 172.21.15.87:0/3595502767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae0415a240 0x7fae0414ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:14.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.256+0000 7fae0a43d640 1 --2- 172.21.15.87:0/3595502767 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae040cb480 0x7fae04158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:14.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.256+0000 7fae0a43d640 1 --2- 172.21.15.87:0/3595502767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae040cb0a0 0x7fae0414d950 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:14.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.256+0000 7fae0a43d640 1 -- 172.21.15.87:0/3595502767 >> 172.21.15.87:0/3595502767 conn(0x7fae0406cd60 msgr2=0x7fae040c0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:14.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.256+0000 7fae0a43d640 1 -- 172.21.15.87:0/3595502767 shutdown_connections 2023-12-16T20:22:14.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.256+0000 7fae0a43d640 1 -- 172.21.15.87:0/3595502767 wait complete. 2023-12-16T20:22:14.268 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T20:22:14.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.372+0000 7faafc5a9640 1 Processor -- start 2023-12-16T20:22:14.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.372+0000 7faafc5a9640 1 -- start start 2023-12-16T20:22:14.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.373+0000 7faafc5a9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faaf41504e0 0x7faaf406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:14.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.373+0000 7faafc5a9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7faaf40c7190 0x7faaf406e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:14.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.373+0000 7faafc5a9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf40c5f60 con 0x7faaf40c7700 2023-12-16T20:22:14.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.373+0000 7faafc5a9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf40c2c60 con 0x7faaf41504e0 2023-12-16T20:22:14.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.373+0000 7faafc5a9640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf40c2f20 con 0x7faaf40c7190 2023-12-16T20:22:14.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.374+0000 7faafa345640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faaf41504e0 0x7faaf406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:14.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.374+0000 7faafab46640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7faaf40c7700 0x7faaf40c7ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60064/0 (socket says 172.21.15.87:60064) 2023-12-16T20:22:14.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.374+0000 7faafab46640 1 -- 172.21.15.87:0/3470703532 learned_addr learned my addr 172.21.15.87:0/3470703532 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:14.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.374+0000 7faaf9b44640 1 --2- 172.21.15.87:0/3470703532 >> v2:172.21.15.195:3300/0 conn(0x7faaf40c7190 0x7faaf406e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:14.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.377+0000 7faaf9b44640 1 -- 172.21.15.87:0/3470703532 >> v2:172.21.15.87:3300/0 conn(0x7faaf41504e0 msgr2=0x7faaf406e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:14.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.377+0000 7faaf9b44640 1 --2- 172.21.15.87:0/3470703532 >> v2:172.21.15.87:3300/0 conn(0x7faaf41504e0 0x7faaf406e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:14.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.377+0000 7faaf9b44640 1 -- 172.21.15.87:0/3470703532 >> v1:172.21.15.87:6789/0 conn(0x7faaf40c7700 legacy=0x7faaf40c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:14.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.377+0000 7faaf9b44640 1 -- 172.21.15.87:0/3470703532 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf40c61b0 con 0x7faaf40c7190 2023-12-16T20:22:14.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.377+0000 7faafa345640 1 --2- 172.21.15.87:0/3470703532 >> v2:172.21.15.87:3300/0 conn(0x7faaf41504e0 0x7faaf406e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:22:14.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.379+0000 7faaf9b44640 1 --2- 172.21.15.87:0/3470703532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaf40c7190 0x7faaf406e6e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faaf40708c0 tx=0x7faae402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b078be16cc39388 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:14.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.382+0000 7faaf9343640 1 -- 172.21.15.87:0/3470703532 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae402e070 con 0x7faaf40c7190 2023-12-16T20:22:14.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.382+0000 7faaf9343640 1 -- 172.21.15.87:0/3470703532 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae40315a0 con 0x7faaf40c7190 2023-12-16T20:22:14.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.382+0000 7faaf9343640 1 -- 172.21.15.87:0/3470703532 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae4031930 con 0x7faaf40c7190 2023-12-16T20:22:14.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.383+0000 7faafc5a9640 1 -- 172.21.15.87:0/3470703532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaf40c7190 msgr2=0x7faaf406e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:14.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.383+0000 7faafc5a9640 1 --2- 172.21.15.87:0/3470703532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaf40c7190 0x7faaf406e6e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faaf40708c0 tx=0x7faae402b840 comp rx=0 tx=0).stop 2023-12-16T20:22:14.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.383+0000 7faafc5a9640 1 -- 172.21.15.87:0/3470703532 shutdown_connections 2023-12-16T20:22:14.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.383+0000 7faafc5a9640 1 --2- 172.21.15.87:0/3470703532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaf40c7190 0x7faaf406e6e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:14.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.383+0000 7faafc5a9640 1 --2- 172.21.15.87:0/3470703532 >> v2:172.21.15.87:3300/0 conn(0x7faaf41504e0 0x7faaf406e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:14.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.383+0000 7faafc5a9640 1 -- 172.21.15.87:0/3470703532 >> 172.21.15.87:0/3470703532 conn(0x7faaf40cbef0 msgr2=0x7faaf40cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:14.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.383+0000 7faafc5a9640 1 -- 172.21.15.87:0/3470703532 shutdown_connections 2023-12-16T20:22:14.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.383+0000 7faafc5a9640 1 -- 172.21.15.87:0/3470703532 wait complete. 2023-12-16T20:22:14.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.384+0000 7faafc5a9640 1 Processor -- start 2023-12-16T20:22:14.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.384+0000 7faafc5a9640 1 -- start start 2023-12-16T20:22:14.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.385+0000 7faafc5a9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaf40c7190 0x7faaf41462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:14.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.385+0000 7faafc5a9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaf40c7700 0x7faaf4142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:14.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.385+0000 7faafc5a9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaf41504e0 0x7faaf414ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:14.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.385+0000 7faafc5a9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4143100 con 0x7faaf40c7190 2023-12-16T20:22:14.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.385+0000 7faafc5a9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4143af0 con 0x7faaf40c7700 2023-12-16T20:22:14.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.385+0000 7faafc5a9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf41ec020 con 0x7faaf41504e0 2023-12-16T20:22:14.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.386+0000 7faafa345640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaf40c7190 0x7faaf41462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:14.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.386+0000 7faafa345640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaf40c7190 0x7faaf41462d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46808/0 (socket says 172.21.15.87:46808) 2023-12-16T20:22:14.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.386+0000 7faafa345640 1 -- 172.21.15.87:0/2590337695 learned_addr learned my addr 172.21.15.87:0/2590337695 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:14.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.386+0000 7faafab46640 1 --2- 172.21.15.87:0/2590337695 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaf41504e0 0x7faaf414ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:14.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.386+0000 7faaf9b44640 1 --2- 172.21.15.87:0/2590337695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaf40c7700 0x7faaf4142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:14.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.389+0000 7faafa345640 1 -- 172.21.15.87:0/2590337695 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaf41504e0 msgr2=0x7faaf414ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:14.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.389+0000 7faafa345640 1 --2- 172.21.15.87:0/2590337695 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaf41504e0 0x7faaf414ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:14.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.389+0000 7faafa345640 1 -- 172.21.15.87:0/2590337695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaf40c7700 msgr2=0x7faaf4142bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:14.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.389+0000 7faafa345640 1 --2- 172.21.15.87:0/2590337695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaf40c7700 0x7faaf4142bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:14.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.389+0000 7faafa345640 1 -- 172.21.15.87:0/2590337695 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec009400 con 0x7faaf40c7190 2023-12-16T20:22:14.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.391+0000 7faafa345640 1 --2- 172.21.15.87:0/2590337695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaf40c7190 0x7faaf41462d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faaec00e960 tx=0x7faaec00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:14.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.394+0000 7faaeaffd640 1 -- 172.21.15.87:0/2590337695 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec00ca00 con 0x7faaf40c7190 2023-12-16T20:22:14.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.395+0000 7faaeaffd640 1 -- 172.21.15.87:0/2590337695 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec00cb60 con 0x7faaf40c7190 2023-12-16T20:22:14.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.395+0000 7faafc5a9640 1 -- 172.21.15.87:0/2590337695 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae4009400 con 0x7faaf40c7190 2023-12-16T20:22:14.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.395+0000 7faaeaffd640 1 -- 172.21.15.87:0/2590337695 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec011450 con 0x7faaf40c7190 2023-12-16T20:22:14.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.395+0000 7faafc5a9640 1 -- 172.21.15.87:0/2590337695 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf41ec5c0 con 0x7faaf40c7190 2023-12-16T20:22:14.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.396+0000 7faafc5a9640 1 -- 172.21.15.87:0/2590337695 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf40740e0 con 0x7faaf40c7190 2023-12-16T20:22:14.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.637+0000 7faaeaffd640 1 -- 172.21.15.87:0/2590337695 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7faaec0115b0 con 0x7faaf40c7190 2023-12-16T20:22:14.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.638+0000 7faaeaffd640 1 --2- 172.21.15.87:0/2590337695 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7faad806ae40 0x7faad806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:14.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.638+0000 7faaf9b44640 1 --2- 172.21.15.87:0/2590337695 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7faad806ae40 0x7faad806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:14.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.638+0000 7faaf9b44640 1 --2- 172.21.15.87:0/2590337695 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7faad806ae40 0x7faad806d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faae4036000 tx=0x7faae403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:14.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.651+0000 7faaeaffd640 1 -- 172.21.15.87:0/2590337695 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7faaec05a740 con 0x7faaf40c7190 2023-12-16T20:22:14.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.651+0000 7faaeaffd640 1 -- 172.21.15.87:0/2590337695 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7faaec056a80 con 0x7faaf40c7190 2023-12-16T20:22:14.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.832+0000 7faafc5a9640 1 -- 172.21.15.87:0/2590337695 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faaf40c5320 con 0x7faaf40c7190 2023-12-16T20:22:14.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.837+0000 7faaeaffd640 1 -- 172.21.15.87:0/2590337695 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7faaec01e070 con 0x7faaf40c7190 2023-12-16T20:22:14.839 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-12-16T20:22:14.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.839+0000 7faafc5a9640 1 -- 172.21.15.87:0/2590337695 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7faad806ae40 msgr2=0x7faad806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:14.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.839+0000 7faafc5a9640 1 --2- 172.21.15.87:0/2590337695 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7faad806ae40 0x7faad806d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faae4036000 tx=0x7faae403d040 comp rx=0 tx=0).stop 2023-12-16T20:22:14.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.839+0000 7faafc5a9640 1 -- 172.21.15.87:0/2590337695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaf40c7190 msgr2=0x7faaf41462d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:14.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.839+0000 7faafc5a9640 1 --2- 172.21.15.87:0/2590337695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaf40c7190 0x7faaf41462d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faaec00e960 tx=0x7faaec00ee20 comp rx=0 tx=0).stop 2023-12-16T20:22:14.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.839+0000 7faafc5a9640 1 -- 172.21.15.87:0/2590337695 shutdown_connections 2023-12-16T20:22:14.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.839+0000 7faafc5a9640 1 --2- 172.21.15.87:0/2590337695 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaf41504e0 0x7faaf414ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:14.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.839+0000 7faafc5a9640 1 --2- 172.21.15.87:0/2590337695 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7faad806ae40 0x7faad806d300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:14.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.839+0000 7faafc5a9640 1 --2- 172.21.15.87:0/2590337695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaf40c7700 0x7faaf4142bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:14.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.839+0000 7faafc5a9640 1 --2- 172.21.15.87:0/2590337695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaf40c7190 0x7faaf41462d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:14.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.840+0000 7faafc5a9640 1 -- 172.21.15.87:0/2590337695 >> 172.21.15.87:0/2590337695 conn(0x7faaf40cbef0 msgr2=0x7faaf4145bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:14.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.840+0000 7faafc5a9640 1 -- 172.21.15.87:0/2590337695 shutdown_connections 2023-12-16T20:22:14.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.840+0000 7faafc5a9640 1 -- 172.21.15.87:0/2590337695 wait complete. 2023-12-16T20:22:14.853 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-16T20:22:14.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.954+0000 7fbdbdae0640 1 Processor -- start 2023-12-16T20:22:14.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.955+0000 7fbdbdae0640 1 -- start start 2023-12-16T20:22:14.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.955+0000 7fbdbdae0640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbdb8153c70 0x7fbdb815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:14.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.955+0000 7fbdbdae0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb815a700 con 0x7fbdb8153890 2023-12-16T20:22:14.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.955+0000 7fbdbdae0640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb80ca870 con 0x7fbdb80ceef0 2023-12-16T20:22:14.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.955+0000 7fbdbdae0640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb8159af0 con 0x7fbdb8153c70 2023-12-16T20:22:14.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.956+0000 7fbdb77fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbdb8153890 0x7fbdb80c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60078/0 (socket says 172.21.15.87:60078) 2023-12-16T20:22:14.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.956+0000 7fbdb77fe640 1 -- 172.21.15.87:0/3335964222 learned_addr learned my addr 172.21.15.87:0/3335964222 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:14.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.956+0000 7fbdaeffd640 1 --2- 172.21.15.87:0/3335964222 >> v2:172.21.15.195:3300/0 conn(0x7fbdb8153c70 0x7fbdb815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:14.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.958+0000 7fbdb6ffd640 1 -- 172.21.15.87:0/3335964222 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648733206 0 0) 0x7fbdb815a700 con 0x7fbdb8153890 2023-12-16T20:22:14.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.958+0000 7fbdb6ffd640 1 -- 172.21.15.87:0/3335964222 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbda4003520 con 0x7fbdb8153890 2023-12-16T20:22:14.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.960+0000 7fbdaeffd640 1 -- 172.21.15.87:0/3335964222 >> v1:172.21.15.195:6789/0 conn(0x7fbdb80ceef0 legacy=0x7fbdb815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:14.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.960+0000 7fbdaeffd640 1 -- 172.21.15.87:0/3335964222 >> v1:172.21.15.87:6789/0 conn(0x7fbdb8153890 legacy=0x7fbdb80c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:14.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.960+0000 7fbdaeffd640 1 -- 172.21.15.87:0/3335964222 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb8159dd0 con 0x7fbdb8153c70 2023-12-16T20:22:14.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.964+0000 7fbdaeffd640 1 --2- 172.21.15.87:0/3335964222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdb8153c70 0x7fbdb815d950 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbda00097a0 tx=0x7fbda002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3381399a03d7bd3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:14.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.966+0000 7fbdb6ffd640 1 -- 172.21.15.87:0/3335964222 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda002f810 con 0x7fbdb8153c70 2023-12-16T20:22:14.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.968+0000 7fbdb6ffd640 1 -- 172.21.15.87:0/3335964222 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda002f970 con 0x7fbdb8153c70 2023-12-16T20:22:14.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.968+0000 7fbdb6ffd640 1 -- 172.21.15.87:0/3335964222 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda002fce0 con 0x7fbdb8153c70 2023-12-16T20:22:14.971 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.968+0000 7fbdbdae0640 1 -- 172.21.15.87:0/3335964222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdb8153c70 msgr2=0x7fbdb815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:14.971 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.968+0000 7fbdbdae0640 1 --2- 172.21.15.87:0/3335964222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdb8153c70 0x7fbdb815d950 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbda00097a0 tx=0x7fbda002b9f0 comp rx=0 tx=0).stop 2023-12-16T20:22:14.971 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.968+0000 7fbdbdae0640 1 -- 172.21.15.87:0/3335964222 shutdown_connections 2023-12-16T20:22:14.971 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.968+0000 7fbdbdae0640 1 --2- 172.21.15.87:0/3335964222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdb8153c70 0x7fbdb815d950 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:14.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.968+0000 7fbdbdae0640 1 -- 172.21.15.87:0/3335964222 >> 172.21.15.87:0/3335964222 conn(0x7fbdb806ba00 msgr2=0x7fbdb806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:14.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.968+0000 7fbdbdae0640 1 -- 172.21.15.87:0/3335964222 shutdown_connections 2023-12-16T20:22:14.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.968+0000 7fbdbdae0640 1 -- 172.21.15.87:0/3335964222 wait complete. 2023-12-16T20:22:14.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.970+0000 7fbdbdae0640 1 Processor -- start 2023-12-16T20:22:14.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.970+0000 7fbdbdae0640 1 -- start start 2023-12-16T20:22:14.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.970+0000 7fbdbdae0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdb80ceef0 0x7fbdb8156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:14.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.970+0000 7fbdbdae0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbdb8153890 0x7fbdb80b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:14.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.970+0000 7fbdbdae0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdb8153c70 0x7fbdb8154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:14.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.970+0000 7fbdbdae0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb8155050 con 0x7fbdb8153c70 2023-12-16T20:22:14.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.970+0000 7fbdbdae0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb81ef8d0 con 0x7fbdb80ceef0 2023-12-16T20:22:14.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.970+0000 7fbdbdae0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb814dc40 con 0x7fbdb8153890 2023-12-16T20:22:14.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.971+0000 7fbdb7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdb8153c70 0x7fbdb8154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:14.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.971+0000 7fbdb77fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdb80ceef0 0x7fbdb8156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:14.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.971+0000 7fbdaeffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbdb8153890 0x7fbdb80b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:14.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.971+0000 7fbdb7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdb8153c70 0x7fbdb8154300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46810/0 (socket says 172.21.15.87:46810) 2023-12-16T20:22:14.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.971+0000 7fbdb7fff640 1 -- 172.21.15.87:0/3663023412 learned_addr learned my addr 172.21.15.87:0/3663023412 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:14.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.975+0000 7fbdb7fff640 1 -- 172.21.15.87:0/3663023412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbdb8153890 msgr2=0x7fbdb80b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:14.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.975+0000 7fbdb7fff640 1 --2- 172.21.15.87:0/3663023412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbdb8153890 0x7fbdb80b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:14.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.975+0000 7fbdb7fff640 1 -- 172.21.15.87:0/3663023412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdb80ceef0 msgr2=0x7fbdb8156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:14.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.975+0000 7fbdb7fff640 1 --2- 172.21.15.87:0/3663023412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdb80ceef0 0x7fbdb8156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:14.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.975+0000 7fbdb7fff640 1 -- 172.21.15.87:0/3663023412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda0009400 con 0x7fbdb8153c70 2023-12-16T20:22:14.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.975+0000 7fbdb77fe640 1 --2- 172.21.15.87:0/3663023412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdb80ceef0 0x7fbdb8156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:22:14.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.977+0000 7fbdb7fff640 1 --2- 172.21.15.87:0/3663023412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdb8153c70 0x7fbdb8154300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000c7a0 tx=0x7fbdb000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:14.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.980+0000 7fbdb4ff9640 1 -- 172.21.15.87:0/3663023412 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0003b70 con 0x7fbdb8153c70 2023-12-16T20:22:14.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.980+0000 7fbdb4ff9640 1 -- 172.21.15.87:0/3663023412 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb0003cf0 con 0x7fbdb8153c70 2023-12-16T20:22:14.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.980+0000 7fbdbdae0640 1 -- 172.21.15.87:0/3663023412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb814df20 con 0x7fbdb8153c70 2023-12-16T20:22:14.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.980+0000 7fbdb4ff9640 1 -- 172.21.15.87:0/3663023412 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0003ea0 con 0x7fbdb8153c70 2023-12-16T20:22:14.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.980+0000 7fbdbdae0640 1 -- 172.21.15.87:0/3663023412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb81efe70 con 0x7fbdb8153c70 2023-12-16T20:22:14.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:14.981+0000 7fbdbdae0640 1 -- 172.21.15.87:0/3663023412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb8067500 con 0x7fbdb8153c70 2023-12-16T20:22:15.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.219+0000 7fbdb4ff9640 1 -- 172.21.15.87:0/3663023412 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fbdb000aa90 con 0x7fbdb8153c70 2023-12-16T20:22:15.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.219+0000 7fbdb4ff9640 1 --2- 172.21.15.87:0/3663023412 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fbd9806ae90 0x7fbd9806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:15.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.219+0000 7fbdb77fe640 1 --2- 172.21.15.87:0/3663023412 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fbd9806ae90 0x7fbd9806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:15.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.219+0000 7fbdb77fe640 1 --2- 172.21.15.87:0/3663023412 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fbd9806ae90 0x7fbd9806d350 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbda80011e0 tx=0x7fbda8007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:15.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.232+0000 7fbdb4ff9640 1 -- 172.21.15.87:0/3663023412 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fbdb0058c80 con 0x7fbdb8153c70 2023-12-16T20:22:15.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.232+0000 7fbdb4ff9640 1 -- 172.21.15.87:0/3663023412 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fbdb0054fc0 con 0x7fbdb8153c70 2023-12-16T20:22:15.406 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.404+0000 7fbdbdae0640 1 -- 172.21.15.87:0/3663023412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbdb81571a0 con 0x7fbdb8153c70 2023-12-16T20:22:15.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.411+0000 7fbdb4ff9640 1 -- 172.21.15.87:0/3663023412 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbdb00585e0 con 0x7fbdb8153c70 2023-12-16T20:22:15.412 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-12-16T20:22:15.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.413+0000 7fbdbdae0640 1 -- 172.21.15.87:0/3663023412 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fbd9806ae90 msgr2=0x7fbd9806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:15.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.413+0000 7fbdbdae0640 1 --2- 172.21.15.87:0/3663023412 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fbd9806ae90 0x7fbd9806d350 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbda80011e0 tx=0x7fbda8007d30 comp rx=0 tx=0).stop 2023-12-16T20:22:15.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.413+0000 7fbdbdae0640 1 -- 172.21.15.87:0/3663023412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdb8153c70 msgr2=0x7fbdb8154300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:15.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.413+0000 7fbdbdae0640 1 --2- 172.21.15.87:0/3663023412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdb8153c70 0x7fbdb8154300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000c7a0 tx=0x7fbdb000cc60 comp rx=0 tx=0).stop 2023-12-16T20:22:15.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.413+0000 7fbdbdae0640 1 -- 172.21.15.87:0/3663023412 shutdown_connections 2023-12-16T20:22:15.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.413+0000 7fbdbdae0640 1 --2- 172.21.15.87:0/3663023412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdb8153c70 0x7fbdb8154300 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:15.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.413+0000 7fbdbdae0640 1 --2- 172.21.15.87:0/3663023412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbdb8153890 0x7fbdb80b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:15.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.413+0000 7fbdbdae0640 1 --2- 172.21.15.87:0/3663023412 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fbd9806ae90 0x7fbd9806d350 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:15.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.413+0000 7fbdbdae0640 1 --2- 172.21.15.87:0/3663023412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbdb80ceef0 0x7fbdb8156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:15.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.413+0000 7fbdbdae0640 1 -- 172.21.15.87:0/3663023412 >> 172.21.15.87:0/3663023412 conn(0x7fbdb806ba00 msgr2=0x7fbdb80cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:15.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.413+0000 7fbdbdae0640 1 -- 172.21.15.87:0/3663023412 shutdown_connections 2023-12-16T20:22:15.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.413+0000 7fbdbdae0640 1 -- 172.21.15.87:0/3663023412 wait complete. 2023-12-16T20:22:15.425 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T20:22:15.525 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.523+0000 7f43eacbb640 1 Processor -- start 2023-12-16T20:22:15.525 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.523+0000 7f43eacbb640 1 -- start start 2023-12-16T20:22:15.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.524+0000 7f43eacbb640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e40710e0 0x7f43e4153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:15.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.524+0000 7f43eacbb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f43e40c7700 0x7f43e41538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:15.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.524+0000 7f43eacbb640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e40ca6c0 con 0x7f43e4070d00 2023-12-16T20:22:15.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.524+0000 7f43eacbb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e4159880 con 0x7f43e40c7700 2023-12-16T20:22:15.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.524+0000 7f43eacbb640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e4159b60 con 0x7f43e40710e0 2023-12-16T20:22:15.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.525+0000 7f43e9258640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f43e40c7700 0x7f43e41538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:15.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.525+0000 7f43e8a57640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f43e4070d00 0x7f43e415d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:51834/0 (socket says 172.21.15.87:51834) 2023-12-16T20:22:15.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.525+0000 7f43e8a57640 1 -- 172.21.15.87:0/1012244057 learned_addr learned my addr 172.21.15.87:0/1012244057 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:15.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.525+0000 7f43e3fff640 1 --2- 172.21.15.87:0/1012244057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e40710e0 0x7f43e4153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:15.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.527+0000 7f43e9258640 1 -- 172.21.15.87:0/1012244057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e40710e0 msgr2=0x7f43e4153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:15.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.527+0000 7f43e9258640 1 --2- 172.21.15.87:0/1012244057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e40710e0 0x7f43e4153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:15.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.527+0000 7f43e9258640 1 -- 172.21.15.87:0/1012244057 >> v1:172.21.15.195:6789/0 conn(0x7f43e4070d00 legacy=0x7f43e415d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:15.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.527+0000 7f43e9258640 1 -- 172.21.15.87:0/1012244057 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e4159e40 con 0x7f43e40c7700 2023-12-16T20:22:15.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.529+0000 7f43e9258640 1 --2- 172.21.15.87:0/1012244057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43e40c7700 0x7f43e41538c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009d90 tx=0x7f43dc02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd62ee447e895077 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:15.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.531+0000 7f43e37fe640 1 -- 172.21.15.87:0/1012244057 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc02cce0 con 0x7f43e40c7700 2023-12-16T20:22:15.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.533+0000 7f43e37fe640 1 -- 172.21.15.87:0/1012244057 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc02ce40 con 0x7f43e40c7700 2023-12-16T20:22:15.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.533+0000 7f43e37fe640 1 -- 172.21.15.87:0/1012244057 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc034660 con 0x7f43e40c7700 2023-12-16T20:22:15.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.533+0000 7f43eacbb640 1 -- 172.21.15.87:0/1012244057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43e40c7700 msgr2=0x7f43e41538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:15.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.533+0000 7f43eacbb640 1 --2- 172.21.15.87:0/1012244057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43e40c7700 0x7f43e41538c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009d90 tx=0x7f43dc02bf30 comp rx=0 tx=0).stop 2023-12-16T20:22:15.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.533+0000 7f43eacbb640 1 -- 172.21.15.87:0/1012244057 shutdown_connections 2023-12-16T20:22:15.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.533+0000 7f43eacbb640 1 --2- 172.21.15.87:0/1012244057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43e40c7700 0x7f43e41538c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:15.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.533+0000 7f43eacbb640 1 --2- 172.21.15.87:0/1012244057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e40710e0 0x7f43e4153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:15.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.533+0000 7f43eacbb640 1 -- 172.21.15.87:0/1012244057 >> 172.21.15.87:0/1012244057 conn(0x7f43e406ab30 msgr2=0x7f43e406ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:15.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.533+0000 7f43eacbb640 1 -- 172.21.15.87:0/1012244057 shutdown_connections 2023-12-16T20:22:15.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.533+0000 7f43eacbb640 1 -- 172.21.15.87:0/1012244057 wait complete. 2023-12-16T20:22:15.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.535+0000 7f43eacbb640 1 Processor -- start 2023-12-16T20:22:15.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.535+0000 7f43eacbb640 1 -- start start 2023-12-16T20:22:15.537 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.536+0000 7f43eacbb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43e4070d00 0x7f43e41e24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:15.537 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.536+0000 7f43eacbb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e40710e0 0x7f43e41ef4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:15.537 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.536+0000 7f43eacbb640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e40c7700 0x7f43e414f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:15.537 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.536+0000 7f43eacbb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e41ef0d0 con 0x7f43e4070d00 2023-12-16T20:22:15.537 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.536+0000 7f43eacbb640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e4156290 con 0x7f43e40710e0 2023-12-16T20:22:15.537 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.536+0000 7f43eacbb640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e4154060 con 0x7f43e40c7700 2023-12-16T20:22:15.538 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.536+0000 7f43e8a57640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43e4070d00 0x7f43e41e24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:15.538 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.536+0000 7f43e9258640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e40c7700 0x7f43e414f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:15.538 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.537+0000 7f43e8a57640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43e4070d00 0x7f43e41e24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46828/0 (socket says 172.21.15.87:46828) 2023-12-16T20:22:15.538 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.537+0000 7f43e8a57640 1 -- 172.21.15.87:0/4169847043 learned_addr learned my addr 172.21.15.87:0/4169847043 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:15.539 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.537+0000 7f43e3fff640 1 --2- 172.21.15.87:0/4169847043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e40710e0 0x7f43e41ef4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:15.541 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.540+0000 7f43e9258640 1 -- 172.21.15.87:0/4169847043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e40710e0 msgr2=0x7f43e41ef4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:15.541 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.540+0000 7f43e9258640 1 --2- 172.21.15.87:0/4169847043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e40710e0 0x7f43e41ef4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:15.541 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.540+0000 7f43e9258640 1 -- 172.21.15.87:0/4169847043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43e4070d00 msgr2=0x7f43e41e24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:15.541 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.540+0000 7f43e9258640 1 --2- 172.21.15.87:0/4169847043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43e4070d00 0x7f43e41e24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:15.541 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.540+0000 7f43e9258640 1 -- 172.21.15.87:0/4169847043 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc009a70 con 0x7f43e40c7700 2023-12-16T20:22:15.541 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.540+0000 7f43e8a57640 1 --2- 172.21.15.87:0/4169847043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43e4070d00 0x7f43e41e24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:22:15.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.542+0000 7f43e9258640 1 --2- 172.21.15.87:0/4169847043 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e40c7700 0x7f43e414f160 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f43dc033000 tx=0x7f43dc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:15.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.546+0000 7f43e17fa640 1 -- 172.21.15.87:0/4169847043 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc03d600 con 0x7f43e40c7700 2023-12-16T20:22:15.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.546+0000 7f43e17fa640 1 -- 172.21.15.87:0/4169847043 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc03d780 con 0x7f43e40c7700 2023-12-16T20:22:15.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.546+0000 7f43e17fa640 1 -- 172.21.15.87:0/4169847043 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc03db30 con 0x7f43e40c7700 2023-12-16T20:22:15.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.546+0000 7f43eacbb640 1 -- 172.21.15.87:0/4169847043 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e4154340 con 0x7f43e40c7700 2023-12-16T20:22:15.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.546+0000 7f43eacbb640 1 -- 172.21.15.87:0/4169847043 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e41eecf0 con 0x7f43e40c7700 2023-12-16T20:22:15.548 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.547+0000 7f43eacbb640 1 -- 172.21.15.87:0/4169847043 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e41ef210 con 0x7f43e40c7700 2023-12-16T20:22:15.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.565+0000 7f43e17fa640 1 -- 172.21.15.87:0/4169847043 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f43dc03b040 con 0x7f43e40c7700 2023-12-16T20:22:15.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.565+0000 7f43e17fa640 1 --2- 172.21.15.87:0/4169847043 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f43d006ae90 0x7f43d006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:15.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.565+0000 7f43e8a57640 1 --2- 172.21.15.87:0/4169847043 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f43d006ae90 0x7f43d006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:15.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.566+0000 7f43e8a57640 1 --2- 172.21.15.87:0/4169847043 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f43d006ae90 0x7f43d006d350 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f43d4005880 tx=0x7f43d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:15.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.567+0000 7f43e17fa640 1 -- 172.21.15.87:0/4169847043 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f43dc07a860 con 0x7f43e40c7700 2023-12-16T20:22:15.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:15.801+0000 7f43e17fa640 1 -- 172.21.15.87:0/4169847043 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f43dc076ba0 con 0x7f43e40c7700 2023-12-16T20:22:16.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.009+0000 7f43eacbb640 1 -- 172.21.15.87:0/4169847043 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43e41ef210 con 0x7f43e40c7700 2023-12-16T20:22:16.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.039+0000 7f43e17fa640 1 -- 172.21.15.87:0/4169847043 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6526 (secure 0 0 0) 0x7f43e41ef210 con 0x7f43e40c7700 2023-12-16T20:22:16.040 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:22:16.040 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2198156124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2198156124},{"type":"v1","addr":"172.21.15.87:6835","nonce":2198156124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3187160209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3187160209},{"type":"v1","addr":"172.21.15.195:6833","nonce":3187160209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3703236183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":3703236183},{"type":"v1","addr":"172.21.15.87:6837","nonce":3703236183}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1942743723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1942743723},{"type":"v1","addr":"172.21.15.87:6839","nonce":1942743723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/3327792325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3327792325},{"type":"v1","addr":"172.21.15.195:6836","nonce":3327792325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T20:21:36.158936+0000","modified":"2023-12-16T20:22:01.721931+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6837/3093855583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3093855583},{"type":"v1","addr":"172.21.15.195:6837","nonce":3093855583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T20:22:16.040 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 10 2023-12-16T20:22:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.040+0000 7f43eacbb640 1 -- 172.21.15.87:0/4169847043 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f43d006ae90 msgr2=0x7f43d006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.040+0000 7f43eacbb640 1 --2- 172.21.15.87:0/4169847043 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f43d006ae90 0x7f43d006d350 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f43d4005880 tx=0x7f43d4009040 comp rx=0 tx=0).stop 2023-12-16T20:22:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.040+0000 7f43eacbb640 1 -- 172.21.15.87:0/4169847043 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e40c7700 msgr2=0x7f43e414f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.040+0000 7f43eacbb640 1 --2- 172.21.15.87:0/4169847043 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e40c7700 0x7f43e414f160 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f43dc033000 tx=0x7f43dc004a40 comp rx=0 tx=0).stop 2023-12-16T20:22:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.040+0000 7f43eacbb640 1 -- 172.21.15.87:0/4169847043 shutdown_connections 2023-12-16T20:22:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.040+0000 7f43eacbb640 1 --2- 172.21.15.87:0/4169847043 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43e40c7700 0x7f43e414f160 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.040+0000 7f43eacbb640 1 --2- 172.21.15.87:0/4169847043 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f43d006ae90 0x7f43d006d350 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.040+0000 7f43eacbb640 1 --2- 172.21.15.87:0/4169847043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43e40710e0 0x7f43e41ef4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:16.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.040+0000 7f43eacbb640 1 --2- 172.21.15.87:0/4169847043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43e4070d00 0x7f43e41e24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:16.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.040+0000 7f43eacbb640 1 -- 172.21.15.87:0/4169847043 >> 172.21.15.87:0/4169847043 conn(0x7f43e406ab30 msgr2=0x7f43e406c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:16.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.040+0000 7f43eacbb640 1 -- 172.21.15.87:0/4169847043 shutdown_connections 2023-12-16T20:22:16.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.040+0000 7f43eacbb640 1 -- 172.21.15.87:0/4169847043 wait complete. 2023-12-16T20:22:16.053 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:22:16.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.150+0000 7f13b325c640 1 Processor -- start 2023-12-16T20:22:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.150+0000 7f13b325c640 1 -- start start 2023-12-16T20:22:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.151+0000 7f13b325c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f13ac153890 0x7f13ac15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.151+0000 7f13b325c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f13ac153c70 0x7f13ac0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:16.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.151+0000 7f13b325c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ac15a700 con 0x7f13ac0ceef0 2023-12-16T20:22:16.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.151+0000 7f13b325c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ac0ca870 con 0x7f13ac153c70 2023-12-16T20:22:16.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.151+0000 7f13b325c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ac159af0 con 0x7f13ac153890 2023-12-16T20:22:16.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.152+0000 7f13b0ff8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f13ac153890 0x7f13ac15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:16.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.152+0000 7f13b0ff8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f13ac153890 0x7f13ac15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:43106/0 (socket says 172.21.15.87:43106) 2023-12-16T20:22:16.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.152+0000 7f13b0ff8640 1 -- 172.21.15.87:0/1278681323 learned_addr learned my addr 172.21.15.87:0/1278681323 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:16.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.154+0000 7f13abfff640 1 --2- 172.21.15.87:0/1278681323 >> v2:172.21.15.87:3300/0 conn(0x7f13ac153c70 0x7f13ac0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:16.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.156+0000 7f13b0ff8640 1 -- 172.21.15.87:0/1278681323 >> v2:172.21.15.87:3300/0 conn(0x7f13ac153c70 msgr2=0x7f13ac0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:16.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.156+0000 7f13b0ff8640 1 --2- 172.21.15.87:0/1278681323 >> v2:172.21.15.87:3300/0 conn(0x7f13ac153c70 0x7f13ac0c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:16.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.156+0000 7f13b0ff8640 1 -- 172.21.15.87:0/1278681323 >> v1:172.21.15.87:6789/0 conn(0x7f13ac0ceef0 legacy=0x7f13ac15aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:16.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.156+0000 7f13b0ff8640 1 -- 172.21.15.87:0/1278681323 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac159dd0 con 0x7f13ac153890 2023-12-16T20:22:16.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.158+0000 7f13b0ff8640 1 --2- 172.21.15.87:0/1278681323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13ac153890 0x7f13ac15d950 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0ccaa0 tx=0x7f13a002ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c048decedf3b916 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:16.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.161+0000 7f13ab7fe640 1 -- 172.21.15.87:0/1278681323 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a002f850 con 0x7f13ac153890 2023-12-16T20:22:16.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.161+0000 7f13ab7fe640 1 -- 172.21.15.87:0/1278681323 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a002f9b0 con 0x7f13ac153890 2023-12-16T20:22:16.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.162+0000 7f13ab7fe640 1 -- 172.21.15.87:0/1278681323 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a002fd40 con 0x7f13ac153890 2023-12-16T20:22:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.162+0000 7f13b325c640 1 -- 172.21.15.87:0/1278681323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13ac153890 msgr2=0x7f13ac15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.162+0000 7f13b325c640 1 --2- 172.21.15.87:0/1278681323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13ac153890 0x7f13ac15d950 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0ccaa0 tx=0x7f13a002ba30 comp rx=0 tx=0).stop 2023-12-16T20:22:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.162+0000 7f13b325c640 1 -- 172.21.15.87:0/1278681323 shutdown_connections 2023-12-16T20:22:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.162+0000 7f13b325c640 1 --2- 172.21.15.87:0/1278681323 >> v2:172.21.15.87:3300/0 conn(0x7f13ac153c70 0x7f13ac0c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.162+0000 7f13b325c640 1 --2- 172.21.15.87:0/1278681323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13ac153890 0x7f13ac15d950 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.162+0000 7f13b325c640 1 -- 172.21.15.87:0/1278681323 >> 172.21.15.87:0/1278681323 conn(0x7f13ac06ba00 msgr2=0x7f13ac06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.162+0000 7f13b325c640 1 -- 172.21.15.87:0/1278681323 shutdown_connections 2023-12-16T20:22:16.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.162+0000 7f13b325c640 1 -- 172.21.15.87:0/1278681323 wait complete. 2023-12-16T20:22:16.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.163+0000 7f13b325c640 1 Processor -- start 2023-12-16T20:22:16.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.163+0000 7f13b325c640 1 -- start start 2023-12-16T20:22:16.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.164+0000 7f13b325c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f13ac0ceef0 0x7f13ac1519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:16.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.164+0000 7f13b325c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13ac153890 0x7f13ac1e6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:16.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.164+0000 7f13b325c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13ac153c70 0x7f13ac0ce110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:16.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.164+0000 7f13b325c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac151ee0 con 0x7f13ac153c70 2023-12-16T20:22:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.164+0000 7f13b325c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac0b3670 con 0x7f13ac153890 2023-12-16T20:22:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.164+0000 7f13b325c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac1e6c90 con 0x7f13ac0ceef0 2023-12-16T20:22:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.165+0000 7f13b17f9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13ac153c70 0x7f13ac0ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.165+0000 7f13abfff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13ac153890 0x7f13ac1e6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.165+0000 7f13b0ff8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f13ac0ceef0 0x7f13ac1519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.165+0000 7f13b17f9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13ac153c70 0x7f13ac0ce110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46860/0 (socket says 172.21.15.87:46860) 2023-12-16T20:22:16.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.165+0000 7f13b17f9640 1 -- 172.21.15.87:0/1537827047 learned_addr learned my addr 172.21.15.87:0/1537827047 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.168+0000 7f13b17f9640 1 -- 172.21.15.87:0/1537827047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f13ac0ceef0 msgr2=0x7f13ac1519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.168+0000 7f13b17f9640 1 --2- 172.21.15.87:0/1537827047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f13ac0ceef0 0x7f13ac1519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.168+0000 7f13b17f9640 1 -- 172.21.15.87:0/1537827047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13ac153890 msgr2=0x7f13ac1e6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.168+0000 7f13b17f9640 1 --2- 172.21.15.87:0/1537827047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13ac153890 0x7f13ac1e6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:16.171 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.169+0000 7f13b17f9640 1 -- 172.21.15.87:0/1537827047 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a00094d0 con 0x7f13ac153c70 2023-12-16T20:22:16.173 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.171+0000 7f13b17f9640 1 --2- 172.21.15.87:0/1537827047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13ac153c70 0x7f13ac0ce110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f13a400c6b0 tx=0x7f13a400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.174+0000 7f13a97fa640 1 -- 172.21.15.87:0/1537827047 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4003b70 con 0x7f13ac153c70 2023-12-16T20:22:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.174+0000 7f13a97fa640 1 -- 172.21.15.87:0/1537827047 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a4003cf0 con 0x7f13ac153c70 2023-12-16T20:22:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.174+0000 7f13a97fa640 1 -- 172.21.15.87:0/1537827047 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4003ea0 con 0x7f13ac153c70 2023-12-16T20:22:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.174+0000 7f13b325c640 1 -- 172.21.15.87:0/1537827047 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ac152930 con 0x7f13ac153c70 2023-12-16T20:22:16.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.174+0000 7f13b325c640 1 -- 172.21.15.87:0/1537827047 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ac152ef0 con 0x7f13ac153c70 2023-12-16T20:22:16.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.175+0000 7f13b325c640 1 -- 172.21.15.87:0/1537827047 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ac067500 con 0x7f13ac153c70 2023-12-16T20:22:16.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.193+0000 7f13a97fa640 1 -- 172.21.15.87:0/1537827047 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f13a4005310 con 0x7f13ac153c70 2023-12-16T20:22:16.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.194+0000 7f13a97fa640 1 --2- 172.21.15.87:0/1537827047 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f139006ae70 0x7f139006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:16.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.194+0000 7f13b0ff8640 1 --2- 172.21.15.87:0/1537827047 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f139006ae70 0x7f139006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:16.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.194+0000 7f13b0ff8640 1 --2- 172.21.15.87:0/1537827047 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f139006ae70 0x7f139006d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f13a0036000 tx=0x7f13a0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:16.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.435+0000 7f13a97fa640 1 -- 172.21.15.87:0/1537827047 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f13a4058b40 con 0x7f13ac153c70 2023-12-16T20:22:16.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.435+0000 7f13a97fa640 1 -- 172.21.15.87:0/1537827047 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f13a4054e80 con 0x7f13ac153c70 2023-12-16T20:22:16.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.623+0000 7f13b325c640 1 -- 172.21.15.87:0/1537827047 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13ac1530b0 con 0x7f13ac153c70 2023-12-16T20:22:16.667 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.665+0000 7f13a97fa640 1 -- 172.21.15.87:0/1537827047 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18702 (secure 0 0 0) 0x7f13a4087920 con 0x7f13ac153c70 2023-12-16T20:22:16.667 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:22:16.668 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":27,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:22:14.653915+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:21:22.654341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T20:21:33.728787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T20:21:34.846119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T20:21:38.657738+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:22:16.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.667+0000 7f13b325c640 1 -- 172.21.15.87:0/1537827047 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f139006ae70 msgr2=0x7f139006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:16.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.667+0000 7f13b325c640 1 --2- 172.21.15.87:0/1537827047 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f139006ae70 0x7f139006d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f13a0036000 tx=0x7f13a0008030 comp rx=0 tx=0).stop 2023-12-16T20:22:16.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.667+0000 7f13b325c640 1 -- 172.21.15.87:0/1537827047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13ac153c70 msgr2=0x7f13ac0ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:16.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.667+0000 7f13b325c640 1 --2- 172.21.15.87:0/1537827047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13ac153c70 0x7f13ac0ce110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f13a400c6b0 tx=0x7f13a400cb70 comp rx=0 tx=0).stop 2023-12-16T20:22:16.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.667+0000 7f13b325c640 1 -- 172.21.15.87:0/1537827047 shutdown_connections 2023-12-16T20:22:16.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.667+0000 7f13b325c640 1 --2- 172.21.15.87:0/1537827047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13ac153c70 0x7f13ac0ce110 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:16.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.667+0000 7f13b325c640 1 --2- 172.21.15.87:0/1537827047 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f139006ae70 0x7f139006d330 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:16.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.667+0000 7f13b325c640 1 --2- 172.21.15.87:0/1537827047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13ac153890 0x7f13ac1e6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:16.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.667+0000 7f13b325c640 1 --2- 172.21.15.87:0/1537827047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f13ac0ceef0 0x7f13ac1519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:16.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.667+0000 7f13b325c640 1 -- 172.21.15.87:0/1537827047 >> 172.21.15.87:0/1537827047 conn(0x7f13ac06ba00 msgr2=0x7f13ac073850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:16.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.667+0000 7f13b325c640 1 -- 172.21.15.87:0/1537827047 shutdown_connections 2023-12-16T20:22:16.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.667+0000 7f13b325c640 1 -- 172.21.15.87:0/1537827047 wait complete. 2023-12-16T20:22:16.680 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T20:21:22.654341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T20:21:33.728787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T20:21:34.846119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-16T20:21:38.657738+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-16T20:22:16.681 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T20:22:16.783 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.781+0000 7f1bd2c09640 1 Processor -- start 2023-12-16T20:22:16.783 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.781+0000 7f1bd2c09640 1 -- start start 2023-12-16T20:22:16.784 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.782+0000 7f1bd2c09640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1bcc153890 0x7f1bcc15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:16.785 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.782+0000 7f1bd2c09640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bcc153c70 0x7f1bcc0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:16.785 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.782+0000 7f1bd2c09640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bcc15a700 con 0x7f1bcc0ceef0 2023-12-16T20:22:16.785 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.782+0000 7f1bd2c09640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bcc0ca870 con 0x7f1bcc153890 2023-12-16T20:22:16.785 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.782+0000 7f1bd2c09640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc159af0 con 0x7f1bcc153c70 2023-12-16T20:22:16.785 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.782+0000 7f1bcbfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bcc153c70 0x7f1bcc0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:16.785 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.782+0000 7f1bd09a5640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1bcc153890 0x7f1bcc15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:16.785 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.783+0000 7f1bcbfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bcc153c70 0x7f1bcc0c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:49664/0 (socket says 172.21.15.87:49664) 2023-12-16T20:22:16.785 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.783+0000 7f1bcbfff640 1 -- 172.21.15.87:0/3111284355 learned_addr learned my addr 172.21.15.87:0/3111284355 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:16.787 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.785+0000 7f1bcbfff640 1 -- 172.21.15.87:0/3111284355 >> v2:172.21.15.195:3300/0 conn(0x7f1bcc153890 msgr2=0x7f1bcc15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:16.788 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.785+0000 7f1bcbfff640 1 --2- 172.21.15.87:0/3111284355 >> v2:172.21.15.195:3300/0 conn(0x7f1bcc153890 0x7f1bcc15d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:16.788 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.785+0000 7f1bcbfff640 1 -- 172.21.15.87:0/3111284355 >> v1:172.21.15.195:6789/0 conn(0x7f1bcc0ceef0 legacy=0x7f1bcc15aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:16.788 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.785+0000 7f1bcbfff640 1 -- 172.21.15.87:0/3111284355 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc159dd0 con 0x7f1bcc153c70 2023-12-16T20:22:16.790 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.787+0000 7f1bcbfff640 1 --2- 172.21.15.87:0/3111284355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bcc153c70 0x7f1bcc0c9fe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009870 tx=0x7f1bb802ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a66731f6e88bf1d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:16.797 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.795+0000 7f1bcb7fe640 1 -- 172.21.15.87:0/3111284355 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb802f840 con 0x7f1bcc153c70 2023-12-16T20:22:16.797 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.795+0000 7f1bcb7fe640 1 -- 172.21.15.87:0/3111284355 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb802f9a0 con 0x7f1bcc153c70 2023-12-16T20:22:16.797 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.795+0000 7f1bcb7fe640 1 -- 172.21.15.87:0/3111284355 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb802fd30 con 0x7f1bcc153c70 2023-12-16T20:22:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.795+0000 7f1bd2c09640 1 -- 172.21.15.87:0/3111284355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bcc153c70 msgr2=0x7f1bcc0c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.796+0000 7f1bd2c09640 1 --2- 172.21.15.87:0/3111284355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bcc153c70 0x7f1bcc0c9fe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009870 tx=0x7f1bb802ba20 comp rx=0 tx=0).stop 2023-12-16T20:22:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.796+0000 7f1bd2c09640 1 -- 172.21.15.87:0/3111284355 shutdown_connections 2023-12-16T20:22:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.796+0000 7f1bd2c09640 1 --2- 172.21.15.87:0/3111284355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bcc153c70 0x7f1bcc0c9fe0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.796+0000 7f1bd2c09640 1 --2- 172.21.15.87:0/3111284355 >> v2:172.21.15.195:3300/0 conn(0x7f1bcc153890 0x7f1bcc15d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.796+0000 7f1bd2c09640 1 -- 172.21.15.87:0/3111284355 >> 172.21.15.87:0/3111284355 conn(0x7f1bcc06ba00 msgr2=0x7f1bcc06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.796+0000 7f1bd2c09640 1 -- 172.21.15.87:0/3111284355 shutdown_connections 2023-12-16T20:22:16.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.796+0000 7f1bd2c09640 1 -- 172.21.15.87:0/3111284355 wait complete. 2023-12-16T20:22:16.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.797+0000 7f1bd2c09640 1 Processor -- start 2023-12-16T20:22:16.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.797+0000 7f1bd2c09640 1 -- start start 2023-12-16T20:22:16.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.798+0000 7f1bd2c09640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bcc0ceef0 0x7f1bcc1f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:16.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.798+0000 7f1bd2c09640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bcc153890 0x7f1bcc1516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:16.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.798+0000 7f1bd2c09640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bcc153c70 0x7f1bcc0c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:16.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.798+0000 7f1bd2c09640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc1f2d80 con 0x7f1bcc153c70 2023-12-16T20:22:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.798+0000 7f1bd2c09640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc1546e0 con 0x7f1bcc0ceef0 2023-12-16T20:22:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.798+0000 7f1bd2c09640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc1549c0 con 0x7f1bcc153890 2023-12-16T20:22:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.798+0000 7f1bd11a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bcc153c70 0x7f1bcc0c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.798+0000 7f1bd09a5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bcc0ceef0 0x7f1bcc1f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.799+0000 7f1bd11a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bcc153c70 0x7f1bcc0c6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46862/0 (socket says 172.21.15.87:46862) 2023-12-16T20:22:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.799+0000 7f1bd11a6640 1 -- 172.21.15.87:0/1043642343 learned_addr learned my addr 172.21.15.87:0/1043642343 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:16.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.800+0000 7f1bcbfff640 1 --2- 172.21.15.87:0/1043642343 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bcc153890 0x7f1bcc1516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:16.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.802+0000 7f1bd11a6640 1 -- 172.21.15.87:0/1043642343 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bcc153890 msgr2=0x7f1bcc1516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:16.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.802+0000 7f1bd11a6640 1 --2- 172.21.15.87:0/1043642343 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bcc153890 0x7f1bcc1516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:16.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.802+0000 7f1bd11a6640 1 -- 172.21.15.87:0/1043642343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bcc0ceef0 msgr2=0x7f1bcc1f3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:16.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.802+0000 7f1bd11a6640 1 --2- 172.21.15.87:0/1043642343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bcc0ceef0 0x7f1bcc1f3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:16.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.802+0000 7f1bd11a6640 1 -- 172.21.15.87:0/1043642343 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb80094d0 con 0x7f1bcc153c70 2023-12-16T20:22:16.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.804+0000 7f1bd11a6640 1 --2- 172.21.15.87:0/1043642343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bcc153c70 0x7f1bcc0c6470 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400c7a0 tx=0x7f1bc400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:16.810 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.807+0000 7f1bc97fa640 1 -- 172.21.15.87:0/1043642343 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4003b70 con 0x7f1bcc153c70 2023-12-16T20:22:16.810 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.808+0000 7f1bc97fa640 1 -- 172.21.15.87:0/1043642343 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc4003cf0 con 0x7f1bcc153c70 2023-12-16T20:22:16.810 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.808+0000 7f1bc97fa640 1 -- 172.21.15.87:0/1043642343 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4003ea0 con 0x7f1bcc153c70 2023-12-16T20:22:16.810 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.808+0000 7f1bd2c09640 1 -- 172.21.15.87:0/1043642343 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bcc1f2730 con 0x7f1bcc153c70 2023-12-16T20:22:16.810 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.808+0000 7f1bd2c09640 1 -- 172.21.15.87:0/1043642343 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bcc154090 con 0x7f1bcc153c70 2023-12-16T20:22:16.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:16.809+0000 7f1bd2c09640 1 -- 172.21.15.87:0/1043642343 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bcc1f2ef0 con 0x7f1bcc153c70 2023-12-16T20:22:17.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.047+0000 7f1bc97fa640 1 -- 172.21.15.87:0/1043642343 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f1bc400aa90 con 0x7f1bcc153c70 2023-12-16T20:22:17.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.048+0000 7f1bc97fa640 1 --2- 172.21.15.87:0/1043642343 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1bb006ae90 0x7f1bb006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:17.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.048+0000 7f1bd09a5640 1 --2- 172.21.15.87:0/1043642343 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1bb006ae90 0x7f1bb006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:17.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.049+0000 7f1bd09a5640 1 --2- 172.21.15.87:0/1043642343 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1bb006ae90 0x7f1bb006d350 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009b40 tx=0x7f1bc0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:17.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.062+0000 7f1bc97fa640 1 -- 172.21.15.87:0/1043642343 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f1bc4058bf0 con 0x7f1bcc153c70 2023-12-16T20:22:17.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.063+0000 7f1bc97fa640 1 -- 172.21.15.87:0/1043642343 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f1bc4054f30 con 0x7f1bcc153c70 2023-12-16T20:22:17.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.239+0000 7f1bd2c09640 1 -- 172.21.15.87:0/1043642343 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1bcc067500 con 0x7f1bcc153c70 2023-12-16T20:22:17.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.243+0000 7f1bc97fa640 1 -- 172.21.15.87:0/1043642343 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1bc4058550 con 0x7f1bcc153c70 2023-12-16T20:22:17.245 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-12-16T20:22:17.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.245+0000 7f1bd2c09640 1 -- 172.21.15.87:0/1043642343 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1bb006ae90 msgr2=0x7f1bb006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:17.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.245+0000 7f1bd2c09640 1 --2- 172.21.15.87:0/1043642343 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1bb006ae90 0x7f1bb006d350 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009b40 tx=0x7f1bc0009190 comp rx=0 tx=0).stop 2023-12-16T20:22:17.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.245+0000 7f1bd2c09640 1 -- 172.21.15.87:0/1043642343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bcc153c70 msgr2=0x7f1bcc0c6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:17.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.245+0000 7f1bd2c09640 1 --2- 172.21.15.87:0/1043642343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bcc153c70 0x7f1bcc0c6470 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400c7a0 tx=0x7f1bc400cc60 comp rx=0 tx=0).stop 2023-12-16T20:22:17.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.245+0000 7f1bd2c09640 1 -- 172.21.15.87:0/1043642343 shutdown_connections 2023-12-16T20:22:17.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.245+0000 7f1bd2c09640 1 --2- 172.21.15.87:0/1043642343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bcc153c70 0x7f1bcc0c6470 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.245+0000 7f1bd2c09640 1 --2- 172.21.15.87:0/1043642343 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bcc153890 0x7f1bcc1516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.245+0000 7f1bd2c09640 1 --2- 172.21.15.87:0/1043642343 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f1bb006ae90 0x7f1bb006d350 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.245+0000 7f1bd2c09640 1 --2- 172.21.15.87:0/1043642343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bcc0ceef0 0x7f1bcc1f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.245+0000 7f1bd2c09640 1 -- 172.21.15.87:0/1043642343 >> 172.21.15.87:0/1043642343 conn(0x7f1bcc06ba00 msgr2=0x7f1bcc158a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:17.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.245+0000 7f1bd2c09640 1 -- 172.21.15.87:0/1043642343 shutdown_connections 2023-12-16T20:22:17.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.245+0000 7f1bd2c09640 1 -- 172.21.15.87:0/1043642343 wait complete. 2023-12-16T20:22:17.258 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T20:22:17.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.357+0000 7fe186b90640 1 Processor -- start 2023-12-16T20:22:17.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.357+0000 7fe186b90640 1 -- start start 2023-12-16T20:22:17.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.358+0000 7fe186b90640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe180157470 0x7fe1800c3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:17.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.358+0000 7fe186b90640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1800c3790 0x7fe1800ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:17.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.358+0000 7fe186b90640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1800c90c0 con 0x7fe180151680 2023-12-16T20:22:17.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.358+0000 7fe186b90640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1800b0ae0 con 0x7fe180157470 2023-12-16T20:22:17.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.358+0000 7fe186b90640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1801583f0 con 0x7fe1800c3790 2023-12-16T20:22:17.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.359+0000 7fe18492c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe180151680 0x7fe1800c7dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60096/0 (socket says 172.21.15.87:60096) 2023-12-16T20:22:17.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.359+0000 7fe18492c640 1 -- 172.21.15.87:0/4023785501 learned_addr learned my addr 172.21.15.87:0/4023785501 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:17.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.359+0000 7fe18512d640 1 --2- 172.21.15.87:0/4023785501 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1800c3790 0x7fe1800ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:17.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.359+0000 7fe17ffff640 1 --2- 172.21.15.87:0/4023785501 >> v2:172.21.15.195:3300/0 conn(0x7fe180157470 0x7fe1800c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:17.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.361+0000 7fe17f7fe640 1 -- 172.21.15.87:0/4023785501 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546948464 0 0) 0x7fe1800c90c0 con 0x7fe180151680 2023-12-16T20:22:17.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.361+0000 7fe17f7fe640 1 -- 172.21.15.87:0/4023785501 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe170003520 con 0x7fe180151680 2023-12-16T20:22:17.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.361+0000 7fe18512d640 1 -- 172.21.15.87:0/4023785501 >> v2:172.21.15.195:3300/0 conn(0x7fe180157470 msgr2=0x7fe1800c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:17.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.361+0000 7fe18512d640 1 --2- 172.21.15.87:0/4023785501 >> v2:172.21.15.195:3300/0 conn(0x7fe180157470 0x7fe1800c3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.361+0000 7fe18512d640 1 -- 172.21.15.87:0/4023785501 >> v1:172.21.15.87:6789/0 conn(0x7fe180151680 legacy=0x7fe1800c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:17.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.361+0000 7fe18512d640 1 -- 172.21.15.87:0/4023785501 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe180157bb0 con 0x7fe1800c3790 2023-12-16T20:22:17.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.363+0000 7fe18512d640 1 --2- 172.21.15.87:0/4023785501 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1800c3790 0x7fe1800ccc40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe178009d90 tx=0x7fe17802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5da95187b7ab8ffc server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:17.369 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.367+0000 7fe17f7fe640 1 -- 172.21.15.87:0/4023785501 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17802cc50 con 0x7fe1800c3790 2023-12-16T20:22:17.369 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.367+0000 7fe17f7fe640 1 -- 172.21.15.87:0/4023785501 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17802cdb0 con 0x7fe1800c3790 2023-12-16T20:22:17.369 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.367+0000 7fe17f7fe640 1 -- 172.21.15.87:0/4023785501 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe178034660 con 0x7fe1800c3790 2023-12-16T20:22:17.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.368+0000 7fe186b90640 1 -- 172.21.15.87:0/4023785501 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1800c3790 msgr2=0x7fe1800ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:17.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.368+0000 7fe186b90640 1 --2- 172.21.15.87:0/4023785501 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1800c3790 0x7fe1800ccc40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe178009d90 tx=0x7fe17802bea0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.368+0000 7fe186b90640 1 -- 172.21.15.87:0/4023785501 shutdown_connections 2023-12-16T20:22:17.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.368+0000 7fe186b90640 1 --2- 172.21.15.87:0/4023785501 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1800c3790 0x7fe1800ccc40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.368+0000 7fe186b90640 1 --2- 172.21.15.87:0/4023785501 >> v2:172.21.15.195:3300/0 conn(0x7fe180157470 0x7fe1800c3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.368+0000 7fe186b90640 1 -- 172.21.15.87:0/4023785501 >> 172.21.15.87:0/4023785501 conn(0x7fe1800708e0 msgr2=0x7fe180070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:17.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.368+0000 7fe186b90640 1 -- 172.21.15.87:0/4023785501 shutdown_connections 2023-12-16T20:22:17.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.368+0000 7fe186b90640 1 -- 172.21.15.87:0/4023785501 wait complete. 2023-12-16T20:22:17.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.369+0000 7fe186b90640 1 Processor -- start 2023-12-16T20:22:17.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.369+0000 7fe186b90640 1 -- start start 2023-12-16T20:22:17.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.370+0000 7fe186b90640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1800c3790 0x7fe1801ed540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:17.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.370+0000 7fe186b90640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe180151680 0x7fe1801eda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:17.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.370+0000 7fe186b90640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe180157470 0x7fe1800c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:17.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.370+0000 7fe186b90640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1801ed0b0 con 0x7fe1800c3790 2023-12-16T20:22:17.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.370+0000 7fe186b90640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1801f04f0 con 0x7fe180157470 2023-12-16T20:22:17.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.370+0000 7fe186b90640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1801f07b0 con 0x7fe180151680 2023-12-16T20:22:17.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.370+0000 7fe18492c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1800c3790 0x7fe1801ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:17.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.370+0000 7fe18492c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1800c3790 0x7fe1801ed540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46872/0 (socket says 172.21.15.87:46872) 2023-12-16T20:22:17.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.370+0000 7fe18492c640 1 -- 172.21.15.87:0/1369173177 learned_addr learned my addr 172.21.15.87:0/1369173177 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:17.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.371+0000 7fe17ffff640 1 --2- 172.21.15.87:0/1369173177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe180151680 0x7fe1801eda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:17.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.371+0000 7fe18512d640 1 --2- 172.21.15.87:0/1369173177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe180157470 0x7fe1800c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:17.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.374+0000 7fe18492c640 1 -- 172.21.15.87:0/1369173177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe180151680 msgr2=0x7fe1801eda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:17.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.374+0000 7fe18492c640 1 --2- 172.21.15.87:0/1369173177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe180151680 0x7fe1801eda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.374+0000 7fe18492c640 1 -- 172.21.15.87:0/1369173177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe180157470 msgr2=0x7fe1800c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:17.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.374+0000 7fe18492c640 1 --2- 172.21.15.87:0/1369173177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe180157470 0x7fe1800c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.374+0000 7fe18492c640 1 -- 172.21.15.87:0/1369173177 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe178009a70 con 0x7fe1800c3790 2023-12-16T20:22:17.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.376+0000 7fe18492c640 1 --2- 172.21.15.87:0/1369173177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1800c3790 0x7fe1801ed540 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe17400c430 tx=0x7fe17400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:17.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.379+0000 7fe17d7fa640 1 -- 172.21.15.87:0/1369173177 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe174005ce0 con 0x7fe1800c3790 2023-12-16T20:22:17.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.380+0000 7fe17d7fa640 1 -- 172.21.15.87:0/1369173177 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe174005e40 con 0x7fe1800c3790 2023-12-16T20:22:17.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.380+0000 7fe17d7fa640 1 -- 172.21.15.87:0/1369173177 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1740072f0 con 0x7fe1800c3790 2023-12-16T20:22:17.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.380+0000 7fe186b90640 1 -- 172.21.15.87:0/1369173177 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1801f0a90 con 0x7fe1800c3790 2023-12-16T20:22:17.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.380+0000 7fe186b90640 1 -- 172.21.15.87:0/1369173177 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1801f1050 con 0x7fe1800c3790 2023-12-16T20:22:17.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.381+0000 7fe186b90640 1 -- 172.21.15.87:0/1369173177 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1800740e0 con 0x7fe1800c3790 2023-12-16T20:22:17.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.624+0000 7fe17d7fa640 1 -- 172.21.15.87:0/1369173177 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fe174007450 con 0x7fe1800c3790 2023-12-16T20:22:17.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.624+0000 7fe17d7fa640 1 --2- 172.21.15.87:0/1369173177 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe16406f2a0 0x7fe164071760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:17.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.624+0000 7fe17ffff640 1 --2- 172.21.15.87:0/1369173177 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe16406f2a0 0x7fe164071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:17.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.625+0000 7fe17ffff640 1 --2- 172.21.15.87:0/1369173177 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe16406f2a0 0x7fe164071760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe1800ccdc0 tx=0x7fe16c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:17.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.637+0000 7fe17d7fa640 1 -- 172.21.15.87:0/1369173177 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe174057ef0 con 0x7fe1800c3790 2023-12-16T20:22:17.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.637+0000 7fe17d7fa640 1 -- 172.21.15.87:0/1369173177 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fe174054230 con 0x7fe1800c3790 2023-12-16T20:22:17.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.807+0000 7fe186b90640 1 -- 172.21.15.87:0/1369173177 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1800c7b90 con 0x7fe1800c3790 2023-12-16T20:22:17.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.813+0000 7fe17d7fa640 1 -- 172.21.15.87:0/1369173177 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe174017020 con 0x7fe1800c3790 2023-12-16T20:22:17.815 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-12-16T20:22:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.814+0000 7fe186b90640 1 -- 172.21.15.87:0/1369173177 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe16406f2a0 msgr2=0x7fe164071760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.815+0000 7fe186b90640 1 --2- 172.21.15.87:0/1369173177 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe16406f2a0 0x7fe164071760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe1800ccdc0 tx=0x7fe16c009190 comp rx=0 tx=0).stop 2023-12-16T20:22:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.815+0000 7fe186b90640 1 -- 172.21.15.87:0/1369173177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1800c3790 msgr2=0x7fe1801ed540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.815+0000 7fe186b90640 1 --2- 172.21.15.87:0/1369173177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1800c3790 0x7fe1801ed540 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe17400c430 tx=0x7fe17400c8f0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.815+0000 7fe186b90640 1 -- 172.21.15.87:0/1369173177 shutdown_connections 2023-12-16T20:22:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.815+0000 7fe186b90640 1 --2- 172.21.15.87:0/1369173177 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe16406f2a0 0x7fe164071760 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.815+0000 7fe186b90640 1 --2- 172.21.15.87:0/1369173177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe180157470 0x7fe1800c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.815+0000 7fe186b90640 1 --2- 172.21.15.87:0/1369173177 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe180151680 0x7fe1801eda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.815+0000 7fe186b90640 1 --2- 172.21.15.87:0/1369173177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1800c3790 0x7fe1801ed540 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.815+0000 7fe186b90640 1 -- 172.21.15.87:0/1369173177 >> 172.21.15.87:0/1369173177 conn(0x7fe1800708e0 msgr2=0x7fe1801568d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.815+0000 7fe186b90640 1 -- 172.21.15.87:0/1369173177 shutdown_connections 2023-12-16T20:22:17.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.815+0000 7fe186b90640 1 -- 172.21.15.87:0/1369173177 wait complete. 2023-12-16T20:22:17.828 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T20:22:17.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.928+0000 7f4486e0e640 1 Processor -- start 2023-12-16T20:22:17.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.928+0000 7f4486e0e640 1 -- start start 2023-12-16T20:22:17.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.929+0000 7f4486e0e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f44801501c0 0x7f4480159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:17.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.929+0000 7f4486e0e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4480072b60 con 0x7f4480156e60 2023-12-16T20:22:17.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.929+0000 7f4486e0e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44800c1a90 con 0x7f44800bff00 2023-12-16T20:22:17.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.929+0000 7f4486e0e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44801572d0 con 0x7f44801501c0 2023-12-16T20:22:17.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.930+0000 7f44853ab640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f4480156e60 0x7f4480071710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60106/0 (socket says 172.21.15.87:60106) 2023-12-16T20:22:17.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.930+0000 7f44853ab640 1 -- 172.21.15.87:0/385745340 learned_addr learned my addr 172.21.15.87:0/385745340 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:17.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.930+0000 7f4484baa640 1 --2- 172.21.15.87:0/385745340 >> v2:172.21.15.195:3300/0 conn(0x7f44801501c0 0x7f4480159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:17.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.932+0000 7f447f7fe640 1 -- 172.21.15.87:0/385745340 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400834238 0 0) 0x7f4480072b60 con 0x7f4480156e60 2023-12-16T20:22:17.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.932+0000 7f447f7fe640 1 -- 172.21.15.87:0/385745340 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4468005730 con 0x7f4480156e60 2023-12-16T20:22:17.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.933+0000 7f4484baa640 1 -- 172.21.15.87:0/385745340 >> v1:172.21.15.195:6789/0 conn(0x7f44800bff00 legacy=0x7f4480072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:17.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.933+0000 7f4484baa640 1 -- 172.21.15.87:0/385745340 >> v1:172.21.15.87:6789/0 conn(0x7f4480156e60 legacy=0x7f4480071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:17.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.933+0000 7f4484baa640 1 -- 172.21.15.87:0/385745340 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44800c1d30 con 0x7f44801501c0 2023-12-16T20:22:17.938 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.936+0000 7f4484baa640 1 --2- 172.21.15.87:0/385745340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44801501c0 0x7f4480159860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f44700097a0 tx=0x7f447002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=549c2b3c5f45d260 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:17.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.940+0000 7f447f7fe640 1 -- 172.21.15.87:0/385745340 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447002f810 con 0x7f44801501c0 2023-12-16T20:22:17.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.940+0000 7f447f7fe640 1 -- 172.21.15.87:0/385745340 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447002f970 con 0x7f44801501c0 2023-12-16T20:22:17.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.940+0000 7f447f7fe640 1 -- 172.21.15.87:0/385745340 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447002fd00 con 0x7f44801501c0 2023-12-16T20:22:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.941+0000 7f4486e0e640 1 -- 172.21.15.87:0/385745340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44801501c0 msgr2=0x7f4480159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.941+0000 7f4486e0e640 1 --2- 172.21.15.87:0/385745340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44801501c0 0x7f4480159860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f44700097a0 tx=0x7f447002b9f0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.941+0000 7f4486e0e640 1 -- 172.21.15.87:0/385745340 shutdown_connections 2023-12-16T20:22:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.941+0000 7f4486e0e640 1 --2- 172.21.15.87:0/385745340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44801501c0 0x7f4480159860 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.941+0000 7f4486e0e640 1 -- 172.21.15.87:0/385745340 >> 172.21.15.87:0/385745340 conn(0x7f448006cd60 msgr2=0x7f448006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.941+0000 7f4486e0e640 1 -- 172.21.15.87:0/385745340 shutdown_connections 2023-12-16T20:22:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.941+0000 7f4486e0e640 1 -- 172.21.15.87:0/385745340 wait complete. 2023-12-16T20:22:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.942+0000 7f4486e0e640 1 Processor -- start 2023-12-16T20:22:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.942+0000 7f4486e0e640 1 -- start start 2023-12-16T20:22:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.943+0000 7f4486e0e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44800bff00 0x7f44800c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.943+0000 7f4486e0e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44801501c0 0x7f448014e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.943+0000 7f4486e0e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4480156e60 0x7f44800c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.943+0000 7f4486e0e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44801e22a0 con 0x7f44800bff00 2023-12-16T20:22:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.943+0000 7f4486e0e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44801e15f0 con 0x7f4480156e60 2023-12-16T20:22:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.943+0000 7f4486e0e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44801e1970 con 0x7f44801501c0 2023-12-16T20:22:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.943+0000 7f4484baa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44800bff00 0x7f44800c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.943+0000 7f4484baa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44800bff00 0x7f44800c2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46880/0 (socket says 172.21.15.87:46880) 2023-12-16T20:22:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.943+0000 7f4484baa640 1 -- 172.21.15.87:0/2599408376 learned_addr learned my addr 172.21.15.87:0/2599408376 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.943+0000 7f44853ab640 1 --2- 172.21.15.87:0/2599408376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4480156e60 0x7f44800c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.944+0000 7f447ffff640 1 --2- 172.21.15.87:0/2599408376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44801501c0 0x7f448014e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.947+0000 7f4484baa640 1 -- 172.21.15.87:0/2599408376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44801501c0 msgr2=0x7f448014e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.947+0000 7f4484baa640 1 --2- 172.21.15.87:0/2599408376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44801501c0 0x7f448014e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.947+0000 7f4484baa640 1 -- 172.21.15.87:0/2599408376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4480156e60 msgr2=0x7f44800c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.947+0000 7f4484baa640 1 --2- 172.21.15.87:0/2599408376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4480156e60 0x7f44800c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.947+0000 7f4484baa640 1 -- 172.21.15.87:0/2599408376 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4470009400 con 0x7f44800bff00 2023-12-16T20:22:17.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.949+0000 7f4484baa640 1 --2- 172.21.15.87:0/2599408376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44800bff00 0x7f44800c2650 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f44700098c0 tx=0x7f44700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:17.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.953+0000 7f447d7fa640 1 -- 172.21.15.87:0/2599408376 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470046070 con 0x7f44800bff00 2023-12-16T20:22:17.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.953+0000 7f447d7fa640 1 -- 172.21.15.87:0/2599408376 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44700376d0 con 0x7f44800bff00 2023-12-16T20:22:17.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.953+0000 7f447d7fa640 1 -- 172.21.15.87:0/2599408376 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447003b040 con 0x7f44800bff00 2023-12-16T20:22:17.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.953+0000 7f4486e0e640 1 -- 172.21.15.87:0/2599408376 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44800c2b90 con 0x7f44800bff00 2023-12-16T20:22:17.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.953+0000 7f4486e0e640 1 -- 172.21.15.87:0/2599408376 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44800c2e00 con 0x7f44800bff00 2023-12-16T20:22:17.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.954+0000 7f4486e0e640 1 -- 172.21.15.87:0/2599408376 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4480067500 con 0x7f44800bff00 2023-12-16T20:22:17.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.973+0000 7f447d7fa640 1 -- 172.21.15.87:0/2599408376 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f4470037a80 con 0x7f44800bff00 2023-12-16T20:22:17.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.973+0000 7f447d7fa640 1 --2- 172.21.15.87:0/2599408376 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f446c06aec0 0x7f446c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:17.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.973+0000 7f447ffff640 1 --2- 172.21.15.87:0/2599408376 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f446c06aec0 0x7f446c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:17.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.974+0000 7f447ffff640 1 --2- 172.21.15.87:0/2599408376 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f446c06aec0 0x7f446c06d380 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f448014d2c0 tx=0x7f4474009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:17.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:17.975+0000 7f447d7fa640 1 -- 172.21.15.87:0/2599408376 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f447007b610 con 0x7f44800bff00 2023-12-16T20:22:18.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.204+0000 7f447d7fa640 1 -- 172.21.15.87:0/2599408376 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f4470077950 con 0x7f44800bff00 2023-12-16T20:22:18.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.382+0000 7f4486e0e640 1 -- 172.21.15.87:0/2599408376 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4480072230 con 0x7f44800bff00 2023-12-16T20:22:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.399+0000 7f447d7fa640 1 -- 172.21.15.87:0/2599408376 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f447007af70 con 0x7f44800bff00 2023-12-16T20:22:18.402 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-12-16T20:22:18.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.402+0000 7f4486e0e640 1 -- 172.21.15.87:0/2599408376 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f446c06aec0 msgr2=0x7f446c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.402+0000 7f4486e0e640 1 --2- 172.21.15.87:0/2599408376 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f446c06aec0 0x7f446c06d380 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f448014d2c0 tx=0x7f4474009040 comp rx=0 tx=0).stop 2023-12-16T20:22:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.402+0000 7f4486e0e640 1 -- 172.21.15.87:0/2599408376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44800bff00 msgr2=0x7f44800c2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.402+0000 7f4486e0e640 1 --2- 172.21.15.87:0/2599408376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44800bff00 0x7f44800c2650 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f44700098c0 tx=0x7f44700046c0 comp rx=0 tx=0).stop 2023-12-16T20:22:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.402+0000 7f4486e0e640 1 -- 172.21.15.87:0/2599408376 shutdown_connections 2023-12-16T20:22:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.402+0000 7f4486e0e640 1 --2- 172.21.15.87:0/2599408376 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f446c06aec0 0x7f446c06d380 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.402+0000 7f4486e0e640 1 --2- 172.21.15.87:0/2599408376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4480156e60 0x7f44800c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.402+0000 7f4486e0e640 1 --2- 172.21.15.87:0/2599408376 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f44801501c0 0x7f448014e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.402+0000 7f4486e0e640 1 --2- 172.21.15.87:0/2599408376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44800bff00 0x7f44800c2650 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.402+0000 7f4486e0e640 1 -- 172.21.15.87:0/2599408376 >> 172.21.15.87:0/2599408376 conn(0x7f448006cd60 msgr2=0x7f448006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.402+0000 7f4486e0e640 1 -- 172.21.15.87:0/2599408376 shutdown_connections 2023-12-16T20:22:18.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.402+0000 7f4486e0e640 1 -- 172.21.15.87:0/2599408376 wait complete. 2023-12-16T20:22:18.415 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-16T20:22:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.515+0000 7f0d2ce89640 1 Processor -- start 2023-12-16T20:22:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.515+0000 7f0d2ce89640 1 -- start start 2023-12-16T20:22:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.515+0000 7f0d2ce89640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0d28151630 0x7f0d2806f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.515+0000 7f0d2ce89640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d28157f50 0x7f0d280c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.515+0000 7f0d2ce89640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0d280ca130 0x7f0d280c2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.515+0000 7f0d2ce89640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2815b9c0 con 0x7f0d280ca130 2023-12-16T20:22:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.515+0000 7f0d2ce89640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2815ab60 con 0x7f0d28151630 2023-12-16T20:22:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.515+0000 7f0d2ce89640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2815ae40 con 0x7f0d28157f50 2023-12-16T20:22:18.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.516+0000 7f0d26d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0d280ca130 0x7f0d280c2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:18.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.516+0000 7f0d1ffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d28157f50 0x7f0d280c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:18.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.516+0000 7f0d2659c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0d28151630 0x7f0d2806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:18.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.516+0000 7f0d26d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0d280ca130 0x7f0d280c2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46888/0 (socket says 172.21.15.87:46888) 2023-12-16T20:22:18.520 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.516+0000 7f0d26d9d640 1 -- 172.21.15.87:0/3584475217 learned_addr learned my addr 172.21.15.87:0/3584475217 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:18.520 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.518+0000 7f0d26d9d640 1 -- 172.21.15.87:0/3584475217 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d28157f50 msgr2=0x7f0d280c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:18.521 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.518+0000 7f0d26d9d640 1 --2- 172.21.15.87:0/3584475217 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d28157f50 0x7f0d280c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:18.521 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.518+0000 7f0d26d9d640 1 -- 172.21.15.87:0/3584475217 >> v2:172.21.15.195:3300/0 conn(0x7f0d28151630 msgr2=0x7f0d2806f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:18.521 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.518+0000 7f0d26d9d640 1 --2- 172.21.15.87:0/3584475217 >> v2:172.21.15.195:3300/0 conn(0x7f0d28151630 0x7f0d2806f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:18.521 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.518+0000 7f0d26d9d640 1 -- 172.21.15.87:0/3584475217 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2815b120 con 0x7f0d280ca130 2023-12-16T20:22:18.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.520+0000 7f0d26d9d640 1 --2- 172.21.15.87:0/3584475217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d280ca130 0x7f0d280c2000 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0d28061ea0 tx=0x7f0d2002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314dbe3d88d32c26 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:18.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.524+0000 7f0d25d9b640 1 -- 172.21.15.87:0/3584475217 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2002cb00 con 0x7f0d280ca130 2023-12-16T20:22:18.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.524+0000 7f0d25d9b640 1 -- 172.21.15.87:0/3584475217 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2002cc60 con 0x7f0d280ca130 2023-12-16T20:22:18.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.524+0000 7f0d25d9b640 1 -- 172.21.15.87:0/3584475217 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d200343f0 con 0x7f0d280ca130 2023-12-16T20:22:18.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.525+0000 7f0d2ce89640 1 -- 172.21.15.87:0/3584475217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d280ca130 msgr2=0x7f0d280c2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:18.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.525+0000 7f0d2ce89640 1 --2- 172.21.15.87:0/3584475217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d280ca130 0x7f0d280c2000 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0d28061ea0 tx=0x7f0d2002bf60 comp rx=0 tx=0).stop 2023-12-16T20:22:18.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.525+0000 7f0d2ce89640 1 -- 172.21.15.87:0/3584475217 shutdown_connections 2023-12-16T20:22:18.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.525+0000 7f0d2ce89640 1 --2- 172.21.15.87:0/3584475217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d280ca130 0x7f0d280c2000 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:18.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.525+0000 7f0d2ce89640 1 --2- 172.21.15.87:0/3584475217 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d28157f50 0x7f0d280c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:18.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.525+0000 7f0d2ce89640 1 --2- 172.21.15.87:0/3584475217 >> v2:172.21.15.195:3300/0 conn(0x7f0d28151630 0x7f0d2806f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:18.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.525+0000 7f0d2ce89640 1 -- 172.21.15.87:0/3584475217 >> 172.21.15.87:0/3584475217 conn(0x7f0d28061100 msgr2=0x7f0d280614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:18.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.525+0000 7f0d2ce89640 1 -- 172.21.15.87:0/3584475217 shutdown_connections 2023-12-16T20:22:18.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.525+0000 7f0d2ce89640 1 -- 172.21.15.87:0/3584475217 wait complete. 2023-12-16T20:22:18.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.526+0000 7f0d2ce89640 1 Processor -- start 2023-12-16T20:22:18.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.526+0000 7f0d2ce89640 1 -- start start 2023-12-16T20:22:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.527+0000 7f0d2ce89640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d280ca130 0x7f0d280c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.527+0000 7f0d2ce89640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d28151630 0x7f0d2806cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.527+0000 7f0d2ce89640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d28157f50 0x7f0d28070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.527+0000 7f0d2ce89640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2806b950 con 0x7f0d28157f50 2023-12-16T20:22:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.527+0000 7f0d2ce89640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d281f2250 con 0x7f0d280ca130 2023-12-16T20:22:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.527+0000 7f0d2ce89640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d28158fb0 con 0x7f0d28151630 2023-12-16T20:22:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.527+0000 7f0d26d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d28157f50 0x7f0d28070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.527+0000 7f0d1ffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d28151630 0x7f0d2806cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.527+0000 7f0d2659c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d280ca130 0x7f0d280c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:18.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.528+0000 7f0d26d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d28157f50 0x7f0d28070ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46904/0 (socket says 172.21.15.87:46904) 2023-12-16T20:22:18.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.528+0000 7f0d26d9d640 1 -- 172.21.15.87:0/2569580295 learned_addr learned my addr 172.21.15.87:0/2569580295 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.531+0000 7f0d26d9d640 1 -- 172.21.15.87:0/2569580295 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d28151630 msgr2=0x7f0d2806cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.531+0000 7f0d26d9d640 1 --2- 172.21.15.87:0/2569580295 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d28151630 0x7f0d2806cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.531+0000 7f0d26d9d640 1 -- 172.21.15.87:0/2569580295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d280ca130 msgr2=0x7f0d280c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.531+0000 7f0d26d9d640 1 --2- 172.21.15.87:0/2569580295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d280ca130 0x7f0d280c5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.531+0000 7f0d26d9d640 1 -- 172.21.15.87:0/2569580295 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d20009b30 con 0x7f0d28157f50 2023-12-16T20:22:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.531+0000 7f0d1ffff640 1 --2- 172.21.15.87:0/2569580295 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d28151630 0x7f0d2806cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:22:18.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.533+0000 7f0d26d9d640 1 --2- 172.21.15.87:0/2569580295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d28157f50 0x7f0d28070ab0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009f40 tx=0x7f0d20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.536+0000 7f0d1effd640 1 -- 172.21.15.87:0/2569580295 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d20007ea0 con 0x7f0d28157f50 2023-12-16T20:22:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.537+0000 7f0d1effd640 1 -- 172.21.15.87:0/2569580295 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2003e450 con 0x7f0d28157f50 2023-12-16T20:22:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.537+0000 7f0d2ce89640 1 -- 172.21.15.87:0/2569580295 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d28157320 con 0x7f0d28157f50 2023-12-16T20:22:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.537+0000 7f0d1effd640 1 -- 172.21.15.87:0/2569580295 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2003e800 con 0x7f0d28157f50 2023-12-16T20:22:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.537+0000 7f0d2ce89640 1 -- 172.21.15.87:0/2569580295 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d28159250 con 0x7f0d28157f50 2023-12-16T20:22:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.538+0000 7f0d2ce89640 1 -- 172.21.15.87:0/2569580295 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d280740e0 con 0x7f0d28157f50 2023-12-16T20:22:18.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.556+0000 7f0d1effd640 1 -- 172.21.15.87:0/2569580295 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f0d2003e960 con 0x7f0d28157f50 2023-12-16T20:22:18.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.557+0000 7f0d1effd640 1 --2- 172.21.15.87:0/2569580295 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0d0806aec0 0x7f0d0806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:18.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.557+0000 7f0d2659c640 1 --2- 172.21.15.87:0/2569580295 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0d0806aec0 0x7f0d0806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:18.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.558+0000 7f0d2659c640 1 --2- 172.21.15.87:0/2569580295 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0d0806aec0 0x7f0d0806d380 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009ac0 tx=0x7f0d18009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:18.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.793+0000 7f0d1effd640 1 -- 172.21.15.87:0/2569580295 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f0d2007b600 con 0x7f0d28157f50 2023-12-16T20:22:18.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.793+0000 7f0d1effd640 1 -- 172.21.15.87:0/2569580295 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f0d20077940 con 0x7f0d28157f50 2023-12-16T20:22:18.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.962+0000 7f0d2ce89640 1 -- 172.21.15.87:0/2569580295 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0d280c6960 con 0x7f0d28157f50 2023-12-16T20:22:18.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.967+0000 7f0d1effd640 1 -- 172.21.15.87:0/2569580295 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0d20043020 con 0x7f0d28157f50 2023-12-16T20:22:18.969 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-12-16T20:22:18.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.969+0000 7f0d2ce89640 1 -- 172.21.15.87:0/2569580295 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0d0806aec0 msgr2=0x7f0d0806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:18.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.969+0000 7f0d2ce89640 1 --2- 172.21.15.87:0/2569580295 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0d0806aec0 0x7f0d0806d380 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009ac0 tx=0x7f0d18009190 comp rx=0 tx=0).stop 2023-12-16T20:22:18.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.969+0000 7f0d2ce89640 1 -- 172.21.15.87:0/2569580295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d28157f50 msgr2=0x7f0d28070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:18.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.969+0000 7f0d2ce89640 1 --2- 172.21.15.87:0/2569580295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d28157f50 0x7f0d28070ab0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009f40 tx=0x7f0d20004a40 comp rx=0 tx=0).stop 2023-12-16T20:22:18.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.969+0000 7f0d2ce89640 1 -- 172.21.15.87:0/2569580295 shutdown_connections 2023-12-16T20:22:18.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.969+0000 7f0d2ce89640 1 --2- 172.21.15.87:0/2569580295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d28157f50 0x7f0d28070ab0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:18.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.969+0000 7f0d2ce89640 1 --2- 172.21.15.87:0/2569580295 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0d28151630 0x7f0d2806cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:18.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.969+0000 7f0d2ce89640 1 --2- 172.21.15.87:0/2569580295 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0d0806aec0 0x7f0d0806d380 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:18.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.969+0000 7f0d2ce89640 1 --2- 172.21.15.87:0/2569580295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d280ca130 0x7f0d280c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:18.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.969+0000 7f0d2ce89640 1 -- 172.21.15.87:0/2569580295 >> 172.21.15.87:0/2569580295 conn(0x7f0d28061100 msgr2=0x7f0d2814f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:18.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.969+0000 7f0d2ce89640 1 -- 172.21.15.87:0/2569580295 shutdown_connections 2023-12-16T20:22:18.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:18.969+0000 7f0d2ce89640 1 -- 172.21.15.87:0/2569580295 wait complete. 2023-12-16T20:22:18.983 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T20:22:19.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.080+0000 7f3638d41640 1 Processor -- start 2023-12-16T20:22:19.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.080+0000 7f3638d41640 1 -- start start 2023-12-16T20:22:19.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.081+0000 7f3638d41640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3634153890 0x7f363415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:19.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.081+0000 7f3638d41640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f36340ceef0 0x7f36340cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:19.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.081+0000 7f3638d41640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363415a700 con 0x7f3634153c70 2023-12-16T20:22:19.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.081+0000 7f3638d41640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36340cf840 con 0x7f3634153890 2023-12-16T20:22:19.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.081+0000 7f3638d41640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36340ca870 con 0x7f36340ceef0 2023-12-16T20:22:19.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.083+0000 7f363259c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3634153890 0x7f363415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:19.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.083+0000 7f363259c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3634153890 0x7f363415d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46912/0 (socket says 172.21.15.87:46912) 2023-12-16T20:22:19.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.083+0000 7f363259c640 1 -- 172.21.15.87:0/1883047425 learned_addr learned my addr 172.21.15.87:0/1883047425 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:19.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.084+0000 7f3632d9d640 1 --2- 172.21.15.87:0/1883047425 >> v2:172.21.15.195:3300/0 conn(0x7f36340ceef0 0x7f36340cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.085+0000 7f363259c640 1 -- 172.21.15.87:0/1883047425 >> v2:172.21.15.195:3300/0 conn(0x7f36340ceef0 msgr2=0x7f36340cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.085+0000 7f363259c640 1 --2- 172.21.15.87:0/1883047425 >> v2:172.21.15.195:3300/0 conn(0x7f36340ceef0 0x7f36340cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.085+0000 7f363259c640 1 -- 172.21.15.87:0/1883047425 >> v1:172.21.15.195:6789/0 conn(0x7f3634153c70 legacy=0x7f36340c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.086+0000 7f363259c640 1 -- 172.21.15.87:0/1883047425 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3634159af0 con 0x7f3634153890 2023-12-16T20:22:19.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.088+0000 7f363259c640 1 --2- 172.21.15.87:0/1883047425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3634153890 0x7f363415d950 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f36340c9ab0 tx=0x7f362402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b5226e5efb3def server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:19.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.093+0000 7f3631d9b640 1 -- 172.21.15.87:0/1883047425 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624030860 con 0x7f3634153890 2023-12-16T20:22:19.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.093+0000 7f3631d9b640 1 -- 172.21.15.87:0/1883047425 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36240309c0 con 0x7f3634153890 2023-12-16T20:22:19.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.093+0000 7f3631d9b640 1 -- 172.21.15.87:0/1883047425 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624030d50 con 0x7f3634153890 2023-12-16T20:22:19.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.093+0000 7f3638d41640 1 -- 172.21.15.87:0/1883047425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3634153890 msgr2=0x7f363415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:19.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.093+0000 7f3638d41640 1 --2- 172.21.15.87:0/1883047425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3634153890 0x7f363415d950 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f36340c9ab0 tx=0x7f362402b9a0 comp rx=0 tx=0).stop 2023-12-16T20:22:19.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.093+0000 7f3638d41640 1 -- 172.21.15.87:0/1883047425 shutdown_connections 2023-12-16T20:22:19.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.093+0000 7f3638d41640 1 --2- 172.21.15.87:0/1883047425 >> v2:172.21.15.195:3300/0 conn(0x7f36340ceef0 0x7f36340cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:19.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.093+0000 7f3638d41640 1 --2- 172.21.15.87:0/1883047425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3634153890 0x7f363415d950 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:19.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.093+0000 7f3638d41640 1 -- 172.21.15.87:0/1883047425 >> 172.21.15.87:0/1883047425 conn(0x7f363406ba00 msgr2=0x7f363406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:19.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.094+0000 7f3638d41640 1 -- 172.21.15.87:0/1883047425 shutdown_connections 2023-12-16T20:22:19.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.094+0000 7f3638d41640 1 -- 172.21.15.87:0/1883047425 wait complete. 2023-12-16T20:22:19.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.095+0000 7f3638d41640 1 Processor -- start 2023-12-16T20:22:19.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.095+0000 7f3638d41640 1 -- start start 2023-12-16T20:22:19.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.096+0000 7f3638d41640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340ceef0 0x7f36340c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:19.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.096+0000 7f3638d41640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3634153890 0x7f36340c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:19.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.096+0000 7f3638d41640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3634153c70 0x7f36341556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:19.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.096+0000 7f3638d41640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36341552d0 con 0x7f3634153890 2023-12-16T20:22:19.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.096+0000 7f3638d41640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3634143850 con 0x7f3634153c70 2023-12-16T20:22:19.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.096+0000 7f3638d41640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36340b4100 con 0x7f36340ceef0 2023-12-16T20:22:19.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.097+0000 7f3632d9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3634153c70 0x7f36341556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:19.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.097+0000 7f363259c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340ceef0 0x7f36340c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:19.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.097+0000 7f363259c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340ceef0 0x7f36340c52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:49728/0 (socket says 172.21.15.87:49728) 2023-12-16T20:22:19.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.097+0000 7f363259c640 1 -- 172.21.15.87:0/2166460322 learned_addr learned my addr 172.21.15.87:0/2166460322 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:19.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.101+0000 7f3632d9d640 1 -- 172.21.15.87:0/2166460322 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340ceef0 msgr2=0x7f36340c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:19.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.101+0000 7f3632d9d640 1 --2- 172.21.15.87:0/2166460322 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340ceef0 0x7f36340c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:19.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.101+0000 7f3632d9d640 1 -- 172.21.15.87:0/2166460322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3634153890 msgr2=0x7f36340c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:19.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.101+0000 7f3632d9d640 1 --2- 172.21.15.87:0/2166460322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3634153890 0x7f36340c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:19.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.101+0000 7f3632d9d640 1 -- 172.21.15.87:0/2166460322 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36240094d0 con 0x7f3634153c70 2023-12-16T20:22:19.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.103+0000 7f3632d9d640 1 --2- 172.21.15.87:0/2166460322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3634153c70 0x7f36341556f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f362c007cf0 tx=0x7f362c00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:19.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.107+0000 7f362affd640 1 -- 172.21.15.87:0/2166460322 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c018070 con 0x7f3634153c70 2023-12-16T20:22:19.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.107+0000 7f362affd640 1 -- 172.21.15.87:0/2166460322 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362c00edd0 con 0x7f3634153c70 2023-12-16T20:22:19.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.107+0000 7f362affd640 1 -- 172.21.15.87:0/2166460322 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c003bb0 con 0x7f3634153c70 2023-12-16T20:22:19.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.107+0000 7f3638d41640 1 -- 172.21.15.87:0/2166460322 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36340b43c0 con 0x7f3634153c70 2023-12-16T20:22:19.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.107+0000 7f3638d41640 1 -- 172.21.15.87:0/2166460322 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36340b4c60 con 0x7f3634153c70 2023-12-16T20:22:19.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.109+0000 7f3638d41640 1 -- 172.21.15.87:0/2166460322 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3634155410 con 0x7f3634153c70 2023-12-16T20:22:19.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.127+0000 7f362affd640 1 -- 172.21.15.87:0/2166460322 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f362c014420 con 0x7f3634153c70 2023-12-16T20:22:19.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.127+0000 7f362affd640 1 --2- 172.21.15.87:0/2166460322 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f361406ae70 0x7f361406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:19.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.128+0000 7f363259c640 1 --2- 172.21.15.87:0/2166460322 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f361406ae70 0x7f361406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:19.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.128+0000 7f363259c640 1 --2- 172.21.15.87:0/2166460322 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f361406ae70 0x7f361406d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f362402b9e0 tx=0x7f3624008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:19.133 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.131+0000 7f362affd640 1 -- 172.21.15.87:0/2166460322 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f362c059930 con 0x7f3634153c70 2023-12-16T20:22:19.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.369+0000 7f362affd640 1 -- 172.21.15.87:0/2166460322 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f362c055570 con 0x7f3634153c70 2023-12-16T20:22:19.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.578+0000 7f3638d41640 1 -- 172.21.15.87:0/2166460322 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3634155410 con 0x7f3634153c70 2023-12-16T20:22:19.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.617+0000 7f362affd640 1 -- 172.21.15.87:0/2166460322 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6526 (secure 0 0 0) 0x7f3634155410 con 0x7f3634153c70 2023-12-16T20:22:19.620 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:22:19.620 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2198156124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2198156124},{"type":"v1","addr":"172.21.15.87:6835","nonce":2198156124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3187160209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3187160209},{"type":"v1","addr":"172.21.15.195:6833","nonce":3187160209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3703236183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":3703236183},{"type":"v1","addr":"172.21.15.87:6837","nonce":3703236183}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1942743723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1942743723},{"type":"v1","addr":"172.21.15.87:6839","nonce":1942743723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/3327792325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3327792325},{"type":"v1","addr":"172.21.15.195:6836","nonce":3327792325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T20:21:36.158936+0000","modified":"2023-12-16T20:22:01.721931+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6837/3093855583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3093855583},{"type":"v1","addr":"172.21.15.195:6837","nonce":3093855583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T20:22:19.621 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 10 2023-12-16T20:22:19.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.619+0000 7f3638d41640 1 -- 172.21.15.87:0/2166460322 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f361406ae70 msgr2=0x7f361406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:19.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.619+0000 7f3638d41640 1 --2- 172.21.15.87:0/2166460322 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f361406ae70 0x7f361406d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f362402b9e0 tx=0x7f3624008030 comp rx=0 tx=0).stop 2023-12-16T20:22:19.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.619+0000 7f3638d41640 1 -- 172.21.15.87:0/2166460322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3634153c70 msgr2=0x7f36341556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:19.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.619+0000 7f3638d41640 1 --2- 172.21.15.87:0/2166460322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3634153c70 0x7f36341556f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f362c007cf0 tx=0x7f362c00e4b0 comp rx=0 tx=0).stop 2023-12-16T20:22:19.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.619+0000 7f3638d41640 1 -- 172.21.15.87:0/2166460322 shutdown_connections 2023-12-16T20:22:19.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.619+0000 7f3638d41640 1 --2- 172.21.15.87:0/2166460322 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f361406ae70 0x7f361406d330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:19.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.619+0000 7f3638d41640 1 --2- 172.21.15.87:0/2166460322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3634153c70 0x7f36341556f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:19.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.619+0000 7f3638d41640 1 --2- 172.21.15.87:0/2166460322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3634153890 0x7f36340c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:19.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.619+0000 7f3638d41640 1 --2- 172.21.15.87:0/2166460322 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f36340ceef0 0x7f36340c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:19.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.619+0000 7f3638d41640 1 -- 172.21.15.87:0/2166460322 >> 172.21.15.87:0/2166460322 conn(0x7f363406ba00 msgr2=0x7f363415b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:19.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.620+0000 7f3638d41640 1 -- 172.21.15.87:0/2166460322 shutdown_connections 2023-12-16T20:22:19.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.620+0000 7f3638d41640 1 -- 172.21.15.87:0/2166460322 wait complete. 2023-12-16T20:22:19.633 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:22:19.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.730+0000 7fe598ab4640 1 Processor -- start 2023-12-16T20:22:19.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.730+0000 7fe598ab4640 1 -- start start 2023-12-16T20:22:19.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.731+0000 7fe598ab4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe594153890 0x7fe59415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:19.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.731+0000 7fe598ab4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5940ceef0 0x7fe5940cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:19.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.731+0000 7fe598ab4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59415a700 con 0x7fe594153c70 2023-12-16T20:22:19.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.731+0000 7fe598ab4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5940ca870 con 0x7fe594153890 2023-12-16T20:22:19.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.731+0000 7fe598ab4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe594159af0 con 0x7fe5940ceef0 2023-12-16T20:22:19.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.732+0000 7fe592d9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5940ceef0 0x7fe5940cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:19.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.732+0000 7fe59259c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe594153890 0x7fe59415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:19.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.732+0000 7fe58bfff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe594153c70 0x7fe5940c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60110/0 (socket says 172.21.15.87:60110) 2023-12-16T20:22:19.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.732+0000 7fe58bfff640 1 -- 172.21.15.87:0/600080145 learned_addr learned my addr 172.21.15.87:0/600080145 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:19.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.734+0000 7fe592d9d640 1 -- 172.21.15.87:0/600080145 >> v2:172.21.15.87:3300/0 conn(0x7fe594153890 msgr2=0x7fe59415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:19.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.734+0000 7fe592d9d640 1 --2- 172.21.15.87:0/600080145 >> v2:172.21.15.87:3300/0 conn(0x7fe594153890 0x7fe59415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:19.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.734+0000 7fe592d9d640 1 -- 172.21.15.87:0/600080145 >> v1:172.21.15.87:6789/0 conn(0x7fe594153c70 legacy=0x7fe5940c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:19.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.734+0000 7fe592d9d640 1 -- 172.21.15.87:0/600080145 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe594159dd0 con 0x7fe5940ceef0 2023-12-16T20:22:19.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.736+0000 7fe592d9d640 1 --2- 172.21.15.87:0/600080145 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5940ceef0 0x7fe5940cf320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe58c009d90 tx=0x7fe58c02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eade20b38ef48e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:19.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.740+0000 7fe591d9b640 1 -- 172.21.15.87:0/600080145 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c02cce0 con 0x7fe5940ceef0 2023-12-16T20:22:19.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.740+0000 7fe591d9b640 1 -- 172.21.15.87:0/600080145 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c02ce40 con 0x7fe5940ceef0 2023-12-16T20:22:19.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.740+0000 7fe591d9b640 1 -- 172.21.15.87:0/600080145 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c034660 con 0x7fe5940ceef0 2023-12-16T20:22:19.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.740+0000 7fe598ab4640 1 -- 172.21.15.87:0/600080145 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5940ceef0 msgr2=0x7fe5940cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:19.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.740+0000 7fe598ab4640 1 --2- 172.21.15.87:0/600080145 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5940ceef0 0x7fe5940cf320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe58c009d90 tx=0x7fe58c02bf30 comp rx=0 tx=0).stop 2023-12-16T20:22:19.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.740+0000 7fe598ab4640 1 -- 172.21.15.87:0/600080145 shutdown_connections 2023-12-16T20:22:19.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.740+0000 7fe598ab4640 1 --2- 172.21.15.87:0/600080145 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5940ceef0 0x7fe5940cf320 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:19.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.740+0000 7fe598ab4640 1 --2- 172.21.15.87:0/600080145 >> v2:172.21.15.87:3300/0 conn(0x7fe594153890 0x7fe59415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:19.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.740+0000 7fe598ab4640 1 -- 172.21.15.87:0/600080145 >> 172.21.15.87:0/600080145 conn(0x7fe59406ba00 msgr2=0x7fe59406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:19.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.740+0000 7fe598ab4640 1 -- 172.21.15.87:0/600080145 shutdown_connections 2023-12-16T20:22:19.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.740+0000 7fe598ab4640 1 -- 172.21.15.87:0/600080145 wait complete. 2023-12-16T20:22:19.744 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.742+0000 7fe598ab4640 1 Processor -- start 2023-12-16T20:22:19.744 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.742+0000 7fe598ab4640 1 -- start start 2023-12-16T20:22:19.744 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.742+0000 7fe598ab4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5940ceef0 0x7fe5941efc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:19.744 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.742+0000 7fe598ab4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe594153890 0x7fe5941e5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:19.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.742+0000 7fe598ab4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe594153c70 0x7fe5940cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:19.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.742+0000 7fe598ab4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe594152a70 con 0x7fe594153c70 2023-12-16T20:22:19.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.742+0000 7fe598ab4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5941524b0 con 0x7fe5940ceef0 2023-12-16T20:22:19.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.742+0000 7fe598ab4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe594152790 con 0x7fe594153890 2023-12-16T20:22:19.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.743+0000 7fe592d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe594153c70 0x7fe5940cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:19.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.743+0000 7fe58bfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe594153890 0x7fe5941e5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:19.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.743+0000 7fe59259c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5940ceef0 0x7fe5941efc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:19.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.743+0000 7fe592d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe594153c70 0x7fe5940cd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46946/0 (socket says 172.21.15.87:46946) 2023-12-16T20:22:19.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.743+0000 7fe592d9d640 1 -- 172.21.15.87:0/3853351495 learned_addr learned my addr 172.21.15.87:0/3853351495 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:19.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.746+0000 7fe592d9d640 1 -- 172.21.15.87:0/3853351495 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe594153890 msgr2=0x7fe5941e5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:19.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.746+0000 7fe592d9d640 1 --2- 172.21.15.87:0/3853351495 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe594153890 0x7fe5941e5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:19.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.746+0000 7fe592d9d640 1 -- 172.21.15.87:0/3853351495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5940ceef0 msgr2=0x7fe5941efc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:19.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.746+0000 7fe592d9d640 1 --2- 172.21.15.87:0/3853351495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5940ceef0 0x7fe5941efc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:19.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.746+0000 7fe592d9d640 1 -- 172.21.15.87:0/3853351495 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58c009a70 con 0x7fe594153c70 2023-12-16T20:22:19.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.748+0000 7fe592d9d640 1 --2- 172.21.15.87:0/3853351495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe594153c70 0x7fe5940cd670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe58c009d90 tx=0x7fe58c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:19.754 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.752+0000 7fe58affd640 1 -- 172.21.15.87:0/3853351495 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c03d600 con 0x7fe594153c70 2023-12-16T20:22:19.754 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.752+0000 7fe58affd640 1 -- 172.21.15.87:0/3853351495 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c03d780 con 0x7fe594153c70 2023-12-16T20:22:19.754 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.752+0000 7fe58affd640 1 -- 172.21.15.87:0/3853351495 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c03db30 con 0x7fe594153c70 2023-12-16T20:22:19.754 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.752+0000 7fe598ab4640 1 -- 172.21.15.87:0/3853351495 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5940cce70 con 0x7fe594153c70 2023-12-16T20:22:19.754 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.752+0000 7fe598ab4640 1 -- 172.21.15.87:0/3853351495 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5941e64b0 con 0x7fe594153c70 2023-12-16T20:22:19.755 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.753+0000 7fe598ab4640 1 -- 172.21.15.87:0/3853351495 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5940cd390 con 0x7fe594153c70 2023-12-16T20:22:19.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.772+0000 7fe58affd640 1 -- 172.21.15.87:0/3853351495 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fe58c03b040 con 0x7fe594153c70 2023-12-16T20:22:19.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.772+0000 7fe58affd640 1 --2- 172.21.15.87:0/3853351495 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe57406ae90 0x7fe57406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:19.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.772+0000 7fe59259c640 1 --2- 172.21.15.87:0/3853351495 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe57406ae90 0x7fe57406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:19.775 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:19.772+0000 7fe59259c640 1 --2- 172.21.15.87:0/3853351495 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe57406ae90 0x7fe57406d350 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe584009b40 tx=0x7fe584009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:20.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.007+0000 7fe58affd640 1 -- 172.21.15.87:0/3853351495 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe58c07acd0 con 0x7fe594153c70 2023-12-16T20:22:20.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.007+0000 7fe58affd640 1 -- 172.21.15.87:0/3853351495 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fe58c077010 con 0x7fe594153c70 2023-12-16T20:22:20.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.179+0000 7fe598ab4640 1 -- 172.21.15.87:0/3853351495 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5940cd390 con 0x7fe594153c70 2023-12-16T20:22:20.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.220+0000 7fe58affd640 1 -- 172.21.15.87:0/3853351495 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18702 (secure 0 0 0) 0x7fe5940cd390 con 0x7fe594153c70 2023-12-16T20:22:20.223 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:22:20.223 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":27,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:22:14.653915+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:21:22.654341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T20:21:33.728787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T20:21:34.846119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T20:21:38.657738+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:22:20.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.222+0000 7fe598ab4640 1 -- 172.21.15.87:0/3853351495 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe57406ae90 msgr2=0x7fe57406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:20.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.222+0000 7fe598ab4640 1 --2- 172.21.15.87:0/3853351495 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe57406ae90 0x7fe57406d350 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe584009b40 tx=0x7fe584009190 comp rx=0 tx=0).stop 2023-12-16T20:22:20.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.222+0000 7fe598ab4640 1 -- 172.21.15.87:0/3853351495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe594153c70 msgr2=0x7fe5940cd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:20.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.222+0000 7fe598ab4640 1 --2- 172.21.15.87:0/3853351495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe594153c70 0x7fe5940cd670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe58c009d90 tx=0x7fe58c004a40 comp rx=0 tx=0).stop 2023-12-16T20:22:20.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.222+0000 7fe598ab4640 1 -- 172.21.15.87:0/3853351495 shutdown_connections 2023-12-16T20:22:20.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.222+0000 7fe598ab4640 1 --2- 172.21.15.87:0/3853351495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe594153c70 0x7fe5940cd670 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:20.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.222+0000 7fe598ab4640 1 --2- 172.21.15.87:0/3853351495 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe594153890 0x7fe5941e5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:20.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.222+0000 7fe598ab4640 1 --2- 172.21.15.87:0/3853351495 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe57406ae90 0x7fe57406d350 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:20.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.222+0000 7fe598ab4640 1 --2- 172.21.15.87:0/3853351495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5940ceef0 0x7fe5941efc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:20.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.222+0000 7fe598ab4640 1 -- 172.21.15.87:0/3853351495 >> 172.21.15.87:0/3853351495 conn(0x7fe59406ba00 msgr2=0x7fe5940cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:20.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.223+0000 7fe598ab4640 1 -- 172.21.15.87:0/3853351495 shutdown_connections 2023-12-16T20:22:20.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.223+0000 7fe598ab4640 1 -- 172.21.15.87:0/3853351495 wait complete. 2023-12-16T20:22:20.236 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T20:22:20.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.335+0000 7f7665c56640 1 Processor -- start 2023-12-16T20:22:20.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.335+0000 7f7665c56640 1 -- start start 2023-12-16T20:22:20.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.335+0000 7f7665c56640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7660151510 0x7f76600cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:20.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.335+0000 7f7665c56640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f76600c61a0 0x7f76600cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:20.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.335+0000 7f7665c56640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766015b6e0 con 0x7f76600728b0 2023-12-16T20:22:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.335+0000 7f7665c56640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766015a880 con 0x7f7660151510 2023-12-16T20:22:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.335+0000 7f7665c56640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766006f7e0 con 0x7f76600c61a0 2023-12-16T20:22:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.336+0000 7f765ffff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f76600c61a0 0x7f76600cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.336+0000 7f765effd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f76600728b0 0x7f76600c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60114/0 (socket says 172.21.15.87:60114) 2023-12-16T20:22:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.336+0000 7f765effd640 1 -- 172.21.15.87:0/3392032123 learned_addr learned my addr 172.21.15.87:0/3392032123 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.336+0000 7f765f7fe640 1 --2- 172.21.15.87:0/3392032123 >> v2:172.21.15.87:3300/0 conn(0x7f7660151510 0x7f76600cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.339+0000 7f765ffff640 1 -- 172.21.15.87:0/3392032123 >> v2:172.21.15.87:3300/0 conn(0x7f7660151510 msgr2=0x7f76600cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.339+0000 7f765ffff640 1 --2- 172.21.15.87:0/3392032123 >> v2:172.21.15.87:3300/0 conn(0x7f7660151510 0x7f76600cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.339+0000 7f765ffff640 1 -- 172.21.15.87:0/3392032123 >> v1:172.21.15.87:6789/0 conn(0x7f76600728b0 legacy=0x7f76600c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.339+0000 7f765ffff640 1 -- 172.21.15.87:0/3392032123 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766015aad0 con 0x7f76600c61a0 2023-12-16T20:22:20.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.341+0000 7f765ffff640 1 --2- 172.21.15.87:0/3392032123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76600c61a0 0x7f76600cb370 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7660070bf0 tx=0x7f765802bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f67846d0cb1b89d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:20.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.344+0000 7f765e7fc640 1 -- 172.21.15.87:0/3392032123 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765802cc80 con 0x7f76600c61a0 2023-12-16T20:22:20.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.344+0000 7f765e7fc640 1 -- 172.21.15.87:0/3392032123 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765802cde0 con 0x7f76600c61a0 2023-12-16T20:22:20.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.344+0000 7f765e7fc640 1 -- 172.21.15.87:0/3392032123 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658034660 con 0x7f76600c61a0 2023-12-16T20:22:20.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.345+0000 7f7665c56640 1 -- 172.21.15.87:0/3392032123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76600c61a0 msgr2=0x7f76600cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:20.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.345+0000 7f7665c56640 1 --2- 172.21.15.87:0/3392032123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76600c61a0 0x7f76600cb370 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7660070bf0 tx=0x7f765802bed0 comp rx=0 tx=0).stop 2023-12-16T20:22:20.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.345+0000 7f7665c56640 1 -- 172.21.15.87:0/3392032123 shutdown_connections 2023-12-16T20:22:20.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.345+0000 7f7665c56640 1 --2- 172.21.15.87:0/3392032123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76600c61a0 0x7f76600cb370 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:20.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.345+0000 7f7665c56640 1 --2- 172.21.15.87:0/3392032123 >> v2:172.21.15.87:3300/0 conn(0x7f7660151510 0x7f76600cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:20.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.345+0000 7f7665c56640 1 -- 172.21.15.87:0/3392032123 >> 172.21.15.87:0/3392032123 conn(0x7f766006cd60 msgr2=0x7f766006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:20.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.345+0000 7f7665c56640 1 -- 172.21.15.87:0/3392032123 shutdown_connections 2023-12-16T20:22:20.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.345+0000 7f7665c56640 1 -- 172.21.15.87:0/3392032123 wait complete. 2023-12-16T20:22:20.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.346+0000 7f7665c56640 1 Processor -- start 2023-12-16T20:22:20.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.346+0000 7f7665c56640 1 -- start start 2023-12-16T20:22:20.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.347+0000 7f7665c56640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76600728b0 0x7f76600c3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:20.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.347+0000 7f7665c56640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76600c61a0 0x7f7660146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:20.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.347+0000 7f7665c56640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7660151510 0x7f7660141820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:20.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.347+0000 7f7665c56640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7660143b70 con 0x7f76600728b0 2023-12-16T20:22:20.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.347+0000 7f7665c56640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766015a6b0 con 0x7f7660151510 2023-12-16T20:22:20.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.347+0000 7f7665c56640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76600c3e40 con 0x7f76600c61a0 2023-12-16T20:22:20.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.347+0000 7f765f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76600728b0 0x7f76600c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:20.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.348+0000 7f765f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76600728b0 0x7f76600c3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46962/0 (socket says 172.21.15.87:46962) 2023-12-16T20:22:20.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.348+0000 7f765f7fe640 1 -- 172.21.15.87:0/3520293405 learned_addr learned my addr 172.21.15.87:0/3520293405 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:20.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.348+0000 7f765ffff640 1 --2- 172.21.15.87:0/3520293405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7660151510 0x7f7660141820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:20.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.348+0000 7f765effd640 1 --2- 172.21.15.87:0/3520293405 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76600c61a0 0x7f7660146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:20.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.351+0000 7f765f7fe640 1 -- 172.21.15.87:0/3520293405 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76600c61a0 msgr2=0x7f7660146d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:20.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.351+0000 7f765f7fe640 1 --2- 172.21.15.87:0/3520293405 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76600c61a0 0x7f7660146d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:20.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.351+0000 7f765f7fe640 1 -- 172.21.15.87:0/3520293405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7660151510 msgr2=0x7f7660141820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:20.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.351+0000 7f765f7fe640 1 --2- 172.21.15.87:0/3520293405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7660151510 0x7f7660141820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:20.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.351+0000 7f765f7fe640 1 -- 172.21.15.87:0/3520293405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7658009a70 con 0x7f76600728b0 2023-12-16T20:22:20.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.353+0000 7f765f7fe640 1 --2- 172.21.15.87:0/3520293405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76600728b0 0x7f76600c3800 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f765400e9b0 tx=0x7f765400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:20.359 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.356+0000 7f7647fff640 1 -- 172.21.15.87:0/3520293405 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7654009670 con 0x7f76600728b0 2023-12-16T20:22:20.359 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.356+0000 7f7647fff640 1 -- 172.21.15.87:0/3520293405 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765400c9a0 con 0x7f76600728b0 2023-12-16T20:22:20.359 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.356+0000 7f7647fff640 1 -- 172.21.15.87:0/3520293405 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765400cd50 con 0x7f76600728b0 2023-12-16T20:22:20.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.356+0000 7f7665c56640 1 -- 172.21.15.87:0/3520293405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76600c4470 con 0x7f76600728b0 2023-12-16T20:22:20.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.357+0000 7f7665c56640 1 -- 172.21.15.87:0/3520293405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76600c4a30 con 0x7f76600728b0 2023-12-16T20:22:20.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.357+0000 7f7665c56640 1 -- 172.21.15.87:0/3520293405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7660067500 con 0x7f76600728b0 2023-12-16T20:22:20.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.597+0000 7f7647fff640 1 -- 172.21.15.87:0/3520293405 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f7654013470 con 0x7f76600728b0 2023-12-16T20:22:20.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.598+0000 7f7647fff640 1 --2- 172.21.15.87:0/3520293405 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f764c06aec0 0x7f764c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:20.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.598+0000 7f765effd640 1 --2- 172.21.15.87:0/3520293405 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f764c06aec0 0x7f764c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:20.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.598+0000 7f765effd640 1 --2- 172.21.15.87:0/3520293405 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f764c06aec0 0x7f764c06d380 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f76600c52c0 tx=0x7f7650007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:20.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.613+0000 7f7647fff640 1 -- 172.21.15.87:0/3520293405 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7654058d70 con 0x7f76600728b0 2023-12-16T20:22:20.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.613+0000 7f7647fff640 1 -- 172.21.15.87:0/3520293405 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f76540550b0 con 0x7f76600728b0 2023-12-16T20:22:20.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.839+0000 7f7665c56640 1 -- 172.21.15.87:0/3520293405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76600cb710 con 0x7f76600728b0 2023-12-16T20:22:20.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.851+0000 7f7647fff640 1 -- 172.21.15.87:0/3520293405 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6526 (secure 0 0 0) 0x7f7654017090 con 0x7f76600728b0 2023-12-16T20:22:20.854 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:22:20.854 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2198156124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2198156124},{"type":"v1","addr":"172.21.15.87:6835","nonce":2198156124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3187160209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3187160209},{"type":"v1","addr":"172.21.15.195:6833","nonce":3187160209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3703236183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":3703236183},{"type":"v1","addr":"172.21.15.87:6837","nonce":3703236183}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1942743723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1942743723},{"type":"v1","addr":"172.21.15.87:6839","nonce":1942743723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/3327792325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3327792325},{"type":"v1","addr":"172.21.15.195:6836","nonce":3327792325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T20:21:36.158936+0000","modified":"2023-12-16T20:22:01.721931+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6837/3093855583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3093855583},{"type":"v1","addr":"172.21.15.195:6837","nonce":3093855583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T20:22:20.854 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 10 2023-12-16T20:22:20.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.854+0000 7f7665c56640 1 -- 172.21.15.87:0/3520293405 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f764c06aec0 msgr2=0x7f764c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:20.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.854+0000 7f7665c56640 1 --2- 172.21.15.87:0/3520293405 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f764c06aec0 0x7f764c06d380 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f76600c52c0 tx=0x7f7650007e80 comp rx=0 tx=0).stop 2023-12-16T20:22:20.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.854+0000 7f7665c56640 1 -- 172.21.15.87:0/3520293405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76600728b0 msgr2=0x7f76600c3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:20.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.854+0000 7f7665c56640 1 --2- 172.21.15.87:0/3520293405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76600728b0 0x7f76600c3800 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f765400e9b0 tx=0x7f765400ee70 comp rx=0 tx=0).stop 2023-12-16T20:22:20.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.854+0000 7f7665c56640 1 -- 172.21.15.87:0/3520293405 shutdown_connections 2023-12-16T20:22:20.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.854+0000 7f7665c56640 1 --2- 172.21.15.87:0/3520293405 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f764c06aec0 0x7f764c06d380 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:20.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.854+0000 7f7665c56640 1 --2- 172.21.15.87:0/3520293405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7660151510 0x7f7660141820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:20.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.854+0000 7f7665c56640 1 --2- 172.21.15.87:0/3520293405 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76600c61a0 0x7f7660146d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:20.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.854+0000 7f7665c56640 1 --2- 172.21.15.87:0/3520293405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76600728b0 0x7f76600c3800 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:20.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.854+0000 7f7665c56640 1 -- 172.21.15.87:0/3520293405 >> 172.21.15.87:0/3520293405 conn(0x7f766006cd60 msgr2=0x7f766006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:20.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.854+0000 7f7665c56640 1 -- 172.21.15.87:0/3520293405 shutdown_connections 2023-12-16T20:22:20.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:20.854+0000 7f7665c56640 1 -- 172.21.15.87:0/3520293405 wait complete. 2023-12-16T20:22:21.192 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:22:21.195 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:22:21.471 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-16T20:21:36.158936+0000', 'modified': '2023-12-16T20:22:01.721931+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4251': {'gid': 4251, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.195:6837/3093855583', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6835', 'nonce': 3093855583}, {'type': 'v1', 'addr': '172.21.15.195:6837', 'nonce': 3093855583}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-16T20:22:21.472 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-16T20:22:21.472 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-12-16T20:22:21.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.571+0000 7f724700e640 1 Processor -- start 2023-12-16T20:22:21.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.571+0000 7f724700e640 1 -- start start 2023-12-16T20:22:21.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.571+0000 7f724700e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f724015d950 0x7f724015aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.571+0000 7f724700e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f724015a700 con 0x7f7240153c70 2023-12-16T20:22:21.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.572+0000 7f724700e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72400ca870 con 0x7f7240153890 2023-12-16T20:22:21.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.572+0000 7f724700e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724015dd80 con 0x7f724015d950 2023-12-16T20:22:21.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.572+0000 7f723ffff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7240153c70 0x7f72400ceef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:52224/0 (socket says 172.21.15.87:52224) 2023-12-16T20:22:21.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.572+0000 7f723ffff640 1 -- 172.21.15.87:0/3052227532 learned_addr learned my addr 172.21.15.87:0/3052227532 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:21.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.572+0000 7f72455ab640 1 --2- 172.21.15.87:0/3052227532 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f724015d950 0x7f724015aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:21.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.574+0000 7f723f7fe640 1 -- 172.21.15.87:0/3052227532 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407117869 0 0) 0x7f724015a700 con 0x7f7240153c70 2023-12-16T20:22:21.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.574+0000 7f723f7fe640 1 -- 172.21.15.87:0/3052227532 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7228003520 con 0x7f7240153c70 2023-12-16T20:22:21.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.575+0000 7f723f7fe640 1 -- 172.21.15.87:0/3052227532 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008789367 0 0) 0x7f72400ca870 con 0x7f7240153890 2023-12-16T20:22:21.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.575+0000 7f723f7fe640 1 -- 172.21.15.87:0/3052227532 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f724015a700 con 0x7f7240153890 2023-12-16T20:22:21.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.575+0000 7f72455ab640 1 -- 172.21.15.87:0/3052227532 >> v1:172.21.15.195:6789/0 conn(0x7f7240153890 legacy=0x7f72400c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:21.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.575+0000 7f72455ab640 1 -- 172.21.15.87:0/3052227532 >> v1:172.21.15.87:6789/0 conn(0x7f7240153c70 legacy=0x7f72400ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:21.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.575+0000 7f72455ab640 1 -- 172.21.15.87:0/3052227532 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7240159af0 con 0x7f724015d950 2023-12-16T20:22:21.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.577+0000 7f72455ab640 1 --2- 172.21.15.87:0/3052227532 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f724015d950 0x7f724015aed0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f72300097d0 tx=0x7f723002b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=916e4a1df9d12764 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:21.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.580+0000 7f723f7fe640 1 -- 172.21.15.87:0/3052227532 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7230030880 con 0x7f724015d950 2023-12-16T20:22:21.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.582+0000 7f723f7fe640 1 -- 172.21.15.87:0/3052227532 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72300309e0 con 0x7f724015d950 2023-12-16T20:22:21.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.582+0000 7f723f7fe640 1 -- 172.21.15.87:0/3052227532 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7230030d50 con 0x7f724015d950 2023-12-16T20:22:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.582+0000 7f724700e640 1 -- 172.21.15.87:0/3052227532 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f724015d950 msgr2=0x7f724015aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.582+0000 7f724700e640 1 --2- 172.21.15.87:0/3052227532 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f724015d950 0x7f724015aed0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f72300097d0 tx=0x7f723002b9c0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.582+0000 7f724700e640 1 -- 172.21.15.87:0/3052227532 shutdown_connections 2023-12-16T20:22:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.582+0000 7f724700e640 1 --2- 172.21.15.87:0/3052227532 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f724015d950 0x7f724015aed0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.582+0000 7f724700e640 1 -- 172.21.15.87:0/3052227532 >> 172.21.15.87:0/3052227532 conn(0x7f724006ba00 msgr2=0x7f724006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.582+0000 7f724700e640 1 -- 172.21.15.87:0/3052227532 shutdown_connections 2023-12-16T20:22:21.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.582+0000 7f724700e640 1 -- 172.21.15.87:0/3052227532 wait complete. 2023-12-16T20:22:21.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.583+0000 7f724700e640 1 Processor -- start 2023-12-16T20:22:21.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.583+0000 7f724700e640 1 -- start start 2023-12-16T20:22:21.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.584+0000 7f724700e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7240153890 0x7f724014f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.584+0000 7f724700e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7240153c70 0x7f7240149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.584+0000 7f724700e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f724015d950 0x7f72401511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.584+0000 7f724700e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724014a230 con 0x7f724015d950 2023-12-16T20:22:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.584+0000 7f724700e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7240151710 con 0x7f7240153c70 2023-12-16T20:22:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.584+0000 7f724700e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7240151980 con 0x7f7240153890 2023-12-16T20:22:21.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.585+0000 7f72455ab640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f724015d950 0x7f72401511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:21.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.585+0000 7f7244daa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7240153890 0x7f724014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:21.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.585+0000 7f723ffff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7240153c70 0x7f7240149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:21.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.585+0000 7f7244daa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7240153890 0x7f724014f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:47812/0 (socket says 172.21.15.87:47812) 2023-12-16T20:22:21.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.585+0000 7f7244daa640 1 -- 172.21.15.87:0/3092749769 learned_addr learned my addr 172.21.15.87:0/3092749769 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:21.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.588+0000 7f72455ab640 1 -- 172.21.15.87:0/3092749769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7240153890 msgr2=0x7f724014f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:21.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.588+0000 7f72455ab640 1 --2- 172.21.15.87:0/3092749769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7240153890 0x7f724014f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.588+0000 7f72455ab640 1 -- 172.21.15.87:0/3092749769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7240153c70 msgr2=0x7f7240149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:21.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.588+0000 7f72455ab640 1 --2- 172.21.15.87:0/3092749769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7240153c70 0x7f7240149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.588+0000 7f72455ab640 1 -- 172.21.15.87:0/3092749769 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7230009400 con 0x7f724015d950 2023-12-16T20:22:21.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.592+0000 7f72455ab640 1 --2- 172.21.15.87:0/3092749769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f724015d950 0x7f72401511d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7230033000 tx=0x7f72300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:21.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.594+0000 7f723d7fa640 1 -- 172.21.15.87:0/3092749769 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723003e070 con 0x7f724015d950 2023-12-16T20:22:21.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.594+0000 7f723d7fa640 1 -- 172.21.15.87:0/3092749769 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7230003610 con 0x7f724015d950 2023-12-16T20:22:21.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.594+0000 7f723d7fa640 1 -- 172.21.15.87:0/3092749769 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7230003980 con 0x7f724015d950 2023-12-16T20:22:21.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.594+0000 7f724700e640 1 -- 172.21.15.87:0/3092749769 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72401f2af0 con 0x7f724015d950 2023-12-16T20:22:21.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.594+0000 7f724700e640 1 -- 172.21.15.87:0/3092749769 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72401f30b0 con 0x7f724015d950 2023-12-16T20:22:21.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.597+0000 7f7249ba6740 1 Processor -- start 2023-12-16T20:22:21.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.597+0000 7f7249ba6740 1 -- start start 2023-12-16T20:22:21.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.597+0000 7f7249ba6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b4079360 0x5569b4079740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.597+0000 7f7249ba6740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b40c31e0 0x5569b4079c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.597+0000 7f7249ba6740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b4077dc0 0x5569b40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.597+0000 7f7249ba6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b3fe7090 con 0x5569b4079360 2023-12-16T20:22:21.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.597+0000 7f7249ba6740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b3fe4780 con 0x5569b40c31e0 2023-12-16T20:22:21.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.597+0000 7f7249ba6740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569b3fe0070 con 0x5569b4077dc0 2023-12-16T20:22:21.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.598+0000 7f723ffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b4077dc0 0x5569b40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:21.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.598+0000 7f7244daa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b40c31e0 0x5569b4079c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:21.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.598+0000 7f723ffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b4077dc0 0x5569b40b8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:47822/0 (socket says 172.21.15.87:47822) 2023-12-16T20:22:21.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.598+0000 7f723ffff640 1 -- 172.21.15.87:0/3129487125 learned_addr learned my addr 172.21.15.87:0/3129487125 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:21.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.600+0000 7f723ffff640 1 -- 172.21.15.87:0/3129487125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b40c31e0 msgr2=0x5569b4079c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:21.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.600+0000 7f723ffff640 1 --2- 172.21.15.87:0/3129487125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b40c31e0 0x5569b4079c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.600+0000 7f723ffff640 1 -- 172.21.15.87:0/3129487125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b4079360 msgr2=0x5569b4079740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:21.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.600+0000 7f723ffff640 1 --2- 172.21.15.87:0/3129487125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b4079360 0x5569b4079740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.600+0000 7f723ffff640 1 -- 172.21.15.87:0/3129487125 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569b3fa2d00 con 0x5569b4077dc0 2023-12-16T20:22:21.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.602+0000 7f723ffff640 1 --2- 172.21.15.87:0/3129487125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b4077dc0 0x5569b40b8bc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7234001740 tx=0x7f7234001c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdf9c402d98395a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:21.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.607+0000 7f72267fc640 1 -- 172.21.15.87:0/3129487125 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7234011b60 con 0x5569b4077dc0 2023-12-16T20:22:21.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.607+0000 7f72267fc640 1 -- 172.21.15.87:0/3129487125 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7234011cc0 con 0x5569b4077dc0 2023-12-16T20:22:21.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.607+0000 7f72267fc640 1 -- 172.21.15.87:0/3129487125 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7234007110 con 0x5569b4077dc0 2023-12-16T20:22:21.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.607+0000 7f7249ba6740 1 -- 172.21.15.87:0/3129487125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b4077dc0 msgr2=0x5569b40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:21.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.607+0000 7f7249ba6740 1 --2- 172.21.15.87:0/3129487125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b4077dc0 0x5569b40b8bc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7234001740 tx=0x7f7234001c00 comp rx=0 tx=0).stop 2023-12-16T20:22:21.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.607+0000 7f7249ba6740 1 -- 172.21.15.87:0/3129487125 shutdown_connections 2023-12-16T20:22:21.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.607+0000 7f7249ba6740 1 --2- 172.21.15.87:0/3129487125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b4077dc0 0x5569b40b8bc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.607+0000 7f7249ba6740 1 --2- 172.21.15.87:0/3129487125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b40c31e0 0x5569b4079c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.607+0000 7f7249ba6740 1 --2- 172.21.15.87:0/3129487125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b4079360 0x5569b4079740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.607+0000 7f7249ba6740 1 -- 172.21.15.87:0/3129487125 >> 172.21.15.87:0/3129487125 conn(0x5569b4075d60 msgr2=0x5569b4078410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:21.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.607+0000 7f7249ba6740 1 -- 172.21.15.87:0/3129487125 shutdown_connections 2023-12-16T20:22:21.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.607+0000 7f7249ba6740 1 -- 172.21.15.87:0/3129487125 wait complete. 2023-12-16T20:22:21.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.608+0000 7f7249ba6740 1 -- start start 2023-12-16T20:22:21.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.608+0000 7f7249ba6740 1 Processor -- start 2023-12-16T20:22:21.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.609+0000 7f7249ba6740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b4079360 0x5569b409ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.609+0000 7f7249ba6740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b40c31e0 0x5569b40a1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.609+0000 7f7249ba6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b40c98e0 0x5569b40b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.609+0000 7f7249ba6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b3f99e70 con 0x5569b40c98e0 2023-12-16T20:22:21.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.609+0000 7f7249ba6740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b3f99b10 con 0x5569b4079360 2023-12-16T20:22:21.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.609+0000 7f7249ba6740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569b3f5f2e0 con 0x5569b40c31e0 2023-12-16T20:22:21.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.609+0000 7f7249ba6740 10 client.0 _ll_register_callbacks cb 0x5569b3cf1ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-16T20:22:21.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.609+0000 7f7244daa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b40c31e0 0x5569b40a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:21.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.609+0000 7f723ffff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b4079360 0x5569b409ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:21.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.609+0000 7f7244daa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b40c31e0 0x5569b40a1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:47838/0 (socket says 172.21.15.87:47838) 2023-12-16T20:22:21.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.609+0000 7f7244daa640 1 -- 172.21.15.87:0/170026334 learned_addr learned my addr 172.21.15.87:0/170026334 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:21.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.613+0000 7f723ffff640 1 -- 172.21.15.87:0/170026334 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b40c31e0 msgr2=0x5569b40a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:21.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.613+0000 7f723ffff640 1 --2- 172.21.15.87:0/170026334 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b40c31e0 0x5569b40a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.613+0000 7f723ffff640 1 -- 172.21.15.87:0/170026334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b40c98e0 msgr2=0x5569b40b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:21.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.613+0000 7f723ffff640 1 --2- 172.21.15.87:0/170026334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b40c98e0 0x5569b40b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.613+0000 7f723ffff640 1 -- 172.21.15.87:0/170026334 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7228003520 con 0x5569b4079360 2023-12-16T20:22:21.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.616+0000 7f723ffff640 1 --2- 172.21.15.87:0/170026334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b4079360 0x5569b409ddf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7234017000 tx=0x7f7234000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcb1288db2f931ca server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:21.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.616+0000 7f721f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-12-16T20:22:21.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.616+0000 7f723d7fa640 1 -- 172.21.15.87:0/3092749769 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f7230003ae0 con 0x7f724015d950 2023-12-16T20:22:21.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.616+0000 7f723d7fa640 1 --2- 172.21.15.87:0/3092749769 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f722c06ae30 0x7f722c06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.616+0000 7f7244daa640 1 --2- 172.21.15.87:0/3092749769 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f722c06ae30 0x7f722c06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:21.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.616+0000 7f7244daa640 1 --2- 172.21.15.87:0/3092749769 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f722c06ae30 0x7f722c06d2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7238015470 tx=0x7f7238009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:21.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.619+0000 7f721f7fe640 1 -- 172.21.15.87:0/170026334 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7234005c60 con 0x5569b4079360 2023-12-16T20:22:21.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.619+0000 7f721f7fe640 1 -- 172.21.15.87:0/170026334 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7234005dc0 con 0x5569b4079360 2023-12-16T20:22:21.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.619+0000 7f7249ba6740 1 -- 172.21.15.87:0/170026334 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5569b3fd8f00 con 0x5569b4079360 2023-12-16T20:22:21.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.619+0000 7f723d7fa640 1 -- 172.21.15.87:0/3092749769 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f723007a1c0 con 0x7f724015d950 2023-12-16T20:22:21.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.621+0000 7f721f7fe640 1 -- 172.21.15.87:0/170026334 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72340070f0 con 0x5569b4079360 2023-12-16T20:22:21.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.621+0000 7f7249ba6740 10 client.4675 fetch_fsmap learned FSMap version 10 2023-12-16T20:22:21.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.621+0000 7f7249ba6740 1 -- 172.21.15.87:0/170026334 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x5569b3fde6f0 con 0x5569b4079360 2023-12-16T20:22:21.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.625+0000 7f721f7fe640 1 -- 172.21.15.87:0/170026334 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5569b3fd8f00 con 0x5569b4079360 2023-12-16T20:22:21.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.625+0000 7f721f7fe640 1 -- 172.21.15.87:0/170026334 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 10) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f723401f040 con 0x5569b4079360 2023-12-16T20:22:21.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.625+0000 7f7249ba6740 10 client.4675 fetch_fsmap finished waiting for FSMap version 10 2023-12-16T20:22:21.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.625+0000 7f7249ba6740 10 client.4675 resolve_mds: resolved name 'f' to daemon mds.f 2023-12-16T20:22:21.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.625+0000 7f7249ba6740 20 client.4675 populate_metadata read hostname 'smithi087' 2023-12-16T20:22:21.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.625+0000 7f7249ba6740 1 --2- 172.21.15.87:0/170026334 >> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] conn(0x5569b40b6960 0x5569b40cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.625+0000 7f7249ba6740 4 client.4675 mds_command: new command op to 4251 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-16T20:22:21.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.625+0000 7f7249ba6740 1 -- 172.21.15.87:0/170026334 --> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5569b3fd8c20 con 0x5569b40b6960 2023-12-16T20:22:21.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.626+0000 7f723ffff640 1 --2- 172.21.15.87:0/170026334 >> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] conn(0x5569b40b6960 0x5569b40cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:21.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.630+0000 7f723ffff640 1 --2- 172.21.15.87:0/170026334 >> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] conn(0x5569b40b6960 0x5569b40cd570 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c85f1e4017fcdc85 server_cookie=3eb97b108b98098e in_seq=0 out_seq=0 2023-12-16T20:22:21.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.630+0000 7f721f7fe640 10 client.4675 ms_handle_connect on v2:172.21.15.195:6835/3093855583 2023-12-16T20:22:21.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.647+0000 7f721f7fe640 1 -- 172.21.15.87:0/170026334 <== mds.0 v2:172.21.15.195:6835/3093855583 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5569b3fd8c20 con 0x5569b40b6960 2023-12-16T20:22:21.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.647+0000 7f721f7fe640 10 client.4675 handle_command_reply: tid=0 2023-12-16T20:22:21.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.647+0000 7f7249ba6740 1 client.4675 shutdown 2023-12-16T20:22:21.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.647+0000 7f7249ba6740 1 -- 172.21.15.87:0/170026334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b4079360 msgr2=0x5569b409ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:21.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.647+0000 7f7249ba6740 1 --2- 172.21.15.87:0/170026334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b4079360 0x5569b409ddf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7234017000 tx=0x7f7234000ed0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.647+0000 7f7249ba6740 1 -- 172.21.15.87:0/170026334 shutdown_connections 2023-12-16T20:22:21.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.647+0000 7f7249ba6740 1 --2- 172.21.15.87:0/170026334 >> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] conn(0x5569b40b6960 0x5569b40cd570 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.647+0000 7f7249ba6740 1 --2- 172.21.15.87:0/170026334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b40c98e0 0x5569b40b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.647+0000 7f721f7fe640 0 client.4675 ms_handle_reset on v2:172.21.15.195:6835/3093855583 2023-12-16T20:22:21.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.647+0000 7f7249ba6740 1 --2- 172.21.15.87:0/170026334 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b40c31e0 0x5569b40a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.647+0000 7f7249ba6740 1 --2- 172.21.15.87:0/170026334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b4079360 0x5569b409ddf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.647+0000 7f7249ba6740 1 -- 172.21.15.87:0/170026334 >> 172.21.15.87:0/170026334 conn(0x5569b4077dc0 msgr2=0x5569b40ba550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:21.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.647+0000 7f7249ba6740 1 -- 172.21.15.87:0/170026334 shutdown_connections 2023-12-16T20:22:21.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.647+0000 7f7249ba6740 1 -- 172.21.15.87:0/170026334 wait complete. 2023-12-16T20:22:21.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.647+0000 7f7249ba6740 20 client.4675 trim_cache size 0 max 16384 2023-12-16T20:22:21.667 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.665+0000 7f7249ba6740 1 Processor -- start 2023-12-16T20:22:21.667 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.665+0000 7f7249ba6740 1 -- start start 2023-12-16T20:22:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.665+0000 7f7249ba6740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b4079360 0x5569b40d3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.665+0000 7f7249ba6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b40b6960 0x5569b40782d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.665+0000 7f7249ba6740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b40c31e0 0x5569b4078810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.665+0000 7f7249ba6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b40b75a0 con 0x5569b40b6960 2023-12-16T20:22:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.665+0000 7f7249ba6740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b40b5f90 con 0x5569b40c31e0 2023-12-16T20:22:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.665+0000 7f7249ba6740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569b40b7380 con 0x5569b4079360 2023-12-16T20:22:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.666+0000 7f7244daa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b4079360 0x5569b40d3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:21.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.668+0000 7f7244daa640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b4079360 0x5569b40d3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:47844/0 (socket says 172.21.15.87:47844) 2023-12-16T20:22:21.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.668+0000 7f7244daa640 1 -- 172.21.15.87:0/226954073 learned_addr learned my addr 172.21.15.87:0/226954073 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:21.710 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.708+0000 7f723ffff640 1 --2- 172.21.15.87:0/226954073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b40b6960 0x5569b40782d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:21.710 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.708+0000 7f72455ab640 1 --2- 172.21.15.87:0/226954073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b40c31e0 0x5569b4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.711+0000 7f723ffff640 1 -- 172.21.15.87:0/226954073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b4079360 msgr2=0x5569b40d3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.711+0000 7f723ffff640 1 --2- 172.21.15.87:0/226954073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b4079360 0x5569b40d3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.711+0000 7f723ffff640 1 -- 172.21.15.87:0/226954073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b40c31e0 msgr2=0x5569b4078810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.711+0000 7f723ffff640 1 --2- 172.21.15.87:0/226954073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b40c31e0 0x5569b4078810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.711+0000 7f723ffff640 1 -- 172.21.15.87:0/226954073 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569b3f7bd70 con 0x5569b40b6960 2023-12-16T20:22:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.714+0000 7f723ffff640 1 --2- 172.21.15.87:0/226954073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b40b6960 0x5569b40782d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f723401e420 tx=0x7f7234020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3793f17645542c10 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:21.722 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.720+0000 7f7226ffd640 1 -- 172.21.15.87:0/226954073 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7234037040 con 0x5569b40b6960 2023-12-16T20:22:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.720+0000 7f7226ffd640 1 -- 172.21.15.87:0/226954073 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7234000e40 con 0x5569b40b6960 2023-12-16T20:22:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.720+0000 7f7226ffd640 1 -- 172.21.15.87:0/226954073 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7234029530 con 0x5569b40b6960 2023-12-16T20:22:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.721+0000 7f7249ba6740 1 -- 172.21.15.87:0/226954073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b40b6960 msgr2=0x5569b40782d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.721+0000 7f7249ba6740 1 --2- 172.21.15.87:0/226954073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b40b6960 0x5569b40782d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f723401e420 tx=0x7f7234020000 comp rx=0 tx=0).stop 2023-12-16T20:22:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.721+0000 7f7249ba6740 1 -- 172.21.15.87:0/226954073 shutdown_connections 2023-12-16T20:22:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.721+0000 7f7249ba6740 1 --2- 172.21.15.87:0/226954073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b40c31e0 0x5569b4078810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.721+0000 7f7249ba6740 1 --2- 172.21.15.87:0/226954073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b40b6960 0x5569b40782d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.721+0000 7f7249ba6740 1 --2- 172.21.15.87:0/226954073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b4079360 0x5569b40d3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.721+0000 7f7249ba6740 1 -- 172.21.15.87:0/226954073 >> 172.21.15.87:0/226954073 conn(0x5569b4077dc0 msgr2=0x5569b40b5470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.721+0000 7f7249ba6740 1 -- 172.21.15.87:0/226954073 shutdown_connections 2023-12-16T20:22:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.721+0000 7f7249ba6740 1 -- 172.21.15.87:0/226954073 wait complete. 2023-12-16T20:22:21.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.722+0000 7f7249ba6740 1 -- start start 2023-12-16T20:22:21.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.722+0000 7f7249ba6740 1 Processor -- start 2023-12-16T20:22:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.723+0000 7f7249ba6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b4079360 0x5569b411e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.723+0000 7f7249ba6740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b40b6960 0x5569b40b8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.723+0000 7f7249ba6740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b40c31e0 0x5569b40cc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.723+0000 7f7249ba6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b40a0c40 con 0x5569b4079360 2023-12-16T20:22:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.723+0000 7f7249ba6740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b40b94a0 con 0x5569b40b6960 2023-12-16T20:22:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.723+0000 7f7249ba6740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569b40bd760 con 0x5569b40c31e0 2023-12-16T20:22:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.723+0000 7f7249ba6740 10 client.0 _ll_register_callbacks cb 0x7f72340013b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-16T20:22:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.723+0000 7f7244daa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b4079360 0x5569b411e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.724+0000 7f723ffff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b40b6960 0x5569b40b8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.724+0000 7f72455ab640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b40c31e0 0x5569b40cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:21.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.724+0000 7f7244daa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b4079360 0x5569b411e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35592/0 (socket says 172.21.15.87:35592) 2023-12-16T20:22:21.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.724+0000 7f72455ab640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b40c31e0 0x5569b40cc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:47856/0 (socket says 172.21.15.87:47856) 2023-12-16T20:22:21.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.724+0000 7f7244daa640 1 -- 172.21.15.87:0/3548055725 learned_addr learned my addr 172.21.15.87:0/3548055725 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:21.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.727+0000 7f7244daa640 1 -- 172.21.15.87:0/3548055725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b40c31e0 msgr2=0x5569b40cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:21.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.727+0000 7f7244daa640 1 --2- 172.21.15.87:0/3548055725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b40c31e0 0x5569b40cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.727+0000 7f7244daa640 1 -- 172.21.15.87:0/3548055725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b40b6960 msgr2=0x5569b40b8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:21.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.727+0000 7f7244daa640 1 --2- 172.21.15.87:0/3548055725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b40b6960 0x5569b40b8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.727+0000 7f7244daa640 1 -- 172.21.15.87:0/3548055725 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5569b3fde6f0 con 0x5569b4079360 2023-12-16T20:22:21.731 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.729+0000 7f7244daa640 1 --2- 172.21.15.87:0/3548055725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b4079360 0x5569b411e320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7238023bf0 tx=0x7f72380014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a716453eb1e1b825 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:21.731 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.729+0000 7f721f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2023-12-16T20:22:21.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.732+0000 7f721f7fe640 1 -- 172.21.15.87:0/3548055725 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7238016bf0 con 0x5569b4079360 2023-12-16T20:22:21.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.732+0000 7f721f7fe640 1 -- 172.21.15.87:0/3548055725 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7238016d50 con 0x5569b4079360 2023-12-16T20:22:21.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.732+0000 7f7249ba6740 1 -- 172.21.15.87:0/3548055725 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7234011cc0 con 0x5569b4079360 2023-12-16T20:22:21.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.733+0000 7f721f7fe640 1 -- 172.21.15.87:0/3548055725 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f723802c440 con 0x5569b4079360 2023-12-16T20:22:21.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.735+0000 7f7249ba6740 10 client.4722 fetch_fsmap learned FSMap version 10 2023-12-16T20:22:21.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.735+0000 7f7249ba6740 1 -- 172.21.15.87:0/3548055725 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x5569b3fa1560 con 0x5569b4079360 2023-12-16T20:22:21.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.740+0000 7f721f7fe640 1 -- 172.21.15.87:0/3548055725 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7234011cc0 con 0x5569b4079360 2023-12-16T20:22:21.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.740+0000 7f721f7fe640 1 -- 172.21.15.87:0/3548055725 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 10) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f7238012050 con 0x5569b4079360 2023-12-16T20:22:21.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.740+0000 7f7249ba6740 10 client.4722 fetch_fsmap finished waiting for FSMap version 10 2023-12-16T20:22:21.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.740+0000 7f7249ba6740 10 client.4722 resolve_mds: resolved name 'f' to daemon mds.f 2023-12-16T20:22:21.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.740+0000 7f7249ba6740 20 client.4722 populate_metadata read hostname 'smithi087' 2023-12-16T20:22:21.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.740+0000 7f7249ba6740 1 --2- 172.21.15.87:0/3548055725 >> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] conn(0x5569b40c98e0 0x5569b4073c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:21.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.740+0000 7f7249ba6740 4 client.4722 mds_command: new command op to 4251 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-16T20:22:21.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.740+0000 7f7249ba6740 1 -- 172.21.15.87:0/3548055725 --> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5569b3ce06c0 con 0x5569b40c98e0 2023-12-16T20:22:21.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.740+0000 7f723ffff640 1 --2- 172.21.15.87:0/3548055725 >> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] conn(0x5569b40c98e0 0x5569b4073c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:21.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.744+0000 7f723ffff640 1 --2- 172.21.15.87:0/3548055725 >> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] conn(0x5569b40c98e0 0x5569b4073c20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e2cbf193ebac17b server_cookie=b32c886c14b17832 in_seq=0 out_seq=0 2023-12-16T20:22:21.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.744+0000 7f721f7fe640 10 client.4722 ms_handle_connect on v2:172.21.15.195:6835/3093855583 2023-12-16T20:22:21.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.747+0000 7f721f7fe640 1 -- 172.21.15.87:0/3548055725 <== mds.0 v2:172.21.15.195:6835/3093855583 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5569b3ce06c0 con 0x5569b40c98e0 2023-12-16T20:22:21.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.747+0000 7f721f7fe640 10 client.4722 handle_command_reply: tid=0 2023-12-16T20:22:21.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.747+0000 7f7249ba6740 1 client.4722 shutdown 2023-12-16T20:22:21.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.747+0000 7f7249ba6740 1 -- 172.21.15.87:0/3548055725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b4079360 msgr2=0x5569b411e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:21.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.747+0000 7f7249ba6740 1 --2- 172.21.15.87:0/3548055725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b4079360 0x5569b411e320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7238023bf0 tx=0x7f72380014d0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.747+0000 7f7249ba6740 1 -- 172.21.15.87:0/3548055725 shutdown_connections 2023-12-16T20:22:21.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.747+0000 7f7249ba6740 1 --2- 172.21.15.87:0/3548055725 >> [v2:172.21.15.195:6835/3093855583,v1:172.21.15.195:6837/3093855583] conn(0x5569b40c98e0 0x5569b4073c20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.747+0000 7f7249ba6740 1 --2- 172.21.15.87:0/3548055725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5569b40c31e0 0x5569b40cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.747+0000 7f7249ba6740 1 --2- 172.21.15.87:0/3548055725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b40b6960 0x5569b40b8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.747+0000 7f7249ba6740 1 --2- 172.21.15.87:0/3548055725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569b4079360 0x5569b411e320 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.747+0000 7f721f7fe640 0 client.4722 ms_handle_reset on v2:172.21.15.195:6835/3093855583 2023-12-16T20:22:21.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.747+0000 7f7249ba6740 1 -- 172.21.15.87:0/3548055725 >> 172.21.15.87:0/3548055725 conn(0x5569b4077dc0 msgr2=0x5569b40b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:21.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.747+0000 7f7249ba6740 1 -- 172.21.15.87:0/3548055725 shutdown_connections 2023-12-16T20:22:21.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.747+0000 7f7249ba6740 1 -- 172.21.15.87:0/3548055725 wait complete. 2023-12-16T20:22:21.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.747+0000 7f7249ba6740 20 client.4722 trim_cache size 0 max 16384 2023-12-16T20:22:21.750 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-12-16T20:22:21.750 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "281751e9-025f-43bb-9b42-7cc76907fa5a", 2023-12-16T20:22:21.750 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 0, 2023-12-16T20:22:21.750 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4251, 2023-12-16T20:22:21.750 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2023-12-16T20:22:21.750 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2023-12-16T20:22:21.751 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2023-12-16T20:22:21.751 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 45.078343336000003, 2023-12-16T20:22:21.751 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 10, 2023-12-16T20:22:21.751 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 27, 2023-12-16T20:22:21.751 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 25, 2023-12-16T20:22:21.751 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 53.451180932 2023-12-16T20:22:21.751 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-12-16T20:22:21.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.748+0000 7f724700e640 1 -- 172.21.15.87:0/3092749769 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f722c06ae30 msgr2=0x7f722c06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:21.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.748+0000 7f724700e640 1 --2- 172.21.15.87:0/3092749769 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f722c06ae30 0x7f722c06d2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7238015470 tx=0x7f7238009040 comp rx=0 tx=0).stop 2023-12-16T20:22:21.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.748+0000 7f724700e640 1 -- 172.21.15.87:0/3092749769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f724015d950 msgr2=0x7f72401511d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:21.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.748+0000 7f724700e640 1 --2- 172.21.15.87:0/3092749769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f724015d950 0x7f72401511d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7230033000 tx=0x7f72300046c0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.748+0000 7f724700e640 1 -- 172.21.15.87:0/3092749769 shutdown_connections 2023-12-16T20:22:21.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.748+0000 7f724700e640 1 --2- 172.21.15.87:0/3092749769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f724015d950 0x7f72401511d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.748+0000 7f724700e640 1 --2- 172.21.15.87:0/3092749769 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f722c06ae30 0x7f722c06d2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.748+0000 7f724700e640 1 --2- 172.21.15.87:0/3092749769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7240153c70 0x7f7240149cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.748+0000 7f724700e640 1 --2- 172.21.15.87:0/3092749769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7240153890 0x7f724014f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:21.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.748+0000 7f724700e640 1 -- 172.21.15.87:0/3092749769 >> 172.21.15.87:0/3092749769 conn(0x7f724006ba00 msgr2=0x7f7240158700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:21.753 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.748+0000 7f724700e640 1 -- 172.21.15.87:0/3092749769 shutdown_connections 2023-12-16T20:22:21.753 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:21.748+0000 7f724700e640 1 -- 172.21.15.87:0/3092749769 wait complete. 2023-12-16T20:22:21.760 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-16T20:22:21.772 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-16T20:22:21.772 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-12-16T20:22:21.772 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-12-16T20:22:21.772 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-16T20:22:21.772 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T20:22:21.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:21.772 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2023-12-16T20:22:21.787 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-16T20:22:21.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:21.788 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-16T20:22:21.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:21.855 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2023-12-16T20:22:21.953 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-16T20:22:21.953 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T20:22:22.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.053+0000 7f598f415640 1 Processor -- start 2023-12-16T20:22:22.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.053+0000 7f598f415640 1 -- start start 2023-12-16T20:22:22.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.054+0000 7f598f415640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5988151510 0x7f59880cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:22.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.054+0000 7f598f415640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59880c61a0 0x7f59880cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:22.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.054+0000 7f598f415640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598815b6e0 con 0x7f59880728b0 2023-12-16T20:22:22.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.054+0000 7f598f415640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f598815a880 con 0x7f5988151510 2023-12-16T20:22:22.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.054+0000 7f598f415640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598806f7e0 con 0x7f59880c61a0 2023-12-16T20:22:22.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.054+0000 7f598d1b1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5988151510 0x7f59880cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:22.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.054+0000 7f598d9b2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59880c61a0 0x7f59880cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:22.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.054+0000 7f598c9b0640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f59880728b0 0x7f59880c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:39216/0 (socket says 172.21.15.87:39216) 2023-12-16T20:22:22.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.054+0000 7f598c9b0640 1 -- 172.21.15.87:0/473421886 learned_addr learned my addr 172.21.15.87:0/473421886 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:22:22.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.057+0000 7f598d1b1640 1 -- 172.21.15.87:0/473421886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59880c61a0 msgr2=0x7f59880cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:22:22.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.057+0000 7f598d1b1640 1 --2- 172.21.15.87:0/473421886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59880c61a0 0x7f59880cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:22.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.057+0000 7f598d1b1640 1 -- 172.21.15.87:0/473421886 >> v1:172.21.15.195:6789/0 conn(0x7f59880728b0 legacy=0x7f59880c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:22.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.057+0000 7f598d1b1640 1 -- 172.21.15.87:0/473421886 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598815aad0 con 0x7f5988151510 2023-12-16T20:22:22.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.058+0000 7f598d1b1640 1 --2- 172.21.15.87:0/473421886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5988151510 0x7f59880cae30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f59840097a0 tx=0x7f598402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4748a1e3c5d785fa server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:22.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.062+0000 7f597ffff640 1 -- 172.21.15.87:0/473421886 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984031830 con 0x7f5988151510 2023-12-16T20:22:22.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.062+0000 7f597ffff640 1 -- 172.21.15.87:0/473421886 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5984031990 con 0x7f5988151510 2023-12-16T20:22:22.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.062+0000 7f597ffff640 1 -- 172.21.15.87:0/473421886 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984031d20 con 0x7f5988151510 2023-12-16T20:22:22.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.063+0000 7f598f415640 1 -- 172.21.15.87:0/473421886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5988151510 msgr2=0x7f59880cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:22.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.063+0000 7f598f415640 1 --2- 172.21.15.87:0/473421886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5988151510 0x7f59880cae30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f59840097a0 tx=0x7f598402b8d0 comp rx=0 tx=0).stop 2023-12-16T20:22:22.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.063+0000 7f598f415640 1 -- 172.21.15.87:0/473421886 shutdown_connections 2023-12-16T20:22:22.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.063+0000 7f598f415640 1 --2- 172.21.15.87:0/473421886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59880c61a0 0x7f59880cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:22.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.063+0000 7f598f415640 1 --2- 172.21.15.87:0/473421886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5988151510 0x7f59880cae30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:22.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.063+0000 7f598f415640 1 -- 172.21.15.87:0/473421886 >> 172.21.15.87:0/473421886 conn(0x7f598806cd60 msgr2=0x7f598806d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:22.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.063+0000 7f598f415640 1 -- 172.21.15.87:0/473421886 shutdown_connections 2023-12-16T20:22:22.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.063+0000 7f598f415640 1 -- 172.21.15.87:0/473421886 wait complete. 2023-12-16T20:22:22.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.064+0000 7f598f415640 1 Processor -- start 2023-12-16T20:22:22.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.064+0000 7f598f415640 1 -- start start 2023-12-16T20:22:22.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.065+0000 7f598f415640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59880728b0 0x7f5988145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:22.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.065+0000 7f598f415640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59880c61a0 0x7f59881415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:22.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.065+0000 7f598f415640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5988151510 0x7f5988141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:22.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.065+0000 7f598f415640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5988143670 con 0x7f59880728b0 2023-12-16T20:22:22.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.065+0000 7f598f415640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5988143950 con 0x7f5988151510 2023-12-16T20:22:22.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.065+0000 7f598f415640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5988143c30 con 0x7f59880c61a0 2023-12-16T20:22:22.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.065+0000 7f598d1b1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59880728b0 0x7f5988145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:22.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.065+0000 7f598c9b0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59880c61a0 0x7f59881415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:22.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.065+0000 7f598d9b2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5988151510 0x7f5988141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:22.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.065+0000 7f598d1b1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59880728b0 0x7f5988145ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35600/0 (socket says 172.21.15.87:35600) 2023-12-16T20:22:22.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.065+0000 7f598d1b1640 1 -- 172.21.15.87:0/4090446097 learned_addr learned my addr 172.21.15.87:0/4090446097 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:22:22.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.068+0000 7f598d1b1640 1 -- 172.21.15.87:0/4090446097 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59880c61a0 msgr2=0x7f59881415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:22.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.069+0000 7f598d1b1640 1 --2- 172.21.15.87:0/4090446097 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59880c61a0 0x7f59881415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:22.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.069+0000 7f598d1b1640 1 -- 172.21.15.87:0/4090446097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5988151510 msgr2=0x7f5988141b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:22.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.069+0000 7f598d1b1640 1 --2- 172.21.15.87:0/4090446097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5988151510 0x7f5988141b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:22.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.069+0000 7f598d1b1640 1 -- 172.21.15.87:0/4090446097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5984009400 con 0x7f59880728b0 2023-12-16T20:22:22.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.071+0000 7f598d1b1640 1 --2- 172.21.15.87:0/4090446097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59880728b0 0x7f5988145ca0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f59840098c0 tx=0x7f59840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:22.075 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.074+0000 7f597dffb640 1 -- 172.21.15.87:0/4090446097 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598403b9f0 con 0x7f59880728b0 2023-12-16T20:22:22.075 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.074+0000 7f597dffb640 1 -- 172.21.15.87:0/4090446097 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598403bb70 con 0x7f59880728b0 2023-12-16T20:22:22.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.074+0000 7f597dffb640 1 -- 172.21.15.87:0/4090446097 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59840453f0 con 0x7f59880728b0 2023-12-16T20:22:22.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.074+0000 7f598f415640 1 -- 172.21.15.87:0/4090446097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5988143f10 con 0x7f59880728b0 2023-12-16T20:22:22.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.074+0000 7f598f415640 1 -- 172.21.15.87:0/4090446097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59881461e0 con 0x7f59880728b0 2023-12-16T20:22:22.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.075+0000 7f598f415640 1 -- 172.21.15.87:0/4090446097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59881440d0 con 0x7f59880728b0 2023-12-16T20:22:22.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.092+0000 7f597dffb640 1 -- 172.21.15.87:0/4090446097 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f598404e450 con 0x7f59880728b0 2023-12-16T20:22:22.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.093+0000 7f597dffb640 1 --2- 172.21.15.87:0/4090446097 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f596c06ae70 0x7f596c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:22:22.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.093+0000 7f598c9b0640 1 --2- 172.21.15.87:0/4090446097 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f596c06ae70 0x7f596c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:22:22.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.093+0000 7f598c9b0640 1 --2- 172.21.15.87:0/4090446097 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f596c06ae70 0x7f596c06d330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f598814f5f0 tx=0x7f5978007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:22:22.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.096+0000 7f597dffb640 1 -- 172.21.15.87:0/4090446097 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f598407a800 con 0x7f59880728b0 2023-12-16T20:22:22.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.329+0000 7f597dffb640 1 -- 172.21.15.87:0/4090446097 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f5984076b40 con 0x7f59880728b0 2023-12-16T20:22:22.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.548+0000 7f598f415640 1 -- 172.21.15.87:0/4090446097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5988067500 con 0x7f59880728b0 2023-12-16T20:22:22.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.554+0000 7f597dffb640 1 -- 172.21.15.87:0/4090446097 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v10) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5984035070 con 0x7f59880728b0 2023-12-16T20:22:22.556 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-16T20:22:22.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.556+0000 7f598f415640 1 -- 172.21.15.87:0/4090446097 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f596c06ae70 msgr2=0x7f596c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:22.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.556+0000 7f598f415640 1 --2- 172.21.15.87:0/4090446097 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f596c06ae70 0x7f596c06d330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f598814f5f0 tx=0x7f5978007e80 comp rx=0 tx=0).stop 2023-12-16T20:22:22.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.556+0000 7f598f415640 1 -- 172.21.15.87:0/4090446097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59880728b0 msgr2=0x7f5988145ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:22:22.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.556+0000 7f598f415640 1 --2- 172.21.15.87:0/4090446097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59880728b0 0x7f5988145ca0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f59840098c0 tx=0x7f59840046c0 comp rx=0 tx=0).stop 2023-12-16T20:22:22.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.556+0000 7f598f415640 1 -- 172.21.15.87:0/4090446097 shutdown_connections 2023-12-16T20:22:22.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.556+0000 7f598f415640 1 --2- 172.21.15.87:0/4090446097 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f596c06ae70 0x7f596c06d330 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:22.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.556+0000 7f598f415640 1 --2- 172.21.15.87:0/4090446097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5988151510 0x7f5988141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:22.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.556+0000 7f598f415640 1 --2- 172.21.15.87:0/4090446097 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f59880c61a0 0x7f59881415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:22.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.556+0000 7f598f415640 1 --2- 172.21.15.87:0/4090446097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59880728b0 0x7f5988145ca0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:22:22.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.556+0000 7f598f415640 1 -- 172.21.15.87:0/4090446097 >> 172.21.15.87:0/4090446097 conn(0x7f598806cd60 msgr2=0x7f598814d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:22:22.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.556+0000 7f598f415640 1 -- 172.21.15.87:0/4090446097 shutdown_connections 2023-12-16T20:22:22.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:22.556+0000 7f598f415640 1 -- 172.21.15.87:0/4090446097 wait complete. 2023-12-16T20:22:22.569 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-16T20:22:22.569 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T20:22:22.569 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2023-12-16T20:22:22.569 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-16T20:22:22.569 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T20:22:22.569 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-16T20:22:22.569 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-16T20:22:22.569 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T20:22:22.569 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T20:22:22.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:22.570 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2023-12-16T20:22:22.585 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T20:22:22.585 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T20:22:22.586 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T20:22:22.586 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-12-16T20:22:22.586 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2023-12-16T20:22:22.586 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-12-16T20:22:22.586 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T20:22:22.586 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2023-12-16T20:22:22.586 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2023-12-16T20:22:22.586 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T20:22:22.586 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2023-12-16T20:22:22.586 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2023-12-16T20:22:22.586 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T20:22:22.586 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2023-12-16T20:22:22.586 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T20:22:22.586 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2023-12-16T20:22:22.587 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-16T20:22:22.587 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42226sec preferred_lft 42226sec 2023-12-16T20:22:22.587 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2023-12-16T20:22:22.587 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-12-16T20:22:22.587 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-16T20:22:22.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:22.587 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-12-16T20:22:22.587 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-12-16T20:22:22.587 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add name ceph-brx type bridge 2023-12-16T20:22:22.587 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr flush dev ceph-brx 2023-12-16T20:22:22.587 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set ceph-brx up 2023-12-16T20:22:22.588 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-16T20:22:22.588 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-12-16T20:22:22.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:22.696 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T20:22:22.722 INFO:teuthology.orchestra.run.smithi087.stdout:1 2023-12-16T20:22:22.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:22.724 DEBUG:teuthology.orchestra.run.smithi087:> route 2023-12-16T20:22:22.781 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2023-12-16T20:22:22.781 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T20:22:22.781 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-16T20:22:22.782 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-16T20:22:22.782 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T20:22:22.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:22.782 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-12-16T20:22:22.782 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-12-16T20:22:22.782 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-16T20:22:22.782 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-16T20:22:22.782 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-16T20:22:22.782 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-12-16T20:22:22.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:22.890 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2023-12-16T20:22:22.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:22.909 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2023-12-16T20:22:22.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:22.967 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-12-16T20:22:22.967 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-12-16T20:22:22.968 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T20:22:22.968 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-16T20:22:22.968 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-12-16T20:22:23.051 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-16T20:22:23.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:23.052 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-12-16T20:22:23.052 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-12-16T20:22:23.052 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-16T20:22:23.052 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-16T20:22:23.052 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-16T20:22:23.052 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-16T20:22:23.052 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-16T20:22:23.052 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-12-16T20:22:23.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:23.179 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-12-16T20:22:23.179 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-12-16T20:22:23.179 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2023-12-16T20:22:23.179 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.0 master ceph-brx 2023-12-16T20:22:23.179 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-12-16T20:22:23.221 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-12-16T20:22:23.221 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T20:22:23.221 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-16T20:22:23.276 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-16T20:22:23.276 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T20:22:23.276 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-16T20:22:23.330 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-16T20:22:23.330 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2023-12-16T20:22:23.400 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T20:22:23.456 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2023-12-16T20:22:23.456 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2023-12-16T20:22:23.456 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2023-12-16T20:22:23.456 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2023-12-16T20:22:23.456 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2023-12-16T20:22:23.456 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2023-12-16T20:22:23.456 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2023-12-16T20:22:23.456 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2023-12-16T20:22:23.456 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2023-12-16T20:22:23.456 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2023-12-16T20:22:23.457 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2023-12-16T20:22:23.457 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2023-12-16T20:22:23.457 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T20:22:23.457 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2023-12-16T20:22:23.457 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2023-12-16T20:22:23.457 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2023-12-16T20:22:23.457 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2023-12-16T20:22:23.457 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2023-12-16T20:22:23.457 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2023-12-16T20:22:23.457 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T20:22:23.457 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T20:22:23.457 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T20:22:23.457 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T20:22:23.458 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2023-12-16T20:22:23.458 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2023-12-16T20:22:23.458 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T20:22:23.458 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T20:22:23.458 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T20:22:23.458 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T20:22:23.458 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2023-12-16T20:22:23.458 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T20:22:23.458 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T20:22:23.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:23.458 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2023-12-16T20:22:23.511 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-16T20:22:23.511 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-16T20:22:23.554 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2023-12-16T20:22:23.581 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T20:22:23.637 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2023-12-16T20:22:23.637 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2023-12-16T20:22:23.637 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2023-12-16T20:22:23.637 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2023-12-16T20:22:23.637 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2023-12-16T20:22:23.637 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2023-12-16T20:22:23.638 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2023-12-16T20:22:23.638 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2023-12-16T20:22:23.638 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2023-12-16T20:22:23.638 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2023-12-16T20:22:23.638 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2023-12-16T20:22:23.638 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2023-12-16T20:22:23.638 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T20:22:23.638 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2023-12-16T20:22:23.638 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2023-12-16T20:22:23.638 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2023-12-16T20:22:23.638 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2023-12-16T20:22:23.638 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2023-12-16T20:22:23.638 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2023-12-16T20:22:23.638 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T20:22:23.639 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T20:22:23.639 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T20:22:23.639 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T20:22:23.639 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2023-12-16T20:22:23.639 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2023-12-16T20:22:23.639 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T20:22:23.639 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T20:22:23.639 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T20:22:23.639 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T20:22:23.639 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2023-12-16T20:22:23.639 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T20:22:23.639 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T20:22:23.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:23.640 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2023-12-16T20:22:24.793 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2023-12-16T20:22:24.822 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T20:22:24.878 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2023-12-16T20:22:24.878 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2023-12-16T20:22:24.878 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2023-12-16T20:22:24.878 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2023-12-16T20:22:24.878 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2023-12-16T20:22:24.878 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2023-12-16T20:22:24.878 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2023-12-16T20:22:24.878 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2023-12-16T20:22:24.878 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2023-12-16T20:22:24.878 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2023-12-16T20:22:24.878 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2023-12-16T20:22:24.878 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2023-12-16T20:22:24.879 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T20:22:24.879 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2023-12-16T20:22:24.879 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2023-12-16T20:22:24.879 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2023-12-16T20:22:24.879 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2023-12-16T20:22:24.879 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2023-12-16T20:22:24.879 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2023-12-16T20:22:24.879 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T20:22:24.879 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T20:22:24.879 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T20:22:24.879 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T20:22:24.879 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2023-12-16T20:22:24.879 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2023-12-16T20:22:24.880 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T20:22:24.880 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T20:22:24.880 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T20:22:24.880 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T20:22:24.880 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2023-12-16T20:22:24.880 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T20:22:24.880 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T20:22:24.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:24.880 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2023-12-16T20:22:26.034 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2023-12-16T20:22:26.062 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T20:22:26.117 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2023-12-16T20:22:26.117 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2023-12-16T20:22:26.118 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2023-12-16T20:22:26.118 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2023-12-16T20:22:26.118 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2023-12-16T20:22:26.118 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2023-12-16T20:22:26.118 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2023-12-16T20:22:26.118 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2023-12-16T20:22:26.118 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2023-12-16T20:22:26.118 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2023-12-16T20:22:26.118 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2023-12-16T20:22:26.118 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2023-12-16T20:22:26.118 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T20:22:26.118 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2023-12-16T20:22:26.119 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2023-12-16T20:22:26.119 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2023-12-16T20:22:26.119 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2023-12-16T20:22:26.119 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2023-12-16T20:22:26.119 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2023-12-16T20:22:26.119 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T20:22:26.119 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T20:22:26.119 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T20:22:26.119 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T20:22:26.119 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2023-12-16T20:22:26.119 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2023-12-16T20:22:26.119 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T20:22:26.119 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T20:22:26.119 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T20:22:26.120 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T20:22:26.120 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2023-12-16T20:22:26.120 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T20:22:26.120 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T20:22:26.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:26.120 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2023-12-16T20:22:27.274 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2023-12-16T20:22:27.302 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T20:22:27.357 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2023-12-16T20:22:27.358 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2023-12-16T20:22:27.358 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2023-12-16T20:22:27.358 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2023-12-16T20:22:27.358 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2023-12-16T20:22:27.358 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2023-12-16T20:22:27.358 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2023-12-16T20:22:27.358 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2023-12-16T20:22:27.358 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2023-12-16T20:22:27.358 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2023-12-16T20:22:27.358 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2023-12-16T20:22:27.358 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2023-12-16T20:22:27.358 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T20:22:27.358 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2023-12-16T20:22:27.358 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2023-12-16T20:22:27.358 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2023-12-16T20:22:27.359 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2023-12-16T20:22:27.359 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2023-12-16T20:22:27.359 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2023-12-16T20:22:27.359 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T20:22:27.359 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T20:22:27.359 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T20:22:27.359 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T20:22:27.359 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2023-12-16T20:22:27.359 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2023-12-16T20:22:27.359 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T20:22:27.359 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T20:22:27.359 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T20:22:27.359 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T20:22:27.359 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2023-12-16T20:22:27.360 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T20:22:27.360 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T20:22:27.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:27.360 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2023-12-16T20:22:28.515 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2023-12-16T20:22:28.543 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T20:22:28.599 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2023-12-16T20:22:28.599 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2023-12-16T20:22:28.599 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2023-12-16T20:22:28.599 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2023-12-16T20:22:28.600 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2023-12-16T20:22:28.600 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2023-12-16T20:22:28.600 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2023-12-16T20:22:28.600 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2023-12-16T20:22:28.600 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2023-12-16T20:22:28.600 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2023-12-16T20:22:28.600 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2023-12-16T20:22:28.600 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2023-12-16T20:22:28.600 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T20:22:28.600 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2023-12-16T20:22:28.600 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2023-12-16T20:22:28.600 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2023-12-16T20:22:28.600 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2023-12-16T20:22:28.600 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2023-12-16T20:22:28.601 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2023-12-16T20:22:28.601 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T20:22:28.601 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T20:22:28.601 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T20:22:28.601 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T20:22:28.601 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2023-12-16T20:22:28.601 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2023-12-16T20:22:28.601 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T20:22:28.601 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T20:22:28.601 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T20:22:28.601 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T20:22:28.601 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2023-12-16T20:22:28.601 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T20:22:28.602 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T20:22:28.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:28.602 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2023-12-16T20:22:29.223 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[97634]: starting ceph client2023-12-16T20:22:29.104+0000 64d8100 -1 init, newargv = 0x81dca80 newargc=15 2023-12-16T20:22:29.224 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr: 2023-12-16T20:22:29.755 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2023-12-16T20:22:29.783 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2023-12-16T20:22:29.838 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2023-12-16T20:22:29.839 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2023-12-16T20:22:29.839 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2023-12-16T20:22:29.839 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2023-12-16T20:22:29.839 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2023-12-16T20:22:29.839 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2023-12-16T20:22:29.839 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2023-12-16T20:22:29.839 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2023-12-16T20:22:29.839 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2023-12-16T20:22:29.839 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2023-12-16T20:22:29.839 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2023-12-16T20:22:29.839 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2023-12-16T20:22:29.839 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2023-12-16T20:22:29.839 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2023-12-16T20:22:29.839 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2023-12-16T20:22:29.840 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2023-12-16T20:22:29.840 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2023-12-16T20:22:29.840 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2023-12-16T20:22:29.840 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2023-12-16T20:22:29.840 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2023-12-16T20:22:29.840 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-16T20:22:29.840 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-16T20:22:29.840 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2023-12-16T20:22:29.840 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2023-12-16T20:22:29.840 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2023-12-16T20:22:29.840 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2023-12-16T20:22:29.840 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2023-12-16T20:22:29.840 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2023-12-16T20:22:29.840 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2023-12-16T20:22:29.840 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2023-12-16T20:22:29.841 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T20:22:29.841 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T20:22:29.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:29.841 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2023-12-16T20:22:29.865 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[97634]: starting fuse 2023-12-16T20:22:29.879 INFO:teuthology.orchestra.run.smithi087.stdout:41 2023-12-16T20:22:29.879 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-16T20:22:29.879 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2023-12-16T20:22:29.879 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2023-12-16T20:22:29.879 DEBUG:teuthology.orchestra.run.smithi087:> import re 2023-12-16T20:22:29.879 DEBUG:teuthology.orchestra.run.smithi087:> import os 2023-12-16T20:22:29.879 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2023-12-16T20:22:29.879 DEBUG:teuthology.orchestra.run.smithi087:> 2023-12-16T20:22:29.879 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2023-12-16T20:22:29.880 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-16T20:22:29.880 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2023-12-16T20:22:29.880 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-16T20:22:29.880 DEBUG:teuthology.orchestra.run.smithi087:> 2023-12-16T20:22:29.880 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2023-12-16T20:22:29.880 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2023-12-16T20:22:29.880 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2023-12-16T20:22:29.880 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2023-12-16T20:22:29.880 DEBUG:teuthology.orchestra.run.smithi087:> 2023-12-16T20:22:29.880 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2023-12-16T20:22:29.880 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-16T20:22:29.880 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-16T20:22:29.880 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-16T20:22:29.880 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2023-12-16T20:22:29.880 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2023-12-16T20:22:29.880 DEBUG:teuthology.orchestra.run.smithi087:> return f 2023-12-16T20:22:29.881 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-16T20:22:29.881 DEBUG:teuthology.orchestra.run.smithi087:> 2023-12-16T20:22:29.881 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.0")) 2023-12-16T20:22:29.881 DEBUG:teuthology.orchestra.run.smithi087:> ' 2023-12-16T20:22:30.000 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.0.97634.asok 2023-12-16T20:22:30.003 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:22:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-16T20:22:30.010 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.97634.asok 2023-12-16T20:22:30.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:30.010 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.97634.asok status 2023-12-16T20:22:30.243 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-12-16T20:22:30.243 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2023-12-16T20:22:30.243 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "c7586e95519b7be76f3b6e3a4b333888baf46bc9", 2023-12-16T20:22:30.243 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 19.0.0-202-gc7586e95 (c7586e95519b7be76f3b6e3a4b333888baf46bc9) reef (dev)", 2023-12-16T20:22:30.243 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "0", 2023-12-16T20:22:30.243 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2023-12-16T20:22:30.243 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-16T20:22:30.243 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "97634", 2023-12-16T20:22:30.243 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2023-12-16T20:22:30.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-12-16T20:22:30.243 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2023-12-16T20:22:30.244 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2023-12-16T20:22:30.244 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4622, 2023-12-16T20:22:30.244 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2023-12-16T20:22:30.244 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2023-12-16T20:22:30.244 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2023-12-16T20:22:30.244 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 4622 2023-12-16T20:22:30.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-12-16T20:22:30.244 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2023-12-16T20:22:30.244 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2023-12-16T20:22:30.244 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2023-12-16T20:22:30.244 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2703902331 2023-12-16T20:22:30.244 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-12-16T20:22:30.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-12-16T20:22:30.245 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2023-12-16T20:22:30.245 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2023-12-16T20:22:30.245 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2023-12-16T20:22:30.245 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2703902331 2023-12-16T20:22:30.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-12-16T20:22:30.245 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.4622 172.21.15.87:0/2703902331", 2023-12-16T20:22:30.245 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "172.21.15.87:0/2703902331", 2023-12-16T20:22:30.245 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2023-12-16T20:22:30.245 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 10, 2023-12-16T20:22:30.245 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 27, 2023-12-16T20:22:30.245 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2023-12-16T20:22:30.245 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2023-12-16T20:22:30.245 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2023-12-16T20:22:30.246 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-12-16T20:22:30.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:30.252 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2023-12-16T20:22:30.252 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-16T20:22:30.306 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2023-12-16T20:22:30.306 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-16T20:22:30.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:22:30.307 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-16T20:22:30.359 INFO:teuthology.run_tasks:Running task workunit... 2023-12-16T20:22:30.372 INFO:tasks.workunit:Pulling workunits from ref c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:22:30.373 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-16T20:22:30.373 INFO:tasks.workunit:timeout=3h 2023-12-16T20:22:30.373 INFO:tasks.workunit:cleanup=True 2023-12-16T20:22:30.373 DEBUG:teuthology.orchestra.run.smithi087:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-16T20:22:30.389 INFO:teuthology.orchestra.run.smithi087.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-16T20:22:30.389 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-12-16T20:22:30.389 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 29h/41d Inode: 1 Links: 2 2023-12-16T20:22:30.389 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T20:22:30.389 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:fusefs_t:s0 2023-12-16T20:22:30.389 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-16T20:22:30.390 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2023-12-16 20:21:36.964062756 +0000 2023-12-16T20:22:30.390 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2023-12-16 20:21:50.144991516 +0000 2023-12-16T20:22:30.390 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2023-12-16T20:22:30.390 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-16T20:22:30.390 DEBUG:teuthology.orchestra.run.smithi087:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-16T20:22:30.819 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-16T20:22:30.835 INFO:tasks.workunit.client.0.smithi087.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-16T20:22:51.299 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:22:51.302 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:23:19.438 INFO:tasks.workunit.client.0.smithi087.stderr:Note: switching to 'c7586e95519b7be76f3b6e3a4b333888baf46bc9'. 2023-12-16T20:23:19.438 INFO:tasks.workunit.client.0.smithi087.stderr: 2023-12-16T20:23:19.438 INFO:tasks.workunit.client.0.smithi087.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-16T20:23:19.438 INFO:tasks.workunit.client.0.smithi087.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-16T20:23:19.438 INFO:tasks.workunit.client.0.smithi087.stderr:state without impacting any branches by switching back to a branch. 2023-12-16T20:23:19.438 INFO:tasks.workunit.client.0.smithi087.stderr: 2023-12-16T20:23:19.438 INFO:tasks.workunit.client.0.smithi087.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-16T20:23:19.438 INFO:tasks.workunit.client.0.smithi087.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-16T20:23:19.439 INFO:tasks.workunit.client.0.smithi087.stderr: 2023-12-16T20:23:19.439 INFO:tasks.workunit.client.0.smithi087.stderr: git switch -c 2023-12-16T20:23:19.439 INFO:tasks.workunit.client.0.smithi087.stderr: 2023-12-16T20:23:19.439 INFO:tasks.workunit.client.0.smithi087.stderr:Or undo this operation with: 2023-12-16T20:23:19.439 INFO:tasks.workunit.client.0.smithi087.stderr: 2023-12-16T20:23:19.439 INFO:tasks.workunit.client.0.smithi087.stderr: git switch - 2023-12-16T20:23:19.439 INFO:tasks.workunit.client.0.smithi087.stderr: 2023-12-16T20:23:19.439 INFO:tasks.workunit.client.0.smithi087.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-16T20:23:19.439 INFO:tasks.workunit.client.0.smithi087.stderr: 2023-12-16T20:23:19.439 INFO:tasks.workunit.client.0.smithi087.stderr:HEAD is now at c7586e95519 Merge branch 'wip-qa-container-distros-s' of https://github.com/cbodley/ceph into wip-yuri8-testing-2023-12-15-0911 2023-12-16T20:23:19.442 DEBUG:teuthology.orchestra.run.smithi087:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-16T20:23:19.467 INFO:tasks.workunit.client.0.smithi087.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-16T20:23:19.469 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-16T20:23:19.469 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-16T20:23:20.140 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-16T20:23:20.204 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-16T20:23:20.245 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-16T20:23:20.247 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-16T20:23:20.247 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-16T20:23:20.286 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-16T20:23:20.290 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:23:20.290 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-16T20:23:20.346 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2023-12-16T20:23:20.347 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2023-12-16T20:23:20.348 DEBUG:teuthology.orchestra.run.smithi087:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c7586e95519b7be76f3b6e3a4b333888baf46bc9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2023-12-16T20:23:20.564 INFO:tasks.workunit.client.0.smithi087.stderr:+ dbench 1 2023-12-16T20:23:20.574 INFO:tasks.workunit.client.0.smithi087.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-12-16T20:23:20.574 INFO:tasks.workunit.client.0.smithi087.stdout: 2023-12-16T20:23:20.574 INFO:tasks.workunit.client.0.smithi087.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-12-16T20:23:20.583 INFO:tasks.workunit.client.0.smithi087.stdout:0 of 1 processes prepared for launch 0 sec 2023-12-16T20:23:20.683 INFO:tasks.workunit.client.0.smithi087.stdout:1 of 1 processes prepared for launch 0 sec 2023-12-16T20:23:20.683 INFO:tasks.workunit.client.0.smithi087.stdout:releasing clients 2023-12-16T20:23:21.595 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:23:21.598 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:23:21.683 INFO:tasks.workunit.client.0.smithi087.stdout: 1 31 1.05 MB/sec warmup 1 sec latency 46.680 ms 2023-12-16T20:23:22.683 INFO:tasks.workunit.client.0.smithi087.stdout: 1 113 2.62 MB/sec warmup 2 sec latency 201.497 ms 2023-12-16T20:23:23.683 INFO:tasks.workunit.client.0.smithi087.stdout: 1 157 2.18 MB/sec warmup 3 sec latency 162.121 ms 2023-12-16T20:23:24.683 INFO:tasks.workunit.client.0.smithi087.stdout: 1 207 2.03 MB/sec warmup 4 sec latency 172.529 ms 2023-12-16T20:23:25.683 INFO:tasks.workunit.client.0.smithi087.stdout: 1 248 1.88 MB/sec warmup 5 sec latency 165.611 ms 2023-12-16T20:23:26.683 INFO:tasks.workunit.client.0.smithi087.stdout: 1 297 1.83 MB/sec warmup 6 sec latency 167.095 ms 2023-12-16T20:23:27.683 INFO:tasks.workunit.client.0.smithi087.stdout: 1 339 1.75 MB/sec warmup 7 sec latency 195.729 ms 2023-12-16T20:23:28.683 INFO:tasks.workunit.client.0.smithi087.stdout: 1 381 1.70 MB/sec warmup 8 sec latency 199.398 ms 2023-12-16T20:23:29.683 INFO:tasks.workunit.client.0.smithi087.stdout: 1 413 1.62 MB/sec warmup 9 sec latency 336.351 ms 2023-12-16T20:23:30.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 453 1.59 MB/sec warmup 10 sec latency 333.751 ms 2023-12-16T20:23:31.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 493 1.56 MB/sec warmup 11 sec latency 302.383 ms 2023-12-16T20:23:32.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 528 1.52 MB/sec warmup 12 sec latency 274.148 ms 2023-12-16T20:23:33.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 609 1.61 MB/sec warmup 13 sec latency 280.880 ms 2023-12-16T20:23:34.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 644 1.50 MB/sec warmup 14 sec latency 412.428 ms 2023-12-16T20:23:35.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 653 1.40 MB/sec warmup 15 sec latency 422.039 ms 2023-12-16T20:23:36.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 680 1.32 MB/sec warmup 16 sec latency 320.945 ms 2023-12-16T20:23:37.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 710 1.25 MB/sec warmup 17 sec latency 370.299 ms 2023-12-16T20:23:38.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 744 1.18 MB/sec warmup 18 sec latency 256.312 ms 2023-12-16T20:23:39.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 769 1.12 MB/sec warmup 19 sec latency 526.404 ms 2023-12-16T20:23:40.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 808 1.07 MB/sec warmup 20 sec latency 208.297 ms 2023-12-16T20:23:41.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 818 1.02 MB/sec warmup 21 sec latency 305.587 ms 2023-12-16T20:23:42.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 854 0.98 MB/sec warmup 22 sec latency 280.282 ms 2023-12-16T20:23:43.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 864 0.94 MB/sec warmup 23 sec latency 313.154 ms 2023-12-16T20:23:44.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 902 0.90 MB/sec warmup 24 sec latency 289.740 ms 2023-12-16T20:23:45.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 928 0.87 MB/sec warmup 25 sec latency 333.067 ms 2023-12-16T20:23:46.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 935 0.84 MB/sec warmup 26 sec latency 317.896 ms 2023-12-16T20:23:47.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 969 0.81 MB/sec warmup 27 sec latency 296.161 ms 2023-12-16T20:23:48.685 INFO:tasks.workunit.client.0.smithi087.stdout: 1 994 0.78 MB/sec warmup 28 sec latency 263.864 ms 2023-12-16T20:23:49.684 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1033 0.79 MB/sec warmup 29 sec latency 308.040 ms 2023-12-16T20:23:50.685 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1047 0.76 MB/sec warmup 30 sec latency 310.231 ms 2023-12-16T20:23:51.685 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1064 0.74 MB/sec warmup 31 sec latency 301.070 ms 2023-12-16T20:23:51.716 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:23:51.719 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:23:52.685 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1100 0.72 MB/sec warmup 32 sec latency 305.122 ms 2023-12-16T20:23:53.685 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1128 0.70 MB/sec warmup 33 sec latency 301.640 ms 2023-12-16T20:23:54.685 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1159 0.68 MB/sec warmup 34 sec latency 290.521 ms 2023-12-16T20:23:55.685 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1170 0.66 MB/sec warmup 35 sec latency 298.487 ms 2023-12-16T20:23:56.685 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1202 0.64 MB/sec warmup 36 sec latency 296.162 ms 2023-12-16T20:23:57.685 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1225 0.62 MB/sec warmup 37 sec latency 425.373 ms 2023-12-16T20:23:58.685 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1251 0.61 MB/sec warmup 38 sec latency 304.716 ms 2023-12-16T20:23:59.685 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1280 0.59 MB/sec warmup 39 sec latency 320.124 ms 2023-12-16T20:24:00.685 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1296 0.59 MB/sec warmup 40 sec latency 308.178 ms 2023-12-16T20:24:01.685 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1381 0.63 MB/sec warmup 41 sec latency 302.514 ms 2023-12-16T20:24:02.685 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1397 0.62 MB/sec warmup 42 sec latency 311.768 ms 2023-12-16T20:24:03.685 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1419 0.61 MB/sec warmup 43 sec latency 320.427 ms 2023-12-16T20:24:04.685 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1448 0.59 MB/sec warmup 44 sec latency 267.187 ms 2023-12-16T20:24:05.685 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1481 0.58 MB/sec warmup 45 sec latency 309.157 ms 2023-12-16T20:24:06.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1492 0.57 MB/sec warmup 46 sec latency 315.349 ms 2023-12-16T20:24:07.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1526 0.56 MB/sec warmup 47 sec latency 165.947 ms 2023-12-16T20:24:08.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1552 0.54 MB/sec warmup 48 sec latency 292.598 ms 2023-12-16T20:24:09.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1574 0.53 MB/sec warmup 49 sec latency 454.805 ms 2023-12-16T20:24:10.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1603 0.52 MB/sec warmup 50 sec latency 311.863 ms 2023-12-16T20:24:11.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1616 0.51 MB/sec warmup 51 sec latency 297.840 ms 2023-12-16T20:24:12.689 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1643 0.50 MB/sec warmup 52 sec latency 309.081 ms 2023-12-16T20:24:13.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1684 0.49 MB/sec warmup 53 sec latency 299.648 ms 2023-12-16T20:24:14.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1701 0.49 MB/sec warmup 54 sec latency 271.518 ms 2023-12-16T20:24:15.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1760 0.48 MB/sec warmup 55 sec latency 290.744 ms 2023-12-16T20:24:16.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1802 0.47 MB/sec warmup 56 sec latency 305.937 ms 2023-12-16T20:24:17.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1822 0.46 MB/sec warmup 57 sec latency 320.428 ms 2023-12-16T20:24:18.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1840 0.45 MB/sec warmup 58 sec latency 299.852 ms 2023-12-16T20:24:19.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1858 0.45 MB/sec warmup 59 sec latency 444.682 ms 2023-12-16T20:24:20.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1869 0.44 MB/sec warmup 60 sec latency 312.040 ms 2023-12-16T20:24:21.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1903 0.43 MB/sec warmup 61 sec latency 335.355 ms 2023-12-16T20:24:22.581 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:24:22.584 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:24:22.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1920 0.43 MB/sec warmup 62 sec latency 309.700 ms 2023-12-16T20:24:23.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 1975 0.42 MB/sec warmup 63 sec latency 305.750 ms 2023-12-16T20:24:24.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2027 0.41 MB/sec warmup 64 sec latency 295.287 ms 2023-12-16T20:24:25.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2051 0.41 MB/sec warmup 65 sec latency 306.228 ms 2023-12-16T20:24:26.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2061 0.40 MB/sec warmup 66 sec latency 305.947 ms 2023-12-16T20:24:27.686 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2083 0.40 MB/sec warmup 67 sec latency 323.974 ms 2023-12-16T20:24:28.687 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2104 0.39 MB/sec warmup 68 sec latency 325.895 ms 2023-12-16T20:24:29.687 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2146 0.39 MB/sec warmup 69 sec latency 299.435 ms 2023-12-16T20:24:30.687 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2175 0.38 MB/sec warmup 70 sec latency 320.747 ms 2023-12-16T20:24:31.687 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2198 0.38 MB/sec warmup 71 sec latency 307.344 ms 2023-12-16T20:24:32.687 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2258 0.37 MB/sec warmup 72 sec latency 309.927 ms 2023-12-16T20:24:33.687 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2301 0.38 MB/sec warmup 73 sec latency 302.285 ms 2023-12-16T20:24:34.687 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2307 0.38 MB/sec warmup 74 sec latency 413.782 ms 2023-12-16T20:24:35.687 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2334 0.37 MB/sec warmup 75 sec latency 304.642 ms 2023-12-16T20:24:36.687 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2353 0.37 MB/sec warmup 76 sec latency 283.980 ms 2023-12-16T20:24:37.687 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2364 0.36 MB/sec warmup 77 sec latency 302.861 ms 2023-12-16T20:24:38.687 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2371 0.36 MB/sec warmup 78 sec latency 301.873 ms 2023-12-16T20:24:39.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2391 0.35 MB/sec warmup 79 sec latency 309.135 ms 2023-12-16T20:24:40.687 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2410 0.35 MB/sec warmup 80 sec latency 318.256 ms 2023-12-16T20:24:41.687 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2432 0.35 MB/sec warmup 81 sec latency 324.522 ms 2023-12-16T20:24:42.687 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2449 0.34 MB/sec warmup 82 sec latency 292.651 ms 2023-12-16T20:24:43.687 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2479 0.35 MB/sec warmup 83 sec latency 303.190 ms 2023-12-16T20:24:44.687 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2496 0.34 MB/sec warmup 84 sec latency 305.487 ms 2023-12-16T20:24:45.687 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2549 0.34 MB/sec warmup 85 sec latency 325.153 ms 2023-12-16T20:24:46.687 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2560 0.34 MB/sec warmup 86 sec latency 292.052 ms 2023-12-16T20:24:47.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2581 0.33 MB/sec warmup 87 sec latency 315.058 ms 2023-12-16T20:24:48.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2600 0.33 MB/sec warmup 88 sec latency 313.510 ms 2023-12-16T20:24:49.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2615 0.33 MB/sec warmup 89 sec latency 305.758 ms 2023-12-16T20:24:50.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2621 0.32 MB/sec warmup 90 sec latency 306.131 ms 2023-12-16T20:24:51.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2745 0.35 MB/sec warmup 91 sec latency 321.963 ms 2023-12-16T20:24:52.653 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:24:52.656 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:24:52.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2764 0.35 MB/sec warmup 92 sec latency 336.072 ms 2023-12-16T20:24:53.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2797 0.34 MB/sec warmup 93 sec latency 288.522 ms 2023-12-16T20:24:54.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2895 0.35 MB/sec warmup 94 sec latency 298.678 ms 2023-12-16T20:24:55.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2931 0.35 MB/sec warmup 95 sec latency 137.765 ms 2023-12-16T20:24:56.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2966 0.35 MB/sec warmup 96 sec latency 295.627 ms 2023-12-16T20:24:57.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 2977 0.35 MB/sec warmup 97 sec latency 396.564 ms 2023-12-16T20:24:58.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3000 0.34 MB/sec warmup 98 sec latency 299.900 ms 2023-12-16T20:24:59.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3024 0.34 MB/sec warmup 99 sec latency 284.793 ms 2023-12-16T20:25:00.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3169 0.34 MB/sec warmup 100 sec latency 374.331 ms 2023-12-16T20:25:01.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3190 0.34 MB/sec warmup 101 sec latency 296.741 ms 2023-12-16T20:25:02.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3266 0.35 MB/sec warmup 102 sec latency 194.950 ms 2023-12-16T20:25:03.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3280 0.34 MB/sec warmup 103 sec latency 269.586 ms 2023-12-16T20:25:04.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3283 0.34 MB/sec warmup 104 sec latency 316.707 ms 2023-12-16T20:25:05.688 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3288 0.34 MB/sec warmup 105 sec latency 369.764 ms 2023-12-16T20:25:06.689 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3292 0.33 MB/sec warmup 106 sec latency 367.660 ms 2023-12-16T20:25:07.689 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3297 0.33 MB/sec warmup 107 sec latency 384.257 ms 2023-12-16T20:25:08.689 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3303 0.33 MB/sec warmup 108 sec latency 338.491 ms 2023-12-16T20:25:09.689 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3308 0.32 MB/sec warmup 109 sec latency 418.694 ms 2023-12-16T20:25:10.689 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3311 0.32 MB/sec warmup 110 sec latency 294.093 ms 2023-12-16T20:25:11.689 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3314 0.32 MB/sec warmup 111 sec latency 296.182 ms 2023-12-16T20:25:12.689 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3319 0.32 MB/sec warmup 112 sec latency 317.117 ms 2023-12-16T20:25:13.689 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3323 0.31 MB/sec warmup 113 sec latency 310.622 ms 2023-12-16T20:25:14.689 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3326 0.31 MB/sec warmup 114 sec latency 297.248 ms 2023-12-16T20:25:15.689 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3332 0.31 MB/sec warmup 115 sec latency 300.172 ms 2023-12-16T20:25:16.689 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3335 0.30 MB/sec warmup 116 sec latency 292.939 ms 2023-12-16T20:25:17.689 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3351 0.30 MB/sec warmup 117 sec latency 284.433 ms 2023-12-16T20:25:18.689 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3373 0.30 MB/sec warmup 118 sec latency 125.821 ms 2023-12-16T20:25:19.689 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3393 0.30 MB/sec warmup 119 sec latency 350.889 ms 2023-12-16T20:25:21.689 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3530 0.03 MB/sec execute 1 sec latency 292.985 ms 2023-12-16T20:25:22.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3556 0.04 MB/sec execute 2 sec latency 282.359 ms 2023-12-16T20:25:22.761 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:25:22.763 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:25:23.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3573 0.03 MB/sec execute 3 sec latency 291.873 ms 2023-12-16T20:25:24.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3617 0.06 MB/sec execute 4 sec latency 359.535 ms 2023-12-16T20:25:25.689 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3642 0.06 MB/sec execute 5 sec latency 149.614 ms 2023-12-16T20:25:26.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3672 0.06 MB/sec execute 6 sec latency 297.690 ms 2023-12-16T20:25:27.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3686 0.06 MB/sec execute 7 sec latency 343.997 ms 2023-12-16T20:25:28.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3708 0.05 MB/sec execute 8 sec latency 369.085 ms 2023-12-16T20:25:29.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3758 0.16 MB/sec execute 9 sec latency 318.852 ms 2023-12-16T20:25:30.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3780 0.14 MB/sec execute 10 sec latency 321.683 ms 2023-12-16T20:25:31.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3792 0.13 MB/sec execute 11 sec latency 179.154 ms 2023-12-16T20:25:32.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3805 0.12 MB/sec execute 12 sec latency 191.721 ms 2023-12-16T20:25:33.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3821 0.11 MB/sec execute 13 sec latency 168.320 ms 2023-12-16T20:25:34.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3839 0.10 MB/sec execute 14 sec latency 152.642 ms 2023-12-16T20:25:35.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3856 0.09 MB/sec execute 15 sec latency 143.189 ms 2023-12-16T20:25:36.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3870 0.09 MB/sec execute 16 sec latency 205.020 ms 2023-12-16T20:25:37.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3884 0.08 MB/sec execute 17 sec latency 331.386 ms 2023-12-16T20:25:38.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3900 0.09 MB/sec execute 18 sec latency 293.907 ms 2023-12-16T20:25:39.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3921 0.09 MB/sec execute 19 sec latency 348.613 ms 2023-12-16T20:25:40.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3937 0.09 MB/sec execute 20 sec latency 161.335 ms 2023-12-16T20:25:41.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3948 0.08 MB/sec execute 21 sec latency 190.816 ms 2023-12-16T20:25:42.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3966 0.08 MB/sec execute 22 sec latency 177.357 ms 2023-12-16T20:25:43.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 3983 0.07 MB/sec execute 23 sec latency 166.549 ms 2023-12-16T20:25:44.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4000 0.07 MB/sec execute 24 sec latency 187.639 ms 2023-12-16T20:25:45.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4018 0.07 MB/sec execute 25 sec latency 141.115 ms 2023-12-16T20:25:46.690 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4031 0.07 MB/sec execute 26 sec latency 283.543 ms 2023-12-16T20:25:47.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4040 0.06 MB/sec execute 27 sec latency 325.242 ms 2023-12-16T20:25:48.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4060 0.06 MB/sec execute 28 sec latency 293.705 ms 2023-12-16T20:25:49.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4079 0.06 MB/sec execute 29 sec latency 291.858 ms 2023-12-16T20:25:50.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4102 0.06 MB/sec execute 30 sec latency 305.309 ms 2023-12-16T20:25:51.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4123 0.06 MB/sec execute 31 sec latency 226.015 ms 2023-12-16T20:25:52.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4153 0.05 MB/sec execute 32 sec latency 90.712 ms 2023-12-16T20:25:52.910 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:25:52.913 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:25:53.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4170 0.05 MB/sec execute 33 sec latency 401.703 ms 2023-12-16T20:25:54.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4181 0.05 MB/sec execute 34 sec latency 273.269 ms 2023-12-16T20:25:55.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4216 0.05 MB/sec execute 35 sec latency 373.516 ms 2023-12-16T20:25:56.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4226 0.05 MB/sec execute 36 sec latency 325.488 ms 2023-12-16T20:25:57.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4254 0.05 MB/sec execute 37 sec latency 274.837 ms 2023-12-16T20:25:58.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4292 0.05 MB/sec execute 38 sec latency 293.281 ms 2023-12-16T20:25:59.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4317 0.05 MB/sec execute 39 sec latency 431.066 ms 2023-12-16T20:26:00.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4360 0.06 MB/sec execute 40 sec latency 292.124 ms 2023-12-16T20:26:01.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4384 0.06 MB/sec execute 41 sec latency 310.741 ms 2023-12-16T20:26:02.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4423 0.06 MB/sec execute 42 sec latency 314.955 ms 2023-12-16T20:26:03.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4432 0.05 MB/sec execute 43 sec latency 300.593 ms 2023-12-16T20:26:04.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4462 0.06 MB/sec execute 44 sec latency 342.447 ms 2023-12-16T20:26:05.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4497 0.06 MB/sec execute 45 sec latency 222.120 ms 2023-12-16T20:26:06.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4501 0.06 MB/sec execute 46 sec latency 322.625 ms 2023-12-16T20:26:07.691 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4517 0.05 MB/sec execute 47 sec latency 316.886 ms 2023-12-16T20:26:08.692 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4562 0.06 MB/sec execute 48 sec latency 233.405 ms 2023-12-16T20:26:09.692 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4596 0.07 MB/sec execute 49 sec latency 302.899 ms 2023-12-16T20:26:10.692 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4614 0.07 MB/sec execute 50 sec latency 301.116 ms 2023-12-16T20:26:11.692 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4627 0.07 MB/sec execute 51 sec latency 320.881 ms 2023-12-16T20:26:12.692 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4659 0.07 MB/sec execute 52 sec latency 285.303 ms 2023-12-16T20:26:13.692 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4684 0.07 MB/sec execute 53 sec latency 277.332 ms 2023-12-16T20:26:14.692 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4724 0.07 MB/sec execute 54 sec latency 182.937 ms 2023-12-16T20:26:15.692 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4735 0.07 MB/sec execute 55 sec latency 310.512 ms 2023-12-16T20:26:16.692 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4747 0.07 MB/sec execute 56 sec latency 297.538 ms 2023-12-16T20:26:17.692 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4780 0.07 MB/sec execute 57 sec latency 303.107 ms 2023-12-16T20:26:18.692 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4814 0.07 MB/sec execute 58 sec latency 212.257 ms 2023-12-16T20:26:19.692 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4844 0.07 MB/sec execute 59 sec latency 351.144 ms 2023-12-16T20:26:20.692 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4850 0.07 MB/sec execute 60 sec latency 344.814 ms 2023-12-16T20:26:21.692 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4946 0.11 MB/sec execute 61 sec latency 314.825 ms 2023-12-16T20:26:22.693 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4962 0.11 MB/sec execute 62 sec latency 296.987 ms 2023-12-16T20:26:22.987 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:26:22.989 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:26:23.692 INFO:tasks.workunit.client.0.smithi087.stdout: 1 4984 0.11 MB/sec execute 63 sec latency 291.426 ms 2023-12-16T20:26:24.692 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5014 0.11 MB/sec execute 64 sec latency 190.221 ms 2023-12-16T20:26:25.692 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5042 0.10 MB/sec execute 65 sec latency 389.771 ms 2023-12-16T20:26:26.692 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5056 0.10 MB/sec execute 66 sec latency 285.461 ms 2023-12-16T20:26:27.693 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5091 0.10 MB/sec execute 67 sec latency 316.287 ms 2023-12-16T20:26:28.693 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5118 0.10 MB/sec execute 68 sec latency 305.790 ms 2023-12-16T20:26:29.693 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5141 0.10 MB/sec execute 69 sec latency 297.791 ms 2023-12-16T20:26:30.693 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5168 0.10 MB/sec execute 70 sec latency 284.357 ms 2023-12-16T20:26:31.693 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5181 0.10 MB/sec execute 71 sec latency 308.921 ms 2023-12-16T20:26:32.693 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5208 0.10 MB/sec execute 72 sec latency 310.987 ms 2023-12-16T20:26:33.693 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5251 0.10 MB/sec execute 73 sec latency 304.667 ms 2023-12-16T20:26:34.693 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5266 0.09 MB/sec execute 74 sec latency 312.230 ms 2023-12-16T20:26:35.693 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5334 0.09 MB/sec execute 75 sec latency 287.491 ms 2023-12-16T20:26:36.693 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5369 0.09 MB/sec execute 76 sec latency 278.851 ms 2023-12-16T20:26:37.693 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5388 0.09 MB/sec execute 77 sec latency 303.256 ms 2023-12-16T20:26:38.693 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5406 0.09 MB/sec execute 78 sec latency 292.179 ms 2023-12-16T20:26:39.693 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5427 0.09 MB/sec execute 79 sec latency 369.026 ms 2023-12-16T20:26:40.693 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5463 0.09 MB/sec execute 80 sec latency 302.996 ms 2023-12-16T20:26:41.693 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5477 0.09 MB/sec execute 81 sec latency 341.550 ms 2023-12-16T20:26:42.694 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5537 0.09 MB/sec execute 82 sec latency 280.769 ms 2023-12-16T20:26:43.693 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5562 0.09 MB/sec execute 83 sec latency 274.234 ms 2023-12-16T20:26:44.693 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5604 0.09 MB/sec execute 84 sec latency 296.289 ms 2023-12-16T20:26:45.694 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5615 0.09 MB/sec execute 85 sec latency 307.916 ms 2023-12-16T20:26:46.694 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5641 0.09 MB/sec execute 86 sec latency 318.787 ms 2023-12-16T20:26:47.694 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5655 0.09 MB/sec execute 87 sec latency 315.809 ms 2023-12-16T20:26:48.694 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5702 0.08 MB/sec execute 88 sec latency 331.552 ms 2023-12-16T20:26:49.694 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5735 0.08 MB/sec execute 89 sec latency 414.950 ms 2023-12-16T20:26:50.694 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5744 0.08 MB/sec execute 90 sec latency 298.359 ms 2023-12-16T20:26:51.694 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5782 0.08 MB/sec execute 91 sec latency 346.122 ms 2023-12-16T20:26:52.694 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5853 0.09 MB/sec execute 92 sec latency 268.928 ms 2023-12-16T20:26:53.284 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:26:53.286 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:26:53.694 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5866 0.09 MB/sec execute 93 sec latency 312.857 ms 2023-12-16T20:26:54.694 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5884 0.09 MB/sec execute 94 sec latency 472.769 ms 2023-12-16T20:26:55.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5898 0.09 MB/sec execute 95 sec latency 300.190 ms 2023-12-16T20:26:56.694 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5921 0.09 MB/sec execute 96 sec latency 283.263 ms 2023-12-16T20:26:57.694 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5927 0.09 MB/sec execute 97 sec latency 348.753 ms 2023-12-16T20:26:58.694 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5948 0.09 MB/sec execute 98 sec latency 461.236 ms 2023-12-16T20:26:59.694 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5961 0.09 MB/sec execute 99 sec latency 292.399 ms 2023-12-16T20:27:00.695 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5988 0.09 MB/sec execute 100 sec latency 313.490 ms 2023-12-16T20:27:01.695 INFO:tasks.workunit.client.0.smithi087.stdout: 1 5999 0.09 MB/sec execute 101 sec latency 348.071 ms 2023-12-16T20:27:02.695 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6027 0.09 MB/sec execute 102 sec latency 151.785 ms 2023-12-16T20:27:03.695 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6052 0.09 MB/sec execute 103 sec latency 318.064 ms 2023-12-16T20:27:04.695 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6064 0.09 MB/sec execute 104 sec latency 335.430 ms 2023-12-16T20:27:05.695 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6114 0.09 MB/sec execute 105 sec latency 302.663 ms 2023-12-16T20:27:06.695 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6135 0.09 MB/sec execute 106 sec latency 301.346 ms 2023-12-16T20:27:07.695 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6149 0.09 MB/sec execute 107 sec latency 327.006 ms 2023-12-16T20:27:08.695 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6166 0.09 MB/sec execute 108 sec latency 294.988 ms 2023-12-16T20:27:09.695 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6176 0.09 MB/sec execute 109 sec latency 413.698 ms 2023-12-16T20:27:10.695 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6275 0.12 MB/sec execute 110 sec latency 298.132 ms 2023-12-16T20:27:11.695 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6316 0.11 MB/sec execute 111 sec latency 315.248 ms 2023-12-16T20:27:12.695 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6336 0.11 MB/sec execute 112 sec latency 303.432 ms 2023-12-16T20:27:13.695 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6435 0.11 MB/sec execute 113 sec latency 303.323 ms 2023-12-16T20:27:14.695 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6473 0.12 MB/sec execute 114 sec latency 143.687 ms 2023-12-16T20:27:15.695 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6499 0.12 MB/sec execute 115 sec latency 290.949 ms 2023-12-16T20:27:16.695 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6530 0.12 MB/sec execute 116 sec latency 349.566 ms 2023-12-16T20:27:17.695 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6549 0.12 MB/sec execute 117 sec latency 184.825 ms 2023-12-16T20:27:18.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6578 0.12 MB/sec execute 118 sec latency 279.984 ms 2023-12-16T20:27:19.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6724 0.13 MB/sec execute 119 sec latency 373.202 ms 2023-12-16T20:27:20.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6745 0.13 MB/sec execute 120 sec latency 288.013 ms 2023-12-16T20:27:21.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6820 0.13 MB/sec execute 121 sec latency 249.190 ms 2023-12-16T20:27:22.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6834 0.13 MB/sec execute 122 sec latency 297.622 ms 2023-12-16T20:27:23.422 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:27:23.425 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:27:23.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6839 0.13 MB/sec execute 123 sec latency 310.347 ms 2023-12-16T20:27:24.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6844 0.13 MB/sec execute 124 sec latency 388.519 ms 2023-12-16T20:27:25.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6847 0.13 MB/sec execute 125 sec latency 290.849 ms 2023-12-16T20:27:26.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6853 0.13 MB/sec execute 126 sec latency 367.018 ms 2023-12-16T20:27:27.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6861 0.13 MB/sec execute 127 sec latency 397.531 ms 2023-12-16T20:27:28.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6865 0.13 MB/sec execute 128 sec latency 298.859 ms 2023-12-16T20:27:29.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6868 0.13 MB/sec execute 129 sec latency 403.159 ms 2023-12-16T20:27:30.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6872 0.12 MB/sec execute 130 sec latency 292.590 ms 2023-12-16T20:27:31.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6875 0.12 MB/sec execute 131 sec latency 320.273 ms 2023-12-16T20:27:32.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6880 0.12 MB/sec execute 132 sec latency 297.264 ms 2023-12-16T20:27:33.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6885 0.12 MB/sec execute 133 sec latency 299.193 ms 2023-12-16T20:27:34.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6888 0.12 MB/sec execute 134 sec latency 300.568 ms 2023-12-16T20:27:35.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6892 0.12 MB/sec execute 135 sec latency 295.734 ms 2023-12-16T20:27:36.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6919 0.12 MB/sec execute 136 sec latency 277.160 ms 2023-12-16T20:27:37.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6946 0.12 MB/sec execute 137 sec latency 133.376 ms 2023-12-16T20:27:38.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 6952 0.12 MB/sec execute 138 sec latency 301.134 ms 2023-12-16T20:27:39.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7069 0.14 MB/sec execute 139 sec latency 280.112 ms 2023-12-16T20:27:40.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7099 0.14 MB/sec execute 140 sec latency 300.789 ms 2023-12-16T20:27:41.696 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7114 0.14 MB/sec execute 141 sec latency 340.705 ms 2023-12-16T20:27:42.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7135 0.14 MB/sec execute 142 sec latency 340.690 ms 2023-12-16T20:27:43.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7185 0.14 MB/sec execute 143 sec latency 282.215 ms 2023-12-16T20:27:44.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7209 0.14 MB/sec execute 144 sec latency 292.666 ms 2023-12-16T20:27:45.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7222 0.13 MB/sec execute 145 sec latency 400.641 ms 2023-12-16T20:27:46.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7242 0.13 MB/sec execute 146 sec latency 309.009 ms 2023-12-16T20:27:47.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7292 0.14 MB/sec execute 147 sec latency 133.928 ms 2023-12-16T20:27:48.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7317 0.14 MB/sec execute 148 sec latency 286.657 ms 2023-12-16T20:27:49.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7333 0.14 MB/sec execute 149 sec latency 163.252 ms 2023-12-16T20:27:50.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7344 0.14 MB/sec execute 150 sec latency 178.704 ms 2023-12-16T20:27:51.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7359 0.14 MB/sec execute 151 sec latency 155.229 ms 2023-12-16T20:27:52.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7376 0.14 MB/sec execute 152 sec latency 236.225 ms 2023-12-16T20:27:53.486 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:27:53.489 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:27:53.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7392 0.13 MB/sec execute 153 sec latency 294.034 ms 2023-12-16T20:27:54.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7408 0.13 MB/sec execute 154 sec latency 245.701 ms 2023-12-16T20:27:55.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7420 0.13 MB/sec execute 155 sec latency 285.269 ms 2023-12-16T20:27:56.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7441 0.13 MB/sec execute 156 sec latency 306.933 ms 2023-12-16T20:27:57.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7459 0.13 MB/sec execute 157 sec latency 290.686 ms 2023-12-16T20:27:58.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7476 0.13 MB/sec execute 158 sec latency 156.149 ms 2023-12-16T20:27:59.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7488 0.13 MB/sec execute 159 sec latency 202.179 ms 2023-12-16T20:28:00.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7503 0.13 MB/sec execute 160 sec latency 174.704 ms 2023-12-16T20:28:01.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7520 0.13 MB/sec execute 161 sec latency 163.103 ms 2023-12-16T20:28:02.697 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7538 0.13 MB/sec execute 162 sec latency 156.547 ms 2023-12-16T20:28:03.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7557 0.13 MB/sec execute 163 sec latency 158.425 ms 2023-12-16T20:28:04.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7571 0.13 MB/sec execute 164 sec latency 248.775 ms 2023-12-16T20:28:05.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7578 0.13 MB/sec execute 165 sec latency 353.782 ms 2023-12-16T20:28:06.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7591 0.13 MB/sec execute 166 sec latency 282.440 ms 2023-12-16T20:28:07.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7610 0.12 MB/sec execute 167 sec latency 304.300 ms 2023-12-16T20:28:08.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7632 0.12 MB/sec execute 168 sec latency 295.059 ms 2023-12-16T20:28:09.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7654 0.12 MB/sec execute 169 sec latency 183.475 ms 2023-12-16T20:28:10.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7681 0.12 MB/sec execute 170 sec latency 213.003 ms 2023-12-16T20:28:11.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7699 0.12 MB/sec execute 171 sec latency 395.760 ms 2023-12-16T20:28:12.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7715 0.12 MB/sec execute 172 sec latency 270.245 ms 2023-12-16T20:28:13.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7728 0.12 MB/sec execute 173 sec latency 384.316 ms 2023-12-16T20:28:14.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7759 0.12 MB/sec execute 174 sec latency 528.044 ms 2023-12-16T20:28:15.699 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7778 0.12 MB/sec execute 175 sec latency 298.975 ms 2023-12-16T20:28:16.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7812 0.12 MB/sec execute 176 sec latency 295.164 ms 2023-12-16T20:28:17.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7855 0.12 MB/sec execute 177 sec latency 208.862 ms 2023-12-16T20:28:18.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7886 0.12 MB/sec execute 178 sec latency 296.136 ms 2023-12-16T20:28:19.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7925 0.12 MB/sec execute 179 sec latency 218.477 ms 2023-12-16T20:28:20.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7930 0.12 MB/sec execute 180 sec latency 302.593 ms 2023-12-16T20:28:21.699 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7966 0.12 MB/sec execute 181 sec latency 315.438 ms 2023-12-16T20:28:22.698 INFO:tasks.workunit.client.0.smithi087.stdout: 1 7992 0.12 MB/sec execute 182 sec latency 297.691 ms 2023-12-16T20:28:23.626 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:28:23.628 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:28:23.699 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8016 0.12 MB/sec execute 183 sec latency 277.160 ms 2023-12-16T20:28:24.699 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8040 0.12 MB/sec execute 184 sec latency 361.079 ms 2023-12-16T20:28:25.699 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8048 0.12 MB/sec execute 185 sec latency 438.698 ms 2023-12-16T20:28:26.699 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8081 0.12 MB/sec execute 186 sec latency 286.717 ms 2023-12-16T20:28:27.699 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8116 0.12 MB/sec execute 187 sec latency 287.690 ms 2023-12-16T20:28:28.699 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8148 0.12 MB/sec execute 188 sec latency 304.930 ms 2023-12-16T20:28:29.699 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8158 0.12 MB/sec execute 189 sec latency 286.913 ms 2023-12-16T20:28:30.699 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8194 0.12 MB/sec execute 190 sec latency 297.629 ms 2023-12-16T20:28:31.699 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8212 0.12 MB/sec execute 191 sec latency 298.559 ms 2023-12-16T20:28:32.699 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8252 0.12 MB/sec execute 192 sec latency 288.714 ms 2023-12-16T20:28:33.699 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8276 0.12 MB/sec execute 193 sec latency 273.806 ms 2023-12-16T20:28:34.699 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8281 0.12 MB/sec execute 194 sec latency 369.926 ms 2023-12-16T20:28:35.699 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8312 0.12 MB/sec execute 195 sec latency 127.916 ms 2023-12-16T20:28:36.699 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8343 0.12 MB/sec execute 196 sec latency 309.417 ms 2023-12-16T20:28:37.699 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8375 0.12 MB/sec execute 197 sec latency 300.585 ms 2023-12-16T20:28:38.699 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8390 0.12 MB/sec execute 198 sec latency 293.603 ms 2023-12-16T20:28:39.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8486 0.13 MB/sec execute 199 sec latency 302.315 ms 2023-12-16T20:28:40.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8494 0.13 MB/sec execute 200 sec latency 280.042 ms 2023-12-16T20:28:41.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8522 0.13 MB/sec execute 201 sec latency 289.405 ms 2023-12-16T20:28:42.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8555 0.13 MB/sec execute 202 sec latency 280.944 ms 2023-12-16T20:28:43.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8575 0.13 MB/sec execute 203 sec latency 277.992 ms 2023-12-16T20:28:44.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8596 0.13 MB/sec execute 204 sec latency 381.545 ms 2023-12-16T20:28:45.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8621 0.13 MB/sec execute 205 sec latency 323.829 ms 2023-12-16T20:28:46.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8639 0.13 MB/sec execute 206 sec latency 272.914 ms 2023-12-16T20:28:47.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8672 0.13 MB/sec execute 207 sec latency 308.072 ms 2023-12-16T20:28:48.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8697 0.13 MB/sec execute 208 sec latency 257.599 ms 2023-12-16T20:28:49.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8720 0.12 MB/sec execute 209 sec latency 348.200 ms 2023-12-16T20:28:50.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8749 0.12 MB/sec execute 210 sec latency 312.477 ms 2023-12-16T20:28:51.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8770 0.12 MB/sec execute 211 sec latency 299.430 ms 2023-12-16T20:28:52.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8808 0.12 MB/sec execute 212 sec latency 222.180 ms 2023-12-16T20:28:53.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8866 0.12 MB/sec execute 213 sec latency 278.954 ms 2023-12-16T20:28:53.756 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:28:53.759 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:28:54.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8889 0.12 MB/sec execute 214 sec latency 424.917 ms 2023-12-16T20:28:55.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8929 0.12 MB/sec execute 215 sec latency 279.785 ms 2023-12-16T20:28:56.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8948 0.12 MB/sec execute 216 sec latency 295.803 ms 2023-12-16T20:28:57.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8968 0.12 MB/sec execute 217 sec latency 306.625 ms 2023-12-16T20:28:58.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 8989 0.12 MB/sec execute 218 sec latency 313.701 ms 2023-12-16T20:28:59.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9019 0.12 MB/sec execute 219 sec latency 282.502 ms 2023-12-16T20:29:00.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9066 0.12 MB/sec execute 220 sec latency 282.750 ms 2023-12-16T20:29:01.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9098 0.12 MB/sec execute 221 sec latency 283.293 ms 2023-12-16T20:29:02.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9141 0.12 MB/sec execute 222 sec latency 278.167 ms 2023-12-16T20:29:03.700 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9159 0.12 MB/sec execute 223 sec latency 310.709 ms 2023-12-16T20:29:04.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9167 0.12 MB/sec execute 224 sec latency 369.425 ms 2023-12-16T20:29:05.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9195 0.12 MB/sec execute 225 sec latency 434.739 ms 2023-12-16T20:29:06.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9243 0.12 MB/sec execute 226 sec latency 331.171 ms 2023-12-16T20:29:07.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9256 0.12 MB/sec execute 227 sec latency 363.602 ms 2023-12-16T20:29:08.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9284 0.12 MB/sec execute 228 sec latency 318.300 ms 2023-12-16T20:29:09.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9307 0.12 MB/sec execute 229 sec latency 305.943 ms 2023-12-16T20:29:10.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9367 0.12 MB/sec execute 230 sec latency 314.415 ms 2023-12-16T20:29:11.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9407 0.12 MB/sec execute 231 sec latency 275.462 ms 2023-12-16T20:29:12.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9425 0.12 MB/sec execute 232 sec latency 425.970 ms 2023-12-16T20:29:13.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9439 0.12 MB/sec execute 233 sec latency 288.652 ms 2023-12-16T20:29:14.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9463 0.12 MB/sec execute 234 sec latency 292.663 ms 2023-12-16T20:29:15.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9470 0.12 MB/sec execute 235 sec latency 302.385 ms 2023-12-16T20:29:16.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9475 0.12 MB/sec execute 236 sec latency 528.030 ms 2023-12-16T20:29:17.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9500 0.12 MB/sec execute 237 sec latency 291.498 ms 2023-12-16T20:29:18.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9527 0.12 MB/sec execute 238 sec latency 308.052 ms 2023-12-16T20:29:19.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9538 0.12 MB/sec execute 239 sec latency 324.981 ms 2023-12-16T20:29:20.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9557 0.12 MB/sec execute 240 sec latency 164.492 ms 2023-12-16T20:29:21.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9593 0.12 MB/sec execute 241 sec latency 336.307 ms 2023-12-16T20:29:22.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9601 0.12 MB/sec execute 242 sec latency 301.844 ms 2023-12-16T20:29:23.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9653 0.12 MB/sec execute 243 sec latency 291.791 ms 2023-12-16T20:29:23.944 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:29:23.947 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:29:24.702 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9664 0.12 MB/sec execute 244 sec latency 368.027 ms 2023-12-16T20:29:25.702 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9683 0.12 MB/sec execute 245 sec latency 299.700 ms 2023-12-16T20:29:26.701 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9704 0.12 MB/sec execute 246 sec latency 308.429 ms 2023-12-16T20:29:27.702 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9719 0.12 MB/sec execute 247 sec latency 295.663 ms 2023-12-16T20:29:28.702 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9757 0.12 MB/sec execute 248 sec latency 311.556 ms 2023-12-16T20:29:29.702 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9852 0.13 MB/sec execute 249 sec latency 297.094 ms 2023-12-16T20:29:30.702 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9875 0.13 MB/sec execute 250 sec latency 338.574 ms 2023-12-16T20:29:31.702 INFO:tasks.workunit.client.0.smithi087.stdout: 1 9973 0.13 MB/sec execute 251 sec latency 295.027 ms 2023-12-16T20:29:32.702 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10002 0.13 MB/sec execute 252 sec latency 148.049 ms 2023-12-16T20:29:33.702 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10037 0.13 MB/sec execute 253 sec latency 192.102 ms 2023-12-16T20:29:34.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10073 0.13 MB/sec execute 254 sec latency 292.740 ms 2023-12-16T20:29:35.702 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10092 0.13 MB/sec execute 255 sec latency 371.943 ms 2023-12-16T20:29:36.702 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10114 0.13 MB/sec execute 256 sec latency 283.341 ms 2023-12-16T20:29:37.702 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10266 0.13 MB/sec execute 257 sec latency 308.010 ms 2023-12-16T20:29:38.702 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10287 0.13 MB/sec execute 258 sec latency 340.664 ms 2023-12-16T20:29:39.702 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10331 0.13 MB/sec execute 259 sec latency 278.415 ms 2023-12-16T20:29:40.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10374 0.14 MB/sec execute 260 sec latency 296.003 ms 2023-12-16T20:29:41.702 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10382 0.14 MB/sec execute 261 sec latency 315.501 ms 2023-12-16T20:29:42.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10386 0.13 MB/sec execute 262 sec latency 293.279 ms 2023-12-16T20:29:43.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10391 0.13 MB/sec execute 263 sec latency 365.415 ms 2023-12-16T20:29:44.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10394 0.13 MB/sec execute 264 sec latency 448.533 ms 2023-12-16T20:29:45.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10402 0.13 MB/sec execute 265 sec latency 345.347 ms 2023-12-16T20:29:46.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10407 0.13 MB/sec execute 266 sec latency 355.203 ms 2023-12-16T20:29:47.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10410 0.13 MB/sec execute 267 sec latency 295.446 ms 2023-12-16T20:29:48.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10415 0.13 MB/sec execute 268 sec latency 296.707 ms 2023-12-16T20:29:49.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10418 0.13 MB/sec execute 269 sec latency 285.387 ms 2023-12-16T20:29:50.329 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:08:55.568 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:29:50.389 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:08:55.628 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:29:50.400 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:08:55.593 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:29:50.463 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:08:55.656 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:29:50.471 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:08:55.664 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:29:50.525 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:08:55.718 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:29:50.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10423 0.13 MB/sec execute 270 sec latency 326.207 ms 2023-12-16T20:29:50.765 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:08:56.005 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:29:50.855 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:08:56.048 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:29:50.887 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:08:56.080 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:29:51.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10426 0.13 MB/sec execute 271 sec latency 383.395 ms 2023-12-16T20:29:52.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10431 0.13 MB/sec execute 272 sec latency 311.198 ms 2023-12-16T20:29:53.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10434 0.13 MB/sec execute 273 sec latency 310.953 ms 2023-12-16T20:29:54.008 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:29:54.011 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:29:54.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10442 0.13 MB/sec execute 274 sec latency 291.697 ms 2023-12-16T20:29:55.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10471 0.13 MB/sec execute 275 sec latency 147.725 ms 2023-12-16T20:29:56.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10492 0.13 MB/sec execute 276 sec latency 309.626 ms 2023-12-16T20:29:57.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10591 0.14 MB/sec execute 277 sec latency 294.849 ms 2023-12-16T20:29:58.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10627 0.14 MB/sec execute 278 sec latency 167.563 ms 2023-12-16T20:29:59.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10653 0.14 MB/sec execute 279 sec latency 278.950 ms 2023-12-16T20:30:00.704 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10668 0.14 MB/sec execute 280 sec latency 300.414 ms 2023-12-16T20:30:01.703 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10719 0.14 MB/sec execute 281 sec latency 315.661 ms 2023-12-16T20:30:02.704 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10735 0.14 MB/sec execute 282 sec latency 325.923 ms 2023-12-16T20:30:03.704 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10763 0.14 MB/sec execute 283 sec latency 278.686 ms 2023-12-16T20:30:04.704 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10776 0.14 MB/sec execute 284 sec latency 396.753 ms 2023-12-16T20:30:05.704 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10799 0.14 MB/sec execute 285 sec latency 434.250 ms 2023-12-16T20:30:06.704 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10850 0.14 MB/sec execute 286 sec latency 293.254 ms 2023-12-16T20:30:07.704 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10870 0.14 MB/sec execute 287 sec latency 308.296 ms 2023-12-16T20:30:08.704 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10881 0.14 MB/sec execute 288 sec latency 189.524 ms 2023-12-16T20:30:09.704 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10894 0.14 MB/sec execute 289 sec latency 256.380 ms 2023-12-16T20:30:10.704 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10910 0.14 MB/sec execute 290 sec latency 163.816 ms 2023-12-16T20:30:11.704 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10927 0.14 MB/sec execute 291 sec latency 233.068 ms 2023-12-16T20:30:12.704 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10943 0.14 MB/sec execute 292 sec latency 262.279 ms 2023-12-16T20:30:13.704 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10960 0.14 MB/sec execute 293 sec latency 156.307 ms 2023-12-16T20:30:14.704 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10969 0.13 MB/sec execute 294 sec latency 444.659 ms 2023-12-16T20:30:15.704 INFO:tasks.workunit.client.0.smithi087.stdout: 1 10988 0.14 MB/sec execute 295 sec latency 301.177 ms 2023-12-16T20:30:16.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11010 0.13 MB/sec execute 296 sec latency 291.539 ms 2023-12-16T20:30:17.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11026 0.13 MB/sec execute 297 sec latency 177.963 ms 2023-12-16T20:30:18.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11037 0.13 MB/sec execute 298 sec latency 182.529 ms 2023-12-16T20:30:19.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11053 0.13 MB/sec execute 299 sec latency 162.428 ms 2023-12-16T20:30:20.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11072 0.13 MB/sec execute 300 sec latency 158.407 ms 2023-12-16T20:30:21.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11089 0.13 MB/sec execute 301 sec latency 165.887 ms 2023-12-16T20:30:22.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11105 0.13 MB/sec execute 302 sec latency 156.862 ms 2023-12-16T20:30:23.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11118 0.13 MB/sec execute 303 sec latency 305.930 ms 2023-12-16T20:30:24.132 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:30:24.135 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:30:24.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11126 0.13 MB/sec execute 304 sec latency 411.334 ms 2023-12-16T20:30:25.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11148 0.13 MB/sec execute 305 sec latency 316.998 ms 2023-12-16T20:30:26.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11161 0.13 MB/sec execute 306 sec latency 270.224 ms 2023-12-16T20:30:27.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11186 0.13 MB/sec execute 307 sec latency 295.809 ms 2023-12-16T20:30:28.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11207 0.13 MB/sec execute 308 sec latency 218.188 ms 2023-12-16T20:30:29.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11237 0.13 MB/sec execute 309 sec latency 200.385 ms 2023-12-16T20:30:30.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11252 0.13 MB/sec execute 310 sec latency 256.933 ms 2023-12-16T20:30:31.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11265 0.13 MB/sec execute 311 sec latency 323.826 ms 2023-12-16T20:30:32.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11300 0.13 MB/sec execute 312 sec latency 311.081 ms 2023-12-16T20:30:33.599 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:09:38.838 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:30:33.605 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:09:38.844 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:30:33.614 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:09:38.807 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:30:33.615 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:09:38.808 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:30:33.616 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:09:38.810 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:30:33.618 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:09:38.811 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:30:33.655 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:09:38.895 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:30:33.667 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:09:38.860 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:30:33.679 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:09:38.872 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:30:33.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11314 0.13 MB/sec execute 313 sec latency 377.568 ms 2023-12-16T20:30:34.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11336 0.13 MB/sec execute 314 sec latency 333.689 ms 2023-12-16T20:30:35.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11365 0.13 MB/sec execute 315 sec latency 294.986 ms 2023-12-16T20:30:36.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11404 0.13 MB/sec execute 316 sec latency 227.015 ms 2023-12-16T20:30:37.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11433 0.13 MB/sec execute 317 sec latency 320.910 ms 2023-12-16T20:30:38.705 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11472 0.13 MB/sec execute 318 sec latency 217.243 ms 2023-12-16T20:30:39.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11477 0.13 MB/sec execute 319 sec latency 322.502 ms 2023-12-16T20:30:40.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11513 0.13 MB/sec execute 320 sec latency 311.875 ms 2023-12-16T20:30:41.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11535 0.13 MB/sec execute 321 sec latency 330.914 ms 2023-12-16T20:30:42.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11563 0.13 MB/sec execute 322 sec latency 272.879 ms 2023-12-16T20:30:43.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11588 0.13 MB/sec execute 323 sec latency 307.415 ms 2023-12-16T20:30:44.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11595 0.13 MB/sec execute 324 sec latency 300.844 ms 2023-12-16T20:30:45.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11627 0.13 MB/sec execute 325 sec latency 285.409 ms 2023-12-16T20:30:46.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11658 0.13 MB/sec execute 326 sec latency 281.911 ms 2023-12-16T20:30:47.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11695 0.13 MB/sec execute 327 sec latency 310.147 ms 2023-12-16T20:30:48.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11705 0.13 MB/sec execute 328 sec latency 323.319 ms 2023-12-16T20:30:49.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11741 0.13 MB/sec execute 329 sec latency 328.550 ms 2023-12-16T20:30:50.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11759 0.13 MB/sec execute 330 sec latency 303.763 ms 2023-12-16T20:30:51.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11792 0.13 MB/sec execute 331 sec latency 279.122 ms 2023-12-16T20:30:52.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11824 0.13 MB/sec execute 332 sec latency 296.977 ms 2023-12-16T20:30:53.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11829 0.13 MB/sec execute 333 sec latency 296.623 ms 2023-12-16T20:30:54.231 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:30:54.233 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:30:54.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11857 0.13 MB/sec execute 334 sec latency 211.787 ms 2023-12-16T20:30:55.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11887 0.13 MB/sec execute 335 sec latency 297.350 ms 2023-12-16T20:30:56.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11911 0.13 MB/sec execute 336 sec latency 341.832 ms 2023-12-16T20:30:57.706 INFO:tasks.workunit.client.0.smithi087.stdout: 1 11937 0.13 MB/sec execute 337 sec latency 352.232 ms 2023-12-16T20:30:58.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12032 0.13 MB/sec execute 338 sec latency 302.418 ms 2023-12-16T20:30:59.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12041 0.13 MB/sec execute 339 sec latency 286.165 ms 2023-12-16T20:31:00.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12059 0.13 MB/sec execute 340 sec latency 309.080 ms 2023-12-16T20:31:01.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12085 0.13 MB/sec execute 341 sec latency 278.265 ms 2023-12-16T20:31:02.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12118 0.13 MB/sec execute 342 sec latency 348.795 ms 2023-12-16T20:31:03.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12141 0.13 MB/sec execute 343 sec latency 294.906 ms 2023-12-16T20:31:04.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12156 0.13 MB/sec execute 344 sec latency 295.995 ms 2023-12-16T20:31:05.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12183 0.13 MB/sec execute 345 sec latency 306.850 ms 2023-12-16T20:31:06.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12210 0.13 MB/sec execute 346 sec latency 306.700 ms 2023-12-16T20:31:07.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12242 0.13 MB/sec execute 347 sec latency 303.159 ms 2023-12-16T20:31:08.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12264 0.13 MB/sec execute 348 sec latency 281.773 ms 2023-12-16T20:31:09.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12282 0.13 MB/sec execute 349 sec latency 326.185 ms 2023-12-16T20:31:10.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12308 0.13 MB/sec execute 350 sec latency 317.027 ms 2023-12-16T20:31:11.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12344 0.13 MB/sec execute 351 sec latency 379.912 ms 2023-12-16T20:31:12.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12362 0.13 MB/sec execute 352 sec latency 285.790 ms 2023-12-16T20:31:13.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12427 0.13 MB/sec execute 353 sec latency 298.919 ms 2023-12-16T20:31:14.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12462 0.13 MB/sec execute 354 sec latency 296.104 ms 2023-12-16T20:31:15.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12482 0.13 MB/sec execute 355 sec latency 439.489 ms 2023-12-16T20:31:16.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12505 0.13 MB/sec execute 356 sec latency 309.414 ms 2023-12-16T20:31:17.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12524 0.13 MB/sec execute 357 sec latency 298.446 ms 2023-12-16T20:31:18.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12556 0.13 MB/sec execute 358 sec latency 311.910 ms 2023-12-16T20:31:19.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12570 0.13 MB/sec execute 359 sec latency 298.656 ms 2023-12-16T20:31:20.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12631 0.13 MB/sec execute 360 sec latency 325.675 ms 2023-12-16T20:31:21.707 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12655 0.13 MB/sec execute 361 sec latency 274.861 ms 2023-12-16T20:31:22.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12698 0.13 MB/sec execute 362 sec latency 309.246 ms 2023-12-16T20:31:23.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12711 0.13 MB/sec execute 363 sec latency 308.100 ms 2023-12-16T20:31:24.384 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:31:24.386 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:31:24.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12734 0.13 MB/sec execute 364 sec latency 319.659 ms 2023-12-16T20:31:25.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12748 0.13 MB/sec execute 365 sec latency 419.645 ms 2023-12-16T20:31:26.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12795 0.12 MB/sec execute 366 sec latency 353.535 ms 2023-12-16T20:31:27.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12828 0.12 MB/sec execute 367 sec latency 313.811 ms 2023-12-16T20:31:28.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12837 0.12 MB/sec execute 368 sec latency 327.522 ms 2023-12-16T20:31:29.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12875 0.12 MB/sec execute 369 sec latency 332.198 ms 2023-12-16T20:31:30.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12947 0.13 MB/sec execute 370 sec latency 296.540 ms 2023-12-16T20:31:31.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12960 0.13 MB/sec execute 371 sec latency 427.962 ms 2023-12-16T20:31:32.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12978 0.13 MB/sec execute 372 sec latency 344.175 ms 2023-12-16T20:31:33.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 12990 0.13 MB/sec execute 373 sec latency 334.840 ms 2023-12-16T20:31:34.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13015 0.13 MB/sec execute 374 sec latency 306.512 ms 2023-12-16T20:31:35.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13018 0.13 MB/sec execute 375 sec latency 465.394 ms 2023-12-16T20:31:36.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13030 0.12 MB/sec execute 376 sec latency 535.218 ms 2023-12-16T20:31:37.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13053 0.12 MB/sec execute 377 sec latency 295.535 ms 2023-12-16T20:31:38.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13079 0.12 MB/sec execute 378 sec latency 281.110 ms 2023-12-16T20:31:39.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13088 0.12 MB/sec execute 379 sec latency 359.046 ms 2023-12-16T20:31:40.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13108 0.12 MB/sec execute 380 sec latency 169.884 ms 2023-12-16T20:31:41.708 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13143 0.13 MB/sec execute 381 sec latency 313.441 ms 2023-12-16T20:31:42.709 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13155 0.12 MB/sec execute 382 sec latency 302.533 ms 2023-12-16T20:31:43.709 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13203 0.13 MB/sec execute 383 sec latency 303.184 ms 2023-12-16T20:31:44.709 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13223 0.12 MB/sec execute 384 sec latency 322.098 ms 2023-12-16T20:31:45.709 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13234 0.12 MB/sec execute 385 sec latency 321.244 ms 2023-12-16T20:31:46.709 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13255 0.12 MB/sec execute 386 sec latency 320.097 ms 2023-12-16T20:31:47.709 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13269 0.12 MB/sec execute 387 sec latency 308.498 ms 2023-12-16T20:31:48.709 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13370 0.13 MB/sec execute 388 sec latency 326.259 ms 2023-12-16T20:31:49.709 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13410 0.13 MB/sec execute 389 sec latency 329.023 ms 2023-12-16T20:31:50.709 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13427 0.13 MB/sec execute 390 sec latency 312.911 ms 2023-12-16T20:31:51.709 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13526 0.13 MB/sec execute 391 sec latency 296.499 ms 2023-12-16T20:31:52.709 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13558 0.13 MB/sec execute 392 sec latency 143.800 ms 2023-12-16T20:31:53.709 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13588 0.13 MB/sec execute 393 sec latency 188.259 ms 2023-12-16T20:31:54.443 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:31:54.446 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:31:54.709 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13624 0.13 MB/sec execute 394 sec latency 309.418 ms 2023-12-16T20:31:55.709 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13643 0.13 MB/sec execute 395 sec latency 470.622 ms 2023-12-16T20:31:56.709 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13665 0.13 MB/sec execute 396 sec latency 297.271 ms 2023-12-16T20:31:57.709 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13817 0.13 MB/sec execute 397 sec latency 317.767 ms 2023-12-16T20:31:58.709 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13838 0.13 MB/sec execute 398 sec latency 302.183 ms 2023-12-16T20:31:59.709 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13882 0.13 MB/sec execute 399 sec latency 301.264 ms 2023-12-16T20:32:00.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13924 0.14 MB/sec execute 400 sec latency 285.232 ms 2023-12-16T20:32:01.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13932 0.14 MB/sec execute 401 sec latency 292.865 ms 2023-12-16T20:32:02.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13936 0.14 MB/sec execute 402 sec latency 295.504 ms 2023-12-16T20:32:03.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13941 0.13 MB/sec execute 403 sec latency 372.238 ms 2023-12-16T20:32:04.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13943 0.13 MB/sec execute 404 sec latency 439.759 ms 2023-12-16T20:32:05.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13948 0.13 MB/sec execute 405 sec latency 503.579 ms 2023-12-16T20:32:06.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13956 0.13 MB/sec execute 406 sec latency 366.429 ms 2023-12-16T20:32:07.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13960 0.13 MB/sec execute 407 sec latency 309.316 ms 2023-12-16T20:32:08.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13963 0.13 MB/sec execute 408 sec latency 315.255 ms 2023-12-16T20:32:09.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13967 0.13 MB/sec execute 409 sec latency 341.252 ms 2023-12-16T20:32:10.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13971 0.13 MB/sec execute 410 sec latency 305.139 ms 2023-12-16T20:32:11.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13975 0.13 MB/sec execute 411 sec latency 322.005 ms 2023-12-16T20:32:12.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13980 0.13 MB/sec execute 412 sec latency 300.552 ms 2023-12-16T20:32:13.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13983 0.13 MB/sec execute 413 sec latency 300.951 ms 2023-12-16T20:32:14.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 13986 0.13 MB/sec execute 414 sec latency 404.794 ms 2023-12-16T20:32:15.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14014 0.13 MB/sec execute 415 sec latency 413.538 ms 2023-12-16T20:32:16.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14040 0.13 MB/sec execute 416 sec latency 182.993 ms 2023-12-16T20:32:17.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14047 0.13 MB/sec execute 417 sec latency 303.956 ms 2023-12-16T20:32:18.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14172 0.14 MB/sec execute 418 sec latency 280.805 ms 2023-12-16T20:32:19.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14197 0.14 MB/sec execute 419 sec latency 288.843 ms 2023-12-16T20:32:20.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14217 0.14 MB/sec execute 420 sec latency 298.280 ms 2023-12-16T20:32:21.711 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14230 0.14 MB/sec execute 421 sec latency 322.016 ms 2023-12-16T20:32:22.711 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14281 0.14 MB/sec execute 422 sec latency 386.736 ms 2023-12-16T20:32:23.711 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14307 0.14 MB/sec execute 423 sec latency 302.049 ms 2023-12-16T20:32:24.579 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:32:24.581 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:32:24.710 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14318 0.14 MB/sec execute 424 sec latency 298.683 ms 2023-12-16T20:32:25.711 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14337 0.14 MB/sec execute 425 sec latency 295.109 ms 2023-12-16T20:32:26.711 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14396 0.14 MB/sec execute 426 sec latency 151.433 ms 2023-12-16T20:32:27.711 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14413 0.14 MB/sec execute 427 sec latency 323.548 ms 2023-12-16T20:32:28.711 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14428 0.14 MB/sec execute 428 sec latency 178.231 ms 2023-12-16T20:32:29.711 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14439 0.14 MB/sec execute 429 sec latency 185.595 ms 2023-12-16T20:32:30.711 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14454 0.14 MB/sec execute 430 sec latency 206.567 ms 2023-12-16T20:32:31.711 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14471 0.14 MB/sec execute 431 sec latency 140.785 ms 2023-12-16T20:32:32.711 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14490 0.14 MB/sec execute 432 sec latency 138.629 ms 2023-12-16T20:32:33.711 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14507 0.14 MB/sec execute 433 sec latency 255.170 ms 2023-12-16T20:32:34.711 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14515 0.14 MB/sec execute 434 sec latency 334.891 ms 2023-12-16T20:32:35.711 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14535 0.14 MB/sec execute 435 sec latency 488.787 ms 2023-12-16T20:32:36.711 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14553 0.14 MB/sec execute 436 sec latency 300.716 ms 2023-12-16T20:32:37.711 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14571 0.14 MB/sec execute 437 sec latency 311.208 ms 2023-12-16T20:32:38.711 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14582 0.13 MB/sec execute 438 sec latency 189.575 ms 2023-12-16T20:32:39.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14597 0.13 MB/sec execute 439 sec latency 178.586 ms 2023-12-16T20:32:40.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14614 0.13 MB/sec execute 440 sec latency 154.818 ms 2023-12-16T20:32:41.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14630 0.13 MB/sec execute 441 sec latency 161.037 ms 2023-12-16T20:32:42.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14648 0.13 MB/sec execute 442 sec latency 157.780 ms 2023-12-16T20:32:43.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14666 0.13 MB/sec execute 443 sec latency 143.728 ms 2023-12-16T20:32:44.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14673 0.13 MB/sec execute 444 sec latency 309.082 ms 2023-12-16T20:32:45.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14686 0.13 MB/sec execute 445 sec latency 322.698 ms 2023-12-16T20:32:46.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14705 0.13 MB/sec execute 446 sec latency 306.766 ms 2023-12-16T20:32:47.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14727 0.13 MB/sec execute 447 sec latency 287.734 ms 2023-12-16T20:32:48.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14749 0.13 MB/sec execute 448 sec latency 258.127 ms 2023-12-16T20:32:49.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14774 0.13 MB/sec execute 449 sec latency 180.448 ms 2023-12-16T20:32:50.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14795 0.13 MB/sec execute 450 sec latency 300.672 ms 2023-12-16T20:32:51.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14810 0.13 MB/sec execute 451 sec latency 306.159 ms 2023-12-16T20:32:52.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14822 0.13 MB/sec execute 452 sec latency 354.413 ms 2023-12-16T20:32:53.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14857 0.13 MB/sec execute 453 sec latency 330.680 ms 2023-12-16T20:32:54.680 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:32:54.683 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:32:54.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14872 0.13 MB/sec execute 454 sec latency 349.023 ms 2023-12-16T20:32:55.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14904 0.13 MB/sec execute 455 sec latency 298.871 ms 2023-12-16T20:32:56.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14945 0.13 MB/sec execute 456 sec latency 233.788 ms 2023-12-16T20:32:57.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 14976 0.13 MB/sec execute 457 sec latency 292.498 ms 2023-12-16T20:32:58.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15018 0.13 MB/sec execute 458 sec latency 223.987 ms 2023-12-16T20:32:59.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15024 0.13 MB/sec execute 459 sec latency 326.514 ms 2023-12-16T20:33:00.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15060 0.13 MB/sec execute 460 sec latency 301.009 ms 2023-12-16T20:33:01.712 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15079 0.13 MB/sec execute 461 sec latency 316.496 ms 2023-12-16T20:33:02.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15108 0.13 MB/sec execute 462 sec latency 325.008 ms 2023-12-16T20:33:03.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15134 0.13 MB/sec execute 463 sec latency 287.226 ms 2023-12-16T20:33:04.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15140 0.13 MB/sec execute 464 sec latency 286.816 ms 2023-12-16T20:33:05.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15172 0.13 MB/sec execute 465 sec latency 313.878 ms 2023-12-16T20:33:06.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15199 0.13 MB/sec execute 466 sec latency 235.860 ms 2023-12-16T20:33:07.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15238 0.13 MB/sec execute 467 sec latency 301.394 ms 2023-12-16T20:33:08.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15252 0.13 MB/sec execute 468 sec latency 304.791 ms 2023-12-16T20:33:09.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15278 0.13 MB/sec execute 469 sec latency 281.169 ms 2023-12-16T20:33:10.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15304 0.13 MB/sec execute 470 sec latency 297.715 ms 2023-12-16T20:33:11.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15331 0.13 MB/sec execute 471 sec latency 296.019 ms 2023-12-16T20:33:12.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15362 0.13 MB/sec execute 472 sec latency 312.753 ms 2023-12-16T20:33:13.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15372 0.13 MB/sec execute 473 sec latency 296.485 ms 2023-12-16T20:33:14.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15402 0.13 MB/sec execute 474 sec latency 299.887 ms 2023-12-16T20:33:15.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15426 0.13 MB/sec execute 475 sec latency 387.386 ms 2023-12-16T20:33:16.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15454 0.13 MB/sec execute 476 sec latency 285.139 ms 2023-12-16T20:33:17.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15482 0.13 MB/sec execute 477 sec latency 323.569 ms 2023-12-16T20:33:18.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15498 0.13 MB/sec execute 478 sec latency 317.068 ms 2023-12-16T20:33:19.714 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15583 0.13 MB/sec execute 479 sec latency 301.586 ms 2023-12-16T20:33:20.713 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15599 0.13 MB/sec execute 480 sec latency 303.232 ms 2023-12-16T20:33:21.714 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15621 0.13 MB/sec execute 481 sec latency 316.891 ms 2023-12-16T20:33:22.714 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15650 0.13 MB/sec execute 482 sec latency 283.542 ms 2023-12-16T20:33:23.714 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15687 0.13 MB/sec execute 483 sec latency 299.053 ms 2023-12-16T20:33:24.714 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15701 0.13 MB/sec execute 484 sec latency 326.564 ms 2023-12-16T20:33:24.807 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:33:24.810 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:33:25.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15728 0.13 MB/sec execute 485 sec latency 224.410 ms 2023-12-16T20:33:26.714 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15756 0.13 MB/sec execute 486 sec latency 294.010 ms 2023-12-16T20:33:27.714 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15786 0.13 MB/sec execute 487 sec latency 303.308 ms 2023-12-16T20:33:28.714 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15807 0.13 MB/sec execute 488 sec latency 316.020 ms 2023-12-16T20:33:29.714 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15818 0.13 MB/sec execute 489 sec latency 297.031 ms 2023-12-16T20:33:30.714 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15845 0.13 MB/sec execute 490 sec latency 318.369 ms 2023-12-16T20:33:31.714 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15890 0.13 MB/sec execute 491 sec latency 308.449 ms 2023-12-16T20:33:32.714 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15908 0.13 MB/sec execute 492 sec latency 294.410 ms 2023-12-16T20:33:33.714 INFO:tasks.workunit.client.0.smithi087.stdout: 1 15971 0.13 MB/sec execute 493 sec latency 316.899 ms 2023-12-16T20:33:34.715 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16007 0.13 MB/sec execute 494 sec latency 270.886 ms 2023-12-16T20:33:35.714 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16024 0.13 MB/sec execute 495 sec latency 470.050 ms 2023-12-16T20:33:36.714 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16042 0.13 MB/sec execute 496 sec latency 297.132 ms 2023-12-16T20:33:37.715 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16063 0.13 MB/sec execute 497 sec latency 289.118 ms 2023-12-16T20:33:38.715 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16099 0.13 MB/sec execute 498 sec latency 303.042 ms 2023-12-16T20:33:39.715 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16113 0.13 MB/sec execute 499 sec latency 329.359 ms 2023-12-16T20:33:40.715 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16174 0.13 MB/sec execute 500 sec latency 279.925 ms 2023-12-16T20:33:41.715 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16198 0.13 MB/sec execute 501 sec latency 284.759 ms 2023-12-16T20:33:42.715 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16240 0.13 MB/sec execute 502 sec latency 310.085 ms 2023-12-16T20:33:43.715 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16252 0.13 MB/sec execute 503 sec latency 295.353 ms 2023-12-16T20:33:44.715 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16277 0.13 MB/sec execute 504 sec latency 309.156 ms 2023-12-16T20:33:45.715 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16291 0.13 MB/sec execute 505 sec latency 457.572 ms 2023-12-16T20:33:46.715 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16338 0.13 MB/sec execute 506 sec latency 345.784 ms 2023-12-16T20:33:47.715 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16371 0.13 MB/sec execute 507 sec latency 326.924 ms 2023-12-16T20:33:48.715 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16380 0.13 MB/sec execute 508 sec latency 304.649 ms 2023-12-16T20:33:49.715 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16418 0.13 MB/sec execute 509 sec latency 299.544 ms 2023-12-16T20:33:50.715 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16489 0.13 MB/sec execute 510 sec latency 282.608 ms 2023-12-16T20:33:51.715 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16502 0.13 MB/sec execute 511 sec latency 299.354 ms 2023-12-16T20:33:52.715 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16520 0.13 MB/sec execute 512 sec latency 475.650 ms 2023-12-16T20:33:53.716 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16532 0.13 MB/sec execute 513 sec latency 292.609 ms 2023-12-16T20:33:54.716 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16557 0.13 MB/sec execute 514 sec latency 300.398 ms 2023-12-16T20:33:54.955 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:33:54.957 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:33:55.715 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16560 0.13 MB/sec execute 515 sec latency 515.227 ms 2023-12-16T20:33:56.716 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16572 0.13 MB/sec execute 516 sec latency 320.692 ms 2023-12-16T20:33:57.716 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16594 0.13 MB/sec execute 517 sec latency 277.656 ms 2023-12-16T20:33:58.716 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16619 0.13 MB/sec execute 518 sec latency 334.542 ms 2023-12-16T20:33:59.716 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16630 0.13 MB/sec execute 519 sec latency 296.528 ms 2023-12-16T20:34:00.716 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16650 0.13 MB/sec execute 520 sec latency 148.034 ms 2023-12-16T20:34:01.026 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:13:06.266 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:34:01.031 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:13:06.271 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:34:01.085 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:13:06.278 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:34:01.086 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:13:06.279 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:34:01.086 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:13:06.280 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:34:01.087 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:13:06.281 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:34:01.108 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:13:06.348 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:34:01.162 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:13:06.355 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:34:01.163 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:13:06.356 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:34:01.716 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16685 0.13 MB/sec execute 521 sec latency 349.626 ms 2023-12-16T20:34:02.716 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16696 0.13 MB/sec execute 522 sec latency 295.365 ms 2023-12-16T20:34:03.716 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16746 0.13 MB/sec execute 523 sec latency 303.785 ms 2023-12-16T20:34:04.716 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16766 0.13 MB/sec execute 524 sec latency 308.379 ms 2023-12-16T20:34:05.716 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16777 0.13 MB/sec execute 525 sec latency 326.091 ms 2023-12-16T20:34:06.716 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16797 0.13 MB/sec execute 526 sec latency 305.495 ms 2023-12-16T20:34:07.716 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16812 0.13 MB/sec execute 527 sec latency 339.304 ms 2023-12-16T20:34:08.716 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16911 0.13 MB/sec execute 528 sec latency 305.004 ms 2023-12-16T20:34:09.716 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16952 0.13 MB/sec execute 529 sec latency 308.079 ms 2023-12-16T20:34:10.716 INFO:tasks.workunit.client.0.smithi087.stdout: 1 16968 0.13 MB/sec execute 530 sec latency 299.291 ms 2023-12-16T20:34:11.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17067 0.13 MB/sec execute 531 sec latency 303.763 ms 2023-12-16T20:34:12.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17095 0.13 MB/sec execute 532 sec latency 143.661 ms 2023-12-16T20:34:13.716 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17130 0.13 MB/sec execute 533 sec latency 186.237 ms 2023-12-16T20:34:14.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17166 0.13 MB/sec execute 534 sec latency 309.230 ms 2023-12-16T20:34:15.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17185 0.13 MB/sec execute 535 sec latency 473.374 ms 2023-12-16T20:34:16.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17208 0.13 MB/sec execute 536 sec latency 298.589 ms 2023-12-16T20:34:17.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17359 0.13 MB/sec execute 537 sec latency 318.999 ms 2023-12-16T20:34:18.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17380 0.13 MB/sec execute 538 sec latency 291.358 ms 2023-12-16T20:34:19.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17404 0.13 MB/sec execute 539 sec latency 302.068 ms 2023-12-16T20:34:20.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17463 0.14 MB/sec execute 540 sec latency 292.747 ms 2023-12-16T20:34:21.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17474 0.14 MB/sec execute 541 sec latency 287.030 ms 2023-12-16T20:34:22.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17478 0.14 MB/sec execute 542 sec latency 326.374 ms 2023-12-16T20:34:23.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17483 0.14 MB/sec execute 543 sec latency 343.424 ms 2023-12-16T20:34:24.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17486 0.14 MB/sec execute 544 sec latency 365.596 ms 2023-12-16T20:34:25.010 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:34:25.013 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:34:25.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17491 0.13 MB/sec execute 545 sec latency 482.369 ms 2023-12-16T20:34:26.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17499 0.13 MB/sec execute 546 sec latency 355.944 ms 2023-12-16T20:34:27.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17502 0.13 MB/sec execute 547 sec latency 322.982 ms 2023-12-16T20:34:28.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17505 0.13 MB/sec execute 548 sec latency 313.868 ms 2023-12-16T20:34:29.717 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17509 0.13 MB/sec execute 549 sec latency 324.783 ms 2023-12-16T20:34:30.718 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17514 0.13 MB/sec execute 550 sec latency 346.758 ms 2023-12-16T20:34:31.718 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17517 0.13 MB/sec execute 551 sec latency 292.524 ms 2023-12-16T20:34:32.718 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17522 0.13 MB/sec execute 552 sec latency 303.888 ms 2023-12-16T20:34:33.718 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17526 0.13 MB/sec execute 553 sec latency 303.434 ms 2023-12-16T20:34:34.718 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17529 0.13 MB/sec execute 554 sec latency 289.191 ms 2023-12-16T20:34:35.718 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17557 0.13 MB/sec execute 555 sec latency 361.256 ms 2023-12-16T20:34:36.718 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17583 0.13 MB/sec execute 556 sec latency 130.081 ms 2023-12-16T20:34:37.718 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17589 0.13 MB/sec execute 557 sec latency 302.612 ms 2023-12-16T20:34:38.718 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17707 0.14 MB/sec execute 558 sec latency 291.096 ms 2023-12-16T20:34:39.718 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17737 0.14 MB/sec execute 559 sec latency 297.032 ms 2023-12-16T20:34:40.718 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17752 0.14 MB/sec execute 560 sec latency 303.247 ms 2023-12-16T20:34:41.718 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17773 0.14 MB/sec execute 561 sec latency 304.980 ms 2023-12-16T20:34:42.718 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17825 0.14 MB/sec execute 562 sec latency 299.499 ms 2023-12-16T20:34:43.718 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17850 0.14 MB/sec execute 563 sec latency 320.075 ms 2023-12-16T20:34:44.718 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17869 0.14 MB/sec execute 564 sec latency 293.996 ms 2023-12-16T20:34:45.718 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17885 0.14 MB/sec execute 565 sec latency 411.111 ms 2023-12-16T20:34:46.718 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17941 0.14 MB/sec execute 566 sec latency 140.757 ms 2023-12-16T20:34:47.718 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17959 0.14 MB/sec execute 567 sec latency 299.874 ms 2023-12-16T20:34:48.719 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17973 0.14 MB/sec execute 568 sec latency 181.019 ms 2023-12-16T20:34:49.719 INFO:tasks.workunit.client.0.smithi087.stdout: 1 17984 0.14 MB/sec execute 569 sec latency 212.799 ms 2023-12-16T20:34:50.719 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18002 0.14 MB/sec execute 570 sec latency 184.563 ms 2023-12-16T20:34:51.719 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18019 0.14 MB/sec execute 571 sec latency 160.775 ms 2023-12-16T20:34:52.719 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18035 0.14 MB/sec execute 572 sec latency 159.926 ms 2023-12-16T20:34:53.719 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18051 0.14 MB/sec execute 573 sec latency 173.311 ms 2023-12-16T20:34:54.721 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18062 0.14 MB/sec execute 574 sec latency 302.417 ms 2023-12-16T20:34:55.199 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:34:55.202 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:34:55.719 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18081 0.14 MB/sec execute 575 sec latency 284.510 ms 2023-12-16T20:34:56.719 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18102 0.14 MB/sec execute 576 sec latency 297.031 ms 2023-12-16T20:34:57.719 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18118 0.14 MB/sec execute 577 sec latency 186.839 ms 2023-12-16T20:34:58.719 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18127 0.14 MB/sec execute 578 sec latency 193.970 ms 2023-12-16T20:34:59.719 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18143 0.14 MB/sec execute 579 sec latency 170.760 ms 2023-12-16T20:35:00.719 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18161 0.13 MB/sec execute 580 sec latency 139.297 ms 2023-12-16T20:35:01.719 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18178 0.13 MB/sec execute 581 sec latency 171.814 ms 2023-12-16T20:35:02.719 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18197 0.13 MB/sec execute 582 sec latency 138.795 ms 2023-12-16T20:35:03.719 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18210 0.13 MB/sec execute 583 sec latency 235.009 ms 2023-12-16T20:35:04.719 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18218 0.13 MB/sec execute 584 sec latency 315.139 ms 2023-12-16T20:35:05.719 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18230 0.13 MB/sec execute 585 sec latency 428.848 ms 2023-12-16T20:35:06.719 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18253 0.13 MB/sec execute 586 sec latency 299.266 ms 2023-12-16T20:35:07.720 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18276 0.13 MB/sec execute 587 sec latency 288.436 ms 2023-12-16T20:35:08.720 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18298 0.13 MB/sec execute 588 sec latency 229.261 ms 2023-12-16T20:35:09.720 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18326 0.13 MB/sec execute 589 sec latency 199.155 ms 2023-12-16T20:35:10.720 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18345 0.13 MB/sec execute 590 sec latency 233.209 ms 2023-12-16T20:35:11.720 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18360 0.13 MB/sec execute 591 sec latency 365.974 ms 2023-12-16T20:35:12.720 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18370 0.13 MB/sec execute 592 sec latency 288.767 ms 2023-12-16T20:35:13.720 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18408 0.13 MB/sec execute 593 sec latency 332.031 ms 2023-12-16T20:35:14.720 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18436 0.13 MB/sec execute 594 sec latency 303.649 ms 2023-12-16T20:35:15.720 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18461 0.13 MB/sec execute 595 sec latency 422.539 ms 2023-12-16T20:35:16.720 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18499 0.13 MB/sec execute 596 sec latency 210.065 ms 2023-12-16T20:35:17.720 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18533 0.13 MB/sec execute 597 sec latency 336.920 ms 2023-12-16T20:35:18.720 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18567 0.13 MB/sec execute 598 sec latency 215.976 ms 2023-12-16T20:35:19.720 INFO:tasks.workunit.client.0.smithi087.stdout: 1 18577 0.13 MB/sec execute 599 sec latency 313.318 ms 2023-12-16T20:35:20.720 INFO:tasks.workunit.client.0.smithi087.stdout: 1 cleanup 600 sec 2023-12-16T20:35:21.720 INFO:tasks.workunit.client.0.smithi087.stdout: 1 cleanup 601 sec 2023-12-16T20:35:22.721 INFO:tasks.workunit.client.0.smithi087.stdout: 1 cleanup 602 sec 2023-12-16T20:35:23.721 INFO:tasks.workunit.client.0.smithi087.stdout: 1 cleanup 603 sec 2023-12-16T20:35:24.721 INFO:tasks.workunit.client.0.smithi087.stdout: 1 cleanup 604 sec 2023-12-16T20:35:25.270 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:35:25.274 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:35:25.720 INFO:tasks.workunit.client.0.smithi087.stdout: 1 cleanup 605 sec 2023-12-16T20:35:26.721 INFO:tasks.workunit.client.0.smithi087.stdout: 1 cleanup 606 sec 2023-12-16T20:35:26.996 INFO:tasks.workunit.client.0.smithi087.stdout: 0 cleanup 606 sec 2023-12-16T20:35:26.997 INFO:tasks.workunit.client.0.smithi087.stdout: 2023-12-16T20:35:26.997 INFO:tasks.workunit.client.0.smithi087.stdout: Operation Count AvgLat MaxLat 2023-12-16T20:35:26.997 INFO:tasks.workunit.client.0.smithi087.stdout: ---------------------------------------- 2023-12-16T20:35:26.997 INFO:tasks.workunit.client.0.smithi087.stdout: NTCreateX 2677 62.048 308.290 2023-12-16T20:35:26.997 INFO:tasks.workunit.client.0.smithi087.stdout: Close 1931 1.127 24.417 2023-12-16T20:35:26.997 INFO:tasks.workunit.client.0.smithi087.stdout: Rename 110 177.380 379.904 2023-12-16T20:35:26.997 INFO:tasks.workunit.client.0.smithi087.stdout: Unlink 572 69.200 209.317 2023-12-16T20:35:26.997 INFO:tasks.workunit.client.0.smithi087.stdout: Qpathinfo 2402 32.779 255.438 2023-12-16T20:35:26.997 INFO:tasks.workunit.client.0.smithi087.stdout: Qfileinfo 399 0.921 6.840 2023-12-16T20:35:26.997 INFO:tasks.workunit.client.0.smithi087.stdout: Qfsinfo 446 10.554 125.537 2023-12-16T20:35:26.998 INFO:tasks.workunit.client.0.smithi087.stdout: Sfileinfo 211 11.033 13.610 2023-12-16T20:35:26.998 INFO:tasks.workunit.client.0.smithi087.stdout: Find 906 300.653 535.213 2023-12-16T20:35:26.998 INFO:tasks.workunit.client.0.smithi087.stdout: WriteX 1277 3.959 115.953 2023-12-16T20:35:26.998 INFO:tasks.workunit.client.0.smithi087.stdout: ReadX 3981 0.022 2.268 2023-12-16T20:35:26.998 INFO:tasks.workunit.client.0.smithi087.stdout: LockX 8 15.137 16.634 2023-12-16T20:35:26.998 INFO:tasks.workunit.client.0.smithi087.stdout: UnlockX 8 14.224 16.026 2023-12-16T20:35:26.998 INFO:tasks.workunit.client.0.smithi087.stdout: Flush 190 45.956 202.831 2023-12-16T20:35:26.998 INFO:tasks.workunit.client.0.smithi087.stdout: 2023-12-16T20:35:26.998 INFO:tasks.workunit.client.0.smithi087.stdout:Throughput 0.131459 MB/sec 1 clients 1 procs max_latency=535.218 ms 2023-12-16T20:35:26.999 INFO:tasks.workunit.client.0.smithi087.stderr:+ dbench 10 2023-12-16T20:35:26.999 INFO:tasks.workunit.client.0.smithi087.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-12-16T20:35:26.999 INFO:tasks.workunit.client.0.smithi087.stdout: 2023-12-16T20:35:26.999 INFO:tasks.workunit.client.0.smithi087.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-12-16T20:35:26.999 INFO:tasks.workunit.client.0.smithi087.stdout:7 of 10 processes prepared for launch 0 sec 2023-12-16T20:35:27.098 INFO:tasks.workunit.client.0.smithi087.stdout:10 of 10 processes prepared for launch 0 sec 2023-12-16T20:35:27.098 INFO:tasks.workunit.client.0.smithi087.stdout:releasing clients 2023-12-16T20:35:28.098 INFO:tasks.workunit.client.0.smithi087.stdout: 0 3 0.00 MB/sec warmup 1 sec latency 999.812 ms 2023-12-16T20:35:29.098 INFO:tasks.workunit.client.0.smithi087.stdout: 0 6 0.00 MB/sec warmup 2 sec latency 1999.921 ms 2023-12-16T20:35:30.098 INFO:tasks.workunit.client.0.smithi087.stdout: 3 14 1.00 MB/sec warmup 3 sec latency 732.971 ms 2023-12-16T20:35:31.098 INFO:tasks.workunit.client.0.smithi087.stdout: 8 25 1.77 MB/sec warmup 4 sec latency 844.308 ms 2023-12-16T20:35:32.098 INFO:tasks.workunit.client.0.smithi087.stdout: 10 44 3.53 MB/sec warmup 5 sec latency 762.822 ms 2023-12-16T20:35:33.098 INFO:tasks.workunit.client.0.smithi087.stdout: 10 61 4.41 MB/sec warmup 6 sec latency 899.779 ms 2023-12-16T20:35:34.098 INFO:tasks.workunit.client.0.smithi087.stdout: 10 79 5.07 MB/sec warmup 7 sec latency 723.621 ms 2023-12-16T20:35:35.098 INFO:tasks.workunit.client.0.smithi087.stdout: 10 95 5.51 MB/sec warmup 8 sec latency 703.451 ms 2023-12-16T20:35:36.098 INFO:tasks.workunit.client.0.smithi087.stdout: 10 108 5.56 MB/sec warmup 9 sec latency 1142.610 ms 2023-12-16T20:35:37.098 INFO:tasks.workunit.client.0.smithi087.stdout: 10 118 5.44 MB/sec warmup 10 sec latency 847.929 ms 2023-12-16T20:35:38.098 INFO:tasks.workunit.client.0.smithi087.stdout: 10 125 5.12 MB/sec warmup 11 sec latency 1286.055 ms 2023-12-16T20:35:39.098 INFO:tasks.workunit.client.0.smithi087.stdout: 10 131 4.85 MB/sec warmup 12 sec latency 1266.623 ms 2023-12-16T20:35:40.098 INFO:tasks.workunit.client.0.smithi087.stdout: 10 139 4.67 MB/sec warmup 13 sec latency 1189.083 ms 2023-12-16T20:35:41.098 INFO:tasks.workunit.client.0.smithi087.stdout: 10 145 4.47 MB/sec warmup 14 sec latency 1361.135 ms 2023-12-16T20:35:42.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 151 4.28 MB/sec warmup 15 sec latency 1108.591 ms 2023-12-16T20:35:43.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 157 4.12 MB/sec warmup 16 sec latency 1171.357 ms 2023-12-16T20:35:44.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 162 3.96 MB/sec warmup 17 sec latency 1437.866 ms 2023-12-16T20:35:45.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 168 3.84 MB/sec warmup 18 sec latency 1508.396 ms 2023-12-16T20:35:46.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 173 3.72 MB/sec warmup 19 sec latency 1497.231 ms 2023-12-16T20:35:47.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 176 3.59 MB/sec warmup 20 sec latency 2007.548 ms 2023-12-16T20:35:48.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 183 3.52 MB/sec warmup 21 sec latency 2171.080 ms 2023-12-16T20:35:49.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 189 3.45 MB/sec warmup 22 sec latency 1721.050 ms 2023-12-16T20:35:50.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 194 3.36 MB/sec warmup 23 sec latency 1569.460 ms 2023-12-16T20:35:51.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 201 3.31 MB/sec warmup 24 sec latency 1460.683 ms 2023-12-16T20:35:52.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 206 3.24 MB/sec warmup 25 sec latency 1465.666 ms 2023-12-16T20:35:53.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 212 3.19 MB/sec warmup 26 sec latency 1450.576 ms 2023-12-16T20:35:54.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 219 3.16 MB/sec warmup 27 sec latency 1243.991 ms 2023-12-16T20:35:55.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 226 3.11 MB/sec warmup 28 sec latency 1599.431 ms 2023-12-16T20:35:55.393 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:35:55.396 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:35:56.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 231 3.06 MB/sec warmup 29 sec latency 1762.727 ms 2023-12-16T20:35:57.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 235 3.00 MB/sec warmup 30 sec latency 2254.027 ms 2023-12-16T20:35:58.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 240 2.97 MB/sec warmup 31 sec latency 1755.490 ms 2023-12-16T20:35:59.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 246 2.93 MB/sec warmup 32 sec latency 1288.535 ms 2023-12-16T20:36:00.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 250 2.89 MB/sec warmup 33 sec latency 1727.904 ms 2023-12-16T20:36:01.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 258 2.87 MB/sec warmup 34 sec latency 1806.442 ms 2023-12-16T20:36:02.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 264 2.84 MB/sec warmup 35 sec latency 1542.188 ms 2023-12-16T20:36:03.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 270 2.81 MB/sec warmup 36 sec latency 1447.787 ms 2023-12-16T20:36:04.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 277 2.81 MB/sec warmup 37 sec latency 1639.312 ms 2023-12-16T20:36:05.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 281 2.76 MB/sec warmup 38 sec latency 1662.939 ms 2023-12-16T20:36:06.099 INFO:tasks.workunit.client.0.smithi087.stdout: 10 285 2.72 MB/sec warmup 39 sec latency 2226.816 ms 2023-12-16T20:36:07.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 290 2.70 MB/sec warmup 40 sec latency 2092.497 ms 2023-12-16T20:36:08.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 292 2.65 MB/sec warmup 41 sec latency 1932.516 ms 2023-12-16T20:36:09.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 297 2.61 MB/sec warmup 42 sec latency 2041.747 ms 2023-12-16T20:36:10.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 304 2.60 MB/sec warmup 43 sec latency 1338.863 ms 2023-12-16T20:36:11.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 312 2.60 MB/sec warmup 44 sec latency 1257.248 ms 2023-12-16T20:36:12.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 317 2.58 MB/sec warmup 45 sec latency 1234.499 ms 2023-12-16T20:36:13.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 322 2.55 MB/sec warmup 46 sec latency 1589.405 ms 2023-12-16T20:36:14.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 328 2.54 MB/sec warmup 47 sec latency 1490.871 ms 2023-12-16T20:36:15.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 335 2.53 MB/sec warmup 48 sec latency 1168.188 ms 2023-12-16T20:36:16.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 338 2.50 MB/sec warmup 49 sec latency 1707.759 ms 2023-12-16T20:36:17.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 343 2.48 MB/sec warmup 50 sec latency 2042.108 ms 2023-12-16T20:36:18.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 347 2.45 MB/sec warmup 51 sec latency 2289.144 ms 2023-12-16T20:36:19.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 353 2.44 MB/sec warmup 52 sec latency 1367.130 ms 2023-12-16T20:36:20.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 361 2.44 MB/sec warmup 53 sec latency 1103.897 ms 2023-12-16T20:36:21.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 368 2.44 MB/sec warmup 54 sec latency 1381.995 ms 2023-12-16T20:36:22.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 373 2.42 MB/sec warmup 55 sec latency 1466.123 ms 2023-12-16T20:36:23.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 380 2.42 MB/sec warmup 56 sec latency 1685.610 ms 2023-12-16T20:36:24.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 388 2.42 MB/sec warmup 57 sec latency 1548.401 ms 2023-12-16T20:36:25.100 INFO:tasks.workunit.client.0.smithi087.stdout: 10 393 2.41 MB/sec warmup 58 sec latency 1457.125 ms 2023-12-16T20:36:25.533 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:36:25.535 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:36:26.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 396 2.38 MB/sec warmup 59 sec latency 1367.686 ms 2023-12-16T20:36:27.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 400 2.36 MB/sec warmup 60 sec latency 2250.383 ms 2023-12-16T20:36:28.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 404 2.35 MB/sec warmup 61 sec latency 2331.329 ms 2023-12-16T20:36:29.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 412 2.35 MB/sec warmup 62 sec latency 1531.869 ms 2023-12-16T20:36:30.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 417 2.34 MB/sec warmup 63 sec latency 1527.884 ms 2023-12-16T20:36:31.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 422 2.33 MB/sec warmup 64 sec latency 1893.637 ms 2023-12-16T20:36:32.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 427 2.32 MB/sec warmup 65 sec latency 1402.076 ms 2023-12-16T20:36:33.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 433 2.31 MB/sec warmup 66 sec latency 1383.604 ms 2023-12-16T20:36:34.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 441 2.32 MB/sec warmup 67 sec latency 1662.547 ms 2023-12-16T20:36:35.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 447 2.31 MB/sec warmup 68 sec latency 1536.685 ms 2023-12-16T20:36:36.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 451 2.29 MB/sec warmup 69 sec latency 1819.346 ms 2023-12-16T20:36:37.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 454 2.28 MB/sec warmup 70 sec latency 2129.835 ms 2023-12-16T20:36:38.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 460 2.28 MB/sec warmup 71 sec latency 2648.051 ms 2023-12-16T20:36:39.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 465 2.27 MB/sec warmup 72 sec latency 2375.984 ms 2023-12-16T20:36:40.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 476 2.28 MB/sec warmup 73 sec latency 1821.920 ms 2023-12-16T20:36:41.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 480 2.27 MB/sec warmup 74 sec latency 1896.687 ms 2023-12-16T20:36:42.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 485 2.26 MB/sec warmup 75 sec latency 2450.540 ms 2023-12-16T20:36:43.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 489 2.25 MB/sec warmup 76 sec latency 3450.566 ms 2023-12-16T20:36:44.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 494 2.24 MB/sec warmup 77 sec latency 4450.590 ms 2023-12-16T20:36:45.101 INFO:tasks.workunit.client.0.smithi087.stdout: 10 501 2.24 MB/sec warmup 78 sec latency 4582.605 ms 2023-12-16T20:36:46.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 503 2.22 MB/sec warmup 79 sec latency 1994.284 ms 2023-12-16T20:36:47.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 506 2.20 MB/sec warmup 80 sec latency 2181.107 ms 2023-12-16T20:36:48.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 510 2.19 MB/sec warmup 81 sec latency 2448.713 ms 2023-12-16T20:36:49.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 516 2.19 MB/sec warmup 82 sec latency 3138.996 ms 2023-12-16T20:36:50.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 526 2.20 MB/sec warmup 83 sec latency 4139.021 ms 2023-12-16T20:36:51.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 532 2.20 MB/sec warmup 84 sec latency 4279.162 ms 2023-12-16T20:36:52.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 544 2.22 MB/sec warmup 85 sec latency 1925.539 ms 2023-12-16T20:36:53.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 557 2.25 MB/sec warmup 86 sec latency 2724.191 ms 2023-12-16T20:36:54.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 577 2.29 MB/sec warmup 87 sec latency 2881.041 ms 2023-12-16T20:36:55.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 590 2.32 MB/sec warmup 88 sec latency 1787.538 ms 2023-12-16T20:36:55.589 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:36:55.591 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:36:56.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 604 2.34 MB/sec warmup 89 sec latency 2679.751 ms 2023-12-16T20:36:57.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 610 2.33 MB/sec warmup 90 sec latency 3396.109 ms 2023-12-16T20:36:58.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 610 2.31 MB/sec warmup 91 sec latency 3741.215 ms 2023-12-16T20:36:59.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 613 2.28 MB/sec warmup 92 sec latency 3592.777 ms 2023-12-16T20:37:00.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 617 2.26 MB/sec warmup 93 sec latency 3319.343 ms 2023-12-16T20:37:01.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 618 2.23 MB/sec warmup 94 sec latency 2695.361 ms 2023-12-16T20:37:02.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 626 2.21 MB/sec warmup 95 sec latency 2718.961 ms 2023-12-16T20:37:03.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 633 2.19 MB/sec warmup 96 sec latency 2568.530 ms 2023-12-16T20:37:04.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 638 2.17 MB/sec warmup 97 sec latency 2312.137 ms 2023-12-16T20:37:05.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 647 2.15 MB/sec warmup 98 sec latency 2594.394 ms 2023-12-16T20:37:06.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 648 2.13 MB/sec warmup 99 sec latency 2562.834 ms 2023-12-16T20:37:07.102 INFO:tasks.workunit.client.0.smithi087.stdout: 10 649 2.11 MB/sec warmup 100 sec latency 3137.955 ms 2023-12-16T20:37:08.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 650 2.09 MB/sec warmup 101 sec latency 3061.662 ms 2023-12-16T20:37:09.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 652 2.07 MB/sec warmup 102 sec latency 2841.266 ms 2023-12-16T20:37:10.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 655 2.05 MB/sec warmup 103 sec latency 2732.012 ms 2023-12-16T20:37:11.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 658 2.03 MB/sec warmup 104 sec latency 2420.465 ms 2023-12-16T20:37:12.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 662 2.01 MB/sec warmup 105 sec latency 3014.134 ms 2023-12-16T20:37:13.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 667 1.99 MB/sec warmup 106 sec latency 2859.279 ms 2023-12-16T20:37:14.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 670 1.98 MB/sec warmup 107 sec latency 3157.658 ms 2023-12-16T20:37:15.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 675 1.96 MB/sec warmup 108 sec latency 3002.202 ms 2023-12-16T20:37:16.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 680 1.94 MB/sec warmup 109 sec latency 2577.035 ms 2023-12-16T20:37:17.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 687 1.93 MB/sec warmup 110 sec latency 2836.888 ms 2023-12-16T20:37:18.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 691 1.91 MB/sec warmup 111 sec latency 2373.064 ms 2023-12-16T20:37:19.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 695 1.89 MB/sec warmup 112 sec latency 2126.796 ms 2023-12-16T20:37:20.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 700 1.88 MB/sec warmup 113 sec latency 2923.880 ms 2023-12-16T20:37:21.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 703 1.86 MB/sec warmup 114 sec latency 2804.432 ms 2023-12-16T20:37:22.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 708 1.85 MB/sec warmup 115 sec latency 3008.682 ms 2023-12-16T20:37:23.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 714 1.83 MB/sec warmup 116 sec latency 3103.780 ms 2023-12-16T20:37:24.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 725 1.82 MB/sec warmup 117 sec latency 3234.039 ms 2023-12-16T20:37:25.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 730 1.80 MB/sec warmup 118 sec latency 2675.602 ms 2023-12-16T20:37:25.693 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:37:25.696 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:37:26.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 734 1.79 MB/sec warmup 119 sec latency 1733.868 ms 2023-12-16T20:37:28.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 738 0.20 MB/sec execute 1 sec latency 3733.916 ms 2023-12-16T20:37:28.791 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:16:34.030 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:37:28.801 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:16:34.037 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:37:28.861 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:16:34.054 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:37:28.864 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:16:34.057 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:37:28.865 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:16:34.059 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:37:28.868 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:16:34.061 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:37:28.898 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:16:34.137 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:37:28.980 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:16:34.173 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:37:28.981 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:16:34.174 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:37:29.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 746 0.28 MB/sec execute 2 sec latency 4104.764 ms 2023-12-16T20:37:30.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 751 0.20 MB/sec execute 3 sec latency 3016.569 ms 2023-12-16T20:37:31.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 754 0.16 MB/sec execute 4 sec latency 2618.902 ms 2023-12-16T20:37:32.103 INFO:tasks.workunit.client.0.smithi087.stdout: 10 758 0.14 MB/sec execute 5 sec latency 3360.134 ms 2023-12-16T20:37:33.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 766 0.15 MB/sec execute 6 sec latency 3402.431 ms 2023-12-16T20:37:34.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 769 0.13 MB/sec execute 7 sec latency 2822.007 ms 2023-12-16T20:37:35.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 772 0.12 MB/sec execute 8 sec latency 2982.719 ms 2023-12-16T20:37:36.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 777 0.13 MB/sec execute 9 sec latency 3413.103 ms 2023-12-16T20:37:37.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 784 0.14 MB/sec execute 10 sec latency 3456.781 ms 2023-12-16T20:37:38.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 791 0.14 MB/sec execute 11 sec latency 3541.640 ms 2023-12-16T20:37:39.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 798 0.14 MB/sec execute 12 sec latency 3160.046 ms 2023-12-16T20:37:40.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 801 0.13 MB/sec execute 13 sec latency 2638.342 ms 2023-12-16T20:37:41.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 804 0.13 MB/sec execute 14 sec latency 2625.033 ms 2023-12-16T20:37:42.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 807 0.12 MB/sec execute 15 sec latency 3340.597 ms 2023-12-16T20:37:43.105 INFO:tasks.workunit.client.0.smithi087.stdout: 10 811 0.13 MB/sec execute 16 sec latency 3348.974 ms 2023-12-16T20:37:44.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 817 0.13 MB/sec execute 17 sec latency 3389.815 ms 2023-12-16T20:37:45.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 819 0.12 MB/sec execute 18 sec latency 2614.814 ms 2023-12-16T20:37:46.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 819 0.11 MB/sec execute 19 sec latency 2322.263 ms 2023-12-16T20:37:47.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 820 0.11 MB/sec execute 20 sec latency 2526.515 ms 2023-12-16T20:37:48.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 826 0.11 MB/sec execute 21 sec latency 2641.505 ms 2023-12-16T20:37:49.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 827 0.10 MB/sec execute 22 sec latency 2155.120 ms 2023-12-16T20:37:50.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 829 0.10 MB/sec execute 23 sec latency 2243.429 ms 2023-12-16T20:37:51.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 841 0.11 MB/sec execute 24 sec latency 2176.209 ms 2023-12-16T20:37:52.104 INFO:tasks.workunit.client.0.smithi087.stdout: 10 848 0.12 MB/sec execute 25 sec latency 2392.395 ms 2023-12-16T20:37:53.105 INFO:tasks.workunit.client.0.smithi087.stdout: 10 850 0.11 MB/sec execute 26 sec latency 2640.214 ms 2023-12-16T20:37:54.105 INFO:tasks.workunit.client.0.smithi087.stdout: 10 853 0.11 MB/sec execute 27 sec latency 2665.238 ms 2023-12-16T20:37:55.105 INFO:tasks.workunit.client.0.smithi087.stdout: 10 858 0.11 MB/sec execute 28 sec latency 2232.261 ms 2023-12-16T20:37:55.768 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:37:55.771 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:37:56.105 INFO:tasks.workunit.client.0.smithi087.stdout: 10 860 0.11 MB/sec execute 29 sec latency 2329.909 ms 2023-12-16T20:37:57.105 INFO:tasks.workunit.client.0.smithi087.stdout: 10 864 0.11 MB/sec execute 30 sec latency 2672.022 ms 2023-12-16T20:37:58.105 INFO:tasks.workunit.client.0.smithi087.stdout: 10 866 0.11 MB/sec execute 31 sec latency 3064.984 ms 2023-12-16T20:37:59.105 INFO:tasks.workunit.client.0.smithi087.stdout: 10 868 0.10 MB/sec execute 32 sec latency 2473.390 ms 2023-12-16T20:38:00.105 INFO:tasks.workunit.client.0.smithi087.stdout: 10 870 0.10 MB/sec execute 33 sec latency 2919.631 ms 2023-12-16T20:38:01.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 874 0.10 MB/sec execute 34 sec latency 2600.948 ms 2023-12-16T20:38:02.105 INFO:tasks.workunit.client.0.smithi087.stdout: 10 880 0.11 MB/sec execute 35 sec latency 3014.307 ms 2023-12-16T20:38:03.105 INFO:tasks.workunit.client.0.smithi087.stdout: 10 883 0.11 MB/sec execute 36 sec latency 3097.844 ms 2023-12-16T20:38:04.105 INFO:tasks.workunit.client.0.smithi087.stdout: 10 885 0.11 MB/sec execute 37 sec latency 3236.645 ms 2023-12-16T20:38:05.105 INFO:tasks.workunit.client.0.smithi087.stdout: 10 892 0.11 MB/sec execute 38 sec latency 2724.990 ms 2023-12-16T20:38:06.105 INFO:tasks.workunit.client.0.smithi087.stdout: 10 899 0.11 MB/sec execute 39 sec latency 2005.147 ms 2023-12-16T20:38:07.105 INFO:tasks.workunit.client.0.smithi087.stdout: 10 901 0.11 MB/sec execute 40 sec latency 2684.774 ms 2023-12-16T20:38:08.105 INFO:tasks.workunit.client.0.smithi087.stdout: 10 903 0.10 MB/sec execute 41 sec latency 2879.649 ms 2023-12-16T20:38:09.105 INFO:tasks.workunit.client.0.smithi087.stdout: 10 906 0.10 MB/sec execute 42 sec latency 3879.721 ms 2023-12-16T20:38:10.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 912 0.11 MB/sec execute 43 sec latency 4076.868 ms 2023-12-16T20:38:11.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 919 0.11 MB/sec execute 44 sec latency 2300.586 ms 2023-12-16T20:38:11.545 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:17:16.785 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:38:11.549 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:17:16.789 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:38:11.577 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:17:16.816 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:38:11.606 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:17:16.799 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:38:11.607 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:17:16.800 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:38:11.608 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:17:16.801 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:38:11.612 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:17:16.805 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:38:11.633 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:17:16.826 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:38:11.638 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:17:16.831 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:38:12.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 922 0.11 MB/sec execute 45 sec latency 1969.003 ms 2023-12-16T20:38:13.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 923 0.10 MB/sec execute 46 sec latency 2948.453 ms 2023-12-16T20:38:14.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 926 0.11 MB/sec execute 47 sec latency 3535.051 ms 2023-12-16T20:38:15.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 929 0.10 MB/sec execute 48 sec latency 2654.614 ms 2023-12-16T20:38:16.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 929 0.10 MB/sec execute 49 sec latency 2796.448 ms 2023-12-16T20:38:17.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 930 0.10 MB/sec execute 50 sec latency 2764.208 ms 2023-12-16T20:38:18.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 933 0.10 MB/sec execute 51 sec latency 2618.012 ms 2023-12-16T20:38:19.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 934 0.10 MB/sec execute 52 sec latency 2184.082 ms 2023-12-16T20:38:20.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 937 0.10 MB/sec execute 53 sec latency 2185.044 ms 2023-12-16T20:38:21.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 938 0.09 MB/sec execute 54 sec latency 2221.289 ms 2023-12-16T20:38:22.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 941 0.09 MB/sec execute 55 sec latency 2518.060 ms 2023-12-16T20:38:23.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 943 0.09 MB/sec execute 56 sec latency 2774.418 ms 2023-12-16T20:38:24.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 948 0.11 MB/sec execute 57 sec latency 2502.220 ms 2023-12-16T20:38:25.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 951 0.11 MB/sec execute 58 sec latency 2572.274 ms 2023-12-16T20:38:26.039 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:38:26.042 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:38:26.107 INFO:tasks.workunit.client.0.smithi087.stdout: 10 953 0.11 MB/sec execute 59 sec latency 2127.231 ms 2023-12-16T20:38:27.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 956 0.11 MB/sec execute 60 sec latency 2479.734 ms 2023-12-16T20:38:28.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 965 0.11 MB/sec execute 61 sec latency 2238.689 ms 2023-12-16T20:38:29.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 973 0.12 MB/sec execute 62 sec latency 2252.654 ms 2023-12-16T20:38:30.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 976 0.12 MB/sec execute 63 sec latency 2797.225 ms 2023-12-16T20:38:31.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 982 0.12 MB/sec execute 64 sec latency 3114.107 ms 2023-12-16T20:38:32.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 989 0.12 MB/sec execute 65 sec latency 3483.664 ms 2023-12-16T20:38:33.106 INFO:tasks.workunit.client.0.smithi087.stdout: 10 995 0.12 MB/sec execute 66 sec latency 3545.657 ms 2023-12-16T20:38:34.107 INFO:tasks.workunit.client.0.smithi087.stdout: 10 998 0.12 MB/sec execute 67 sec latency 1813.336 ms 2023-12-16T20:38:35.107 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1001 0.12 MB/sec execute 68 sec latency 2813.376 ms 2023-12-16T20:38:36.107 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1004 0.12 MB/sec execute 69 sec latency 3439.345 ms 2023-12-16T20:38:37.107 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1009 0.14 MB/sec execute 70 sec latency 3388.321 ms 2023-12-16T20:38:38.107 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1021 0.19 MB/sec execute 71 sec latency 3245.167 ms 2023-12-16T20:38:39.107 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1028 0.21 MB/sec execute 72 sec latency 2783.882 ms 2023-12-16T20:38:40.107 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1032 0.22 MB/sec execute 73 sec latency 2352.755 ms 2023-12-16T20:38:41.107 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1034 0.22 MB/sec execute 74 sec latency 2147.482 ms 2023-12-16T20:38:42.107 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1036 0.21 MB/sec execute 75 sec latency 2051.622 ms 2023-12-16T20:38:43.107 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1038 0.21 MB/sec execute 76 sec latency 2409.093 ms 2023-12-16T20:38:44.107 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1042 0.21 MB/sec execute 77 sec latency 2879.667 ms 2023-12-16T20:38:45.107 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1045 0.21 MB/sec execute 78 sec latency 2716.735 ms 2023-12-16T20:38:46.107 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1049 0.20 MB/sec execute 79 sec latency 3114.585 ms 2023-12-16T20:38:47.107 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1051 0.20 MB/sec execute 80 sec latency 3096.115 ms 2023-12-16T20:38:48.107 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1052 0.20 MB/sec execute 81 sec latency 3242.784 ms 2023-12-16T20:38:49.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1053 0.20 MB/sec execute 82 sec latency 2895.443 ms 2023-12-16T20:38:50.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1056 0.20 MB/sec execute 83 sec latency 2543.337 ms 2023-12-16T20:38:51.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1057 0.19 MB/sec execute 84 sec latency 2566.265 ms 2023-12-16T20:38:52.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1058 0.19 MB/sec execute 85 sec latency 2717.493 ms 2023-12-16T20:38:53.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1061 0.19 MB/sec execute 86 sec latency 2712.438 ms 2023-12-16T20:38:54.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1064 0.19 MB/sec execute 87 sec latency 2833.167 ms 2023-12-16T20:38:55.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1068 0.18 MB/sec execute 88 sec latency 2735.104 ms 2023-12-16T20:38:56.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1074 0.18 MB/sec execute 89 sec latency 2397.356 ms 2023-12-16T20:38:56.161 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:38:56.164 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:38:57.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1079 0.18 MB/sec execute 90 sec latency 3076.266 ms 2023-12-16T20:38:58.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1086 0.18 MB/sec execute 91 sec latency 1354.921 ms 2023-12-16T20:38:59.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1092 0.18 MB/sec execute 92 sec latency 2354.981 ms 2023-12-16T20:39:00.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1096 0.18 MB/sec execute 93 sec latency 3077.562 ms 2023-12-16T20:39:01.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1099 0.18 MB/sec execute 94 sec latency 3453.338 ms 2023-12-16T20:39:02.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1100 0.18 MB/sec execute 95 sec latency 4082.779 ms 2023-12-16T20:39:03.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1103 0.17 MB/sec execute 96 sec latency 4276.315 ms 2023-12-16T20:39:04.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1107 0.17 MB/sec execute 97 sec latency 3753.482 ms 2023-12-16T20:39:05.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1112 0.17 MB/sec execute 98 sec latency 3028.695 ms 2023-12-16T20:39:06.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1115 0.17 MB/sec execute 99 sec latency 2578.636 ms 2023-12-16T20:39:07.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1118 0.17 MB/sec execute 100 sec latency 3068.691 ms 2023-12-16T20:39:08.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1121 0.17 MB/sec execute 101 sec latency 2729.960 ms 2023-12-16T20:39:09.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1126 0.17 MB/sec execute 102 sec latency 2550.516 ms 2023-12-16T20:39:10.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1130 0.17 MB/sec execute 103 sec latency 2396.384 ms 2023-12-16T20:39:11.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1135 0.16 MB/sec execute 104 sec latency 2390.948 ms 2023-12-16T20:39:12.108 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1141 0.16 MB/sec execute 105 sec latency 2704.808 ms 2023-12-16T20:39:13.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1147 0.16 MB/sec execute 106 sec latency 2718.624 ms 2023-12-16T20:39:14.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1152 0.16 MB/sec execute 107 sec latency 1935.830 ms 2023-12-16T20:39:15.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1156 0.16 MB/sec execute 108 sec latency 1806.527 ms 2023-12-16T20:39:16.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1160 0.16 MB/sec execute 109 sec latency 2510.903 ms 2023-12-16T20:39:17.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1163 0.16 MB/sec execute 110 sec latency 3175.492 ms 2023-12-16T20:39:18.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1166 0.16 MB/sec execute 111 sec latency 3178.111 ms 2023-12-16T20:39:19.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1168 0.16 MB/sec execute 112 sec latency 3080.874 ms 2023-12-16T20:39:20.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1171 0.15 MB/sec execute 113 sec latency 2917.967 ms 2023-12-16T20:39:21.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1175 0.15 MB/sec execute 114 sec latency 2872.799 ms 2023-12-16T20:39:22.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1176 0.15 MB/sec execute 115 sec latency 3129.285 ms 2023-12-16T20:39:23.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1178 0.15 MB/sec execute 116 sec latency 3204.636 ms 2023-12-16T20:39:24.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1179 0.15 MB/sec execute 117 sec latency 3076.864 ms 2023-12-16T20:39:25.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1181 0.15 MB/sec execute 118 sec latency 2513.737 ms 2023-12-16T20:39:26.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1184 0.15 MB/sec execute 119 sec latency 2650.612 ms 2023-12-16T20:39:26.234 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:39:26.236 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:39:27.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1185 0.15 MB/sec execute 120 sec latency 2918.461 ms 2023-12-16T20:39:28.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1189 0.14 MB/sec execute 121 sec latency 2887.636 ms 2023-12-16T20:39:29.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1193 0.14 MB/sec execute 122 sec latency 2243.865 ms 2023-12-16T20:39:30.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1198 0.14 MB/sec execute 123 sec latency 2378.623 ms 2023-12-16T20:39:31.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1201 0.14 MB/sec execute 124 sec latency 2582.546 ms 2023-12-16T20:39:32.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1203 0.14 MB/sec execute 125 sec latency 2881.600 ms 2023-12-16T20:39:33.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1212 0.14 MB/sec execute 126 sec latency 3341.862 ms 2023-12-16T20:39:34.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1219 0.14 MB/sec execute 127 sec latency 2475.140 ms 2023-12-16T20:39:35.109 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1222 0.14 MB/sec execute 128 sec latency 2684.551 ms 2023-12-16T20:39:36.110 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1224 0.14 MB/sec execute 129 sec latency 2946.868 ms 2023-12-16T20:39:37.110 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1228 0.14 MB/sec execute 130 sec latency 2799.756 ms 2023-12-16T20:39:38.110 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1233 0.14 MB/sec execute 131 sec latency 3441.864 ms 2023-12-16T20:39:39.110 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1236 0.14 MB/sec execute 132 sec latency 3145.216 ms 2023-12-16T20:39:40.110 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1242 0.14 MB/sec execute 133 sec latency 3385.416 ms 2023-12-16T20:39:41.110 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1246 0.14 MB/sec execute 134 sec latency 2494.339 ms 2023-12-16T20:39:42.110 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1252 0.14 MB/sec execute 135 sec latency 2229.678 ms 2023-12-16T20:39:43.110 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1267 0.16 MB/sec execute 136 sec latency 2364.204 ms 2023-12-16T20:39:44.110 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1270 0.15 MB/sec execute 137 sec latency 1696.433 ms 2023-12-16T20:39:45.110 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1273 0.15 MB/sec execute 138 sec latency 2696.472 ms 2023-12-16T20:39:46.110 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1274 0.16 MB/sec execute 139 sec latency 3126.765 ms 2023-12-16T20:39:47.110 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1283 0.17 MB/sec execute 140 sec latency 3404.180 ms 2023-12-16T20:39:48.110 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1285 0.17 MB/sec execute 141 sec latency 3455.785 ms 2023-12-16T20:39:49.110 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1295 0.17 MB/sec execute 142 sec latency 3403.629 ms 2023-12-16T20:39:50.110 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1298 0.17 MB/sec execute 143 sec latency 3817.678 ms 2023-12-16T20:39:51.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1299 0.17 MB/sec execute 144 sec latency 3848.249 ms 2023-12-16T20:39:52.110 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1299 0.17 MB/sec execute 145 sec latency 3349.099 ms 2023-12-16T20:39:53.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1301 0.17 MB/sec execute 146 sec latency 3289.575 ms 2023-12-16T20:39:54.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1301 0.17 MB/sec execute 147 sec latency 2418.882 ms 2023-12-16T20:39:55.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1302 0.16 MB/sec execute 148 sec latency 2235.251 ms 2023-12-16T20:39:56.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1321 0.20 MB/sec execute 149 sec latency 2551.705 ms 2023-12-16T20:39:56.372 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:39:56.375 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:39:57.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1323 0.20 MB/sec execute 150 sec latency 2593.600 ms 2023-12-16T20:39:58.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1333 0.22 MB/sec execute 151 sec latency 2785.998 ms 2023-12-16T20:39:59.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1333 0.22 MB/sec execute 152 sec latency 2525.350 ms 2023-12-16T20:40:00.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1339 0.22 MB/sec execute 153 sec latency 2534.854 ms 2023-12-16T20:40:01.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1382 0.31 MB/sec execute 154 sec latency 2302.362 ms 2023-12-16T20:40:02.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1383 0.30 MB/sec execute 155 sec latency 2408.641 ms 2023-12-16T20:40:03.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1384 0.30 MB/sec execute 156 sec latency 2491.047 ms 2023-12-16T20:40:04.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1387 0.30 MB/sec execute 157 sec latency 2227.093 ms 2023-12-16T20:40:05.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1390 0.30 MB/sec execute 158 sec latency 2128.595 ms 2023-12-16T20:40:06.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1392 0.30 MB/sec execute 159 sec latency 1992.324 ms 2023-12-16T20:40:07.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1393 0.30 MB/sec execute 160 sec latency 2821.966 ms 2023-12-16T20:40:08.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1395 0.29 MB/sec execute 161 sec latency 2920.347 ms 2023-12-16T20:40:09.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1398 0.29 MB/sec execute 162 sec latency 2725.368 ms 2023-12-16T20:40:10.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1402 0.29 MB/sec execute 163 sec latency 1332.761 ms 2023-12-16T20:40:11.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1403 0.29 MB/sec execute 164 sec latency 2242.138 ms 2023-12-16T20:40:12.111 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1407 0.29 MB/sec execute 165 sec latency 2513.187 ms 2023-12-16T20:40:13.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1413 0.29 MB/sec execute 166 sec latency 2607.402 ms 2023-12-16T20:40:14.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1418 0.28 MB/sec execute 167 sec latency 2155.191 ms 2023-12-16T20:40:15.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1419 0.28 MB/sec execute 168 sec latency 2016.293 ms 2023-12-16T20:40:16.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1422 0.28 MB/sec execute 169 sec latency 2312.634 ms 2023-12-16T20:40:17.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1430 0.28 MB/sec execute 170 sec latency 2288.678 ms 2023-12-16T20:40:18.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1436 0.28 MB/sec execute 171 sec latency 2843.095 ms 2023-12-16T20:40:19.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1440 0.28 MB/sec execute 172 sec latency 2299.881 ms 2023-12-16T20:40:20.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1440 0.27 MB/sec execute 173 sec latency 2915.967 ms 2023-12-16T20:40:21.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1444 0.27 MB/sec execute 174 sec latency 2473.995 ms 2023-12-16T20:40:22.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1450 0.27 MB/sec execute 175 sec latency 2446.353 ms 2023-12-16T20:40:23.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1457 0.27 MB/sec execute 176 sec latency 2659.928 ms 2023-12-16T20:40:24.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1461 0.27 MB/sec execute 177 sec latency 1229.213 ms 2023-12-16T20:40:25.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1463 0.27 MB/sec execute 178 sec latency 1900.678 ms 2023-12-16T20:40:26.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1465 0.27 MB/sec execute 179 sec latency 2900.734 ms 2023-12-16T20:40:26.474 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:40:26.477 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:40:27.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1468 0.26 MB/sec execute 180 sec latency 3065.205 ms 2023-12-16T20:40:28.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1473 0.26 MB/sec execute 181 sec latency 2721.897 ms 2023-12-16T20:40:29.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1479 0.26 MB/sec execute 182 sec latency 2295.778 ms 2023-12-16T20:40:30.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1482 0.26 MB/sec execute 183 sec latency 913.274 ms 2023-12-16T20:40:31.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1484 0.26 MB/sec execute 184 sec latency 1810.333 ms 2023-12-16T20:40:32.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1487 0.26 MB/sec execute 185 sec latency 1160.165 ms 2023-12-16T20:40:33.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1487 0.26 MB/sec execute 186 sec latency 2160.200 ms 2023-12-16T20:40:34.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1494 0.26 MB/sec execute 187 sec latency 2681.258 ms 2023-12-16T20:40:35.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1500 0.25 MB/sec execute 188 sec latency 1681.666 ms 2023-12-16T20:40:36.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1503 0.25 MB/sec execute 189 sec latency 1867.680 ms 2023-12-16T20:40:37.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1506 0.25 MB/sec execute 190 sec latency 2296.285 ms 2023-12-16T20:40:38.112 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1511 0.25 MB/sec execute 191 sec latency 3179.323 ms 2023-12-16T20:40:39.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1515 0.25 MB/sec execute 192 sec latency 3193.410 ms 2023-12-16T20:40:40.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1516 0.25 MB/sec execute 193 sec latency 1473.848 ms 2023-12-16T20:40:41.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1517 0.25 MB/sec execute 194 sec latency 2143.706 ms 2023-12-16T20:40:42.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1520 0.25 MB/sec execute 195 sec latency 2558.340 ms 2023-12-16T20:40:43.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1524 0.25 MB/sec execute 196 sec latency 2991.845 ms 2023-12-16T20:40:44.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1530 0.24 MB/sec execute 197 sec latency 3002.036 ms 2023-12-16T20:40:45.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1533 0.24 MB/sec execute 198 sec latency 2848.201 ms 2023-12-16T20:40:46.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1540 0.24 MB/sec execute 199 sec latency 2442.297 ms 2023-12-16T20:40:47.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1546 0.24 MB/sec execute 200 sec latency 2920.021 ms 2023-12-16T20:40:48.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1548 0.24 MB/sec execute 201 sec latency 3417.782 ms 2023-12-16T20:40:49.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1550 0.24 MB/sec execute 202 sec latency 3243.760 ms 2023-12-16T20:40:50.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1552 0.24 MB/sec execute 203 sec latency 3180.200 ms 2023-12-16T20:40:51.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1556 0.24 MB/sec execute 204 sec latency 2396.018 ms 2023-12-16T20:40:52.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1560 0.24 MB/sec execute 205 sec latency 2518.335 ms 2023-12-16T20:40:53.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1561 0.24 MB/sec execute 206 sec latency 3508.585 ms 2023-12-16T20:40:54.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1567 0.23 MB/sec execute 207 sec latency 3630.854 ms 2023-12-16T20:40:55.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1573 0.23 MB/sec execute 208 sec latency 3226.301 ms 2023-12-16T20:40:56.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1578 0.23 MB/sec execute 209 sec latency 2999.311 ms 2023-12-16T20:40:56.551 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:40:56.553 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:40:57.113 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1579 0.23 MB/sec execute 210 sec latency 2769.461 ms 2023-12-16T20:40:58.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1583 0.23 MB/sec execute 211 sec latency 3089.191 ms 2023-12-16T20:40:59.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1589 0.23 MB/sec execute 212 sec latency 2382.272 ms 2023-12-16T20:41:00.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1593 0.23 MB/sec execute 213 sec latency 2057.284 ms 2023-12-16T20:41:01.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1597 0.23 MB/sec execute 214 sec latency 3057.311 ms 2023-12-16T20:41:02.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1600 0.23 MB/sec execute 215 sec latency 3918.882 ms 2023-12-16T20:41:03.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1604 0.23 MB/sec execute 216 sec latency 4052.729 ms 2023-12-16T20:41:04.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1606 0.23 MB/sec execute 217 sec latency 1304.961 ms 2023-12-16T20:41:05.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1610 0.22 MB/sec execute 218 sec latency 1940.735 ms 2023-12-16T20:41:06.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1612 0.22 MB/sec execute 219 sec latency 2611.816 ms 2023-12-16T20:41:07.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1620 0.22 MB/sec execute 220 sec latency 2243.284 ms 2023-12-16T20:41:08.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1622 0.22 MB/sec execute 221 sec latency 944.547 ms 2023-12-16T20:41:09.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1625 0.22 MB/sec execute 222 sec latency 1319.110 ms 2023-12-16T20:41:10.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1626 0.22 MB/sec execute 223 sec latency 2319.150 ms 2023-12-16T20:41:11.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1630 0.22 MB/sec execute 224 sec latency 2840.047 ms 2023-12-16T20:41:12.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1636 0.22 MB/sec execute 225 sec latency 2465.884 ms 2023-12-16T20:41:13.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1638 0.22 MB/sec execute 226 sec latency 1804.208 ms 2023-12-16T20:41:14.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1640 0.22 MB/sec execute 227 sec latency 2286.357 ms 2023-12-16T20:41:15.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1643 0.22 MB/sec execute 228 sec latency 2027.570 ms 2023-12-16T20:41:16.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1644 0.21 MB/sec execute 229 sec latency 1626.114 ms 2023-12-16T20:41:17.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1650 0.21 MB/sec execute 230 sec latency 2451.092 ms 2023-12-16T20:41:18.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1652 0.21 MB/sec execute 231 sec latency 2789.757 ms 2023-12-16T20:41:19.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1661 0.21 MB/sec execute 232 sec latency 2969.983 ms 2023-12-16T20:41:20.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1672 0.21 MB/sec execute 233 sec latency 3019.366 ms 2023-12-16T20:41:21.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1676 0.21 MB/sec execute 234 sec latency 2720.423 ms 2023-12-16T20:41:22.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1683 0.21 MB/sec execute 235 sec latency 2380.429 ms 2023-12-16T20:41:23.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1686 0.21 MB/sec execute 236 sec latency 3262.490 ms 2023-12-16T20:41:24.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1689 0.21 MB/sec execute 237 sec latency 2954.102 ms 2023-12-16T20:41:25.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1691 0.21 MB/sec execute 238 sec latency 3070.217 ms 2023-12-16T20:41:26.114 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1691 0.21 MB/sec execute 239 sec latency 2793.206 ms 2023-12-16T20:41:26.680 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:41:26.683 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:41:27.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1694 0.21 MB/sec execute 240 sec latency 3500.583 ms 2023-12-16T20:41:28.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1696 0.21 MB/sec execute 241 sec latency 4362.101 ms 2023-12-16T20:41:29.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1700 0.20 MB/sec execute 242 sec latency 4540.583 ms 2023-12-16T20:41:30.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1708 0.20 MB/sec execute 243 sec latency 4780.422 ms 2023-12-16T20:41:31.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1715 0.20 MB/sec execute 244 sec latency 2886.467 ms 2023-12-16T20:41:32.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1718 0.20 MB/sec execute 245 sec latency 3061.517 ms 2023-12-16T20:41:33.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1723 0.20 MB/sec execute 246 sec latency 2890.211 ms 2023-12-16T20:41:34.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1727 0.20 MB/sec execute 247 sec latency 3426.307 ms 2023-12-16T20:41:35.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1732 0.20 MB/sec execute 248 sec latency 3688.582 ms 2023-12-16T20:41:36.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1738 0.20 MB/sec execute 249 sec latency 3021.070 ms 2023-12-16T20:41:37.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1740 0.20 MB/sec execute 250 sec latency 4021.160 ms 2023-12-16T20:41:38.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1745 0.20 MB/sec execute 251 sec latency 4112.506 ms 2023-12-16T20:41:39.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1747 0.20 MB/sec execute 252 sec latency 4625.636 ms 2023-12-16T20:41:40.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1750 0.20 MB/sec execute 253 sec latency 4457.041 ms 2023-12-16T20:41:41.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1754 0.20 MB/sec execute 254 sec latency 3142.777 ms 2023-12-16T20:41:42.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1758 0.20 MB/sec execute 255 sec latency 2679.253 ms 2023-12-16T20:41:43.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1763 0.20 MB/sec execute 256 sec latency 2794.146 ms 2023-12-16T20:41:44.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1767 0.20 MB/sec execute 257 sec latency 2480.670 ms 2023-12-16T20:41:45.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1775 0.19 MB/sec execute 258 sec latency 2369.042 ms 2023-12-16T20:41:46.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1781 0.19 MB/sec execute 259 sec latency 2697.614 ms 2023-12-16T20:41:47.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1792 0.19 MB/sec execute 260 sec latency 2386.547 ms 2023-12-16T20:41:48.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1798 0.19 MB/sec execute 261 sec latency 2513.156 ms 2023-12-16T20:41:49.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1800 0.19 MB/sec execute 262 sec latency 2960.773 ms 2023-12-16T20:41:50.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1804 0.19 MB/sec execute 263 sec latency 3068.757 ms 2023-12-16T20:41:51.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1806 0.19 MB/sec execute 264 sec latency 3159.934 ms 2023-12-16T20:41:52.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1812 0.19 MB/sec execute 265 sec latency 2408.136 ms 2023-12-16T20:41:53.115 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1816 0.19 MB/sec execute 266 sec latency 2189.346 ms 2023-12-16T20:41:54.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1819 0.19 MB/sec execute 267 sec latency 2829.657 ms 2023-12-16T20:41:55.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1824 0.19 MB/sec execute 268 sec latency 3289.525 ms 2023-12-16T20:41:56.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1826 0.19 MB/sec execute 269 sec latency 3718.095 ms 2023-12-16T20:41:56.786 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:41:56.788 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:41:57.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1830 0.19 MB/sec execute 270 sec latency 2498.839 ms 2023-12-16T20:41:58.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1833 0.19 MB/sec execute 271 sec latency 2509.537 ms 2023-12-16T20:41:59.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1837 0.19 MB/sec execute 272 sec latency 2450.389 ms 2023-12-16T20:42:00.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1842 0.19 MB/sec execute 273 sec latency 2673.970 ms 2023-12-16T20:42:01.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1845 0.19 MB/sec execute 274 sec latency 2294.265 ms 2023-12-16T20:42:02.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1848 0.18 MB/sec execute 275 sec latency 2339.204 ms 2023-12-16T20:42:03.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1850 0.18 MB/sec execute 276 sec latency 2343.187 ms 2023-12-16T20:42:04.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1853 0.18 MB/sec execute 277 sec latency 2386.581 ms 2023-12-16T20:42:05.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1856 0.18 MB/sec execute 278 sec latency 2367.482 ms 2023-12-16T20:42:06.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1860 0.18 MB/sec execute 279 sec latency 2071.960 ms 2023-12-16T20:42:07.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1863 0.18 MB/sec execute 280 sec latency 2093.427 ms 2023-12-16T20:42:08.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1864 0.18 MB/sec execute 281 sec latency 2146.462 ms 2023-12-16T20:42:09.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1870 0.18 MB/sec execute 282 sec latency 2343.711 ms 2023-12-16T20:42:10.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1877 0.18 MB/sec execute 283 sec latency 2313.342 ms 2023-12-16T20:42:11.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1883 0.18 MB/sec execute 284 sec latency 2422.309 ms 2023-12-16T20:42:12.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1887 0.18 MB/sec execute 285 sec latency 2472.765 ms 2023-12-16T20:42:13.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1890 0.18 MB/sec execute 286 sec latency 2051.477 ms 2023-12-16T20:42:14.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1893 0.18 MB/sec execute 287 sec latency 2172.444 ms 2023-12-16T20:42:15.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1900 0.18 MB/sec execute 288 sec latency 2359.933 ms 2023-12-16T20:42:16.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1904 0.18 MB/sec execute 289 sec latency 2487.624 ms 2023-12-16T20:42:17.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1905 0.18 MB/sec execute 290 sec latency 2795.611 ms 2023-12-16T20:42:18.116 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1908 0.18 MB/sec execute 291 sec latency 2254.670 ms 2023-12-16T20:42:19.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1912 0.18 MB/sec execute 292 sec latency 2650.894 ms 2023-12-16T20:42:20.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1917 0.18 MB/sec execute 293 sec latency 2683.108 ms 2023-12-16T20:42:21.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1922 0.18 MB/sec execute 294 sec latency 2710.206 ms 2023-12-16T20:42:22.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1931 0.18 MB/sec execute 295 sec latency 2734.298 ms 2023-12-16T20:42:23.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1935 0.17 MB/sec execute 296 sec latency 2651.386 ms 2023-12-16T20:42:24.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1937 0.17 MB/sec execute 297 sec latency 2797.664 ms 2023-12-16T20:42:25.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1946 0.17 MB/sec execute 298 sec latency 2726.652 ms 2023-12-16T20:42:26.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1950 0.17 MB/sec execute 299 sec latency 2311.745 ms 2023-12-16T20:42:26.909 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:42:26.912 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:42:27.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1956 0.17 MB/sec execute 300 sec latency 2549.521 ms 2023-12-16T20:42:28.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1958 0.17 MB/sec execute 301 sec latency 3065.813 ms 2023-12-16T20:42:29.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1959 0.17 MB/sec execute 302 sec latency 3627.113 ms 2023-12-16T20:42:30.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1964 0.17 MB/sec execute 303 sec latency 3745.372 ms 2023-12-16T20:42:31.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1969 0.17 MB/sec execute 304 sec latency 2460.457 ms 2023-12-16T20:42:32.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1970 0.17 MB/sec execute 305 sec latency 2847.720 ms 2023-12-16T20:42:33.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1973 0.17 MB/sec execute 306 sec latency 3198.378 ms 2023-12-16T20:42:34.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1977 0.17 MB/sec execute 307 sec latency 3492.583 ms 2023-12-16T20:42:35.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1987 0.17 MB/sec execute 308 sec latency 3510.332 ms 2023-12-16T20:42:36.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1991 0.17 MB/sec execute 309 sec latency 2803.925 ms 2023-12-16T20:42:37.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 1997 0.17 MB/sec execute 310 sec latency 2951.867 ms 2023-12-16T20:42:38.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2003 0.17 MB/sec execute 311 sec latency 2598.708 ms 2023-12-16T20:42:39.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2006 0.17 MB/sec execute 312 sec latency 2951.247 ms 2023-12-16T20:42:40.117 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2011 0.17 MB/sec execute 313 sec latency 3270.267 ms 2023-12-16T20:42:41.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2013 0.17 MB/sec execute 314 sec latency 3893.883 ms 2023-12-16T20:42:42.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2015 0.17 MB/sec execute 315 sec latency 4607.883 ms 2023-12-16T20:42:43.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2017 0.17 MB/sec execute 316 sec latency 4464.984 ms 2023-12-16T20:42:44.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2019 0.17 MB/sec execute 317 sec latency 4493.838 ms 2023-12-16T20:42:45.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2024 0.17 MB/sec execute 318 sec latency 4657.492 ms 2023-12-16T20:42:46.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2026 0.17 MB/sec execute 319 sec latency 3373.094 ms 2023-12-16T20:42:47.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2031 0.17 MB/sec execute 320 sec latency 3493.905 ms 2023-12-16T20:42:48.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2034 0.16 MB/sec execute 321 sec latency 2579.987 ms 2023-12-16T20:42:49.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2038 0.16 MB/sec execute 322 sec latency 2468.307 ms 2023-12-16T20:42:50.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2043 0.16 MB/sec execute 323 sec latency 2962.749 ms 2023-12-16T20:42:51.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2047 0.16 MB/sec execute 324 sec latency 2842.292 ms 2023-12-16T20:42:52.121 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2049 0.16 MB/sec execute 325 sec latency 2793.992 ms 2023-12-16T20:42:53.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2051 0.16 MB/sec execute 326 sec latency 3106.461 ms 2023-12-16T20:42:54.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2055 0.16 MB/sec execute 327 sec latency 3244.469 ms 2023-12-16T20:42:55.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2060 0.16 MB/sec execute 328 sec latency 2647.604 ms 2023-12-16T20:42:56.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2063 0.16 MB/sec execute 329 sec latency 2468.456 ms 2023-12-16T20:42:57.039 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:42:57.041 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:42:57.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2066 0.16 MB/sec execute 330 sec latency 2371.941 ms 2023-12-16T20:42:58.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2068 0.16 MB/sec execute 331 sec latency 2405.570 ms 2023-12-16T20:42:59.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2070 0.16 MB/sec execute 332 sec latency 2471.925 ms 2023-12-16T20:43:00.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2074 0.16 MB/sec execute 333 sec latency 2505.037 ms 2023-12-16T20:43:01.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2080 0.16 MB/sec execute 334 sec latency 2049.965 ms 2023-12-16T20:43:02.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2081 0.16 MB/sec execute 335 sec latency 2945.832 ms 2023-12-16T20:43:03.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2083 0.16 MB/sec execute 336 sec latency 3081.073 ms 2023-12-16T20:43:04.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2085 0.16 MB/sec execute 337 sec latency 3567.187 ms 2023-12-16T20:43:05.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2088 0.16 MB/sec execute 338 sec latency 2663.961 ms 2023-12-16T20:43:06.118 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2089 0.16 MB/sec execute 339 sec latency 2134.001 ms 2023-12-16T20:43:07.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2093 0.16 MB/sec execute 340 sec latency 2191.638 ms 2023-12-16T20:43:08.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2094 0.16 MB/sec execute 341 sec latency 2850.447 ms 2023-12-16T20:43:09.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2102 0.16 MB/sec execute 342 sec latency 3150.658 ms 2023-12-16T20:43:10.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2105 0.16 MB/sec execute 343 sec latency 3058.085 ms 2023-12-16T20:43:11.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2109 0.16 MB/sec execute 344 sec latency 3140.074 ms 2023-12-16T20:43:12.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2111 0.16 MB/sec execute 345 sec latency 2280.038 ms 2023-12-16T20:43:13.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2113 0.16 MB/sec execute 346 sec latency 2285.088 ms 2023-12-16T20:43:14.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2121 0.16 MB/sec execute 347 sec latency 2319.819 ms 2023-12-16T20:43:15.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2125 0.16 MB/sec execute 348 sec latency 2328.561 ms 2023-12-16T20:43:16.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2128 0.15 MB/sec execute 349 sec latency 2776.154 ms 2023-12-16T20:43:17.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2132 0.15 MB/sec execute 350 sec latency 2887.496 ms 2023-12-16T20:43:18.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2138 0.15 MB/sec execute 351 sec latency 2672.256 ms 2023-12-16T20:43:19.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2143 0.15 MB/sec execute 352 sec latency 2561.079 ms 2023-12-16T20:43:20.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2147 0.15 MB/sec execute 353 sec latency 2880.931 ms 2023-12-16T20:43:21.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2149 0.15 MB/sec execute 354 sec latency 3337.543 ms 2023-12-16T20:43:22.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2157 0.16 MB/sec execute 355 sec latency 3927.534 ms 2023-12-16T20:43:23.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2164 0.16 MB/sec execute 356 sec latency 3332.480 ms 2023-12-16T20:43:24.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2166 0.15 MB/sec execute 357 sec latency 3790.474 ms 2023-12-16T20:43:25.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2171 0.15 MB/sec execute 358 sec latency 3089.741 ms 2023-12-16T20:43:26.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2174 0.15 MB/sec execute 359 sec latency 4089.769 ms 2023-12-16T20:43:27.104 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:43:27.107 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:43:27.119 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2177 0.15 MB/sec execute 360 sec latency 4136.204 ms 2023-12-16T20:43:28.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2178 0.15 MB/sec execute 361 sec latency 3060.879 ms 2023-12-16T20:43:29.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2180 0.15 MB/sec execute 362 sec latency 3841.734 ms 2023-12-16T20:43:30.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2186 0.15 MB/sec execute 363 sec latency 3734.124 ms 2023-12-16T20:43:31.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2189 0.15 MB/sec execute 364 sec latency 3240.054 ms 2023-12-16T20:43:32.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2194 0.16 MB/sec execute 365 sec latency 3766.921 ms 2023-12-16T20:43:33.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2198 0.15 MB/sec execute 366 sec latency 3172.822 ms 2023-12-16T20:43:34.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2200 0.15 MB/sec execute 367 sec latency 2399.162 ms 2023-12-16T20:43:35.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2203 0.15 MB/sec execute 368 sec latency 2526.596 ms 2023-12-16T20:43:36.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2207 0.15 MB/sec execute 369 sec latency 2270.142 ms 2023-12-16T20:43:37.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2208 0.15 MB/sec execute 370 sec latency 2259.804 ms 2023-12-16T20:43:38.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2213 0.15 MB/sec execute 371 sec latency 2654.344 ms 2023-12-16T20:43:39.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2217 0.15 MB/sec execute 372 sec latency 2508.881 ms 2023-12-16T20:43:40.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2223 0.15 MB/sec execute 373 sec latency 2377.023 ms 2023-12-16T20:43:41.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2228 0.15 MB/sec execute 374 sec latency 2283.865 ms 2023-12-16T20:43:42.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2234 0.15 MB/sec execute 375 sec latency 1534.314 ms 2023-12-16T20:43:43.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2240 0.15 MB/sec execute 376 sec latency 1451.347 ms 2023-12-16T20:43:44.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2240 0.15 MB/sec execute 377 sec latency 2397.421 ms 2023-12-16T20:43:45.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2251 0.15 MB/sec execute 378 sec latency 2914.945 ms 2023-12-16T20:43:46.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2261 0.15 MB/sec execute 379 sec latency 2803.084 ms 2023-12-16T20:43:47.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2272 0.16 MB/sec execute 380 sec latency 3574.702 ms 2023-12-16T20:43:48.120 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2279 0.16 MB/sec execute 381 sec latency 3545.764 ms 2023-12-16T20:43:49.121 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2285 0.16 MB/sec execute 382 sec latency 3890.863 ms 2023-12-16T20:43:50.121 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2288 0.16 MB/sec execute 383 sec latency 2946.232 ms 2023-12-16T20:43:51.121 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2290 0.16 MB/sec execute 384 sec latency 3362.135 ms 2023-12-16T20:43:52.121 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2293 0.16 MB/sec execute 385 sec latency 3811.931 ms 2023-12-16T20:43:53.121 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2298 0.16 MB/sec execute 386 sec latency 3963.686 ms 2023-12-16T20:43:54.121 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2301 0.16 MB/sec execute 387 sec latency 3922.795 ms 2023-12-16T20:43:55.121 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2307 0.17 MB/sec execute 388 sec latency 4662.066 ms 2023-12-16T20:43:56.121 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2312 0.17 MB/sec execute 389 sec latency 4674.254 ms 2023-12-16T20:43:57.121 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2313 0.17 MB/sec execute 390 sec latency 3494.786 ms 2023-12-16T20:43:57.160 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:43:57.162 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:43:58.121 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2315 0.17 MB/sec execute 391 sec latency 2410.535 ms 2023-12-16T20:43:59.121 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2316 0.17 MB/sec execute 392 sec latency 2708.333 ms 2023-12-16T20:44:00.121 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2318 0.17 MB/sec execute 393 sec latency 3055.284 ms 2023-12-16T20:44:01.121 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2319 0.17 MB/sec execute 394 sec latency 2888.934 ms 2023-12-16T20:44:02.121 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2321 0.17 MB/sec execute 395 sec latency 2506.766 ms 2023-12-16T20:44:03.121 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2326 0.17 MB/sec execute 396 sec latency 2546.470 ms 2023-12-16T20:44:04.121 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2328 0.17 MB/sec execute 397 sec latency 2549.432 ms 2023-12-16T20:44:05.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2330 0.16 MB/sec execute 398 sec latency 2541.115 ms 2023-12-16T20:44:06.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2330 0.16 MB/sec execute 399 sec latency 2130.700 ms 2023-12-16T20:44:07.121 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2332 0.16 MB/sec execute 400 sec latency 2331.618 ms 2023-12-16T20:44:08.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2339 0.16 MB/sec execute 401 sec latency 2392.109 ms 2023-12-16T20:44:09.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2340 0.16 MB/sec execute 402 sec latency 2923.128 ms 2023-12-16T20:44:10.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2343 0.16 MB/sec execute 403 sec latency 2952.338 ms 2023-12-16T20:44:11.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2344 0.16 MB/sec execute 404 sec latency 3372.623 ms 2023-12-16T20:44:12.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2345 0.16 MB/sec execute 405 sec latency 2595.178 ms 2023-12-16T20:44:13.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2347 0.16 MB/sec execute 406 sec latency 2446.002 ms 2023-12-16T20:44:14.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2349 0.16 MB/sec execute 407 sec latency 2618.359 ms 2023-12-16T20:44:15.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2353 0.16 MB/sec execute 408 sec latency 2908.262 ms 2023-12-16T20:44:16.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2357 0.16 MB/sec execute 409 sec latency 3245.281 ms 2023-12-16T20:44:17.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2360 0.16 MB/sec execute 410 sec latency 2874.352 ms 2023-12-16T20:44:18.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2364 0.16 MB/sec execute 411 sec latency 2926.083 ms 2023-12-16T20:44:19.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2365 0.16 MB/sec execute 412 sec latency 2900.919 ms 2023-12-16T20:44:20.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2367 0.16 MB/sec execute 413 sec latency 2803.098 ms 2023-12-16T20:44:21.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2369 0.16 MB/sec execute 414 sec latency 2783.682 ms 2023-12-16T20:44:22.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2373 0.16 MB/sec execute 415 sec latency 2814.386 ms 2023-12-16T20:44:22.486 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:23:27.726 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:44:22.490 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:23:27.730 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:44:22.497 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:23:27.691 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:44:22.498 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:23:27.692 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:44:22.499 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:23:27.693 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:44:22.501 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:23:27.695 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:44:22.626 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:23:27.866 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:44:22.642 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:23:27.835 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:44:22.646 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:23:27.840 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:44:23.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2374 0.16 MB/sec execute 416 sec latency 2878.378 ms 2023-12-16T20:44:24.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2375 0.16 MB/sec execute 417 sec latency 3061.358 ms 2023-12-16T20:44:25.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2378 0.16 MB/sec execute 418 sec latency 2917.329 ms 2023-12-16T20:44:26.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2380 0.16 MB/sec execute 419 sec latency 2791.970 ms 2023-12-16T20:44:27.122 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2381 0.16 MB/sec execute 420 sec latency 2365.996 ms 2023-12-16T20:44:27.299 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:44:27.302 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:44:28.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2382 0.16 MB/sec execute 421 sec latency 2338.195 ms 2023-12-16T20:44:29.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2384 0.16 MB/sec execute 422 sec latency 2516.839 ms 2023-12-16T20:44:30.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2386 0.16 MB/sec execute 423 sec latency 2655.190 ms 2023-12-16T20:44:31.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2389 0.16 MB/sec execute 424 sec latency 2663.446 ms 2023-12-16T20:44:32.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2392 0.16 MB/sec execute 425 sec latency 2590.668 ms 2023-12-16T20:44:33.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2397 0.16 MB/sec execute 426 sec latency 2621.493 ms 2023-12-16T20:44:34.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2399 0.16 MB/sec execute 427 sec latency 3059.671 ms 2023-12-16T20:44:35.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2404 0.16 MB/sec execute 428 sec latency 2814.476 ms 2023-12-16T20:44:36.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2406 0.16 MB/sec execute 429 sec latency 2650.902 ms 2023-12-16T20:44:37.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2408 0.16 MB/sec execute 430 sec latency 2949.652 ms 2023-12-16T20:44:38.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2414 0.16 MB/sec execute 431 sec latency 3057.159 ms 2023-12-16T20:44:39.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2417 0.16 MB/sec execute 432 sec latency 3474.022 ms 2023-12-16T20:44:40.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2419 0.16 MB/sec execute 433 sec latency 3821.422 ms 2023-12-16T20:44:41.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2421 0.16 MB/sec execute 434 sec latency 3510.010 ms 2023-12-16T20:44:42.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2423 0.16 MB/sec execute 435 sec latency 3002.105 ms 2023-12-16T20:44:43.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2428 0.16 MB/sec execute 436 sec latency 2615.587 ms 2023-12-16T20:44:44.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2431 0.16 MB/sec execute 437 sec latency 3147.844 ms 2023-12-16T20:44:45.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2434 0.16 MB/sec execute 438 sec latency 3328.068 ms 2023-12-16T20:44:46.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2438 0.16 MB/sec execute 439 sec latency 3356.506 ms 2023-12-16T20:44:47.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2440 0.16 MB/sec execute 440 sec latency 3491.060 ms 2023-12-16T20:44:48.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2442 0.16 MB/sec execute 441 sec latency 2479.265 ms 2023-12-16T20:44:49.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2444 0.16 MB/sec execute 442 sec latency 3054.529 ms 2023-12-16T20:44:50.123 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2451 0.16 MB/sec execute 443 sec latency 2891.866 ms 2023-12-16T20:44:51.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2454 0.16 MB/sec execute 444 sec latency 2325.264 ms 2023-12-16T20:44:52.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2457 0.16 MB/sec execute 445 sec latency 2559.056 ms 2023-12-16T20:44:53.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2460 0.16 MB/sec execute 446 sec latency 2653.035 ms 2023-12-16T20:44:54.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2462 0.16 MB/sec execute 447 sec latency 3277.305 ms 2023-12-16T20:44:55.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2464 0.16 MB/sec execute 448 sec latency 2767.512 ms 2023-12-16T20:44:56.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2471 0.16 MB/sec execute 449 sec latency 2963.249 ms 2023-12-16T20:44:57.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2475 0.16 MB/sec execute 450 sec latency 2869.044 ms 2023-12-16T20:44:57.431 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:44:57.434 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:44:58.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2478 0.16 MB/sec execute 451 sec latency 3008.163 ms 2023-12-16T20:44:59.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2481 0.16 MB/sec execute 452 sec latency 2828.652 ms 2023-12-16T20:45:00.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2482 0.16 MB/sec execute 453 sec latency 3282.046 ms 2023-12-16T20:45:01.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2489 0.16 MB/sec execute 454 sec latency 3252.610 ms 2023-12-16T20:45:02.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2493 0.16 MB/sec execute 455 sec latency 3352.322 ms 2023-12-16T20:45:03.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2497 0.16 MB/sec execute 456 sec latency 3164.006 ms 2023-12-16T20:45:04.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2500 0.16 MB/sec execute 457 sec latency 3303.078 ms 2023-12-16T20:45:05.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2503 0.16 MB/sec execute 458 sec latency 3492.782 ms 2023-12-16T20:45:06.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2504 0.16 MB/sec execute 459 sec latency 3591.256 ms 2023-12-16T20:45:07.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2510 0.16 MB/sec execute 460 sec latency 3265.755 ms 2023-12-16T20:45:08.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2515 0.16 MB/sec execute 461 sec latency 2541.352 ms 2023-12-16T20:45:09.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2516 0.16 MB/sec execute 462 sec latency 2883.301 ms 2023-12-16T20:45:10.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2519 0.16 MB/sec execute 463 sec latency 3114.524 ms 2023-12-16T20:45:11.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2521 0.16 MB/sec execute 464 sec latency 2893.462 ms 2023-12-16T20:45:12.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2524 0.16 MB/sec execute 465 sec latency 2271.331 ms 2023-12-16T20:45:12.748 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:24:17.988 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:45:12.753 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:24:17.993 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:45:12.787 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:24:18.027 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:45:12.808 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:24:18.002 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:45:12.812 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:24:18.005 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:45:12.814 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:24:18.008 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:45:12.819 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:24:18.013 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:45:12.846 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:24:18.040 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:45:12.857 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:24:18.050 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:45:13.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2529 0.16 MB/sec execute 466 sec latency 2092.254 ms 2023-12-16T20:45:14.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2535 0.16 MB/sec execute 467 sec latency 2403.072 ms 2023-12-16T20:45:15.124 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2545 0.16 MB/sec execute 468 sec latency 2572.799 ms 2023-12-16T20:45:16.125 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2552 0.16 MB/sec execute 469 sec latency 2527.330 ms 2023-12-16T20:45:17.125 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2554 0.16 MB/sec execute 470 sec latency 2439.889 ms 2023-12-16T20:45:18.125 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2560 0.16 MB/sec execute 471 sec latency 2309.558 ms 2023-12-16T20:45:19.125 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2566 0.16 MB/sec execute 472 sec latency 2398.039 ms 2023-12-16T20:45:20.125 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2567 0.16 MB/sec execute 473 sec latency 2712.002 ms 2023-12-16T20:45:21.125 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2569 0.16 MB/sec execute 474 sec latency 2851.302 ms 2023-12-16T20:45:22.125 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2571 0.16 MB/sec execute 475 sec latency 2804.108 ms 2023-12-16T20:45:23.125 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2571 0.16 MB/sec execute 476 sec latency 2838.851 ms 2023-12-16T20:45:24.125 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2575 0.16 MB/sec execute 477 sec latency 2909.207 ms 2023-12-16T20:45:25.125 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2580 0.16 MB/sec execute 478 sec latency 2652.807 ms 2023-12-16T20:45:26.125 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2583 0.16 MB/sec execute 479 sec latency 2487.863 ms 2023-12-16T20:45:27.125 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2588 0.16 MB/sec execute 480 sec latency 2965.013 ms 2023-12-16T20:45:27.517 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:45:27.519 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:45:28.125 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2596 0.17 MB/sec execute 481 sec latency 2775.317 ms 2023-12-16T20:45:29.125 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2597 0.17 MB/sec execute 482 sec latency 2483.666 ms 2023-12-16T20:45:30.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2600 0.17 MB/sec execute 483 sec latency 2751.745 ms 2023-12-16T20:45:31.125 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2604 0.17 MB/sec execute 484 sec latency 2784.439 ms 2023-12-16T20:45:32.125 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2607 0.17 MB/sec execute 485 sec latency 2466.859 ms 2023-12-16T20:45:33.125 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2612 0.17 MB/sec execute 486 sec latency 2761.880 ms 2023-12-16T20:45:34.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2621 0.17 MB/sec execute 487 sec latency 2824.523 ms 2023-12-16T20:45:35.125 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2624 0.17 MB/sec execute 488 sec latency 2710.878 ms 2023-12-16T20:45:36.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2626 0.17 MB/sec execute 489 sec latency 2789.855 ms 2023-12-16T20:45:37.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2631 0.17 MB/sec execute 490 sec latency 3028.621 ms 2023-12-16T20:45:38.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2633 0.17 MB/sec execute 491 sec latency 3095.036 ms 2023-12-16T20:45:39.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2636 0.17 MB/sec execute 492 sec latency 2777.864 ms 2023-12-16T20:45:40.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2638 0.17 MB/sec execute 493 sec latency 3087.961 ms 2023-12-16T20:45:41.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2641 0.17 MB/sec execute 494 sec latency 3026.226 ms 2023-12-16T20:45:42.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2644 0.17 MB/sec execute 495 sec latency 2853.005 ms 2023-12-16T20:45:43.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2654 0.17 MB/sec execute 496 sec latency 2624.620 ms 2023-12-16T20:45:44.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2656 0.17 MB/sec execute 497 sec latency 2693.231 ms 2023-12-16T20:45:45.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2657 0.17 MB/sec execute 498 sec latency 2888.050 ms 2023-12-16T20:45:46.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2670 0.17 MB/sec execute 499 sec latency 2565.433 ms 2023-12-16T20:45:47.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2672 0.17 MB/sec execute 500 sec latency 2481.489 ms 2023-12-16T20:45:48.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2672 0.17 MB/sec execute 501 sec latency 2364.811 ms 2023-12-16T20:45:49.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2684 0.18 MB/sec execute 502 sec latency 2379.013 ms 2023-12-16T20:45:50.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2695 0.18 MB/sec execute 503 sec latency 2716.272 ms 2023-12-16T20:45:51.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2700 0.19 MB/sec execute 504 sec latency 2764.936 ms 2023-12-16T20:45:52.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2723 0.19 MB/sec execute 505 sec latency 2874.009 ms 2023-12-16T20:45:53.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2739 0.20 MB/sec execute 506 sec latency 2674.224 ms 2023-12-16T20:45:54.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2745 0.20 MB/sec execute 507 sec latency 2475.931 ms 2023-12-16T20:45:55.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2759 0.21 MB/sec execute 508 sec latency 2573.392 ms 2023-12-16T20:45:56.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2775 0.21 MB/sec execute 509 sec latency 2598.160 ms 2023-12-16T20:45:57.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2781 0.21 MB/sec execute 510 sec latency 2605.621 ms 2023-12-16T20:45:57.720 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:45:57.723 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:45:58.126 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2782 0.21 MB/sec execute 511 sec latency 2679.253 ms 2023-12-16T20:45:59.127 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2791 0.21 MB/sec execute 512 sec latency 2584.960 ms 2023-12-16T20:46:00.127 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2796 0.21 MB/sec execute 513 sec latency 2886.260 ms 2023-12-16T20:46:01.127 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2807 0.21 MB/sec execute 514 sec latency 2827.872 ms 2023-12-16T20:46:02.127 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2810 0.21 MB/sec execute 515 sec latency 2872.425 ms 2023-12-16T20:46:03.127 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2813 0.21 MB/sec execute 516 sec latency 2703.756 ms 2023-12-16T20:46:04.127 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2816 0.21 MB/sec execute 517 sec latency 2546.745 ms 2023-12-16T20:46:05.127 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2818 0.21 MB/sec execute 518 sec latency 2947.773 ms 2023-12-16T20:46:06.127 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2825 0.21 MB/sec execute 519 sec latency 3095.990 ms 2023-12-16T20:46:07.127 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2835 0.21 MB/sec execute 520 sec latency 3082.394 ms 2023-12-16T20:46:08.127 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2846 0.21 MB/sec execute 521 sec latency 2466.871 ms 2023-12-16T20:46:09.127 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2851 0.21 MB/sec execute 522 sec latency 2395.278 ms 2023-12-16T20:46:10.127 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2861 0.21 MB/sec execute 523 sec latency 2992.254 ms 2023-12-16T20:46:11.127 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2882 0.22 MB/sec execute 524 sec latency 3065.306 ms 2023-12-16T20:46:12.127 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2883 0.21 MB/sec execute 525 sec latency 2322.091 ms 2023-12-16T20:46:13.127 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2886 0.22 MB/sec execute 526 sec latency 2621.335 ms 2023-12-16T20:46:14.127 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2900 0.22 MB/sec execute 527 sec latency 2863.151 ms 2023-12-16T20:46:15.127 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2905 0.22 MB/sec execute 528 sec latency 2606.645 ms 2023-12-16T20:46:16.128 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2917 0.22 MB/sec execute 529 sec latency 2627.710 ms 2023-12-16T20:46:17.127 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2923 0.22 MB/sec execute 530 sec latency 2703.506 ms 2023-12-16T20:46:18.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2929 0.22 MB/sec execute 531 sec latency 2737.101 ms 2023-12-16T20:46:19.128 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2932 0.22 MB/sec execute 532 sec latency 2934.177 ms 2023-12-16T20:46:20.128 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2935 0.22 MB/sec execute 533 sec latency 2782.112 ms 2023-12-16T20:46:21.128 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2942 0.23 MB/sec execute 534 sec latency 1180.991 ms 2023-12-16T20:46:22.128 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2946 0.23 MB/sec execute 535 sec latency 1860.211 ms 2023-12-16T20:46:23.128 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2949 0.23 MB/sec execute 536 sec latency 2860.238 ms 2023-12-16T20:46:24.128 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2953 0.23 MB/sec execute 537 sec latency 3601.249 ms 2023-12-16T20:46:25.128 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2971 0.23 MB/sec execute 538 sec latency 3363.079 ms 2023-12-16T20:46:26.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2979 0.23 MB/sec execute 539 sec latency 1596.818 ms 2023-12-16T20:46:27.128 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2982 0.23 MB/sec execute 540 sec latency 2392.231 ms 2023-12-16T20:46:27.779 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:46:27.781 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:46:28.128 INFO:tasks.workunit.client.0.smithi087.stdout: 10 2990 0.23 MB/sec execute 541 sec latency 2626.341 ms 2023-12-16T20:46:29.128 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3005 0.23 MB/sec execute 542 sec latency 2474.420 ms 2023-12-16T20:46:30.128 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3008 0.23 MB/sec execute 543 sec latency 2790.881 ms 2023-12-16T20:46:31.128 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3011 0.23 MB/sec execute 544 sec latency 2953.366 ms 2023-12-16T20:46:32.128 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3015 0.23 MB/sec execute 545 sec latency 3028.820 ms 2023-12-16T20:46:33.128 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3019 0.23 MB/sec execute 546 sec latency 2553.634 ms 2023-12-16T20:46:33.170 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:25:38.410 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:46:33.174 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:25:38.414 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:46:33.211 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:25:38.451 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:46:33.228 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:25:38.421 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:46:33.228 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:25:38.422 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:46:33.231 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:25:38.425 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:46:33.233 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:25:38.426 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:46:33.281 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:25:38.475 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:46:33.283 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:25:38.476 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:46:34.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3022 0.23 MB/sec execute 547 sec latency 2594.329 ms 2023-12-16T20:46:35.128 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3027 0.23 MB/sec execute 548 sec latency 2912.553 ms 2023-12-16T20:46:36.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3032 0.23 MB/sec execute 549 sec latency 1771.110 ms 2023-12-16T20:46:37.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3038 0.23 MB/sec execute 550 sec latency 2665.338 ms 2023-12-16T20:46:38.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3040 0.23 MB/sec execute 551 sec latency 2469.606 ms 2023-12-16T20:46:39.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3043 0.23 MB/sec execute 552 sec latency 2611.381 ms 2023-12-16T20:46:40.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3044 0.23 MB/sec execute 553 sec latency 2827.628 ms 2023-12-16T20:46:41.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3066 0.23 MB/sec execute 554 sec latency 2865.714 ms 2023-12-16T20:46:42.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3071 0.23 MB/sec execute 555 sec latency 3149.340 ms 2023-12-16T20:46:43.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3074 0.23 MB/sec execute 556 sec latency 3435.283 ms 2023-12-16T20:46:44.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3078 0.23 MB/sec execute 557 sec latency 2964.946 ms 2023-12-16T20:46:45.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3081 0.23 MB/sec execute 558 sec latency 2662.715 ms 2023-12-16T20:46:46.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3084 0.23 MB/sec execute 559 sec latency 2717.568 ms 2023-12-16T20:46:47.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3088 0.23 MB/sec execute 560 sec latency 3085.437 ms 2023-12-16T20:46:48.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3092 0.23 MB/sec execute 561 sec latency 3233.452 ms 2023-12-16T20:46:49.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3134 0.23 MB/sec execute 562 sec latency 2860.561 ms 2023-12-16T20:46:50.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3135 0.23 MB/sec execute 563 sec latency 2852.118 ms 2023-12-16T20:46:51.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3166 0.23 MB/sec execute 564 sec latency 3074.647 ms 2023-12-16T20:46:52.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3167 0.23 MB/sec execute 565 sec latency 3041.123 ms 2023-12-16T20:46:53.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3172 0.23 MB/sec execute 566 sec latency 3103.578 ms 2023-12-16T20:46:54.132 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3189 0.23 MB/sec execute 567 sec latency 2858.204 ms 2023-12-16T20:46:55.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3206 0.23 MB/sec execute 568 sec latency 2800.402 ms 2023-12-16T20:46:56.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3209 0.23 MB/sec execute 569 sec latency 2896.486 ms 2023-12-16T20:46:57.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3211 0.23 MB/sec execute 570 sec latency 2755.659 ms 2023-12-16T20:46:57.900 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:46:57.903 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:46:58.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3213 0.23 MB/sec execute 571 sec latency 2519.055 ms 2023-12-16T20:46:59.129 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3219 0.23 MB/sec execute 572 sec latency 2608.758 ms 2023-12-16T20:47:00.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3222 0.23 MB/sec execute 573 sec latency 2956.354 ms 2023-12-16T20:47:01.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3227 0.23 MB/sec execute 574 sec latency 3215.286 ms 2023-12-16T20:47:02.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3237 0.23 MB/sec execute 575 sec latency 3511.045 ms 2023-12-16T20:47:03.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3245 0.24 MB/sec execute 576 sec latency 3537.484 ms 2023-12-16T20:47:04.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3255 0.24 MB/sec execute 577 sec latency 2737.041 ms 2023-12-16T20:47:05.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3259 0.24 MB/sec execute 578 sec latency 2259.606 ms 2023-12-16T20:47:06.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3264 0.24 MB/sec execute 579 sec latency 2556.381 ms 2023-12-16T20:47:07.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3269 0.24 MB/sec execute 580 sec latency 2801.076 ms 2023-12-16T20:47:08.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3274 0.24 MB/sec execute 581 sec latency 2458.721 ms 2023-12-16T20:47:09.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3276 0.24 MB/sec execute 582 sec latency 2620.356 ms 2023-12-16T20:47:10.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3278 0.24 MB/sec execute 583 sec latency 2790.913 ms 2023-12-16T20:47:11.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3280 0.24 MB/sec execute 584 sec latency 2795.510 ms 2023-12-16T20:47:12.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3281 0.24 MB/sec execute 585 sec latency 2983.832 ms 2023-12-16T20:47:13.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3282 0.24 MB/sec execute 586 sec latency 3012.633 ms 2023-12-16T20:47:14.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3283 0.24 MB/sec execute 587 sec latency 2188.076 ms 2023-12-16T20:47:15.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3284 0.24 MB/sec execute 588 sec latency 2462.625 ms 2023-12-16T20:47:16.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3284 0.24 MB/sec execute 589 sec latency 2521.321 ms 2023-12-16T20:47:17.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3285 0.24 MB/sec execute 590 sec latency 2257.096 ms 2023-12-16T20:47:18.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3285 0.24 MB/sec execute 591 sec latency 2149.925 ms 2023-12-16T20:47:19.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3286 0.24 MB/sec execute 592 sec latency 2205.502 ms 2023-12-16T20:47:20.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3287 0.24 MB/sec execute 593 sec latency 2321.575 ms 2023-12-16T20:47:21.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3287 0.24 MB/sec execute 594 sec latency 2382.641 ms 2023-12-16T20:47:22.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3288 0.24 MB/sec execute 595 sec latency 2182.004 ms 2023-12-16T20:47:23.130 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3289 0.24 MB/sec execute 596 sec latency 2146.304 ms 2023-12-16T20:47:24.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3289 0.24 MB/sec execute 597 sec latency 2083.945 ms 2023-12-16T20:47:25.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3290 0.24 MB/sec execute 598 sec latency 1989.702 ms 2023-12-16T20:47:26.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 3292 0.23 MB/sec execute 599 sec latency 2028.817 ms 2023-12-16T20:47:27.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 600 sec 2023-12-16T20:47:27.970 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:47:27.973 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:47:28.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 601 sec 2023-12-16T20:47:29.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 602 sec 2023-12-16T20:47:30.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 603 sec 2023-12-16T20:47:31.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 604 sec 2023-12-16T20:47:32.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 605 sec 2023-12-16T20:47:33.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 606 sec 2023-12-16T20:47:34.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 607 sec 2023-12-16T20:47:35.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 608 sec 2023-12-16T20:47:36.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 609 sec 2023-12-16T20:47:37.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 610 sec 2023-12-16T20:47:38.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 611 sec 2023-12-16T20:47:39.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 612 sec 2023-12-16T20:47:40.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 613 sec 2023-12-16T20:47:41.131 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 614 sec 2023-12-16T20:47:42.132 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 615 sec 2023-12-16T20:47:43.132 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 616 sec 2023-12-16T20:47:44.132 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 617 sec 2023-12-16T20:47:45.132 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 618 sec 2023-12-16T20:47:46.132 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 619 sec 2023-12-16T20:47:47.132 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 620 sec 2023-12-16T20:47:48.132 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 621 sec 2023-12-16T20:47:49.132 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 622 sec 2023-12-16T20:47:49.420 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:26:54.660 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:47:49.424 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:26:54.664 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:47:49.430 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:26:54.624 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:47:49.432 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:26:54.626 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:47:49.433 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:26:54.627 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:47:49.435 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:26:54.629 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:47:49.468 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:26:54.708 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:47:49.494 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:26:54.688 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:47:49.518 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:26:54.712 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:47:50.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 623 sec 2023-12-16T20:47:51.132 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 624 sec 2023-12-16T20:47:52.132 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 625 sec 2023-12-16T20:47:53.132 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 626 sec 2023-12-16T20:47:54.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 627 sec 2023-12-16T20:47:55.132 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 628 sec 2023-12-16T20:47:56.132 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 629 sec 2023-12-16T20:47:57.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 630 sec 2023-12-16T20:47:58.119 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:47:58.122 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:47:58.132 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 631 sec 2023-12-16T20:47:59.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 632 sec 2023-12-16T20:48:00.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 633 sec 2023-12-16T20:48:01.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 634 sec 2023-12-16T20:48:02.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 635 sec 2023-12-16T20:48:03.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 636 sec 2023-12-16T20:48:04.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 637 sec 2023-12-16T20:48:05.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 638 sec 2023-12-16T20:48:06.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 639 sec 2023-12-16T20:48:07.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 640 sec 2023-12-16T20:48:08.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 641 sec 2023-12-16T20:48:09.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 642 sec 2023-12-16T20:48:10.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 643 sec 2023-12-16T20:48:11.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 644 sec 2023-12-16T20:48:12.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 645 sec 2023-12-16T20:48:13.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 646 sec 2023-12-16T20:48:14.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 647 sec 2023-12-16T20:48:15.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 648 sec 2023-12-16T20:48:16.133 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 649 sec 2023-12-16T20:48:17.134 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 650 sec 2023-12-16T20:48:18.134 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 651 sec 2023-12-16T20:48:19.134 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 652 sec 2023-12-16T20:48:20.134 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 653 sec 2023-12-16T20:48:21.134 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 654 sec 2023-12-16T20:48:22.134 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 655 sec 2023-12-16T20:48:23.134 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 656 sec 2023-12-16T20:48:24.134 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 657 sec 2023-12-16T20:48:25.134 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 658 sec 2023-12-16T20:48:26.134 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 659 sec 2023-12-16T20:48:27.134 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 660 sec 2023-12-16T20:48:28.134 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 661 sec 2023-12-16T20:48:28.250 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:48:28.253 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:48:29.134 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 662 sec 2023-12-16T20:48:30.134 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 663 sec 2023-12-16T20:48:31.134 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 664 sec 2023-12-16T20:48:32.134 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 665 sec 2023-12-16T20:48:33.134 INFO:tasks.workunit.client.0.smithi087.stdout: 10 cleanup 666 sec 2023-12-16T20:48:34.135 INFO:tasks.workunit.client.0.smithi087.stdout: 8 cleanup 667 sec 2023-12-16T20:48:35.135 INFO:tasks.workunit.client.0.smithi087.stdout: 6 cleanup 668 sec 2023-12-16T20:48:36.134 INFO:tasks.workunit.client.0.smithi087.stdout: 6 cleanup 669 sec 2023-12-16T20:48:37.135 INFO:tasks.workunit.client.0.smithi087.stdout: 6 cleanup 670 sec 2023-12-16T20:48:38.135 INFO:tasks.workunit.client.0.smithi087.stdout: 3 cleanup 671 sec 2023-12-16T20:48:39.135 INFO:tasks.workunit.client.0.smithi087.stdout: 1 cleanup 672 sec 2023-12-16T20:48:39.711 INFO:tasks.workunit.client.0.smithi087.stdout: 0 cleanup 673 sec 2023-12-16T20:48:39.711 INFO:tasks.workunit.client.0.smithi087.stdout: 2023-12-16T20:48:39.711 INFO:tasks.workunit.client.0.smithi087.stdout: Operation Count AvgLat MaxLat 2023-12-16T20:48:39.711 INFO:tasks.workunit.client.0.smithi087.stdout: ---------------------------------------- 2023-12-16T20:48:39.711 INFO:tasks.workunit.client.0.smithi087.stdout: NTCreateX 3926 292.079 2587.255 2023-12-16T20:48:39.712 INFO:tasks.workunit.client.0.smithi087.stdout: Close 3220 2.805 43.157 2023-12-16T20:48:39.712 INFO:tasks.workunit.client.0.smithi087.stdout: Rename 209 823.979 1577.355 2023-12-16T20:48:39.712 INFO:tasks.workunit.client.0.smithi087.stdout: Unlink 463 272.397 743.544 2023-12-16T20:48:39.712 INFO:tasks.workunit.client.0.smithi087.stdout: Qpathinfo 4011 185.751 1968.994 2023-12-16T20:48:39.712 INFO:tasks.workunit.client.0.smithi087.stdout: Qfileinfo 858 6.226 56.567 2023-12-16T20:48:39.712 INFO:tasks.workunit.client.0.smithi087.stdout: Qfsinfo 575 20.412 177.541 2023-12-16T20:48:39.712 INFO:tasks.workunit.client.0.smithi087.stdout: Sfileinfo 447 38.969 141.537 2023-12-16T20:48:39.712 INFO:tasks.workunit.client.0.smithi087.stdout: Find 1388 2648.168 4780.416 2023-12-16T20:48:39.712 INFO:tasks.workunit.client.0.smithi087.stdout: WriteX 2408 12.174 405.264 2023-12-16T20:48:39.712 INFO:tasks.workunit.client.0.smithi087.stdout: ReadX 7750 0.079 33.286 2023-12-16T20:48:39.712 INFO:tasks.workunit.client.0.smithi087.stdout: LockX 20 133.466 223.254 2023-12-16T20:48:39.712 INFO:tasks.workunit.client.0.smithi087.stdout: UnlockX 20 112.370 209.977 2023-12-16T20:48:39.712 INFO:tasks.workunit.client.0.smithi087.stdout: Flush 297 260.548 1617.389 2023-12-16T20:48:39.712 INFO:tasks.workunit.client.0.smithi087.stdout: 2023-12-16T20:48:39.712 INFO:tasks.workunit.client.0.smithi087.stdout:Throughput 0.234896 MB/sec 10 clients 10 procs max_latency=4780.422 ms 2023-12-16T20:48:39.713 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-16T20:48:39.713 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-16T20:48:58.305 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:48:58.308 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:49:00.751 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2023-12-16T20:49:00.752 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-16T20:49:01.014 DEBUG:teuthology.parallel:result is None 2023-12-16T20:49:01.014 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-16T20:49:01.219 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-16T20:49:01.219 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-12-16T20:49:01.229 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-12-16T20:49:01.229 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:49:01.229 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T20:49:01.246 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:49:01.246 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T20:49:01.301 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:49:01.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.440+0000 7f7e0afd5640 1 Processor -- start 2023-12-16T20:49:01.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.440+0000 7f7e0afd5640 1 -- start start 2023-12-16T20:49:01.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.441+0000 7f7e0afd5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7e04151510 0x7f7e040cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:01.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.441+0000 7f7e0afd5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e040728b0 0x7f7e040cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:01.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.441+0000 7f7e0afd5640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7e040c5a90 0x7f7e040c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:01.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.441+0000 7f7e0afd5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0415b6e0 con 0x7f7e04151510 2023-12-16T20:49:01.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.441+0000 7f7e0afd5640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0415a880 con 0x7f7e040c5a90 2023-12-16T20:49:01.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.441+0000 7f7e0afd5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e040c6480 con 0x7f7e040728b0 2023-12-16T20:49:01.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.441+0000 7f7e08d71640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7e04151510 0x7f7e040cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:01.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.441+0000 7f7e03fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e040728b0 0x7f7e040cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:01.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.442+0000 7f7e09572640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7e040c5a90 0x7f7e040c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:01.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.442+0000 7f7e08d71640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7e04151510 0x7f7e040cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56700/0 (socket says 172.21.15.87:56700) 2023-12-16T20:49:01.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.442+0000 7f7e08d71640 1 -- 172.21.15.87:0/1660733558 learned_addr learned my addr 172.21.15.87:0/1660733558 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:01.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.444+0000 7f7e08d71640 1 -- 172.21.15.87:0/1660733558 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e040728b0 msgr2=0x7f7e040cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:01.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.444+0000 7f7e08d71640 1 --2- 172.21.15.87:0/1660733558 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e040728b0 0x7f7e040cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:01.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.444+0000 7f7e08d71640 1 -- 172.21.15.87:0/1660733558 >> v2:172.21.15.195:3300/0 conn(0x7f7e040c5a90 msgr2=0x7f7e040c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:01.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.444+0000 7f7e08d71640 1 --2- 172.21.15.87:0/1660733558 >> v2:172.21.15.195:3300/0 conn(0x7f7e040c5a90 0x7f7e040c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:01.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.444+0000 7f7e08d71640 1 -- 172.21.15.87:0/1660733558 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0406f7e0 con 0x7f7e04151510 2023-12-16T20:49:01.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.446+0000 7f7e08d71640 1 --2- 172.21.15.87:0/1660733558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e04151510 0x7f7e040cae30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7e0415b9a0 tx=0x7f7df802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44aeeb8d5d1a8ace server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:01.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.449+0000 7f7e037fe640 1 -- 172.21.15.87:0/1660733558 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df8031870 con 0x7f7e04151510 2023-12-16T20:49:01.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.450+0000 7f7e037fe640 1 -- 172.21.15.87:0/1660733558 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df80319d0 con 0x7f7e04151510 2023-12-16T20:49:01.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.450+0000 7f7e037fe640 1 -- 172.21.15.87:0/1660733558 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df8031d60 con 0x7f7e04151510 2023-12-16T20:49:01.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.450+0000 7f7e0afd5640 1 -- 172.21.15.87:0/1660733558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e04151510 msgr2=0x7f7e040cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:01.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.450+0000 7f7e0afd5640 1 --2- 172.21.15.87:0/1660733558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e04151510 0x7f7e040cae30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7e0415b9a0 tx=0x7f7df802b910 comp rx=0 tx=0).stop 2023-12-16T20:49:01.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.451+0000 7f7e0afd5640 1 -- 172.21.15.87:0/1660733558 shutdown_connections 2023-12-16T20:49:01.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.451+0000 7f7e0afd5640 1 --2- 172.21.15.87:0/1660733558 >> v2:172.21.15.195:3300/0 conn(0x7f7e040c5a90 0x7f7e040c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:01.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.451+0000 7f7e0afd5640 1 --2- 172.21.15.87:0/1660733558 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e040728b0 0x7f7e040cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:01.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.451+0000 7f7e0afd5640 1 --2- 172.21.15.87:0/1660733558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e04151510 0x7f7e040cae30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:01.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.451+0000 7f7e0afd5640 1 -- 172.21.15.87:0/1660733558 >> 172.21.15.87:0/1660733558 conn(0x7f7e0406cd60 msgr2=0x7f7e0406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:01.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.451+0000 7f7e0afd5640 1 -- 172.21.15.87:0/1660733558 shutdown_connections 2023-12-16T20:49:01.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.451+0000 7f7e0afd5640 1 -- 172.21.15.87:0/1660733558 wait complete. 2023-12-16T20:49:01.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.452+0000 7f7e0afd5640 1 Processor -- start 2023-12-16T20:49:01.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.452+0000 7f7e0afd5640 1 -- start start 2023-12-16T20:49:01.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.453+0000 7f7e0afd5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e040728b0 0x7f7e041575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:01.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.453+0000 7f7e0afd5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e040c5a90 0x7f7e0414c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:01.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.453+0000 7f7e0afd5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e04151510 0x7f7e0414cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:01.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.453+0000 7f7e0afd5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e04154550 con 0x7f7e04151510 2023-12-16T20:49:01.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.453+0000 7f7e0afd5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0414d240 con 0x7f7e040728b0 2023-12-16T20:49:01.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.453+0000 7f7e0afd5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e04157ee0 con 0x7f7e040c5a90 2023-12-16T20:49:01.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.454+0000 7f7e08d71640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e040728b0 0x7f7e041575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:01.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.454+0000 7f7e09572640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e04151510 0x7f7e0414cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:01.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.454+0000 7f7e08d71640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e040728b0 0x7f7e041575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:40156/0 (socket says 172.21.15.87:40156) 2023-12-16T20:49:01.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.454+0000 7f7e08d71640 1 -- 172.21.15.87:0/1420524478 learned_addr learned my addr 172.21.15.87:0/1420524478 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:01.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.456+0000 7f7e03fff640 1 --2- 172.21.15.87:0/1420524478 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e040c5a90 0x7f7e0414c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:01.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.458+0000 7f7e09572640 1 -- 172.21.15.87:0/1420524478 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e040c5a90 msgr2=0x7f7e0414c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:01.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.458+0000 7f7e09572640 1 --2- 172.21.15.87:0/1420524478 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e040c5a90 0x7f7e0414c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:01.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.458+0000 7f7e09572640 1 -- 172.21.15.87:0/1420524478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e040728b0 msgr2=0x7f7e041575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:01.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.458+0000 7f7e09572640 1 --2- 172.21.15.87:0/1420524478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e040728b0 0x7f7e041575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:01.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.458+0000 7f7e09572640 1 -- 172.21.15.87:0/1420524478 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df80094d0 con 0x7f7e04151510 2023-12-16T20:49:01.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.461+0000 7f7e09572640 1 --2- 172.21.15.87:0/1420524478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e04151510 0x7f7e0414cd00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc00efc0 tx=0x7f7dfc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:01.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.465+0000 7f7e017fa640 1 -- 172.21.15.87:0/1420524478 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc009c00 con 0x7f7e04151510 2023-12-16T20:49:01.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.465+0000 7f7e017fa640 1 -- 172.21.15.87:0/1420524478 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc00f040 con 0x7f7e04151510 2023-12-16T20:49:01.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.465+0000 7f7e017fa640 1 -- 172.21.15.87:0/1420524478 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc0146c0 con 0x7f7e04151510 2023-12-16T20:49:01.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.465+0000 7f7e0afd5640 1 -- 172.21.15.87:0/1420524478 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0414d4b0 con 0x7f7e04151510 2023-12-16T20:49:01.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.465+0000 7f7e0afd5640 1 -- 172.21.15.87:0/1420524478 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0414d750 con 0x7f7e04151510 2023-12-16T20:49:01.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.466+0000 7f7e0afd5640 1 -- 172.21.15.87:0/1420524478 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e04067500 con 0x7f7e04151510 2023-12-16T20:49:01.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.486+0000 7f7e017fa640 1 -- 172.21.15.87:0/1420524478 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f7dfc014820 con 0x7f7e04151510 2023-12-16T20:49:01.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.486+0000 7f7e017fa640 1 --2- 172.21.15.87:0/1420524478 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7de806ae90 0x7f7de806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:01.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.487+0000 7f7e08d71640 1 --2- 172.21.15.87:0/1420524478 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7de806ae90 0x7f7de806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:01.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.487+0000 7f7e08d71640 1 --2- 172.21.15.87:0/1420524478 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7de806ae90 0x7f7de806d350 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7df8034040 tx=0x7f7df803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:01.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.725+0000 7f7e017fa640 1 -- 172.21.15.87:0/1420524478 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7dfc0596e0 con 0x7f7e04151510 2023-12-16T20:49:01.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.725+0000 7f7e017fa640 1 -- 172.21.15.87:0/1420524478 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f7dfc055a20 con 0x7f7e04151510 2023-12-16T20:49:01.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.899+0000 7f7e0afd5640 1 -- 172.21.15.87:0/1420524478 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e041e44c0 con 0x7f7e04151510 2023-12-16T20:49:01.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.951+0000 7f7e017fa640 1 -- 172.21.15.87:0/1420524478 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18702 (secure 0 0 0) 0x7f7dfc018020 con 0x7f7e04151510 2023-12-16T20:49:01.952 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:49:01.953 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":27,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:22:14.653915+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:21:22.654341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T20:21:33.728787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T20:21:34.846119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T20:21:38.657738+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:49:01.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.953+0000 7f7e0afd5640 1 -- 172.21.15.87:0/1420524478 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7de806ae90 msgr2=0x7f7de806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:01.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.953+0000 7f7e0afd5640 1 --2- 172.21.15.87:0/1420524478 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7de806ae90 0x7f7de806d350 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7df8034040 tx=0x7f7df803c040 comp rx=0 tx=0).stop 2023-12-16T20:49:01.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.953+0000 7f7e0afd5640 1 -- 172.21.15.87:0/1420524478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e04151510 msgr2=0x7f7e0414cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:01.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.953+0000 7f7e0afd5640 1 --2- 172.21.15.87:0/1420524478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e04151510 0x7f7e0414cd00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc00efc0 tx=0x7f7dfc00c490 comp rx=0 tx=0).stop 2023-12-16T20:49:01.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.953+0000 7f7e0afd5640 1 -- 172.21.15.87:0/1420524478 shutdown_connections 2023-12-16T20:49:01.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.953+0000 7f7e0afd5640 1 --2- 172.21.15.87:0/1420524478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e04151510 0x7f7e0414cd00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:01.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.953+0000 7f7e0afd5640 1 --2- 172.21.15.87:0/1420524478 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e040c5a90 0x7f7e0414c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:01.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.953+0000 7f7e0afd5640 1 --2- 172.21.15.87:0/1420524478 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f7de806ae90 0x7f7de806d350 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:01.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.953+0000 7f7e0afd5640 1 --2- 172.21.15.87:0/1420524478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e040728b0 0x7f7e041575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:01.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.953+0000 7f7e0afd5640 1 -- 172.21.15.87:0/1420524478 >> 172.21.15.87:0/1420524478 conn(0x7f7e0406cd60 msgr2=0x7f7e0414f920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:01.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.954+0000 7f7e0afd5640 1 -- 172.21.15.87:0/1420524478 shutdown_connections 2023-12-16T20:49:01.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:01.954+0000 7f7e0afd5640 1 -- 172.21.15.87:0/1420524478 wait complete. 2023-12-16T20:49:01.967 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T20:21:22.654341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T20:21:33.728787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T20:21:34.846119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-16T20:21:38.657738+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-16T20:49:01.967 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T20:49:02.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.068+0000 7f732353e640 1 Processor -- start 2023-12-16T20:49:02.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.069+0000 7f732353e640 1 -- start start 2023-12-16T20:49:02.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.069+0000 7f732353e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f731c0c2e40 0x7f731c164f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:02.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.069+0000 7f732353e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731c06e0f0 con 0x7f731c1537d0 2023-12-16T20:49:02.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.069+0000 7f732353e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731c159710 con 0x7f731c06f160 2023-12-16T20:49:02.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.069+0000 7f732353e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731c0c72d0 con 0x7f731c0c2e40 2023-12-16T20:49:02.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.070+0000 7f7320ad9640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f731c06f160 0x7f731c159bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:57264/0 (socket says 172.21.15.87:57264) 2023-12-16T20:49:02.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.070+0000 7f7320ad9640 1 -- 172.21.15.87:0/3972633909 learned_addr learned my addr 172.21.15.87:0/3972633909 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:49:02.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.070+0000 7f7321adb640 1 --2- 172.21.15.87:0/3972633909 >> v2:172.21.15.87:3300/0 conn(0x7f731c0c2e40 0x7f731c164f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:02.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.073+0000 7f730ffff640 1 -- 172.21.15.87:0/3972633909 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925571030 0 0) 0x7f731c159710 con 0x7f731c06f160 2023-12-16T20:49:02.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.073+0000 7f730ffff640 1 -- 172.21.15.87:0/3972633909 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7308003520 con 0x7f731c06f160 2023-12-16T20:49:02.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.073+0000 7f7321adb640 1 -- 172.21.15.87:0/3972633909 >> v1:172.21.15.195:6789/0 conn(0x7f731c06f160 legacy=0x7f731c159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:02.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.073+0000 7f7321adb640 1 -- 172.21.15.87:0/3972633909 >> v1:172.21.15.87:6789/0 conn(0x7f731c1537d0 legacy=0x7f731c06a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:02.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.073+0000 7f7321adb640 1 -- 172.21.15.87:0/3972633909 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c0c7590 con 0x7f731c0c2e40 2023-12-16T20:49:02.078 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.078+0000 7f7321adb640 1 --2- 172.21.15.87:0/3972633909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f731c0c2e40 0x7f731c164f90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7314009d90 tx=0x7f731402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdfc7c051e757a29 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:02.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.082+0000 7f730ffff640 1 -- 172.21.15.87:0/3972633909 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731402cd80 con 0x7f731c0c2e40 2023-12-16T20:49:02.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.082+0000 7f730ffff640 1 -- 172.21.15.87:0/3972633909 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7314034440 con 0x7f731c0c2e40 2023-12-16T20:49:02.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.082+0000 7f730ffff640 1 -- 172.21.15.87:0/3972633909 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73140347d0 con 0x7f731c0c2e40 2023-12-16T20:49:02.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.083+0000 7f732353e640 1 -- 172.21.15.87:0/3972633909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f731c0c2e40 msgr2=0x7f731c164f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:02.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.083+0000 7f732353e640 1 --2- 172.21.15.87:0/3972633909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f731c0c2e40 0x7f731c164f90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7314009d90 tx=0x7f731402bfd0 comp rx=0 tx=0).stop 2023-12-16T20:49:02.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.083+0000 7f732353e640 1 -- 172.21.15.87:0/3972633909 shutdown_connections 2023-12-16T20:49:02.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.083+0000 7f732353e640 1 --2- 172.21.15.87:0/3972633909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f731c0c2e40 0x7f731c164f90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:02.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.083+0000 7f732353e640 1 -- 172.21.15.87:0/3972633909 >> 172.21.15.87:0/3972633909 conn(0x7f731c0cbf60 msgr2=0x7f731c0cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:02.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.083+0000 7f732353e640 1 -- 172.21.15.87:0/3972633909 shutdown_connections 2023-12-16T20:49:02.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.083+0000 7f732353e640 1 -- 172.21.15.87:0/3972633909 wait complete. 2023-12-16T20:49:02.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.084+0000 7f732353e640 1 Processor -- start 2023-12-16T20:49:02.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.084+0000 7f732353e640 1 -- start start 2023-12-16T20:49:02.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.085+0000 7f732353e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f731c06f160 0x7f731c14dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:02.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.085+0000 7f732353e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f731c0c2e40 0x7f731c0cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:02.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.085+0000 7f732353e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f731c1537d0 0x7f731c1f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:02.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.085+0000 7f732353e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c14cd50 con 0x7f731c0c2e40 2023-12-16T20:49:02.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.085+0000 7f732353e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c1508d0 con 0x7f731c1537d0 2023-12-16T20:49:02.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.085+0000 7f732353e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c150350 con 0x7f731c06f160 2023-12-16T20:49:02.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.085+0000 7f7320ad9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f731c0c2e40 0x7f731c0cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:02.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.086+0000 7f7321adb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f731c1537d0 0x7f731c1f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:02.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.086+0000 7f7320ad9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f731c0c2e40 0x7f731c0cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56730/0 (socket says 172.21.15.87:56730) 2023-12-16T20:49:02.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.086+0000 7f7320ad9640 1 -- 172.21.15.87:0/2335167805 learned_addr learned my addr 172.21.15.87:0/2335167805 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:02.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.086+0000 7f73212da640 1 --2- 172.21.15.87:0/2335167805 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f731c06f160 0x7f731c14dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:02.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.089+0000 7f7320ad9640 1 -- 172.21.15.87:0/2335167805 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f731c06f160 msgr2=0x7f731c14dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:02.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.089+0000 7f7320ad9640 1 --2- 172.21.15.87:0/2335167805 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f731c06f160 0x7f731c14dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:02.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.089+0000 7f7320ad9640 1 -- 172.21.15.87:0/2335167805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f731c1537d0 msgr2=0x7f731c1f28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:02.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.089+0000 7f7320ad9640 1 --2- 172.21.15.87:0/2335167805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f731c1537d0 0x7f731c1f28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:02.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.089+0000 7f7320ad9640 1 -- 172.21.15.87:0/2335167805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7314009a70 con 0x7f731c0c2e40 2023-12-16T20:49:02.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.091+0000 7f7320ad9640 1 --2- 172.21.15.87:0/2335167805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f731c0c2e40 0x7f731c0cb200 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f731800c500 tx=0x7f731800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:02.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.095+0000 7f730dffb640 1 -- 172.21.15.87:0/2335167805 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318005ce0 con 0x7f731c0c2e40 2023-12-16T20:49:02.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.095+0000 7f730dffb640 1 -- 172.21.15.87:0/2335167805 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7318005e40 con 0x7f731c0c2e40 2023-12-16T20:49:02.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.095+0000 7f732353e640 1 -- 172.21.15.87:0/2335167805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731c1505f0 con 0x7f731c0c2e40 2023-12-16T20:49:02.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.095+0000 7f730dffb640 1 -- 172.21.15.87:0/2335167805 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318007330 con 0x7f731c0c2e40 2023-12-16T20:49:02.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.095+0000 7f732353e640 1 -- 172.21.15.87:0/2335167805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731c14c970 con 0x7f731c0c2e40 2023-12-16T20:49:02.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.096+0000 7f732353e640 1 -- 172.21.15.87:0/2335167805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731c0c6650 con 0x7f731c0c2e40 2023-12-16T20:49:02.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.341+0000 7f730dffb640 1 -- 172.21.15.87:0/2335167805 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f7318007550 con 0x7f731c0c2e40 2023-12-16T20:49:02.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.341+0000 7f730dffb640 1 --2- 172.21.15.87:0/2335167805 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f730006ae90 0x7f730006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:02.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.341+0000 7f73212da640 1 --2- 172.21.15.87:0/2335167805 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f730006ae90 0x7f730006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:02.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.342+0000 7f73212da640 1 --2- 172.21.15.87:0/2335167805 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f730006ae90 0x7f730006d350 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f73100016e0 tx=0x7f7310009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:02.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.355+0000 7f730dffb640 1 -- 172.21.15.87:0/2335167805 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7318057f70 con 0x7f731c0c2e40 2023-12-16T20:49:02.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.355+0000 7f730dffb640 1 -- 172.21.15.87:0/2335167805 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f73180542b0 con 0x7f731c0c2e40 2023-12-16T20:49:02.520 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.519+0000 7f732353e640 1 -- 172.21.15.87:0/2335167805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f731c067500 con 0x7f731c0c2e40 2023-12-16T20:49:02.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.525+0000 7f730dffb640 1 -- 172.21.15.87:0/2335167805 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f73180578d0 con 0x7f731c0c2e40 2023-12-16T20:49:02.526 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-12-16T20:49:02.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.527+0000 7f732353e640 1 -- 172.21.15.87:0/2335167805 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f730006ae90 msgr2=0x7f730006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:02.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.527+0000 7f732353e640 1 --2- 172.21.15.87:0/2335167805 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f730006ae90 0x7f730006d350 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f73100016e0 tx=0x7f7310009040 comp rx=0 tx=0).stop 2023-12-16T20:49:02.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.527+0000 7f732353e640 1 -- 172.21.15.87:0/2335167805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f731c0c2e40 msgr2=0x7f731c0cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:02.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.527+0000 7f732353e640 1 --2- 172.21.15.87:0/2335167805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f731c0c2e40 0x7f731c0cb200 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f731800c500 tx=0x7f731800c9c0 comp rx=0 tx=0).stop 2023-12-16T20:49:02.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.527+0000 7f732353e640 1 -- 172.21.15.87:0/2335167805 shutdown_connections 2023-12-16T20:49:02.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.527+0000 7f732353e640 1 --2- 172.21.15.87:0/2335167805 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f730006ae90 0x7f730006d350 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:02.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.527+0000 7f732353e640 1 --2- 172.21.15.87:0/2335167805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f731c1537d0 0x7f731c1f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:02.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.527+0000 7f732353e640 1 --2- 172.21.15.87:0/2335167805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f731c0c2e40 0x7f731c0cb200 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:02.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.527+0000 7f732353e640 1 --2- 172.21.15.87:0/2335167805 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f731c06f160 0x7f731c14dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:02.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.527+0000 7f732353e640 1 -- 172.21.15.87:0/2335167805 >> 172.21.15.87:0/2335167805 conn(0x7f731c0cbf60 msgr2=0x7f731c06fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:02.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.527+0000 7f732353e640 1 -- 172.21.15.87:0/2335167805 shutdown_connections 2023-12-16T20:49:02.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.528+0000 7f732353e640 1 -- 172.21.15.87:0/2335167805 wait complete. 2023-12-16T20:49:02.541 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T20:49:02.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.643+0000 7fe743990640 1 Processor -- start 2023-12-16T20:49:02.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.644+0000 7fe743990640 1 -- start start 2023-12-16T20:49:02.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.644+0000 7fe743990640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe73c153890 0x7fe73c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:02.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.644+0000 7fe743990640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe73c0ceef0 0x7fe73c0cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:02.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.644+0000 7fe743990640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73c15a700 con 0x7fe73c153c70 2023-12-16T20:49:02.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.644+0000 7fe743990640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73c0ca870 con 0x7fe73c0ceef0 2023-12-16T20:49:02.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.644+0000 7fe743990640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c159af0 con 0x7fe73c153890 2023-12-16T20:49:02.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.645+0000 7fe740f2b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe73c153c70 0x7fe73c0c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:37316/0 (socket says 172.21.15.87:37316) 2023-12-16T20:49:02.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.645+0000 7fe740f2b640 1 -- 172.21.15.87:0/4106556500 learned_addr learned my addr 172.21.15.87:0/4106556500 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:49:02.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.645+0000 7fe74172c640 1 --2- 172.21.15.87:0/4106556500 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe73c153890 0x7fe73c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:02.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.646+0000 7fe741f2d640 1 --2- 172.21.15.87:0/4106556500 >> v2:172.21.15.195:3300/0 conn(0x7fe73c0ceef0 0x7fe73c0cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:02.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.648+0000 7fe74172c640 1 -- 172.21.15.87:0/4106556500 >> v2:172.21.15.195:3300/0 conn(0x7fe73c0ceef0 msgr2=0x7fe73c0cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:02.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.648+0000 7fe74172c640 1 --2- 172.21.15.87:0/4106556500 >> v2:172.21.15.195:3300/0 conn(0x7fe73c0ceef0 0x7fe73c0cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:02.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.648+0000 7fe74172c640 1 -- 172.21.15.87:0/4106556500 >> v1:172.21.15.87:6789/0 conn(0x7fe73c153c70 legacy=0x7fe73c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:02.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.649+0000 7fe74172c640 1 -- 172.21.15.87:0/4106556500 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c159dd0 con 0x7fe73c153890 2023-12-16T20:49:02.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.651+0000 7fe74172c640 1 --2- 172.21.15.87:0/4106556500 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe73c153890 0x7fe73c15d950 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe72c009d90 tx=0x7fe72c02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1816be5199f7126b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:02.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.655+0000 7fe73bfff640 1 -- 172.21.15.87:0/4106556500 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c02cce0 con 0x7fe73c153890 2023-12-16T20:49:02.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.655+0000 7fe73bfff640 1 -- 172.21.15.87:0/4106556500 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c02ce40 con 0x7fe73c153890 2023-12-16T20:49:02.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.655+0000 7fe73bfff640 1 -- 172.21.15.87:0/4106556500 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c034660 con 0x7fe73c153890 2023-12-16T20:49:02.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.656+0000 7fe743990640 1 -- 172.21.15.87:0/4106556500 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe73c153890 msgr2=0x7fe73c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:02.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.656+0000 7fe743990640 1 --2- 172.21.15.87:0/4106556500 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe73c153890 0x7fe73c15d950 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe72c009d90 tx=0x7fe72c02bf30 comp rx=0 tx=0).stop 2023-12-16T20:49:02.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.656+0000 7fe743990640 1 -- 172.21.15.87:0/4106556500 shutdown_connections 2023-12-16T20:49:02.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.656+0000 7fe743990640 1 --2- 172.21.15.87:0/4106556500 >> v2:172.21.15.195:3300/0 conn(0x7fe73c0ceef0 0x7fe73c0cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:02.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.656+0000 7fe743990640 1 --2- 172.21.15.87:0/4106556500 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe73c153890 0x7fe73c15d950 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:02.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.656+0000 7fe743990640 1 -- 172.21.15.87:0/4106556500 >> 172.21.15.87:0/4106556500 conn(0x7fe73c06ba00 msgr2=0x7fe73c06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:02.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.656+0000 7fe743990640 1 -- 172.21.15.87:0/4106556500 shutdown_connections 2023-12-16T20:49:02.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.656+0000 7fe743990640 1 -- 172.21.15.87:0/4106556500 wait complete. 2023-12-16T20:49:02.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.657+0000 7fe743990640 1 Processor -- start 2023-12-16T20:49:02.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.657+0000 7fe743990640 1 -- start start 2023-12-16T20:49:02.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.658+0000 7fe743990640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe73c0ceef0 0x7fe73c1557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:02.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.658+0000 7fe743990640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe73c153890 0x7fe73c154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:02.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.658+0000 7fe743990640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe73c153c70 0x7fe73c1565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:02.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.658+0000 7fe743990640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c15ca30 con 0x7fe73c153c70 2023-12-16T20:49:02.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.658+0000 7fe743990640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c152fb0 con 0x7fe73c153890 2023-12-16T20:49:02.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.658+0000 7fe743990640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c1529f0 con 0x7fe73c0ceef0 2023-12-16T20:49:02.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.658+0000 7fe74172c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe73c0ceef0 0x7fe73c1557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:02.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.658+0000 7fe740f2b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe73c153890 0x7fe73c154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:02.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.659+0000 7fe74172c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe73c0ceef0 0x7fe73c1557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:54312/0 (socket says 172.21.15.87:54312) 2023-12-16T20:49:02.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.659+0000 7fe74172c640 1 -- 172.21.15.87:0/1697538869 learned_addr learned my addr 172.21.15.87:0/1697538869 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:02.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.662+0000 7fe74172c640 1 -- 172.21.15.87:0/1697538869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe73c153890 msgr2=0x7fe73c154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:02.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.662+0000 7fe74172c640 1 --2- 172.21.15.87:0/1697538869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe73c153890 0x7fe73c154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:02.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.662+0000 7fe74172c640 1 -- 172.21.15.87:0/1697538869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe73c153c70 msgr2=0x7fe73c1565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:02.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.662+0000 7fe74172c640 1 --2- 172.21.15.87:0/1697538869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe73c153c70 0x7fe73c1565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:02.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.662+0000 7fe74172c640 1 -- 172.21.15.87:0/1697538869 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c009a70 con 0x7fe73c0ceef0 2023-12-16T20:49:02.665 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.665+0000 7fe74172c640 1 --2- 172.21.15.87:0/1697538869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe73c0ceef0 0x7fe73c1557d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe72c000f80 tx=0x7fe72c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:02.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.668+0000 7fe739ffb640 1 -- 172.21.15.87:0/1697538869 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c03e610 con 0x7fe73c0ceef0 2023-12-16T20:49:02.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.668+0000 7fe739ffb640 1 -- 172.21.15.87:0/1697538869 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c03e770 con 0x7fe73c0ceef0 2023-12-16T20:49:02.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.668+0000 7fe743990640 1 -- 172.21.15.87:0/1697538869 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73c152cd0 con 0x7fe73c0ceef0 2023-12-16T20:49:02.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.668+0000 7fe739ffb640 1 -- 172.21.15.87:0/1697538869 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c03eb00 con 0x7fe73c0ceef0 2023-12-16T20:49:02.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.669+0000 7fe743990640 1 -- 172.21.15.87:0/1697538869 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73c1560a0 con 0x7fe73c0ceef0 2023-12-16T20:49:02.671 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.670+0000 7fe743990640 1 -- 172.21.15.87:0/1697538869 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73c067500 con 0x7fe73c0ceef0 2023-12-16T20:49:02.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.923+0000 7fe739ffb640 1 -- 172.21.15.87:0/1697538869 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fe72c03b050 con 0x7fe73c0ceef0 2023-12-16T20:49:02.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.923+0000 7fe739ffb640 1 --2- 172.21.15.87:0/1697538869 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe72806ae90 0x7fe72806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:02.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.923+0000 7fe740f2b640 1 --2- 172.21.15.87:0/1697538869 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe72806ae90 0x7fe72806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:02.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.924+0000 7fe740f2b640 1 --2- 172.21.15.87:0/1697538869 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe72806ae90 0x7fe72806d350 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe73c073a70 tx=0x7fe730007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.926+0000 7fe739ffb640 1 -- 172.21.15.87:0/1697538869 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe72c07b0a0 con 0x7fe73c0ceef0 2023-12-16T20:49:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:02.936+0000 7fe739ffb640 1 -- 172.21.15.87:0/1697538869 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fe72c0773e0 con 0x7fe73c0ceef0 2023-12-16T20:49:03.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.141+0000 7fe743990640 1 -- 172.21.15.87:0/1697538869 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe73c0c6070 con 0x7fe73c0ceef0 2023-12-16T20:49:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.147+0000 7fe739ffb640 1 -- 172.21.15.87:0/1697538869 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe72c04e0a0 con 0x7fe73c0ceef0 2023-12-16T20:49:03.148 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-12-16T20:49:03.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.149+0000 7fe743990640 1 -- 172.21.15.87:0/1697538869 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe72806ae90 msgr2=0x7fe72806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:03.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.149+0000 7fe743990640 1 --2- 172.21.15.87:0/1697538869 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe72806ae90 0x7fe72806d350 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe73c073a70 tx=0x7fe730007e80 comp rx=0 tx=0).stop 2023-12-16T20:49:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.149+0000 7fe743990640 1 -- 172.21.15.87:0/1697538869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe73c0ceef0 msgr2=0x7fe73c1557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.149+0000 7fe743990640 1 --2- 172.21.15.87:0/1697538869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe73c0ceef0 0x7fe73c1557d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe72c000f80 tx=0x7fe72c004a40 comp rx=0 tx=0).stop 2023-12-16T20:49:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.149+0000 7fe743990640 1 -- 172.21.15.87:0/1697538869 shutdown_connections 2023-12-16T20:49:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.149+0000 7fe743990640 1 --2- 172.21.15.87:0/1697538869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe73c153c70 0x7fe73c1565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.149+0000 7fe743990640 1 --2- 172.21.15.87:0/1697538869 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe72806ae90 0x7fe72806d350 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.149+0000 7fe743990640 1 --2- 172.21.15.87:0/1697538869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe73c153890 0x7fe73c154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.149+0000 7fe743990640 1 --2- 172.21.15.87:0/1697538869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe73c0ceef0 0x7fe73c1557d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.149+0000 7fe743990640 1 -- 172.21.15.87:0/1697538869 >> 172.21.15.87:0/1697538869 conn(0x7fe73c06ba00 msgr2=0x7fe73c0cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.149+0000 7fe743990640 1 -- 172.21.15.87:0/1697538869 shutdown_connections 2023-12-16T20:49:03.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.149+0000 7fe743990640 1 -- 172.21.15.87:0/1697538869 wait complete. 2023-12-16T20:49:03.162 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T20:49:03.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.263+0000 7f2f87c31640 1 Processor -- start 2023-12-16T20:49:03.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.264+0000 7f2f87c31640 1 -- start start 2023-12-16T20:49:03.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.264+0000 7f2f87c31640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f801501c0 0x7f2f80159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:03.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.264+0000 7f2f87c31640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2f80156e60 0x7f2f80071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:03.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.264+0000 7f2f87c31640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f80072b60 con 0x7f2f800bff00 2023-12-16T20:49:03.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.264+0000 7f2f87c31640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f800c1a90 con 0x7f2f80156e60 2023-12-16T20:49:03.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.264+0000 7f2f87c31640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800c1d30 con 0x7f2f801501c0 2023-12-16T20:49:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.265+0000 7f2f861ce640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2f80156e60 0x7f2f80071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.265+0000 7f2f859cd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f801501c0 0x7f2f80159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.265+0000 7f2f851cc640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f2f800bff00 0x7f2f80072450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:57268/0 (socket says 172.21.15.87:57268) 2023-12-16T20:49:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.265+0000 7f2f851cc640 1 -- 172.21.15.87:0/3144705705 learned_addr learned my addr 172.21.15.87:0/3144705705 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:49:03.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.268+0000 7f2f861ce640 1 -- 172.21.15.87:0/3144705705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f801501c0 msgr2=0x7f2f80159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:03.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.268+0000 7f2f861ce640 1 --2- 172.21.15.87:0/3144705705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f801501c0 0x7f2f80159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.268+0000 7f2f861ce640 1 -- 172.21.15.87:0/3144705705 >> v1:172.21.15.195:6789/0 conn(0x7f2f800bff00 legacy=0x7f2f80072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:03.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.268+0000 7f2f861ce640 1 -- 172.21.15.87:0/3144705705 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f800c2010 con 0x7f2f80156e60 2023-12-16T20:49:03.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.270+0000 7f2f861ce640 1 --2- 172.21.15.87:0/3144705705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f80156e60 0x7f2f80071710 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0097a0 tx=0x7f2f7c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457108b1ea20a5a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:03.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.273+0000 7f2f849cb640 1 -- 172.21.15.87:0/3144705705 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c030610 con 0x7f2f80156e60 2023-12-16T20:49:03.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.273+0000 7f2f849cb640 1 -- 172.21.15.87:0/3144705705 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c030770 con 0x7f2f80156e60 2023-12-16T20:49:03.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.273+0000 7f2f849cb640 1 -- 172.21.15.87:0/3144705705 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c030b00 con 0x7f2f80156e60 2023-12-16T20:49:03.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.274+0000 7f2f87c31640 1 -- 172.21.15.87:0/3144705705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f80156e60 msgr2=0x7f2f80071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:03.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.274+0000 7f2f87c31640 1 --2- 172.21.15.87:0/3144705705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f80156e60 0x7f2f80071710 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0097a0 tx=0x7f2f7c02b960 comp rx=0 tx=0).stop 2023-12-16T20:49:03.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.274+0000 7f2f87c31640 1 -- 172.21.15.87:0/3144705705 shutdown_connections 2023-12-16T20:49:03.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.274+0000 7f2f87c31640 1 --2- 172.21.15.87:0/3144705705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f80156e60 0x7f2f80071710 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.274+0000 7f2f87c31640 1 --2- 172.21.15.87:0/3144705705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f801501c0 0x7f2f80159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.274+0000 7f2f87c31640 1 -- 172.21.15.87:0/3144705705 >> 172.21.15.87:0/3144705705 conn(0x7f2f8006cd60 msgr2=0x7f2f8006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:03.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.274+0000 7f2f87c31640 1 -- 172.21.15.87:0/3144705705 shutdown_connections 2023-12-16T20:49:03.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.274+0000 7f2f87c31640 1 -- 172.21.15.87:0/3144705705 wait complete. 2023-12-16T20:49:03.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.275+0000 7f2f87c31640 1 Processor -- start 2023-12-16T20:49:03.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.275+0000 7f2f87c31640 1 -- start start 2023-12-16T20:49:03.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.276+0000 7f2f87c31640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f800bff00 0x7f2f801eb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:03.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.276+0000 7f2f87c31640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f801501c0 0x7f2f801eea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:03.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.276+0000 7f2f87c31640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f80156e60 0x7f2f80150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:03.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.276+0000 7f2f87c31640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800cb140 con 0x7f2f801501c0 2023-12-16T20:49:03.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.276+0000 7f2f87c31640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f801ebc40 con 0x7f2f800bff00 2023-12-16T20:49:03.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.276+0000 7f2f87c31640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f801ee5c0 con 0x7f2f80156e60 2023-12-16T20:49:03.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.277+0000 7f2f861ce640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f80156e60 0x7f2f80150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:03.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.277+0000 7f2f859cd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f800bff00 0x7f2f801eb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:03.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.277+0000 7f2f851cc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f801501c0 0x7f2f801eea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:03.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.277+0000 7f2f851cc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f801501c0 0x7f2f801eea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56748/0 (socket says 172.21.15.87:56748) 2023-12-16T20:49:03.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.277+0000 7f2f861ce640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f80156e60 0x7f2f80150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:54324/0 (socket says 172.21.15.87:54324) 2023-12-16T20:49:03.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.277+0000 7f2f851cc640 1 -- 172.21.15.87:0/1984003174 learned_addr learned my addr 172.21.15.87:0/1984003174 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:03.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.280+0000 7f2f861ce640 1 -- 172.21.15.87:0/1984003174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f800bff00 msgr2=0x7f2f801eb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:03.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.280+0000 7f2f861ce640 1 --2- 172.21.15.87:0/1984003174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f800bff00 0x7f2f801eb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.280+0000 7f2f861ce640 1 -- 172.21.15.87:0/1984003174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f801501c0 msgr2=0x7f2f801eea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:03.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.280+0000 7f2f861ce640 1 --2- 172.21.15.87:0/1984003174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f801501c0 0x7f2f801eea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.280+0000 7f2f861ce640 1 -- 172.21.15.87:0/1984003174 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c009400 con 0x7f2f80156e60 2023-12-16T20:49:03.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.283+0000 7f2f861ce640 1 --2- 172.21.15.87:0/1984003174 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f80156e60 0x7f2f80150dd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c033000 tx=0x7f2f7c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:03.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.286+0000 7f2f767fc640 1 -- 172.21.15.87:0/1984003174 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c03e070 con 0x7f2f80156e60 2023-12-16T20:49:03.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.287+0000 7f2f767fc640 1 -- 172.21.15.87:0/1984003174 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c039890 con 0x7f2f80156e60 2023-12-16T20:49:03.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.287+0000 7f2f87c31640 1 -- 172.21.15.87:0/1984003174 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f801ee290 con 0x7f2f80156e60 2023-12-16T20:49:03.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.287+0000 7f2f767fc640 1 -- 172.21.15.87:0/1984003174 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c039c60 con 0x7f2f80156e60 2023-12-16T20:49:03.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.287+0000 7f2f87c31640 1 -- 172.21.15.87:0/1984003174 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f80157a00 con 0x7f2f80156e60 2023-12-16T20:49:03.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.288+0000 7f2f87c31640 1 -- 172.21.15.87:0/1984003174 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f800c77e0 con 0x7f2f80156e60 2023-12-16T20:49:03.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.306+0000 7f2f767fc640 1 -- 172.21.15.87:0/1984003174 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f2f7c0423f0 con 0x7f2f80156e60 2023-12-16T20:49:03.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.307+0000 7f2f767fc640 1 --2- 172.21.15.87:0/1984003174 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2f6406ae90 0x7f2f6406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:03.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.307+0000 7f2f859cd640 1 --2- 172.21.15.87:0/1984003174 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2f6406ae90 0x7f2f6406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:03.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.307+0000 7f2f859cd640 1 --2- 172.21.15.87:0/1984003174 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2f6406ae90 0x7f2f6406d350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2f780113e0 tx=0x7f2f7800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:03.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.309+0000 7f2f767fc640 1 -- 172.21.15.87:0/1984003174 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f2f7c07a440 con 0x7f2f80156e60 2023-12-16T20:49:03.545 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.545+0000 7f2f767fc640 1 -- 172.21.15.87:0/1984003174 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f2f7c076780 con 0x7f2f80156e60 2023-12-16T20:49:03.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.717+0000 7f2f87c31640 1 -- 172.21.15.87:0/1984003174 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f801ee770 con 0x7f2f80156e60 2023-12-16T20:49:03.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.722+0000 7f2f767fc640 1 -- 172.21.15.87:0/1984003174 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f801ee770 con 0x7f2f80156e60 2023-12-16T20:49:03.723 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-12-16T20:49:03.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.724+0000 7f2f87c31640 1 -- 172.21.15.87:0/1984003174 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2f6406ae90 msgr2=0x7f2f6406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:03.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.724+0000 7f2f87c31640 1 --2- 172.21.15.87:0/1984003174 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2f6406ae90 0x7f2f6406d350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2f780113e0 tx=0x7f2f7800b040 comp rx=0 tx=0).stop 2023-12-16T20:49:03.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.724+0000 7f2f87c31640 1 -- 172.21.15.87:0/1984003174 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f80156e60 msgr2=0x7f2f80150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:03.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.724+0000 7f2f87c31640 1 --2- 172.21.15.87:0/1984003174 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f80156e60 0x7f2f80150dd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c033000 tx=0x7f2f7c0046c0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.724+0000 7f2f87c31640 1 -- 172.21.15.87:0/1984003174 shutdown_connections 2023-12-16T20:49:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.724+0000 7f2f87c31640 1 --2- 172.21.15.87:0/1984003174 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f80156e60 0x7f2f80150dd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.724+0000 7f2f87c31640 1 --2- 172.21.15.87:0/1984003174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f801501c0 0x7f2f801eea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.724+0000 7f2f87c31640 1 --2- 172.21.15.87:0/1984003174 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f2f6406ae90 0x7f2f6406d350 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.724+0000 7f2f87c31640 1 --2- 172.21.15.87:0/1984003174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f800bff00 0x7f2f801eb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.724+0000 7f2f87c31640 1 -- 172.21.15.87:0/1984003174 >> 172.21.15.87:0/1984003174 conn(0x7f2f8006cd60 msgr2=0x7f2f8014a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.724+0000 7f2f87c31640 1 -- 172.21.15.87:0/1984003174 shutdown_connections 2023-12-16T20:49:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.724+0000 7f2f87c31640 1 -- 172.21.15.87:0/1984003174 wait complete. 2023-12-16T20:49:03.736 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-16T20:49:03.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.838+0000 7f487943d640 1 Processor -- start 2023-12-16T20:49:03.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.838+0000 7f487943d640 1 -- start start 2023-12-16T20:49:03.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.839+0000 7f487943d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48741538b0 0x7f487415a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:03.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.839+0000 7f487943d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f48740cee80 0x7f48740cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:03.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.839+0000 7f487943d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487415a690 con 0x7f48740c4060 2023-12-16T20:49:03.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.839+0000 7f487943d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48740b2830 con 0x7f48740cee80 2023-12-16T20:49:03.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.839+0000 7f487943d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48740c9db0 con 0x7f48741538b0 2023-12-16T20:49:03.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.839+0000 7f48737fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f48740cee80 0x7f48740cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:03.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.839+0000 7f4872ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48741538b0 0x7f487415a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:03.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.839+0000 7f48737fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f48740cee80 0x7f48740cf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56754/0 (socket says 172.21.15.87:56754) 2023-12-16T20:49:03.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.839+0000 7f48737fe640 1 -- 172.21.15.87:0/4234061608 learned_addr learned my addr 172.21.15.87:0/4234061608 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:03.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.842+0000 7f48737fe640 1 -- 172.21.15.87:0/4234061608 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48741538b0 msgr2=0x7f487415a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:03.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.842+0000 7f48737fe640 1 --2- 172.21.15.87:0/4234061608 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48741538b0 0x7f487415a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.842+0000 7f48737fe640 1 -- 172.21.15.87:0/4234061608 >> v1:172.21.15.195:6789/0 conn(0x7f48740c4060 legacy=0x7f48740cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:03.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.842+0000 7f48737fe640 1 -- 172.21.15.87:0/4234061608 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48740cbc20 con 0x7f48740cee80 2023-12-16T20:49:03.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.844+0000 7f48737fe640 1 --2- 172.21.15.87:0/4234061608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48740cee80 0x7f48740cf2d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f486c009e50 tx=0x7f486c02bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2432f08607cec12a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:03.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.847+0000 7f48727fc640 1 -- 172.21.15.87:0/4234061608 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c02cb90 con 0x7f48740cee80 2023-12-16T20:49:03.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.847+0000 7f48727fc640 1 -- 172.21.15.87:0/4234061608 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c02ccf0 con 0x7f48740cee80 2023-12-16T20:49:03.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.847+0000 7f48727fc640 1 -- 172.21.15.87:0/4234061608 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c034610 con 0x7f48740cee80 2023-12-16T20:49:03.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.848+0000 7f487943d640 1 -- 172.21.15.87:0/4234061608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48740cee80 msgr2=0x7f48740cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:03.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.848+0000 7f487943d640 1 --2- 172.21.15.87:0/4234061608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48740cee80 0x7f48740cf2d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f486c009e50 tx=0x7f486c02bff0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.848+0000 7f487943d640 1 -- 172.21.15.87:0/4234061608 shutdown_connections 2023-12-16T20:49:03.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.848+0000 7f487943d640 1 --2- 172.21.15.87:0/4234061608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48740cee80 0x7f48740cf2d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.848+0000 7f487943d640 1 --2- 172.21.15.87:0/4234061608 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48741538b0 0x7f487415a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.848+0000 7f487943d640 1 -- 172.21.15.87:0/4234061608 >> 172.21.15.87:0/4234061608 conn(0x7f487408afb0 msgr2=0x7f487408b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:03.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.848+0000 7f487943d640 1 -- 172.21.15.87:0/4234061608 shutdown_connections 2023-12-16T20:49:03.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.848+0000 7f487943d640 1 -- 172.21.15.87:0/4234061608 wait complete. 2023-12-16T20:49:03.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.849+0000 7f487943d640 1 Processor -- start 2023-12-16T20:49:03.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.849+0000 7f487943d640 1 -- start start 2023-12-16T20:49:03.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.850+0000 7f487943d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48740c4060 0x7f48740c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:03.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.850+0000 7f487943d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48740cee80 0x7f48740c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:03.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.850+0000 7f487943d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48741538b0 0x7f4874150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:03.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.850+0000 7f487943d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48741eea00 con 0x7f48741538b0 2023-12-16T20:49:03.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.850+0000 7f487943d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48741eecc0 con 0x7f48740cee80 2023-12-16T20:49:03.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.850+0000 7f487943d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48741eefa0 con 0x7f48740c4060 2023-12-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.851+0000 7f48737fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48741538b0 0x7f4874150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.851+0000 7f4872ffd640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48740c4060 0x7f48740c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.851+0000 7f48737fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48741538b0 0x7f4874150e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56764/0 (socket says 172.21.15.87:56764) 2023-12-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.851+0000 7f48737fe640 1 -- 172.21.15.87:0/3186949900 learned_addr learned my addr 172.21.15.87:0/3186949900 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.851+0000 7f486bfff640 1 --2- 172.21.15.87:0/3186949900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48740cee80 0x7f48740c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:03.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.854+0000 7f4872ffd640 1 -- 172.21.15.87:0/3186949900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48740cee80 msgr2=0x7f48740c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:03.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.854+0000 7f4872ffd640 1 --2- 172.21.15.87:0/3186949900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48740cee80 0x7f48740c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.854+0000 7f4872ffd640 1 -- 172.21.15.87:0/3186949900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48741538b0 msgr2=0x7f4874150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:03.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.854+0000 7f4872ffd640 1 --2- 172.21.15.87:0/3186949900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48741538b0 0x7f4874150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:03.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.854+0000 7f4872ffd640 1 -- 172.21.15.87:0/3186949900 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486c009b30 con 0x7f48740c4060 2023-12-16T20:49:03.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.854+0000 7f48737fe640 1 --2- 172.21.15.87:0/3186949900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48741538b0 0x7f4874150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:49:03.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.857+0000 7f4872ffd640 1 --2- 172.21.15.87:0/3186949900 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48740c4060 0x7f48740c8f80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f486400e870 tx=0x7f486400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:03.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.861+0000 7f486b7fe640 1 -- 172.21.15.87:0/3186949900 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486400ee60 con 0x7f48740c4060 2023-12-16T20:49:03.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.861+0000 7f486b7fe640 1 -- 172.21.15.87:0/3186949900 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486400c940 con 0x7f48740c4060 2023-12-16T20:49:03.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.861+0000 7f486b7fe640 1 -- 172.21.15.87:0/3186949900 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486400ccd0 con 0x7f48740c4060 2023-12-16T20:49:03.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.861+0000 7f487943d640 1 -- 172.21.15.87:0/3186949900 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48741ef280 con 0x7f48740c4060 2023-12-16T20:49:03.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.861+0000 7f487943d640 1 -- 172.21.15.87:0/3186949900 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48741ef840 con 0x7f48740c4060 2023-12-16T20:49:03.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:03.862+0000 7f487943d640 1 -- 172.21.15.87:0/3186949900 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4874067500 con 0x7f48740c4060 2023-12-16T20:49:04.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.109+0000 7f486b7fe640 1 -- 172.21.15.87:0/3186949900 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f4864013470 con 0x7f48740c4060 2023-12-16T20:49:04.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.110+0000 7f486b7fe640 1 --2- 172.21.15.87:0/3186949900 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f485406ae40 0x7f485406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:04.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.110+0000 7f486bfff640 1 --2- 172.21.15.87:0/3186949900 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f485406ae40 0x7f485406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:04.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.110+0000 7f486bfff640 1 --2- 172.21.15.87:0/3186949900 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f485406ae40 0x7f485406d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f48740c8ca0 tx=0x7f485c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:04.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.113+0000 7f486b7fe640 1 -- 172.21.15.87:0/3186949900 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f486400ce30 con 0x7f48740c4060 2023-12-16T20:49:04.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.136+0000 7f486b7fe640 1 -- 172.21.15.87:0/3186949900 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f4864054ed0 con 0x7f48740c4060 2023-12-16T20:49:04.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.309+0000 7f487943d640 1 -- 172.21.15.87:0/3186949900 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f48741ef0e0 con 0x7f48740c4060 2023-12-16T20:49:04.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.317+0000 7f486b7fe640 1 -- 172.21.15.87:0/3186949900 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f48741ef0e0 con 0x7f48740c4060 2023-12-16T20:49:04.318 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-12-16T20:49:04.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.320+0000 7f487943d640 1 -- 172.21.15.87:0/3186949900 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f485406ae40 msgr2=0x7f485406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:04.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.320+0000 7f487943d640 1 --2- 172.21.15.87:0/3186949900 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f485406ae40 0x7f485406d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f48740c8ca0 tx=0x7f485c009040 comp rx=0 tx=0).stop 2023-12-16T20:49:04.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.320+0000 7f487943d640 1 -- 172.21.15.87:0/3186949900 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48740c4060 msgr2=0x7f48740c8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:04.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.320+0000 7f487943d640 1 --2- 172.21.15.87:0/3186949900 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48740c4060 0x7f48740c8f80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f486400e870 tx=0x7f486400ed30 comp rx=0 tx=0).stop 2023-12-16T20:49:04.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.320+0000 7f487943d640 1 -- 172.21.15.87:0/3186949900 shutdown_connections 2023-12-16T20:49:04.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.320+0000 7f487943d640 1 --2- 172.21.15.87:0/3186949900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48741538b0 0x7f4874150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:04.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.320+0000 7f487943d640 1 --2- 172.21.15.87:0/3186949900 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f485406ae40 0x7f485406d300 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:04.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.320+0000 7f487943d640 1 --2- 172.21.15.87:0/3186949900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48740cee80 0x7f48740c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:04.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.320+0000 7f487943d640 1 --2- 172.21.15.87:0/3186949900 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48740c4060 0x7f48740c8f80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:04.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.320+0000 7f487943d640 1 -- 172.21.15.87:0/3186949900 >> 172.21.15.87:0/3186949900 conn(0x7f487408afb0 msgr2=0x7f48740b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:04.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.320+0000 7f487943d640 1 -- 172.21.15.87:0/3186949900 shutdown_connections 2023-12-16T20:49:04.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.320+0000 7f487943d640 1 -- 172.21.15.87:0/3186949900 wait complete. 2023-12-16T20:49:04.332 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T20:49:04.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.431+0000 7f69ef71d640 1 Processor -- start 2023-12-16T20:49:04.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.432+0000 7f69ef71d640 1 -- start start 2023-12-16T20:49:04.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.432+0000 7f69ef71d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69e80cd2b0 0x7f69e8070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:04.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.432+0000 7f69ef71d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f69e80cc650 0x7f69e81510f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:04.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.432+0000 7f69ef71d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e8070540 con 0x7f69e80cced0 2023-12-16T20:49:04.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.432+0000 7f69ef71d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e8158400 con 0x7f69e80cd2b0 2023-12-16T20:49:04.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.432+0000 7f69ef71d640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e815ad60 con 0x7f69e80cc650 2023-12-16T20:49:04.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.433+0000 7f69eccb8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69e80cd2b0 0x7f69e8070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:04.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.433+0000 7f69edcba640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f69e80cc650 0x7f69e81510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:04.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.433+0000 7f69eccb8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69e80cd2b0 0x7f69e8070000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56770/0 (socket says 172.21.15.87:56770) 2023-12-16T20:49:04.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.433+0000 7f69eccb8640 1 -- 172.21.15.87:0/1643451465 learned_addr learned my addr 172.21.15.87:0/1643451465 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:04.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.435+0000 7f69eccb8640 1 -- 172.21.15.87:0/1643451465 >> v2:172.21.15.195:3300/0 conn(0x7f69e80cc650 msgr2=0x7f69e81510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:04.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.435+0000 7f69eccb8640 1 --2- 172.21.15.87:0/1643451465 >> v2:172.21.15.195:3300/0 conn(0x7f69e80cc650 0x7f69e81510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:04.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.435+0000 7f69eccb8640 1 -- 172.21.15.87:0/1643451465 >> v1:172.21.15.195:6789/0 conn(0x7f69e80cced0 legacy=0x7f69e80cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:04.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.435+0000 7f69eccb8640 1 -- 172.21.15.87:0/1643451465 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e815b040 con 0x7f69e80cd2b0 2023-12-16T20:49:04.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.437+0000 7f69eccb8640 1 --2- 172.21.15.87:0/1643451465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69e80cd2b0 0x7f69e8070000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f69e80b0080 tx=0x7f69d802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257532db4ce76e06 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:04.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.441+0000 7f69dffff640 1 -- 172.21.15.87:0/1643451465 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d8004230 con 0x7f69e80cd2b0 2023-12-16T20:49:04.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.441+0000 7f69dffff640 1 -- 172.21.15.87:0/1643451465 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d8004390 con 0x7f69e80cd2b0 2023-12-16T20:49:04.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.441+0000 7f69dffff640 1 -- 172.21.15.87:0/1643451465 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d802f840 con 0x7f69e80cd2b0 2023-12-16T20:49:04.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.442+0000 7f69ef71d640 1 -- 172.21.15.87:0/1643451465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69e80cd2b0 msgr2=0x7f69e8070000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:04.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.442+0000 7f69ef71d640 1 --2- 172.21.15.87:0/1643451465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69e80cd2b0 0x7f69e8070000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f69e80b0080 tx=0x7f69d802ba20 comp rx=0 tx=0).stop 2023-12-16T20:49:04.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.442+0000 7f69ef71d640 1 -- 172.21.15.87:0/1643451465 shutdown_connections 2023-12-16T20:49:04.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.442+0000 7f69ef71d640 1 --2- 172.21.15.87:0/1643451465 >> v2:172.21.15.195:3300/0 conn(0x7f69e80cc650 0x7f69e81510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:04.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.442+0000 7f69ef71d640 1 --2- 172.21.15.87:0/1643451465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69e80cd2b0 0x7f69e8070000 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:04.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.442+0000 7f69ef71d640 1 -- 172.21.15.87:0/1643451465 >> 172.21.15.87:0/1643451465 conn(0x7f69e8061660 msgr2=0x7f69e8070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:04.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.442+0000 7f69ef71d640 1 -- 172.21.15.87:0/1643451465 shutdown_connections 2023-12-16T20:49:04.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.442+0000 7f69ef71d640 1 -- 172.21.15.87:0/1643451465 wait complete. 2023-12-16T20:49:04.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.443+0000 7f69ef71d640 1 Processor -- start 2023-12-16T20:49:04.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.443+0000 7f69ef71d640 1 -- start start 2023-12-16T20:49:04.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.444+0000 7f69ef71d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69e80cc650 0x7f69e80aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:04.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.444+0000 7f69ef71d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f69e80cced0 0x7f69e81ef640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:04.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.444+0000 7f69ef71d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69e80cd2b0 0x7f69e81efb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:04.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.444+0000 7f69ef71d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80b1720 con 0x7f69e80cc650 2023-12-16T20:49:04.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.444+0000 7f69ef71d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e81ef1f0 con 0x7f69e80cd2b0 2023-12-16T20:49:04.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.444+0000 7f69ef71d640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e806d600 con 0x7f69e80cced0 2023-12-16T20:49:04.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.444+0000 7f69ed4b9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69e80cc650 0x7f69e80aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:04.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.444+0000 7f69ed4b9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69e80cc650 0x7f69e80aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56774/0 (socket says 172.21.15.87:56774) 2023-12-16T20:49:04.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.444+0000 7f69ed4b9640 1 -- 172.21.15.87:0/1358130714 learned_addr learned my addr 172.21.15.87:0/1358130714 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:04.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.444+0000 7f69edcba640 1 --2- 172.21.15.87:0/1358130714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69e80cd2b0 0x7f69e81efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:04.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.444+0000 7f69eccb8640 1 --2- 172.21.15.87:0/1358130714 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f69e80cced0 0x7f69e81ef640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:04.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.448+0000 7f69ed4b9640 1 -- 172.21.15.87:0/1358130714 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f69e80cced0 msgr2=0x7f69e81ef640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:04.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.448+0000 7f69ed4b9640 1 --2- 172.21.15.87:0/1358130714 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f69e80cced0 0x7f69e81ef640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:04.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.448+0000 7f69ed4b9640 1 -- 172.21.15.87:0/1358130714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69e80cd2b0 msgr2=0x7f69e81efb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:04.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.448+0000 7f69ed4b9640 1 --2- 172.21.15.87:0/1358130714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69e80cd2b0 0x7f69e81efb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:04.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.448+0000 7f69ed4b9640 1 -- 172.21.15.87:0/1358130714 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d8009460 con 0x7f69e80cc650 2023-12-16T20:49:04.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.450+0000 7f69ed4b9640 1 --2- 172.21.15.87:0/1358130714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69e80cc650 0x7f69e80aeae0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f69e000c7c0 tx=0x7f69e000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:04.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.453+0000 7f69ddffb640 1 -- 172.21.15.87:0/1358130714 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0006d50 con 0x7f69e80cc650 2023-12-16T20:49:04.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.453+0000 7f69ddffb640 1 -- 172.21.15.87:0/1358130714 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e0003970 con 0x7f69e80cc650 2023-12-16T20:49:04.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.453+0000 7f69ddffb640 1 -- 172.21.15.87:0/1358130714 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0003d20 con 0x7f69e80cc650 2023-12-16T20:49:04.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.453+0000 7f69ef71d640 1 -- 172.21.15.87:0/1358130714 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e8155a00 con 0x7f69e80cc650 2023-12-16T20:49:04.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.453+0000 7f69ef71d640 1 -- 172.21.15.87:0/1358130714 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e80b0e80 con 0x7f69e80cc650 2023-12-16T20:49:04.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.454+0000 7f69ef71d640 1 -- 172.21.15.87:0/1358130714 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e81ef360 con 0x7f69e80cc650 2023-12-16T20:49:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.472+0000 7f69ddffb640 1 -- 172.21.15.87:0/1358130714 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f69e000a850 con 0x7f69e80cc650 2023-12-16T20:49:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.472+0000 7f69ddffb640 1 --2- 172.21.15.87:0/1358130714 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f69cc06ae90 0x7f69cc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:04.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.472+0000 7f69eccb8640 1 --2- 172.21.15.87:0/1358130714 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f69cc06ae90 0x7f69cc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:04.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.472+0000 7f69eccb8640 1 --2- 172.21.15.87:0/1358130714 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f69cc06ae90 0x7f69cc06d350 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f69d8035000 tx=0x7f69d8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:04.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.476+0000 7f69ddffb640 1 -- 172.21.15.87:0/1358130714 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f69e0058b70 con 0x7f69e80cc650 2023-12-16T20:49:04.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.713+0000 7f69ddffb640 1 -- 172.21.15.87:0/1358130714 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f69e0054eb0 con 0x7f69e80cc650 2023-12-16T20:49:04.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.896+0000 7f69ef71d640 1 -- 172.21.15.87:0/1358130714 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f69e8070540 con 0x7f69e80cc650 2023-12-16T20:49:04.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.900+0000 7f69ddffb640 1 -- 172.21.15.87:0/1358130714 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f69e8070540 con 0x7f69e80cc650 2023-12-16T20:49:04.901 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2023-12-16T20:49:04.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.902+0000 7f69ef71d640 1 -- 172.21.15.87:0/1358130714 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f69cc06ae90 msgr2=0x7f69cc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:04.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.902+0000 7f69ef71d640 1 --2- 172.21.15.87:0/1358130714 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f69cc06ae90 0x7f69cc06d350 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f69d8035000 tx=0x7f69d8008030 comp rx=0 tx=0).stop 2023-12-16T20:49:04.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.902+0000 7f69ef71d640 1 -- 172.21.15.87:0/1358130714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69e80cc650 msgr2=0x7f69e80aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:04.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.902+0000 7f69ef71d640 1 --2- 172.21.15.87:0/1358130714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69e80cc650 0x7f69e80aeae0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f69e000c7c0 tx=0x7f69e000cc80 comp rx=0 tx=0).stop 2023-12-16T20:49:04.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.902+0000 7f69ef71d640 1 -- 172.21.15.87:0/1358130714 shutdown_connections 2023-12-16T20:49:04.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.902+0000 7f69ef71d640 1 --2- 172.21.15.87:0/1358130714 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f69cc06ae90 0x7f69cc06d350 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:04.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.902+0000 7f69ef71d640 1 --2- 172.21.15.87:0/1358130714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69e80cd2b0 0x7f69e81efb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:04.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.902+0000 7f69ef71d640 1 --2- 172.21.15.87:0/1358130714 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f69e80cced0 0x7f69e81ef640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:04.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.902+0000 7f69ef71d640 1 --2- 172.21.15.87:0/1358130714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69e80cc650 0x7f69e80aeae0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:04.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.902+0000 7f69ef71d640 1 -- 172.21.15.87:0/1358130714 >> 172.21.15.87:0/1358130714 conn(0x7f69e8061660 msgr2=0x7f69e80af530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:04.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.902+0000 7f69ef71d640 1 -- 172.21.15.87:0/1358130714 shutdown_connections 2023-12-16T20:49:04.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:04.902+0000 7f69ef71d640 1 -- 172.21.15.87:0/1358130714 wait complete. 2023-12-16T20:49:04.914 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-12-16T20:49:04.914 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T20:49:04.930 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:49:05.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.069+0000 7f8691705640 1 Processor -- start 2023-12-16T20:49:05.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.069+0000 7f8691705640 1 -- start start 2023-12-16T20:49:05.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.070+0000 7f8691705640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f868c0c82b0 0x7f868c0c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:05.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.070+0000 7f8691705640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868c159ba0 con 0x7f868c15d600 2023-12-16T20:49:05.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.070+0000 7f8691705640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868c15a3e0 con 0x7f868c06f720 2023-12-16T20:49:05.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.070+0000 7f8691705640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868c15da90 con 0x7f868c0c82b0 2023-12-16T20:49:05.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.071+0000 7f868b7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f868c15d600 0x7f868c163e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:37328/0 (socket says 172.21.15.87:37328) 2023-12-16T20:49:05.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.071+0000 7f868b7fe640 1 -- 172.21.15.87:0/1843099675 learned_addr learned my addr 172.21.15.87:0/1843099675 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:49:05.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.071+0000 7f868affd640 1 --1- 172.21.15.87:0/1843099675 >> v1:172.21.15.195:6789/0 conn(0x7f868c06f720 0x7f868c159490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:57296/0 (socket says 172.21.15.87:57296) 2023-12-16T20:49:05.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.071+0000 7f868a7fc640 1 --2- 172.21.15.87:0/1843099675 >> v2:172.21.15.87:3300/0 conn(0x7f868c0c82b0 0x7f868c0c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:05.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.073+0000 7f8689ffb640 1 -- 172.21.15.87:0/1843099675 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3211735292 0 0) 0x7f868c15a3e0 con 0x7f868c06f720 2023-12-16T20:49:05.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.073+0000 7f8689ffb640 1 -- 172.21.15.87:0/1843099675 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8674003520 con 0x7f868c06f720 2023-12-16T20:49:05.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.075+0000 7f868a7fc640 1 -- 172.21.15.87:0/1843099675 >> v1:172.21.15.195:6789/0 conn(0x7f868c06f720 legacy=0x7f868c159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:05.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.075+0000 7f868a7fc640 1 -- 172.21.15.87:0/1843099675 >> v1:172.21.15.87:6789/0 conn(0x7f868c15d600 legacy=0x7f868c163e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:05.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.075+0000 7f868a7fc640 1 -- 172.21.15.87:0/1843099675 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c159e20 con 0x7f868c0c82b0 2023-12-16T20:49:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.079+0000 7f868a7fc640 1 --2- 172.21.15.87:0/1843099675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f868c0c82b0 0x7f868c0c7040 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f86800097a0 tx=0x7f868002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8056636b4e11ef9 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:05.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.082+0000 7f8689ffb640 1 -- 172.21.15.87:0/1843099675 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680030610 con 0x7f868c0c82b0 2023-12-16T20:49:05.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.082+0000 7f8689ffb640 1 -- 172.21.15.87:0/1843099675 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8680030770 con 0x7f868c0c82b0 2023-12-16T20:49:05.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.082+0000 7f8689ffb640 1 -- 172.21.15.87:0/1843099675 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680030b00 con 0x7f868c0c82b0 2023-12-16T20:49:05.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.083+0000 7f8691705640 1 -- 172.21.15.87:0/1843099675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f868c0c82b0 msgr2=0x7f868c0c7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:05.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.083+0000 7f8691705640 1 --2- 172.21.15.87:0/1843099675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f868c0c82b0 0x7f868c0c7040 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f86800097a0 tx=0x7f868002b960 comp rx=0 tx=0).stop 2023-12-16T20:49:05.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.083+0000 7f8691705640 1 -- 172.21.15.87:0/1843099675 shutdown_connections 2023-12-16T20:49:05.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.083+0000 7f8691705640 1 --2- 172.21.15.87:0/1843099675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f868c0c82b0 0x7f868c0c7040 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:05.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.083+0000 7f8691705640 1 -- 172.21.15.87:0/1843099675 >> 172.21.15.87:0/1843099675 conn(0x7f868c0cbef0 msgr2=0x7f868c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:05.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.083+0000 7f8691705640 1 -- 172.21.15.87:0/1843099675 shutdown_connections 2023-12-16T20:49:05.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.083+0000 7f8691705640 1 -- 172.21.15.87:0/1843099675 wait complete. 2023-12-16T20:49:05.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.085+0000 7f8691705640 1 Processor -- start 2023-12-16T20:49:05.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.085+0000 7f8691705640 1 -- start start 2023-12-16T20:49:05.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.085+0000 7f8691705640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f868c06f720 0x7f868c157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:05.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.085+0000 7f8691705640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f868c0c82b0 0x7f868c1ef840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:05.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.085+0000 7f8691705640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f868c15d600 0x7f868c14a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:05.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.085+0000 7f8691705640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c0cb3b0 con 0x7f868c15d600 2023-12-16T20:49:05.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.085+0000 7f8691705640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c1eee30 con 0x7f868c06f720 2023-12-16T20:49:05.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.085+0000 7f8691705640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c15a650 con 0x7f868c0c82b0 2023-12-16T20:49:05.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.086+0000 7f868b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f868c15d600 0x7f868c14a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:05.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.086+0000 7f868b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f868c15d600 0x7f868c14a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56800/0 (socket says 172.21.15.87:56800) 2023-12-16T20:49:05.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.086+0000 7f868b7fe640 1 -- 172.21.15.87:0/1023702824 learned_addr learned my addr 172.21.15.87:0/1023702824 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:05.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.086+0000 7f868affd640 1 --2- 172.21.15.87:0/1023702824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f868c06f720 0x7f868c157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:05.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.086+0000 7f868a7fc640 1 --2- 172.21.15.87:0/1023702824 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f868c0c82b0 0x7f868c1ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:05.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.089+0000 7f868b7fe640 1 -- 172.21.15.87:0/1023702824 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f868c0c82b0 msgr2=0x7f868c1ef840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:05.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.089+0000 7f868b7fe640 1 --2- 172.21.15.87:0/1023702824 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f868c0c82b0 0x7f868c1ef840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:05.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.089+0000 7f868b7fe640 1 -- 172.21.15.87:0/1023702824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f868c06f720 msgr2=0x7f868c157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:05.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.089+0000 7f868b7fe640 1 --2- 172.21.15.87:0/1023702824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f868c06f720 0x7f868c157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:05.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.089+0000 7f868b7fe640 1 -- 172.21.15.87:0/1023702824 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8680009400 con 0x7f868c15d600 2023-12-16T20:49:05.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.092+0000 7f868b7fe640 1 --2- 172.21.15.87:0/1023702824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f868c15d600 0x7f868c14a2c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f868400c420 tx=0x7f868400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:05.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.095+0000 7f86737fe640 1 -- 172.21.15.87:0/1023702824 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8684005ce0 con 0x7f868c15d600 2023-12-16T20:49:05.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.095+0000 7f86737fe640 1 -- 172.21.15.87:0/1023702824 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8684005e40 con 0x7f868c15d600 2023-12-16T20:49:05.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.095+0000 7f86737fe640 1 -- 172.21.15.87:0/1023702824 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86840072d0 con 0x7f868c15d600 2023-12-16T20:49:05.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.095+0000 7f8691705640 1 -- 172.21.15.87:0/1023702824 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868c15c960 con 0x7f868c15d600 2023-12-16T20:49:05.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.095+0000 7f8691705640 1 -- 172.21.15.87:0/1023702824 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868c15a8a0 con 0x7f868c15d600 2023-12-16T20:49:05.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.096+0000 7f8691705640 1 -- 172.21.15.87:0/1023702824 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868c15caf0 con 0x7f868c15d600 2023-12-16T20:49:05.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.117+0000 7f86737fe640 1 -- 172.21.15.87:0/1023702824 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f86840074f0 con 0x7f868c15d600 2023-12-16T20:49:05.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.117+0000 7f86737fe640 1 --2- 172.21.15.87:0/1023702824 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f867806ae40 0x7f867806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:05.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.118+0000 7f868affd640 1 --2- 172.21.15.87:0/1023702824 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f867806ae40 0x7f867806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:05.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.118+0000 7f868affd640 1 --2- 172.21.15.87:0/1023702824 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f867806ae40 0x7f867806d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f867c001560 tx=0x7f867c001660 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:05.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.357+0000 7f86737fe640 1 -- 172.21.15.87:0/1023702824 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8684058110 con 0x7f868c15d600 2023-12-16T20:49:05.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.357+0000 7f86737fe640 1 -- 172.21.15.87:0/1023702824 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f8684054450 con 0x7f868c15d600 2023-12-16T20:49:05.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.528+0000 7f8691705640 1 -- 172.21.15.87:0/1023702824 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f868c0740e0 con 0x7f868c15d600 2023-12-16T20:49:05.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.580+0000 7f86737fe640 1 -- 172.21.15.87:0/1023702824 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18702 (secure 0 0 0) 0x7f8684017090 con 0x7f868c15d600 2023-12-16T20:49:05.581 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:49:05.581 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":27,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:22:14.653915+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:21:22.654341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T20:21:33.728787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T20:21:34.846119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T20:21:38.657738+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:49:05.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.582+0000 7f8691705640 1 -- 172.21.15.87:0/1023702824 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f867806ae40 msgr2=0x7f867806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:05.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.582+0000 7f8691705640 1 --2- 172.21.15.87:0/1023702824 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f867806ae40 0x7f867806d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f867c001560 tx=0x7f867c001660 comp rx=0 tx=0).stop 2023-12-16T20:49:05.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.582+0000 7f8691705640 1 -- 172.21.15.87:0/1023702824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f868c15d600 msgr2=0x7f868c14a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:05.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.582+0000 7f8691705640 1 --2- 172.21.15.87:0/1023702824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f868c15d600 0x7f868c14a2c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f868400c420 tx=0x7f868400c8e0 comp rx=0 tx=0).stop 2023-12-16T20:49:05.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.582+0000 7f8691705640 1 -- 172.21.15.87:0/1023702824 shutdown_connections 2023-12-16T20:49:05.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.582+0000 7f8691705640 1 --2- 172.21.15.87:0/1023702824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f868c15d600 0x7f868c14a2c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:05.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.582+0000 7f8691705640 1 --2- 172.21.15.87:0/1023702824 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f868c0c82b0 0x7f868c1ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:05.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.582+0000 7f8691705640 1 --2- 172.21.15.87:0/1023702824 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f867806ae40 0x7f867806d300 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:05.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.582+0000 7f8691705640 1 --2- 172.21.15.87:0/1023702824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f868c06f720 0x7f868c157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:05.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.582+0000 7f8691705640 1 -- 172.21.15.87:0/1023702824 >> 172.21.15.87:0/1023702824 conn(0x7f868c0cbef0 msgr2=0x7f868c1527b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:05.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.582+0000 7f8691705640 1 -- 172.21.15.87:0/1023702824 shutdown_connections 2023-12-16T20:49:05.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.582+0000 7f8691705640 1 -- 172.21.15.87:0/1023702824 wait complete. 2023-12-16T20:49:05.594 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T20:21:22.654341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T20:21:33.728787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T20:21:34.846119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-16T20:21:38.657738+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-16T20:49:05.595 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T20:49:05.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.697+0000 7f7952231640 1 Processor -- start 2023-12-16T20:49:05.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.697+0000 7f7952231640 1 -- start start 2023-12-16T20:49:05.699 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.698+0000 7f7952231640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f794c153890 0x7f794c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:05.699 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.698+0000 7f7952231640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f794c153c70 0x7f794c0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:05.699 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.698+0000 7f7952231640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794c15a700 con 0x7f794c0ceef0 2023-12-16T20:49:05.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.698+0000 7f7952231640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794c0ca870 con 0x7f794c153c70 2023-12-16T20:49:05.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.698+0000 7f7952231640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c159af0 con 0x7f794c153890 2023-12-16T20:49:05.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.699+0000 7f794b7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f794c153890 0x7f794c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:05.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.699+0000 7f794affd640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f794c153c70 0x7f794c0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:05.701 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.699+0000 7f794b7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f794c153890 0x7f794c15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:54382/0 (socket says 172.21.15.87:54382) 2023-12-16T20:49:05.701 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.699+0000 7f794b7fe640 1 -- 172.21.15.87:0/911242634 learned_addr learned my addr 172.21.15.87:0/911242634 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:05.702 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.701+0000 7f794b7fe640 1 -- 172.21.15.87:0/911242634 >> v2:172.21.15.195:3300/0 conn(0x7f794c153c70 msgr2=0x7f794c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:05.702 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.701+0000 7f794b7fe640 1 --2- 172.21.15.87:0/911242634 >> v2:172.21.15.195:3300/0 conn(0x7f794c153c70 0x7f794c0c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:05.702 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.701+0000 7f794b7fe640 1 -- 172.21.15.87:0/911242634 >> v1:172.21.15.195:6789/0 conn(0x7f794c0ceef0 legacy=0x7f794c15aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:05.703 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.701+0000 7f794b7fe640 1 -- 172.21.15.87:0/911242634 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c159dd0 con 0x7f794c153890 2023-12-16T20:49:05.704 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.703+0000 7f794b7fe640 1 --2- 172.21.15.87:0/911242634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f794c153890 0x7f794c15d950 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f793c009870 tx=0x7f793c02ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e776636bfd1cc0c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:05.708 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.707+0000 7f794a7fc640 1 -- 172.21.15.87:0/911242634 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c02f840 con 0x7f794c153890 2023-12-16T20:49:05.708 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.707+0000 7f794a7fc640 1 -- 172.21.15.87:0/911242634 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c02f9a0 con 0x7f794c153890 2023-12-16T20:49:05.708 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.707+0000 7f794a7fc640 1 -- 172.21.15.87:0/911242634 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c02fd30 con 0x7f794c153890 2023-12-16T20:49:05.708 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.707+0000 7f7952231640 1 -- 172.21.15.87:0/911242634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f794c153890 msgr2=0x7f794c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:05.709 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.707+0000 7f7952231640 1 --2- 172.21.15.87:0/911242634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f794c153890 0x7f794c15d950 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f793c009870 tx=0x7f793c02ba20 comp rx=0 tx=0).stop 2023-12-16T20:49:05.709 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.708+0000 7f7952231640 1 -- 172.21.15.87:0/911242634 shutdown_connections 2023-12-16T20:49:05.709 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.708+0000 7f7952231640 1 --2- 172.21.15.87:0/911242634 >> v2:172.21.15.195:3300/0 conn(0x7f794c153c70 0x7f794c0c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:05.709 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.708+0000 7f7952231640 1 --2- 172.21.15.87:0/911242634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f794c153890 0x7f794c15d950 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:05.709 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.708+0000 7f7952231640 1 -- 172.21.15.87:0/911242634 >> 172.21.15.87:0/911242634 conn(0x7f794c06ba00 msgr2=0x7f794c06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:05.709 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.708+0000 7f7952231640 1 -- 172.21.15.87:0/911242634 shutdown_connections 2023-12-16T20:49:05.709 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.708+0000 7f7952231640 1 -- 172.21.15.87:0/911242634 wait complete. 2023-12-16T20:49:05.710 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.709+0000 7f7952231640 1 Processor -- start 2023-12-16T20:49:05.710 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.709+0000 7f7952231640 1 -- start start 2023-12-16T20:49:05.710 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.710+0000 7f7952231640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f794c0ceef0 0x7f794c0c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:05.710 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.710+0000 7f7952231640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f794c153890 0x7f794c1f3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:05.710 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.710+0000 7f7952231640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f794c153c70 0x7f794c0b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:05.710 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.710+0000 7f7952231640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c156550 con 0x7f794c0ceef0 2023-12-16T20:49:05.711 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.710+0000 7f7952231640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c156810 con 0x7f794c153890 2023-12-16T20:49:05.711 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.710+0000 7f7952231640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c156af0 con 0x7f794c153c70 2023-12-16T20:49:05.711 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.710+0000 7f794bfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f794c153c70 0x7f794c0b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:05.711 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.710+0000 7f794affd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f794c153890 0x7f794c1f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:05.711 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.710+0000 7f794b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f794c0ceef0 0x7f794c0c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:05.712 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.710+0000 7f794bfff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f794c153c70 0x7f794c0b4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:54394/0 (socket says 172.21.15.87:54394) 2023-12-16T20:49:05.712 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.710+0000 7f794bfff640 1 -- 172.21.15.87:0/3805735059 learned_addr learned my addr 172.21.15.87:0/3805735059 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:05.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.714+0000 7f794b7fe640 1 -- 172.21.15.87:0/3805735059 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f794c153c70 msgr2=0x7f794c0b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:05.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.714+0000 7f794b7fe640 1 --2- 172.21.15.87:0/3805735059 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f794c153c70 0x7f794c0b4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:05.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.714+0000 7f794b7fe640 1 -- 172.21.15.87:0/3805735059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f794c153890 msgr2=0x7f794c1f3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:05.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.714+0000 7f794b7fe640 1 --2- 172.21.15.87:0/3805735059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f794c153890 0x7f794c1f3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:05.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.714+0000 7f794b7fe640 1 -- 172.21.15.87:0/3805735059 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c0094d0 con 0x7f794c0ceef0 2023-12-16T20:49:05.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.716+0000 7f794b7fe640 1 --2- 172.21.15.87:0/3805735059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f794c0ceef0 0x7f794c0c8dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f793c033000 tx=0x7f793c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:05.720 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.719+0000 7f7933fff640 1 -- 172.21.15.87:0/3805735059 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c046070 con 0x7f794c0ceef0 2023-12-16T20:49:05.720 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.719+0000 7f7933fff640 1 -- 172.21.15.87:0/3805735059 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c037a40 con 0x7f794c0ceef0 2023-12-16T20:49:05.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.719+0000 7f7952231640 1 -- 172.21.15.87:0/3805735059 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c1f2910 con 0x7f794c0ceef0 2023-12-16T20:49:05.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.719+0000 7f7933fff640 1 -- 172.21.15.87:0/3805735059 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c03b040 con 0x7f794c0ceef0 2023-12-16T20:49:05.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.719+0000 7f7952231640 1 -- 172.21.15.87:0/3805735059 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c156240 con 0x7f794c0ceef0 2023-12-16T20:49:05.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.721+0000 7f7952231640 1 -- 172.21.15.87:0/3805735059 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794c1f2e30 con 0x7f794c0ceef0 2023-12-16T20:49:05.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.976+0000 7f7933fff640 1 -- 172.21.15.87:0/3805735059 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f793c04b410 con 0x7f794c0ceef0 2023-12-16T20:49:05.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.977+0000 7f7933fff640 1 --2- 172.21.15.87:0/3805735059 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f793806aec0 0x7f793806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:05.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.977+0000 7f794affd640 1 --2- 172.21.15.87:0/3805735059 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f793806aec0 0x7f793806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:05.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.977+0000 7f794affd640 1 --2- 172.21.15.87:0/3805735059 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f793806aec0 0x7f793806d380 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f794c15ba10 tx=0x7f7940009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:05.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.990+0000 7f7933fff640 1 -- 172.21.15.87:0/3805735059 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f793c07b2c0 con 0x7f794c0ceef0 2023-12-16T20:49:05.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:05.991+0000 7f7933fff640 1 -- 172.21.15.87:0/3805735059 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f793c077600 con 0x7f794c0ceef0 2023-12-16T20:49:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.159+0000 7f7952231640 1 -- 172.21.15.87:0/3805735059 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f794c1f2e30 con 0x7f794c0ceef0 2023-12-16T20:49:06.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.166+0000 7f7933fff640 1 -- 172.21.15.87:0/3805735059 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f794c1f2e30 con 0x7f794c0ceef0 2023-12-16T20:49:06.167 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-12-16T20:49:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.168+0000 7f7952231640 1 -- 172.21.15.87:0/3805735059 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f793806aec0 msgr2=0x7f793806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.168+0000 7f7952231640 1 --2- 172.21.15.87:0/3805735059 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f793806aec0 0x7f793806d380 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f794c15ba10 tx=0x7f7940009190 comp rx=0 tx=0).stop 2023-12-16T20:49:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.168+0000 7f7952231640 1 -- 172.21.15.87:0/3805735059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f794c0ceef0 msgr2=0x7f794c0c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.168+0000 7f7952231640 1 --2- 172.21.15.87:0/3805735059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f794c0ceef0 0x7f794c0c8dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f793c033000 tx=0x7f793c0046c0 comp rx=0 tx=0).stop 2023-12-16T20:49:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.168+0000 7f7952231640 1 -- 172.21.15.87:0/3805735059 shutdown_connections 2023-12-16T20:49:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.168+0000 7f7952231640 1 --2- 172.21.15.87:0/3805735059 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f794c153c70 0x7f794c0b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.168+0000 7f7952231640 1 --2- 172.21.15.87:0/3805735059 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f793806aec0 0x7f793806d380 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.168+0000 7f7952231640 1 --2- 172.21.15.87:0/3805735059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f794c153890 0x7f794c1f3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.168+0000 7f7952231640 1 --2- 172.21.15.87:0/3805735059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f794c0ceef0 0x7f794c0c8dc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:06.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.168+0000 7f7952231640 1 -- 172.21.15.87:0/3805735059 >> 172.21.15.87:0/3805735059 conn(0x7f794c06ba00 msgr2=0x7f794c0cc170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:06.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.168+0000 7f7952231640 1 -- 172.21.15.87:0/3805735059 shutdown_connections 2023-12-16T20:49:06.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.168+0000 7f7952231640 1 -- 172.21.15.87:0/3805735059 wait complete. 2023-12-16T20:49:06.180 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T20:49:06.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.282+0000 7f8f6c54c640 1 Processor -- start 2023-12-16T20:49:06.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.282+0000 7f8f6c54c640 1 -- start start 2023-12-16T20:49:06.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.283+0000 7f8f6c54c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8f641501c0 0x7f8f64159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:06.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.283+0000 7f8f6c54c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f640bff00 0x7f8f64156e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:06.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.283+0000 7f8f6c54c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f640c1a90 con 0x7f8f64072450 2023-12-16T20:49:06.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.283+0000 7f8f6c54c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f640c1d30 con 0x7f8f641501c0 2023-12-16T20:49:06.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.283+0000 7f8f6c54c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640c2010 con 0x7f8f640bff00 2023-12-16T20:49:06.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.284+0000 7f8f69ae7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f640bff00 0x7f8f64156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:06.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.284+0000 7f8f6a2e8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8f641501c0 0x7f8f64159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:06.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.284+0000 7f8f69ae7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f640bff00 0x7f8f64156e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:54402/0 (socket says 172.21.15.87:54402) 2023-12-16T20:49:06.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.284+0000 7f8f69ae7640 1 -- 172.21.15.87:0/321029361 learned_addr learned my addr 172.21.15.87:0/321029361 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:06.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.286+0000 7f8f69ae7640 1 -- 172.21.15.87:0/321029361 >> v2:172.21.15.195:3300/0 conn(0x7f8f641501c0 msgr2=0x7f8f64159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:06.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.286+0000 7f8f69ae7640 1 --2- 172.21.15.87:0/321029361 >> v2:172.21.15.195:3300/0 conn(0x7f8f641501c0 0x7f8f64159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:06.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.286+0000 7f8f69ae7640 1 -- 172.21.15.87:0/321029361 >> v1:172.21.15.195:6789/0 conn(0x7f8f64072450 legacy=0x7f8f64071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:06.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.286+0000 7f8f69ae7640 1 -- 172.21.15.87:0/321029361 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f64156380 con 0x7f8f640bff00 2023-12-16T20:49:06.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.288+0000 7f8f69ae7640 1 --2- 172.21.15.87:0/321029361 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f640bff00 0x7f8f64156e60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8f640cbad0 tx=0x7f8f5402e130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59a392e59d758b08 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:06.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.292+0000 7f8f692e6640 1 -- 172.21.15.87:0/321029361 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54036440 con 0x7f8f640bff00 2023-12-16T20:49:06.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.292+0000 7f8f692e6640 1 -- 172.21.15.87:0/321029361 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f540365a0 con 0x7f8f640bff00 2023-12-16T20:49:06.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.292+0000 7f8f692e6640 1 -- 172.21.15.87:0/321029361 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54036930 con 0x7f8f640bff00 2023-12-16T20:49:06.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.293+0000 7f8f6c54c640 1 -- 172.21.15.87:0/321029361 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f640bff00 msgr2=0x7f8f64156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:06.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.293+0000 7f8f6c54c640 1 --2- 172.21.15.87:0/321029361 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f640bff00 0x7f8f64156e60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8f640cbad0 tx=0x7f8f5402e130 comp rx=0 tx=0).stop 2023-12-16T20:49:06.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.293+0000 7f8f6c54c640 1 -- 172.21.15.87:0/321029361 shutdown_connections 2023-12-16T20:49:06.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.293+0000 7f8f6c54c640 1 --2- 172.21.15.87:0/321029361 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f640bff00 0x7f8f64156e60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:06.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.293+0000 7f8f6c54c640 1 --2- 172.21.15.87:0/321029361 >> v2:172.21.15.195:3300/0 conn(0x7f8f641501c0 0x7f8f64159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:06.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.293+0000 7f8f6c54c640 1 -- 172.21.15.87:0/321029361 >> 172.21.15.87:0/321029361 conn(0x7f8f6406cd60 msgr2=0x7f8f6406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:06.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.293+0000 7f8f6c54c640 1 -- 172.21.15.87:0/321029361 shutdown_connections 2023-12-16T20:49:06.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.293+0000 7f8f6c54c640 1 -- 172.21.15.87:0/321029361 wait complete. 2023-12-16T20:49:06.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.294+0000 7f8f6c54c640 1 Processor -- start 2023-12-16T20:49:06.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.294+0000 7f8f6c54c640 1 -- start start 2023-12-16T20:49:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.295+0000 7f8f6c54c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f64072450 0x7f8f641df870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.295+0000 7f8f6c54c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f640bff00 0x7f8f64158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.295+0000 7f8f6c54c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f641501c0 0x7f8f64159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.295+0000 7f8f6c54c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f64157800 con 0x7f8f64072450 2023-12-16T20:49:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.295+0000 7f8f6c54c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f641e07d0 con 0x7f8f641501c0 2023-12-16T20:49:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.295+0000 7f8f6c54c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f64158b50 con 0x7f8f640bff00 2023-12-16T20:49:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.295+0000 7f8f6a2e8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f64072450 0x7f8f641df870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.296+0000 7f8f69ae7640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f640bff00 0x7f8f64158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.296+0000 7f8f6a2e8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f64072450 0x7f8f641df870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56816/0 (socket says 172.21.15.87:56816) 2023-12-16T20:49:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.296+0000 7f8f6a2e8640 1 -- 172.21.15.87:0/266991908 learned_addr learned my addr 172.21.15.87:0/266991908 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.296+0000 7f8f6aae9640 1 --2- 172.21.15.87:0/266991908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f641501c0 0x7f8f64159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:06.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.299+0000 7f8f6a2e8640 1 -- 172.21.15.87:0/266991908 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f640bff00 msgr2=0x7f8f64158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:06.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.299+0000 7f8f6a2e8640 1 --2- 172.21.15.87:0/266991908 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f640bff00 0x7f8f64158fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:06.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.299+0000 7f8f6a2e8640 1 -- 172.21.15.87:0/266991908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f641501c0 msgr2=0x7f8f64159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:06.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.299+0000 7f8f6a2e8640 1 --2- 172.21.15.87:0/266991908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f641501c0 0x7f8f64159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:06.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.299+0000 7f8f6a2e8640 1 -- 172.21.15.87:0/266991908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5400b770 con 0x7f8f64072450 2023-12-16T20:49:06.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.301+0000 7f8f6a2e8640 1 --2- 172.21.15.87:0/266991908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f64072450 0x7f8f641df870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009d10 tx=0x7f8f6000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:06.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.305+0000 7f8f5affd640 1 -- 172.21.15.87:0/266991908 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60009b80 con 0x7f8f64072450 2023-12-16T20:49:06.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.305+0000 7f8f5affd640 1 -- 172.21.15.87:0/266991908 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6000f040 con 0x7f8f64072450 2023-12-16T20:49:06.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.305+0000 7f8f5affd640 1 -- 172.21.15.87:0/266991908 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60014680 con 0x7f8f64072450 2023-12-16T20:49:06.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.305+0000 7f8f6c54c640 1 -- 172.21.15.87:0/266991908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f64157540 con 0x7f8f64072450 2023-12-16T20:49:06.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.305+0000 7f8f6c54c640 1 -- 172.21.15.87:0/266991908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f64158500 con 0x7f8f64072450 2023-12-16T20:49:06.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.306+0000 7f8f6c54c640 1 -- 172.21.15.87:0/266991908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f640c77e0 con 0x7f8f64072450 2023-12-16T20:49:06.548 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.548+0000 7f8f5affd640 1 -- 172.21.15.87:0/266991908 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f8f600147e0 con 0x7f8f64072450 2023-12-16T20:49:06.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.548+0000 7f8f5affd640 1 --2- 172.21.15.87:0/266991908 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8f4806ae90 0x7f8f4806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:06.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.548+0000 7f8f69ae7640 1 --2- 172.21.15.87:0/266991908 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8f4806ae90 0x7f8f4806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:06.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.548+0000 7f8f69ae7640 1 --2- 172.21.15.87:0/266991908 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8f4806ae90 0x7f8f4806d350 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8f54038000 tx=0x7f8f54032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:06.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.562+0000 7f8f5affd640 1 -- 172.21.15.87:0/266991908 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8f600597a0 con 0x7f8f64072450 2023-12-16T20:49:06.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.562+0000 7f8f5affd640 1 -- 172.21.15.87:0/266991908 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f8f60055ae0 con 0x7f8f64072450 2023-12-16T20:49:06.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.738+0000 7f8f6c54c640 1 -- 172.21.15.87:0/266991908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8f64067500 con 0x7f8f64072450 2023-12-16T20:49:06.744 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.743+0000 7f8f5affd640 1 -- 172.21.15.87:0/266991908 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8f60059100 con 0x7f8f64072450 2023-12-16T20:49:06.744 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-12-16T20:49:06.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.745+0000 7f8f6c54c640 1 -- 172.21.15.87:0/266991908 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8f4806ae90 msgr2=0x7f8f4806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:06.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.745+0000 7f8f6c54c640 1 --2- 172.21.15.87:0/266991908 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8f4806ae90 0x7f8f4806d350 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8f54038000 tx=0x7f8f54032000 comp rx=0 tx=0).stop 2023-12-16T20:49:06.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.745+0000 7f8f6c54c640 1 -- 172.21.15.87:0/266991908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f64072450 msgr2=0x7f8f641df870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.745+0000 7f8f6c54c640 1 --2- 172.21.15.87:0/266991908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f64072450 0x7f8f641df870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009d10 tx=0x7f8f6000c490 comp rx=0 tx=0).stop 2023-12-16T20:49:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.745+0000 7f8f6c54c640 1 -- 172.21.15.87:0/266991908 shutdown_connections 2023-12-16T20:49:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.745+0000 7f8f6c54c640 1 --2- 172.21.15.87:0/266991908 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8f4806ae90 0x7f8f4806d350 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.745+0000 7f8f6c54c640 1 --2- 172.21.15.87:0/266991908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f641501c0 0x7f8f64159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.745+0000 7f8f6c54c640 1 --2- 172.21.15.87:0/266991908 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f640bff00 0x7f8f64158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.745+0000 7f8f6c54c640 1 --2- 172.21.15.87:0/266991908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f64072450 0x7f8f641df870 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.745+0000 7f8f6c54c640 1 -- 172.21.15.87:0/266991908 >> 172.21.15.87:0/266991908 conn(0x7f8f6406cd60 msgr2=0x7f8f6406ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.746+0000 7f8f6c54c640 1 -- 172.21.15.87:0/266991908 shutdown_connections 2023-12-16T20:49:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.746+0000 7f8f6c54c640 1 -- 172.21.15.87:0/266991908 wait complete. 2023-12-16T20:49:06.758 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T20:49:06.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.861+0000 7fd723623640 1 Processor -- start 2023-12-16T20:49:06.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.861+0000 7fd723623640 1 -- start start 2023-12-16T20:49:06.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.862+0000 7fd723623640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd71c153c70 0x7fd71c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:06.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.862+0000 7fd723623640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71c15a700 con 0x7fd71c153890 2023-12-16T20:49:06.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.862+0000 7fd723623640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71c0ca870 con 0x7fd71c0ceef0 2023-12-16T20:49:06.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.862+0000 7fd723623640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71c159af0 con 0x7fd71c153c70 2023-12-16T20:49:06.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.863+0000 7fd721bc0640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fd71c0ceef0 0x7fd71c15aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:57322/0 (socket says 172.21.15.87:57322) 2023-12-16T20:49:06.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.863+0000 7fd721bc0640 1 -- 172.21.15.87:0/2564920366 learned_addr learned my addr 172.21.15.87:0/2564920366 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:49:06.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.863+0000 7fd720bbe640 1 --2- 172.21.15.87:0/2564920366 >> v2:172.21.15.87:3300/0 conn(0x7fd71c153c70 0x7fd71c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:06.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.865+0000 7fd713fff640 1 -- 172.21.15.87:0/2564920366 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237842034 0 0) 0x7fd71c0ca870 con 0x7fd71c0ceef0 2023-12-16T20:49:06.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.865+0000 7fd713fff640 1 -- 172.21.15.87:0/2564920366 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd708003520 con 0x7fd71c0ceef0 2023-12-16T20:49:06.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.866+0000 7fd720bbe640 1 -- 172.21.15.87:0/2564920366 >> v1:172.21.15.195:6789/0 conn(0x7fd71c0ceef0 legacy=0x7fd71c15aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:06.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.866+0000 7fd720bbe640 1 -- 172.21.15.87:0/2564920366 >> v1:172.21.15.87:6789/0 conn(0x7fd71c153890 legacy=0x7fd71c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:06.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.866+0000 7fd720bbe640 1 -- 172.21.15.87:0/2564920366 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c159dd0 con 0x7fd71c153c70 2023-12-16T20:49:06.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.869+0000 7fd720bbe640 1 --2- 172.21.15.87:0/2564920366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd71c153c70 0x7fd71c15d950 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0097a0 tx=0x7fd70c02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65fed862e49f92d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:06.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.874+0000 7fd713fff640 1 -- 172.21.15.87:0/2564920366 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c02f810 con 0x7fd71c153c70 2023-12-16T20:49:06.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.874+0000 7fd713fff640 1 -- 172.21.15.87:0/2564920366 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c02f970 con 0x7fd71c153c70 2023-12-16T20:49:06.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.874+0000 7fd713fff640 1 -- 172.21.15.87:0/2564920366 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c02fd00 con 0x7fd71c153c70 2023-12-16T20:49:06.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.875+0000 7fd723623640 1 -- 172.21.15.87:0/2564920366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd71c153c70 msgr2=0x7fd71c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:06.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.875+0000 7fd723623640 1 --2- 172.21.15.87:0/2564920366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd71c153c70 0x7fd71c15d950 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0097a0 tx=0x7fd70c02b9f0 comp rx=0 tx=0).stop 2023-12-16T20:49:06.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.875+0000 7fd723623640 1 -- 172.21.15.87:0/2564920366 shutdown_connections 2023-12-16T20:49:06.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.875+0000 7fd723623640 1 --2- 172.21.15.87:0/2564920366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd71c153c70 0x7fd71c15d950 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:06.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.875+0000 7fd723623640 1 -- 172.21.15.87:0/2564920366 >> 172.21.15.87:0/2564920366 conn(0x7fd71c06ba00 msgr2=0x7fd71c06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:06.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.875+0000 7fd723623640 1 -- 172.21.15.87:0/2564920366 shutdown_connections 2023-12-16T20:49:06.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.875+0000 7fd723623640 1 -- 172.21.15.87:0/2564920366 wait complete. 2023-12-16T20:49:06.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.877+0000 7fd723623640 1 Processor -- start 2023-12-16T20:49:06.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.877+0000 7fd723623640 1 -- start start 2023-12-16T20:49:06.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.877+0000 7fd723623640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd71c0ceef0 0x7fd71c149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:06.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.877+0000 7fd723623640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd71c153890 0x7fd71c0c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:06.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.877+0000 7fd723623640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd71c153c70 0x7fd71c152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:06.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.877+0000 7fd723623640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c0c8310 con 0x7fd71c153890 2023-12-16T20:49:06.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.877+0000 7fd723623640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c0c7940 con 0x7fd71c0ceef0 2023-12-16T20:49:06.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.877+0000 7fd723623640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c0b4c70 con 0x7fd71c153c70 2023-12-16T20:49:06.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.878+0000 7fd720bbe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd71c153890 0x7fd71c0c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:06.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.878+0000 7fd720bbe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd71c153890 0x7fd71c0c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56840/0 (socket says 172.21.15.87:56840) 2023-12-16T20:49:06.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.878+0000 7fd720bbe640 1 -- 172.21.15.87:0/2243737963 learned_addr learned my addr 172.21.15.87:0/2243737963 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:06.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.878+0000 7fd7213bf640 1 --2- 172.21.15.87:0/2243737963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd71c0ceef0 0x7fd71c149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:06.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.878+0000 7fd721bc0640 1 --2- 172.21.15.87:0/2243737963 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd71c153c70 0x7fd71c152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:06.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.881+0000 7fd720bbe640 1 -- 172.21.15.87:0/2243737963 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd71c153c70 msgr2=0x7fd71c152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:06.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.881+0000 7fd720bbe640 1 --2- 172.21.15.87:0/2243737963 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd71c153c70 0x7fd71c152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:06.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.881+0000 7fd720bbe640 1 -- 172.21.15.87:0/2243737963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd71c0ceef0 msgr2=0x7fd71c149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:06.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.881+0000 7fd720bbe640 1 --2- 172.21.15.87:0/2243737963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd71c0ceef0 0x7fd71c149bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:06.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.881+0000 7fd720bbe640 1 -- 172.21.15.87:0/2243737963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c009400 con 0x7fd71c153890 2023-12-16T20:49:06.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.883+0000 7fd720bbe640 1 --2- 172.21.15.87:0/2243737963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd71c153890 0x7fd71c0c6070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0098c0 tx=0x7fd70c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.887+0000 7fd711ffb640 1 -- 172.21.15.87:0/2243737963 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c046070 con 0x7fd71c153890 2023-12-16T20:49:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.887+0000 7fd711ffb640 1 -- 172.21.15.87:0/2243737963 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c0376d0 con 0x7fd71c153890 2023-12-16T20:49:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.887+0000 7fd723623640 1 -- 172.21.15.87:0/2243737963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71c0b4f50 con 0x7fd71c153890 2023-12-16T20:49:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.887+0000 7fd711ffb640 1 -- 172.21.15.87:0/2243737963 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c03b040 con 0x7fd71c153890 2023-12-16T20:49:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.887+0000 7fd723623640 1 -- 172.21.15.87:0/2243737963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71c0c7cc0 con 0x7fd71c153890 2023-12-16T20:49:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:06.888+0000 7fd723623640 1 -- 172.21.15.87:0/2243737963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71c0c84c0 con 0x7fd71c153890 2023-12-16T20:49:07.133 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.130+0000 7fd711ffb640 1 -- 172.21.15.87:0/2243737963 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fd70c037a80 con 0x7fd71c153890 2023-12-16T20:49:07.133 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.130+0000 7fd711ffb640 1 --2- 172.21.15.87:0/2243737963 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd70006ae40 0x7fd70006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:07.133 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.130+0000 7fd7213bf640 1 --2- 172.21.15.87:0/2243737963 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd70006ae40 0x7fd70006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:07.133 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.131+0000 7fd7213bf640 1 --2- 172.21.15.87:0/2243737963 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd70006ae40 0x7fd70006d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd718001f10 tx=0x7fd718009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:07.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.142+0000 7fd711ffb640 1 -- 172.21.15.87:0/2243737963 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd70c07b2c0 con 0x7fd71c153890 2023-12-16T20:49:07.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.143+0000 7fd711ffb640 1 -- 172.21.15.87:0/2243737963 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fd70c077600 con 0x7fd71c153890 2023-12-16T20:49:07.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.309+0000 7fd723623640 1 -- 172.21.15.87:0/2243737963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd71c0c84c0 con 0x7fd71c153890 2023-12-16T20:49:07.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.314+0000 7fd711ffb640 1 -- 172.21.15.87:0/2243737963 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd71c0c84c0 con 0x7fd71c153890 2023-12-16T20:49:07.315 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-12-16T20:49:07.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.316+0000 7fd723623640 1 -- 172.21.15.87:0/2243737963 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd70006ae40 msgr2=0x7fd70006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:07.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.316+0000 7fd723623640 1 --2- 172.21.15.87:0/2243737963 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd70006ae40 0x7fd70006d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd718001f10 tx=0x7fd718009040 comp rx=0 tx=0).stop 2023-12-16T20:49:07.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.316+0000 7fd723623640 1 -- 172.21.15.87:0/2243737963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd71c153890 msgr2=0x7fd71c0c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:07.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.316+0000 7fd723623640 1 --2- 172.21.15.87:0/2243737963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd71c153890 0x7fd71c0c6070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0098c0 tx=0x7fd70c0046c0 comp rx=0 tx=0).stop 2023-12-16T20:49:07.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.316+0000 7fd723623640 1 -- 172.21.15.87:0/2243737963 shutdown_connections 2023-12-16T20:49:07.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.316+0000 7fd723623640 1 --2- 172.21.15.87:0/2243737963 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd71c153c70 0x7fd71c152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:07.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.316+0000 7fd723623640 1 --2- 172.21.15.87:0/2243737963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd71c153890 0x7fd71c0c6070 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:07.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.316+0000 7fd723623640 1 --2- 172.21.15.87:0/2243737963 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd70006ae40 0x7fd70006d300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:07.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.316+0000 7fd723623640 1 --2- 172.21.15.87:0/2243737963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd71c0ceef0 0x7fd71c149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:07.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.316+0000 7fd723623640 1 -- 172.21.15.87:0/2243737963 >> 172.21.15.87:0/2243737963 conn(0x7fd71c06ba00 msgr2=0x7fd71c15c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:07.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.316+0000 7fd723623640 1 -- 172.21.15.87:0/2243737963 shutdown_connections 2023-12-16T20:49:07.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.316+0000 7fd723623640 1 -- 172.21.15.87:0/2243737963 wait complete. 2023-12-16T20:49:07.328 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-16T20:49:07.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.430+0000 7f08c2eee640 1 Processor -- start 2023-12-16T20:49:07.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.430+0000 7f08c2eee640 1 -- start start 2023-12-16T20:49:07.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.430+0000 7f08c2eee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08bc1538f0 0x7f08bc0c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:07.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.430+0000 7f08c2eee640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f08bc0c7b90 0x7f08bc06b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:07.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.430+0000 7f08c2eee640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08bc1596e0 con 0x7f08bc06bb50 2023-12-16T20:49:07.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.430+0000 7f08c2eee640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08bc0ca630 con 0x7f08bc0c7b90 2023-12-16T20:49:07.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.430+0000 7f08c2eee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc0c2f40 con 0x7f08bc1538f0 2023-12-16T20:49:07.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.431+0000 7f08bbfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f08bc0c7b90 0x7f08bc06b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:07.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.431+0000 7f08bbfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f08bc0c7b90 0x7f08bc06b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56846/0 (socket says 172.21.15.87:56846) 2023-12-16T20:49:07.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.431+0000 7f08bbfff640 1 -- 172.21.15.87:0/817528532 learned_addr learned my addr 172.21.15.87:0/817528532 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:07.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.431+0000 7f08c0c8a640 1 --2- 172.21.15.87:0/817528532 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08bc1538f0 0x7f08bc0c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:07.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.433+0000 7f08bbfff640 1 -- 172.21.15.87:0/817528532 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08bc1538f0 msgr2=0x7f08bc0c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:07.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.433+0000 7f08bbfff640 1 --2- 172.21.15.87:0/817528532 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08bc1538f0 0x7f08bc0c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:07.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.433+0000 7f08bbfff640 1 -- 172.21.15.87:0/817528532 >> v1:172.21.15.195:6789/0 conn(0x7f08bc06bb50 legacy=0x7f08bc159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:07.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.433+0000 7f08bbfff640 1 -- 172.21.15.87:0/817528532 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc0c3220 con 0x7f08bc0c7b90 2023-12-16T20:49:07.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.435+0000 7f08bbfff640 1 --2- 172.21.15.87:0/817528532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08bc0c7b90 0x7f08bc06b610 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009870 tx=0x7f08b002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d9b1277e972755 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:07.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.439+0000 7f08bb7fe640 1 -- 172.21.15.87:0/817528532 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b0031640 con 0x7f08bc0c7b90 2023-12-16T20:49:07.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.439+0000 7f08bb7fe640 1 -- 172.21.15.87:0/817528532 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b00317a0 con 0x7f08bc0c7b90 2023-12-16T20:49:07.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.439+0000 7f08bb7fe640 1 -- 172.21.15.87:0/817528532 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b0031b30 con 0x7f08bc0c7b90 2023-12-16T20:49:07.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.440+0000 7f08c2eee640 1 -- 172.21.15.87:0/817528532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08bc0c7b90 msgr2=0x7f08bc06b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:07.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.440+0000 7f08c2eee640 1 --2- 172.21.15.87:0/817528532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08bc0c7b90 0x7f08bc06b610 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009870 tx=0x7f08b002b8f0 comp rx=0 tx=0).stop 2023-12-16T20:49:07.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.440+0000 7f08c2eee640 1 -- 172.21.15.87:0/817528532 shutdown_connections 2023-12-16T20:49:07.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.440+0000 7f08c2eee640 1 --2- 172.21.15.87:0/817528532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08bc0c7b90 0x7f08bc06b610 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:07.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.440+0000 7f08c2eee640 1 --2- 172.21.15.87:0/817528532 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08bc1538f0 0x7f08bc0c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:07.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.440+0000 7f08c2eee640 1 -- 172.21.15.87:0/817528532 >> 172.21.15.87:0/817528532 conn(0x7f08bc060f20 msgr2=0x7f08bc061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:07.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.440+0000 7f08c2eee640 1 -- 172.21.15.87:0/817528532 shutdown_connections 2023-12-16T20:49:07.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.440+0000 7f08c2eee640 1 -- 172.21.15.87:0/817528532 wait complete. 2023-12-16T20:49:07.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.441+0000 7f08c2eee640 1 Processor -- start 2023-12-16T20:49:07.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.441+0000 7f08c2eee640 1 -- start start 2023-12-16T20:49:07.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.442+0000 7f08c2eee640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08bc06bb50 0x7f08bc156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:07.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.442+0000 7f08c2eee640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08bc0c7b90 0x7f08bc15a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:07.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.442+0000 7f08c2eee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08bc1538f0 0x7f08bc14ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:07.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.442+0000 7f08c2eee640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc156c50 con 0x7f08bc1538f0 2023-12-16T20:49:07.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.442+0000 7f08c2eee640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc1ef110 con 0x7f08bc0c7b90 2023-12-16T20:49:07.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.442+0000 7f08c2eee640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc14a7c0 con 0x7f08bc06bb50 2023-12-16T20:49:07.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.442+0000 7f08c148b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08bc1538f0 0x7f08bc14ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:07.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.443+0000 7f08c148b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08bc1538f0 0x7f08bc14ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56856/0 (socket says 172.21.15.87:56856) 2023-12-16T20:49:07.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.443+0000 7f08c148b640 1 -- 172.21.15.87:0/5633600 learned_addr learned my addr 172.21.15.87:0/5633600 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:07.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.443+0000 7f08c0c8a640 1 --2- 172.21.15.87:0/5633600 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08bc06bb50 0x7f08bc156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:07.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.443+0000 7f08bbfff640 1 --2- 172.21.15.87:0/5633600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08bc0c7b90 0x7f08bc15a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:07.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.446+0000 7f08c148b640 1 -- 172.21.15.87:0/5633600 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08bc06bb50 msgr2=0x7f08bc156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:07.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.446+0000 7f08c148b640 1 --2- 172.21.15.87:0/5633600 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08bc06bb50 0x7f08bc156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:07.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.446+0000 7f08c148b640 1 -- 172.21.15.87:0/5633600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08bc0c7b90 msgr2=0x7f08bc15a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:07.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.446+0000 7f08c148b640 1 --2- 172.21.15.87:0/5633600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08bc0c7b90 0x7f08bc15a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:07.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.446+0000 7f08c148b640 1 -- 172.21.15.87:0/5633600 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b00094d0 con 0x7f08bc1538f0 2023-12-16T20:49:07.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.448+0000 7f08c148b640 1 --2- 172.21.15.87:0/5633600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08bc1538f0 0x7f08bc14ebe0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f08b400c7a0 tx=0x7f08b400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:07.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.452+0000 7f08b97fa640 1 -- 172.21.15.87:0/5633600 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4003b70 con 0x7f08bc1538f0 2023-12-16T20:49:07.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.452+0000 7f08b97fa640 1 -- 172.21.15.87:0/5633600 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b4003cf0 con 0x7f08bc1538f0 2023-12-16T20:49:07.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.452+0000 7f08c2eee640 1 -- 172.21.15.87:0/5633600 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08bc1ef3b0 con 0x7f08bc1538f0 2023-12-16T20:49:07.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.452+0000 7f08b97fa640 1 -- 172.21.15.87:0/5633600 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4003ea0 con 0x7f08bc1538f0 2023-12-16T20:49:07.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.452+0000 7f08c2eee640 1 -- 172.21.15.87:0/5633600 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc1ef970 con 0x7f08bc1538f0 2023-12-16T20:49:07.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.453+0000 7f08c2eee640 1 -- 172.21.15.87:0/5633600 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08bc0c80a0 con 0x7f08bc1538f0 2023-12-16T20:49:07.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.471+0000 7f08b97fa640 1 -- 172.21.15.87:0/5633600 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f08b400aa90 con 0x7f08bc1538f0 2023-12-16T20:49:07.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.472+0000 7f08b97fa640 1 --2- 172.21.15.87:0/5633600 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f08a806ae90 0x7f08a806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:07.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.472+0000 7f08c0c8a640 1 --2- 172.21.15.87:0/5633600 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f08a806ae90 0x7f08a806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:07.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.472+0000 7f08c0c8a640 1 --2- 172.21.15.87:0/5633600 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f08a806ae90 0x7f08a806d350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009aa0 tx=0x7f08ac009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:07.708 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.707+0000 7f08b97fa640 1 -- 172.21.15.87:0/5633600 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f08b4058bf0 con 0x7f08bc1538f0 2023-12-16T20:49:07.708 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.707+0000 7f08b97fa640 1 -- 172.21.15.87:0/5633600 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f08b4054f30 con 0x7f08bc1538f0 2023-12-16T20:49:07.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.884+0000 7f08c2eee640 1 -- 172.21.15.87:0/5633600 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f08bc1efb60 con 0x7f08bc1538f0 2023-12-16T20:49:07.895 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.894+0000 7f08b97fa640 1 -- 172.21.15.87:0/5633600 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f08b4058550 con 0x7f08bc1538f0 2023-12-16T20:49:07.895 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-12-16T20:49:07.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.896+0000 7f08c2eee640 1 -- 172.21.15.87:0/5633600 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f08a806ae90 msgr2=0x7f08a806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:07.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.896+0000 7f08c2eee640 1 --2- 172.21.15.87:0/5633600 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f08a806ae90 0x7f08a806d350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009aa0 tx=0x7f08ac009190 comp rx=0 tx=0).stop 2023-12-16T20:49:07.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.896+0000 7f08c2eee640 1 -- 172.21.15.87:0/5633600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08bc1538f0 msgr2=0x7f08bc14ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:07.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.896+0000 7f08c2eee640 1 --2- 172.21.15.87:0/5633600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08bc1538f0 0x7f08bc14ebe0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f08b400c7a0 tx=0x7f08b400cc60 comp rx=0 tx=0).stop 2023-12-16T20:49:07.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.896+0000 7f08c2eee640 1 -- 172.21.15.87:0/5633600 shutdown_connections 2023-12-16T20:49:07.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.896+0000 7f08c2eee640 1 --2- 172.21.15.87:0/5633600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08bc1538f0 0x7f08bc14ebe0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:07.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.896+0000 7f08c2eee640 1 --2- 172.21.15.87:0/5633600 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f08a806ae90 0x7f08a806d350 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:07.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.896+0000 7f08c2eee640 1 --2- 172.21.15.87:0/5633600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08bc0c7b90 0x7f08bc15a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:07.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.896+0000 7f08c2eee640 1 --2- 172.21.15.87:0/5633600 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f08bc06bb50 0x7f08bc156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:07.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.896+0000 7f08c2eee640 1 -- 172.21.15.87:0/5633600 >> 172.21.15.87:0/5633600 conn(0x7f08bc060f20 msgr2=0x7f08bc151cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:07.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.896+0000 7f08c2eee640 1 -- 172.21.15.87:0/5633600 shutdown_connections 2023-12-16T20:49:07.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:07.896+0000 7f08c2eee640 1 -- 172.21.15.87:0/5633600 wait complete. 2023-12-16T20:49:07.909 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T20:49:08.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.011+0000 7f52b1051640 1 Processor -- start 2023-12-16T20:49:08.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.011+0000 7f52b1051640 1 -- start start 2023-12-16T20:49:08.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.011+0000 7f52b1051640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f52ac153640 0x7f52ac153a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:08.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.011+0000 7f52b1051640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f52ac0c4810 0x7f52ac0c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:08.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.011+0000 7f52b1051640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ac06bba0 con 0x7f52ac0c4210 2023-12-16T20:49:08.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.011+0000 7f52b1051640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ac06be60 con 0x7f52ac0c4810 2023-12-16T20:49:08.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.011+0000 7f52b1051640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ac06c140 con 0x7f52ac153640 2023-12-16T20:49:08.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.012+0000 7f52aad9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f52ac153640 0x7f52ac153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:08.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.012+0000 7f52aad9d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f52ac153640 0x7f52ac153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:40282/0 (socket says 172.21.15.87:40282) 2023-12-16T20:49:08.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.012+0000 7f52aad9d640 1 -- 172.21.15.87:0/627084181 learned_addr learned my addr 172.21.15.87:0/627084181 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:08.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.015+0000 7f52aad9d640 1 -- 172.21.15.87:0/627084181 >> v2:172.21.15.87:3300/0 conn(0x7f52ac0c4810 msgr2=0x7f52ac0c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:08.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.015+0000 7f52aad9d640 1 --2- 172.21.15.87:0/627084181 >> v2:172.21.15.87:3300/0 conn(0x7f52ac0c4810 0x7f52ac0c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:08.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.015+0000 7f52aad9d640 1 -- 172.21.15.87:0/627084181 >> v1:172.21.15.195:6789/0 conn(0x7f52ac0c4210 legacy=0x7f52ac15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:08.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.015+0000 7f52aad9d640 1 -- 172.21.15.87:0/627084181 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac06c420 con 0x7f52ac153640 2023-12-16T20:49:08.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.018+0000 7f52aad9d640 1 --2- 172.21.15.87:0/627084181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52ac153640 0x7f52ac153a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0cc8c0 tx=0x7f529c02ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14bf711876369184 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:08.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.022+0000 7f52a9d9b640 1 -- 172.21.15.87:0/627084181 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c02f850 con 0x7f52ac153640 2023-12-16T20:49:08.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.022+0000 7f52a9d9b640 1 -- 172.21.15.87:0/627084181 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c02f9b0 con 0x7f52ac153640 2023-12-16T20:49:08.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.022+0000 7f52a9d9b640 1 -- 172.21.15.87:0/627084181 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c02fd40 con 0x7f52ac153640 2023-12-16T20:49:08.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.023+0000 7f52b1051640 1 -- 172.21.15.87:0/627084181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52ac153640 msgr2=0x7f52ac153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:08.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.023+0000 7f52b1051640 1 --2- 172.21.15.87:0/627084181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52ac153640 0x7f52ac153a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0cc8c0 tx=0x7f529c02ba30 comp rx=0 tx=0).stop 2023-12-16T20:49:08.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.023+0000 7f52b1051640 1 -- 172.21.15.87:0/627084181 shutdown_connections 2023-12-16T20:49:08.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.023+0000 7f52b1051640 1 --2- 172.21.15.87:0/627084181 >> v2:172.21.15.87:3300/0 conn(0x7f52ac0c4810 0x7f52ac0c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:08.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.023+0000 7f52b1051640 1 --2- 172.21.15.87:0/627084181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52ac153640 0x7f52ac153a20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:08.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.023+0000 7f52b1051640 1 -- 172.21.15.87:0/627084181 >> 172.21.15.87:0/627084181 conn(0x7f52ac08b610 msgr2=0x7f52ac060f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:08.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.023+0000 7f52b1051640 1 -- 172.21.15.87:0/627084181 shutdown_connections 2023-12-16T20:49:08.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.023+0000 7f52b1051640 1 -- 172.21.15.87:0/627084181 wait complete. 2023-12-16T20:49:08.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.024+0000 7f52b1051640 1 Processor -- start 2023-12-16T20:49:08.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.024+0000 7f52b1051640 1 -- start start 2023-12-16T20:49:08.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.025+0000 7f52b1051640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52ac0c4210 0x7f52ac0cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:08.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.025+0000 7f52b1051640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52ac0c4810 0x7f52ac1f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:08.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.025+0000 7f52b1051640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52ac153640 0x7f52ac0c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:08.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.025+0000 7f52b1051640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac0c8550 con 0x7f52ac0c4210 2023-12-16T20:49:08.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.025+0000 7f52b1051640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac0c6280 con 0x7f52ac0c4810 2023-12-16T20:49:08.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.025+0000 7f52b1051640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac0c6560 con 0x7f52ac153640 2023-12-16T20:49:08.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.026+0000 7f52aa59c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52ac0c4810 0x7f52ac1f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:08.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.026+0000 7f52aad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52ac0c4210 0x7f52ac0cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:08.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.026+0000 7f52aa59c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52ac0c4810 0x7f52ac1f2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:40292/0 (socket says 172.21.15.87:40292) 2023-12-16T20:49:08.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.026+0000 7f52aa59c640 1 -- 172.21.15.87:0/3587818598 learned_addr learned my addr 172.21.15.87:0/3587818598 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:08.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.026+0000 7f52ab59e640 1 --2- 172.21.15.87:0/3587818598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52ac153640 0x7f52ac0c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:08.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.029+0000 7f52aa59c640 1 -- 172.21.15.87:0/3587818598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52ac153640 msgr2=0x7f52ac0c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:08.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.029+0000 7f52aa59c640 1 --2- 172.21.15.87:0/3587818598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52ac153640 0x7f52ac0c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:08.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.029+0000 7f52aa59c640 1 -- 172.21.15.87:0/3587818598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52ac0c4210 msgr2=0x7f52ac0cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:08.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.029+0000 7f52aa59c640 1 --2- 172.21.15.87:0/3587818598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52ac0c4210 0x7f52ac0cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:08.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.029+0000 7f52aa59c640 1 -- 172.21.15.87:0/3587818598 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c0094d0 con 0x7f52ac0c4810 2023-12-16T20:49:08.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.032+0000 7f52aa59c640 1 --2- 172.21.15.87:0/3587818598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52ac0c4810 0x7f52ac1f2bb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f52a000c3c0 tx=0x7f52a000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:08.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.036+0000 7f52937fe640 1 -- 172.21.15.87:0/3587818598 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a00052d0 con 0x7f52ac0c4810 2023-12-16T20:49:08.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.036+0000 7f52937fe640 1 -- 172.21.15.87:0/3587818598 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a0005470 con 0x7f52ac0c4810 2023-12-16T20:49:08.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.036+0000 7f52937fe640 1 -- 172.21.15.87:0/3587818598 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a0006a60 con 0x7f52ac0c4810 2023-12-16T20:49:08.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.036+0000 7f52b1051640 1 -- 172.21.15.87:0/3587818598 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ac0c6840 con 0x7f52ac0c4810 2023-12-16T20:49:08.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.036+0000 7f52b1051640 1 -- 172.21.15.87:0/3587818598 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ac0c8a40 con 0x7f52ac0c4810 2023-12-16T20:49:08.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.037+0000 7f52b1051640 1 -- 172.21.15.87:0/3587818598 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ac0c6a60 con 0x7f52ac0c4810 2023-12-16T20:49:08.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.281+0000 7f52937fe640 1 -- 172.21.15.87:0/3587818598 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f52a0006bc0 con 0x7f52ac0c4810 2023-12-16T20:49:08.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.282+0000 7f52937fe640 1 --2- 172.21.15.87:0/3587818598 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f529806ae40 0x7f529806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:08.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.282+0000 7f52aad9d640 1 --2- 172.21.15.87:0/3587818598 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f529806ae40 0x7f529806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:08.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.282+0000 7f52aad9d640 1 --2- 172.21.15.87:0/3587818598 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f529806ae40 0x7f529806d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f529c036000 tx=0x7f529c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:08.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.285+0000 7f52937fe640 1 -- 172.21.15.87:0/3587818598 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f52a0057f20 con 0x7f52ac0c4810 2023-12-16T20:49:08.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.294+0000 7f52937fe640 1 -- 172.21.15.87:0/3587818598 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f52a0054260 con 0x7f52ac0c4810 2023-12-16T20:49:08.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.479+0000 7f52b1051640 1 -- 172.21.15.87:0/3587818598 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f52ac0740e0 con 0x7f52ac0c4810 2023-12-16T20:49:08.520 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.519+0000 7f52937fe640 1 -- 172.21.15.87:0/3587818598 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f52a0020070 con 0x7f52ac0c4810 2023-12-16T20:49:08.520 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2023-12-16T20:49:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.521+0000 7f52b1051640 1 -- 172.21.15.87:0/3587818598 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f529806ae40 msgr2=0x7f529806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.521+0000 7f52b1051640 1 --2- 172.21.15.87:0/3587818598 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f529806ae40 0x7f529806d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f529c036000 tx=0x7f529c008030 comp rx=0 tx=0).stop 2023-12-16T20:49:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.521+0000 7f52b1051640 1 -- 172.21.15.87:0/3587818598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52ac0c4810 msgr2=0x7f52ac1f2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.521+0000 7f52b1051640 1 --2- 172.21.15.87:0/3587818598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52ac0c4810 0x7f52ac1f2bb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f52a000c3c0 tx=0x7f52a000c880 comp rx=0 tx=0).stop 2023-12-16T20:49:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.521+0000 7f52b1051640 1 -- 172.21.15.87:0/3587818598 shutdown_connections 2023-12-16T20:49:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.521+0000 7f52b1051640 1 --2- 172.21.15.87:0/3587818598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52ac153640 0x7f52ac0c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.521+0000 7f52b1051640 1 --2- 172.21.15.87:0/3587818598 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f529806ae40 0x7f529806d300 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.521+0000 7f52b1051640 1 --2- 172.21.15.87:0/3587818598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52ac0c4810 0x7f52ac1f2bb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.521+0000 7f52b1051640 1 --2- 172.21.15.87:0/3587818598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52ac0c4210 0x7f52ac0cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.521+0000 7f52b1051640 1 -- 172.21.15.87:0/3587818598 >> 172.21.15.87:0/3587818598 conn(0x7f52ac08b610 msgr2=0x7f52ac0ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:08.523 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.521+0000 7f52b1051640 1 -- 172.21.15.87:0/3587818598 shutdown_connections 2023-12-16T20:49:08.523 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:08.521+0000 7f52b1051640 1 -- 172.21.15.87:0/3587818598 wait complete. 2023-12-16T20:49:08.533 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2023-12-16T20:49:08.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:49:08.533 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-16T20:49:08.560 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:49:08.584 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[97634]: fuse finished with error 0 and tester_r 0 2023-12-16T20:49:09.087 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:==00:00:26:45.463 97634== 2023-12-16T20:49:09.087 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:==00:00:26:45.463 97634== Exit program on first error (--exit-on-first-error=yes) 2023-12-16T20:49:09.172 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:daemon-helper: command failed with exit status 42 2023-12-16T20:49:14.662 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-16T20:49:14.663 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2023-12-16T20:49:14.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:49:14.663 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-16T20:49:14.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:49:14.679 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2023-12-16T20:49:14.735 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-16T20:49:14.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:49:14.736 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T20:49:14.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T20:49:14.825 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2023-12-16T20:49:14.921 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-16T20:49:14.930 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-16T20:49:14.930 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T20:49:15.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.030+0000 7f707249b640 1 Processor -- start 2023-12-16T20:49:15.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.030+0000 7f707249b640 1 -- start start 2023-12-16T20:49:15.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.031+0000 7f707249b640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f706c1501c0 0x7f706c159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:15.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.031+0000 7f707249b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f706c156e60 0x7f706c071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:15.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.031+0000 7f707249b640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706c072b60 con 0x7f706c0bff00 2023-12-16T20:49:15.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.031+0000 7f707249b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706c1572d0 con 0x7f706c156e60 2023-12-16T20:49:15.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.031+0000 7f707249b640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706c0c1a90 con 0x7f706c1501c0 2023-12-16T20:49:15.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.031+0000 7f7070a38640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f706c156e60 0x7f706c071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:15.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.031+0000 7f706bfff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f706c1501c0 0x7f706c159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:15.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.032+0000 7f7070a38640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f706c156e60 0x7f706c071710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44700/0 (socket says 172.21.15.87:44700) 2023-12-16T20:49:15.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.032+0000 7f7070a38640 1 -- 172.21.15.87:0/3570346628 learned_addr learned my addr 172.21.15.87:0/3570346628 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:15.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.034+0000 7f7070a38640 1 -- 172.21.15.87:0/3570346628 >> v2:172.21.15.195:3300/0 conn(0x7f706c1501c0 msgr2=0x7f706c159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:15.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.034+0000 7f7070a38640 1 --2- 172.21.15.87:0/3570346628 >> v2:172.21.15.195:3300/0 conn(0x7f706c1501c0 0x7f706c159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:15.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.034+0000 7f7070a38640 1 -- 172.21.15.87:0/3570346628 >> v1:172.21.15.195:6789/0 conn(0x7f706c0bff00 legacy=0x7f706c072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:15.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.034+0000 7f7070a38640 1 -- 172.21.15.87:0/3570346628 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c0c1d30 con 0x7f706c156e60 2023-12-16T20:49:15.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.036+0000 7f7070a38640 1 --2- 172.21.15.87:0/3570346628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f706c156e60 0x7f706c071710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f706c0cbad0 tx=0x7f706402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacd9babb61ad086 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:15.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.039+0000 7f706affd640 1 -- 172.21.15.87:0/3570346628 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706402cbb0 con 0x7f706c156e60 2023-12-16T20:49:15.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.039+0000 7f706affd640 1 -- 172.21.15.87:0/3570346628 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706402cd10 con 0x7f706c156e60 2023-12-16T20:49:15.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.039+0000 7f706affd640 1 -- 172.21.15.87:0/3570346628 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7064034610 con 0x7f706c156e60 2023-12-16T20:49:15.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.040+0000 7f707249b640 1 -- 172.21.15.87:0/3570346628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f706c156e60 msgr2=0x7f706c071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:15.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.040+0000 7f707249b640 1 --2- 172.21.15.87:0/3570346628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f706c156e60 0x7f706c071710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f706c0cbad0 tx=0x7f706402c010 comp rx=0 tx=0).stop 2023-12-16T20:49:15.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.040+0000 7f707249b640 1 -- 172.21.15.87:0/3570346628 shutdown_connections 2023-12-16T20:49:15.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.040+0000 7f707249b640 1 --2- 172.21.15.87:0/3570346628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f706c156e60 0x7f706c071710 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:15.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.040+0000 7f707249b640 1 --2- 172.21.15.87:0/3570346628 >> v2:172.21.15.195:3300/0 conn(0x7f706c1501c0 0x7f706c159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:15.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.040+0000 7f707249b640 1 -- 172.21.15.87:0/3570346628 >> 172.21.15.87:0/3570346628 conn(0x7f706c06cd60 msgr2=0x7f706c06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:15.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.040+0000 7f707249b640 1 -- 172.21.15.87:0/3570346628 shutdown_connections 2023-12-16T20:49:15.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.040+0000 7f707249b640 1 -- 172.21.15.87:0/3570346628 wait complete. 2023-12-16T20:49:15.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.041+0000 7f707249b640 1 Processor -- start 2023-12-16T20:49:15.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.042+0000 7f707249b640 1 -- start start 2023-12-16T20:49:15.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.042+0000 7f707249b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f706c0bff00 0x7f706c151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:15.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.042+0000 7f707249b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f706c1501c0 0x7f706c14ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:15.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.042+0000 7f707249b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f706c156e60 0x7f706c1ebb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:15.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.042+0000 7f707249b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c153a50 con 0x7f706c1501c0 2023-12-16T20:49:15.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.042+0000 7f707249b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c152e60 con 0x7f706c0bff00 2023-12-16T20:49:15.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.042+0000 7f707249b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706c0c8ce0 con 0x7f706c156e60 2023-12-16T20:49:15.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.043+0000 7f706b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f706c1501c0 0x7f706c14ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:15.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.043+0000 7f706b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f706c1501c0 0x7f706c14ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44712/0 (socket says 172.21.15.87:44712) 2023-12-16T20:49:15.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.043+0000 7f706b7fe640 1 -- 172.21.15.87:0/2428002091 learned_addr learned my addr 172.21.15.87:0/2428002091 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:15.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.043+0000 7f7070a38640 1 --2- 172.21.15.87:0/2428002091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f706c156e60 0x7f706c1ebb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:15.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.043+0000 7f706bfff640 1 --2- 172.21.15.87:0/2428002091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f706c0bff00 0x7f706c151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:15.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.046+0000 7f706b7fe640 1 -- 172.21.15.87:0/2428002091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f706c156e60 msgr2=0x7f706c1ebb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:15.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.046+0000 7f706b7fe640 1 --2- 172.21.15.87:0/2428002091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f706c156e60 0x7f706c1ebb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:15.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.046+0000 7f706b7fe640 1 -- 172.21.15.87:0/2428002091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f706c0bff00 msgr2=0x7f706c151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:15.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.046+0000 7f706b7fe640 1 --2- 172.21.15.87:0/2428002091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f706c0bff00 0x7f706c151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:15.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.046+0000 7f706b7fe640 1 -- 172.21.15.87:0/2428002091 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7064009b30 con 0x7f706c1501c0 2023-12-16T20:49:15.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.048+0000 7f706b7fe640 1 --2- 172.21.15.87:0/2428002091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f706c1501c0 0x7f706c14ec50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f706000c400 tx=0x7f706000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:15.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.050+0000 7f7068ff9640 1 -- 172.21.15.87:0/2428002091 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70600052d0 con 0x7f706c1501c0 2023-12-16T20:49:15.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.050+0000 7f707249b640 1 -- 172.21.15.87:0/2428002091 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706c0c8fa0 con 0x7f706c1501c0 2023-12-16T20:49:15.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.050+0000 7f707249b640 1 -- 172.21.15.87:0/2428002091 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706c153390 con 0x7f706c1501c0 2023-12-16T20:49:15.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.051+0000 7f707249b640 1 -- 172.21.15.87:0/2428002091 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706c0c77e0 con 0x7f706c1501c0 2023-12-16T20:49:15.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.052+0000 7f7068ff9640 1 -- 172.21.15.87:0/2428002091 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7060005430 con 0x7f706c1501c0 2023-12-16T20:49:15.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.052+0000 7f7068ff9640 1 -- 172.21.15.87:0/2428002091 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7060007240 con 0x7f706c1501c0 2023-12-16T20:49:15.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.294+0000 7f7068ff9640 1 -- 172.21.15.87:0/2428002091 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f70600073a0 con 0x7f706c1501c0 2023-12-16T20:49:15.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.294+0000 7f7068ff9640 1 --2- 172.21.15.87:0/2428002091 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f705806ae40 0x7f705806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:15.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.294+0000 7f706bfff640 1 --2- 172.21.15.87:0/2428002091 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f705806ae40 0x7f705806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:15.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.295+0000 7f706bfff640 1 --2- 172.21.15.87:0/2428002091 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f705806ae40 0x7f705806d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f705c009b40 tx=0x7f705c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:15.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.307+0000 7f7068ff9640 1 -- 172.21.15.87:0/2428002091 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7060007650 con 0x7f706c1501c0 2023-12-16T20:49:15.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.307+0000 7f7068ff9640 1 -- 172.21.15.87:0/2428002091 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f7060054020 con 0x7f706c1501c0 2023-12-16T20:49:15.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.469+0000 7f707249b640 1 -- 172.21.15.87:0/2428002091 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f706c14bca0 con 0x7f705806ae40 2023-12-16T20:49:15.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.479+0000 7f7068ff9640 1 -- 172.21.15.87:0/2428002091 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371496 (secure 0 0 0) 0x7f706c14bca0 con 0x7f705806ae40 2023-12-16T20:49:15.484 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:49:15.487 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-12-16T20:49:15.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.483+0000 7f707249b640 1 -- 172.21.15.87:0/2428002091 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f705806ae40 msgr2=0x7f705806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:15.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.483+0000 7f707249b640 1 --2- 172.21.15.87:0/2428002091 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f705806ae40 0x7f705806d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f705c009b40 tx=0x7f705c009190 comp rx=0 tx=0).stop 2023-12-16T20:49:15.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.483+0000 7f707249b640 1 -- 172.21.15.87:0/2428002091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f706c1501c0 msgr2=0x7f706c14ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:15.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.483+0000 7f707249b640 1 --2- 172.21.15.87:0/2428002091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f706c1501c0 0x7f706c14ec50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f706000c400 tx=0x7f706000c8c0 comp rx=0 tx=0).stop 2023-12-16T20:49:15.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.483+0000 7f707249b640 1 -- 172.21.15.87:0/2428002091 shutdown_connections 2023-12-16T20:49:15.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.483+0000 7f707249b640 1 --2- 172.21.15.87:0/2428002091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f706c156e60 0x7f706c1ebb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:15.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.483+0000 7f707249b640 1 --2- 172.21.15.87:0/2428002091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f706c1501c0 0x7f706c14ec50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:15.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.483+0000 7f707249b640 1 --2- 172.21.15.87:0/2428002091 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f705806ae40 0x7f705806d300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:15.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.483+0000 7f707249b640 1 --2- 172.21.15.87:0/2428002091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f706c0bff00 0x7f706c151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:15.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.483+0000 7f707249b640 1 -- 172.21.15.87:0/2428002091 >> 172.21.15.87:0/2428002091 conn(0x7f706c06cd60 msgr2=0x7f706c0c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:15.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.483+0000 7f707249b640 1 -- 172.21.15.87:0/2428002091 shutdown_connections 2023-12-16T20:49:15.490 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.483+0000 7f707249b640 1 -- 172.21.15.87:0/2428002091 wait complete. 2023-12-16T20:49:15.494 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":857,"stamp":"2023-12-16T20:49:14.645981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41060283,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1154,"num_read_kb":1198,"num_write":13351,"num_write_kb":371526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15840,"ondisk_log_size":15840,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":431648,"kb_used_data":57312,"kb_used_omap":12,"kb_used_meta":374259,"kb_avail":754543072,"statfs":{"total":773094113280,"available":772652105728,"internally_reserved":0,"allocated":58687488,"data_stored":83068718,"data_compressed":7551796,"data_compressed_allocated":11804672,"data_compressed_original":37634048,"omap_allocated":12751,"internal_metadata":383241777},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19037,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":18,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003182"},"pg_stats":[{"pgid":"2.1f","version":"27'642","reported_seq":673,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:50.514980+0000","last_change":"2023-12-16T20:21:35.413343+0000","last_active":"2023-12-16T20:48:50.514980+0000","last_peered":"2023-12-16T20:48:50.514980+0000","last_clean":"2023-12-16T20:48:50.514980+0000","last_became_active":"2023-12-16T20:21:35.413075+0000","last_became_peered":"2023-12-16T20:21:35.413075+0000","last_unstale":"2023-12-16T20:48:50.514980+0000","last_undegraded":"2023-12-16T20:48:50.514980+0000","last_fullsized":"2023-12-16T20:48:50.514980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'31","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.790583+0000","last_change":"2023-12-16T20:21:36.542907+0000","last_active":"2023-12-16T20:49:08.790583+0000","last_peered":"2023-12-16T20:49:08.790583+0000","last_clean":"2023-12-16T20:49:08.790583+0000","last_became_active":"2023-12-16T20:21:36.542667+0000","last_became_peered":"2023-12-16T20:21:36.542667+0000","last_unstale":"2023-12-16T20:49:08.790583+0000","last_undegraded":"2023-12-16T20:49:08.790583+0000","last_fullsized":"2023-12-16T20:49:08.790583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'182","reported_seq":208,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.469341+0000","last_change":"2023-12-16T20:21:41.216466+0000","last_active":"2023-12-16T20:48:41.469341+0000","last_peered":"2023-12-16T20:48:41.469341+0000","last_clean":"2023-12-16T20:48:41.469341+0000","last_became_active":"2023-12-16T20:21:41.216062+0000","last_became_peered":"2023-12-16T20:21:41.216062+0000","last_unstale":"2023-12-16T20:48:41.469341+0000","last_undegraded":"2023-12-16T20:48:41.469341+0000","last_fullsized":"2023-12-16T20:48:41.469341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:33:01.663841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":13331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'710","reported_seq":741,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:47:41.528829+0000","last_change":"2023-12-16T20:21:35.420038+0000","last_active":"2023-12-16T20:47:41.528829+0000","last_peered":"2023-12-16T20:47:41.528829+0000","last_clean":"2023-12-16T20:47:41.528829+0000","last_became_active":"2023-12-16T20:21:35.419745+0000","last_became_peered":"2023-12-16T20:21:35.419745+0000","last_unstale":"2023-12-16T20:47:41.528829+0000","last_undegraded":"2023-12-16T20:47:41.528829+0000","last_fullsized":"2023-12-16T20:47:41.528829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'38","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.972297+0000","last_change":"2023-12-16T20:21:36.552916+0000","last_active":"2023-12-16T20:49:08.972297+0000","last_peered":"2023-12-16T20:49:08.972297+0000","last_clean":"2023-12-16T20:49:08.972297+0000","last_became_active":"2023-12-16T20:21:36.552621+0000","last_became_peered":"2023-12-16T20:21:36.552621+0000","last_unstale":"2023-12-16T20:49:08.972297+0000","last_undegraded":"2023-12-16T20:49:08.972297+0000","last_fullsized":"2023-12-16T20:49:08.972297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'122","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:38.770349+0000","last_change":"2023-12-16T20:21:40.754959+0000","last_active":"2023-12-16T20:48:38.770349+0000","last_peered":"2023-12-16T20:48:38.770349+0000","last_clean":"2023-12-16T20:48:38.770349+0000","last_became_active":"2023-12-16T20:21:40.754509+0000","last_became_peered":"2023-12-16T20:21:40.754509+0000","last_unstale":"2023-12-16T20:48:38.770349+0000","last_undegraded":"2023-12-16T20:48:38.770349+0000","last_fullsized":"2023-12-16T20:48:38.770349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:21.787809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1392","reported_seq":1421,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:01.711787+0000","last_change":"2023-12-16T20:21:35.427622+0000","last_active":"2023-12-16T20:49:01.711787+0000","last_peered":"2023-12-16T20:49:01.711787+0000","last_clean":"2023-12-16T20:49:01.711787+0000","last_became_active":"2023-12-16T20:21:35.427317+0000","last_became_peered":"2023-12-16T20:21:35.427317+0000","last_unstale":"2023-12-16T20:49:01.711787+0000","last_undegraded":"2023-12-16T20:49:01.711787+0000","last_fullsized":"2023-12-16T20:49:01.711787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1392,"log_dups_size":0,"ondisk_log_size":1392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":9004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'33","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.888259+0000","last_change":"2023-12-16T20:22:14.769257+0000","last_active":"2023-12-16T20:49:08.888259+0000","last_peered":"2023-12-16T20:49:08.888259+0000","last_clean":"2023-12-16T20:49:08.888259+0000","last_became_active":"2023-12-16T20:22:14.768968+0000","last_became_peered":"2023-12-16T20:22:14.768968+0000","last_unstale":"2023-12-16T20:49:08.888259+0000","last_undegraded":"2023-12-16T20:49:08.888259+0000","last_fullsized":"2023-12-16T20:49:08.888259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"27'156","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.509449+0000","last_change":"2023-12-16T20:22:14.820429+0000","last_active":"2023-12-16T20:48:41.509449+0000","last_peered":"2023-12-16T20:48:41.509449+0000","last_clean":"2023-12-16T20:48:41.509449+0000","last_became_active":"2023-12-16T20:22:14.819924+0000","last_became_peered":"2023-12-16T20:22:14.819924+0000","last_unstale":"2023-12-16T20:48:41.509449+0000","last_undegraded":"2023-12-16T20:48:41.509449+0000","last_fullsized":"2023-12-16T20:48:41.509449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:10:42.982067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":12476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:59.710315+0000","last_change":"2023-12-16T20:21:35.413521+0000","last_active":"2023-12-16T20:48:59.710315+0000","last_peered":"2023-12-16T20:48:59.710315+0000","last_clean":"2023-12-16T20:48:59.710315+0000","last_became_active":"2023-12-16T20:21:35.413234+0000","last_became_peered":"2023-12-16T20:21:35.413234+0000","last_unstale":"2023-12-16T20:48:59.710315+0000","last_undegraded":"2023-12-16T20:48:59.710315+0000","last_fullsized":"2023-12-16T20:48:59.710315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'49","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.819877+0000","last_change":"2023-12-16T20:21:36.554419+0000","last_active":"2023-12-16T20:49:08.819877+0000","last_peered":"2023-12-16T20:49:08.819877+0000","last_clean":"2023-12-16T20:49:08.819877+0000","last_became_active":"2023-12-16T20:21:36.554014+0000","last_became_peered":"2023-12-16T20:21:36.554014+0000","last_unstale":"2023-12-16T20:49:08.819877+0000","last_undegraded":"2023-12-16T20:49:08.819877+0000","last_fullsized":"2023-12-16T20:49:08.819877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:03.543973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'146","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.419020+0000","last_change":"2023-12-16T20:21:40.794852+0000","last_active":"2023-12-16T20:48:41.419020+0000","last_peered":"2023-12-16T20:48:41.419020+0000","last_clean":"2023-12-16T20:48:41.419020+0000","last_became_active":"2023-12-16T20:21:40.794471+0000","last_became_peered":"2023-12-16T20:21:40.794471+0000","last_unstale":"2023-12-16T20:48:41.419020+0000","last_undegraded":"2023-12-16T20:48:41.419020+0000","last_fullsized":"2023-12-16T20:48:41.419020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:25.004850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'39","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.890251+0000","last_change":"2023-12-16T20:21:36.542450+0000","last_active":"2023-12-16T20:49:08.890251+0000","last_peered":"2023-12-16T20:49:08.890251+0000","last_clean":"2023-12-16T20:49:08.890251+0000","last_became_active":"2023-12-16T20:21:36.542157+0000","last_became_peered":"2023-12-16T20:21:36.542157+0000","last_unstale":"2023-12-16T20:49:08.890251+0000","last_undegraded":"2023-12-16T20:49:08.890251+0000","last_fullsized":"2023-12-16T20:49:08.890251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'680","reported_seq":710,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:01.713499+0000","last_change":"2023-12-16T20:21:35.413681+0000","last_active":"2023-12-16T20:49:01.713499+0000","last_peered":"2023-12-16T20:49:01.713499+0000","last_clean":"2023-12-16T20:49:01.713499+0000","last_became_active":"2023-12-16T20:21:35.413400+0000","last_became_peered":"2023-12-16T20:21:35.413400+0000","last_unstale":"2023-12-16T20:49:01.713499+0000","last_undegraded":"2023-12-16T20:49:01.713499+0000","last_fullsized":"2023-12-16T20:49:01.713499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:27.767422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":4429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'121","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.504489+0000","last_change":"2023-12-16T20:21:40.745971+0000","last_active":"2023-12-16T20:48:41.504489+0000","last_peered":"2023-12-16T20:48:41.504489+0000","last_clean":"2023-12-16T20:48:41.504489+0000","last_became_active":"2023-12-16T20:21:40.745544+0000","last_became_peered":"2023-12-16T20:21:40.745544+0000","last_unstale":"2023-12-16T20:48:41.504489+0000","last_undegraded":"2023-12-16T20:48:41.504489+0000","last_fullsized":"2023-12-16T20:48:41.504489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:18.981353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":10860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'38","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796186+0000","last_change":"2023-12-16T20:21:36.526277+0000","last_active":"2023-12-16T20:49:08.796186+0000","last_peered":"2023-12-16T20:49:08.796186+0000","last_clean":"2023-12-16T20:49:08.796186+0000","last_became_active":"2023-12-16T20:21:36.525983+0000","last_became_peered":"2023-12-16T20:21:36.525983+0000","last_unstale":"2023-12-16T20:49:08.796186+0000","last_undegraded":"2023-12-16T20:49:08.796186+0000","last_fullsized":"2023-12-16T20:49:08.796186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:56.620523+0000","last_change":"2023-12-16T20:21:35.420017+0000","last_active":"2023-12-16T20:48:56.620523+0000","last_peered":"2023-12-16T20:48:56.620523+0000","last_clean":"2023-12-16T20:48:56.620523+0000","last_became_active":"2023-12-16T20:21:35.419731+0000","last_became_peered":"2023-12-16T20:21:35.419731+0000","last_unstale":"2023-12-16T20:48:56.620523+0000","last_undegraded":"2023-12-16T20:48:56.620523+0000","last_fullsized":"2023-12-16T20:48:56.620523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:29.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'169","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.507104+0000","last_change":"2023-12-16T20:21:40.755335+0000","last_active":"2023-12-16T20:48:41.507104+0000","last_peered":"2023-12-16T20:48:41.507104+0000","last_clean":"2023-12-16T20:48:41.507104+0000","last_became_active":"2023-12-16T20:21:40.754829+0000","last_became_peered":"2023-12-16T20:21:40.754829+0000","last_unstale":"2023-12-16T20:48:41.507104+0000","last_undegraded":"2023-12-16T20:48:41.507104+0000","last_fullsized":"2023-12-16T20:48:41.507104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":10412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'38","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.797002+0000","last_change":"2023-12-16T20:21:36.518939+0000","last_active":"2023-12-16T20:49:08.797002+0000","last_peered":"2023-12-16T20:49:08.797002+0000","last_clean":"2023-12-16T20:49:08.797002+0000","last_became_active":"2023-12-16T20:21:36.518686+0000","last_became_peered":"2023-12-16T20:21:36.518686+0000","last_unstale":"2023-12-16T20:49:08.797002+0000","last_undegraded":"2023-12-16T20:49:08.797002+0000","last_fullsized":"2023-12-16T20:49:08.797002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:44.395374+0000","last_change":"2023-12-16T20:21:35.416372+0000","last_active":"2023-12-16T20:48:44.395374+0000","last_peered":"2023-12-16T20:48:44.395374+0000","last_clean":"2023-12-16T20:48:44.395374+0000","last_became_active":"2023-12-16T20:21:35.416067+0000","last_became_peered":"2023-12-16T20:21:35.416067+0000","last_unstale":"2023-12-16T20:48:44.395374+0000","last_undegraded":"2023-12-16T20:48:44.395374+0000","last_fullsized":"2023-12-16T20:48:44.395374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:37.215505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'126","reported_seq":153,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:37.734776+0000","last_change":"2023-12-16T20:21:41.215250+0000","last_active":"2023-12-16T20:48:37.734776+0000","last_peered":"2023-12-16T20:48:37.734776+0000","last_clean":"2023-12-16T20:48:37.734776+0000","last_became_active":"2023-12-16T20:21:41.214198+0000","last_became_peered":"2023-12-16T20:21:41.214198+0000","last_unstale":"2023-12-16T20:48:37.734776+0000","last_undegraded":"2023-12-16T20:48:37.734776+0000","last_fullsized":"2023-12-16T20:48:37.734776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:41.263768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":7034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'34","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.238701+0000","last_change":"2023-12-16T20:21:36.536797+0000","last_active":"2023-12-16T20:48:39.238701+0000","last_peered":"2023-12-16T20:48:39.238701+0000","last_clean":"2023-12-16T20:48:39.238701+0000","last_became_active":"2023-12-16T20:21:36.536321+0000","last_became_peered":"2023-12-16T20:21:36.536321+0000","last_unstale":"2023-12-16T20:48:39.238701+0000","last_undegraded":"2023-12-16T20:48:39.238701+0000","last_fullsized":"2023-12-16T20:48:39.238701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:55:55.607439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:57.613311+0000","last_change":"2023-12-16T20:21:35.425939+0000","last_active":"2023-12-16T20:48:57.613311+0000","last_peered":"2023-12-16T20:48:57.613311+0000","last_clean":"2023-12-16T20:48:57.613311+0000","last_became_active":"2023-12-16T20:21:35.420547+0000","last_became_peered":"2023-12-16T20:21:35.420547+0000","last_unstale":"2023-12-16T20:48:57.613311+0000","last_undegraded":"2023-12-16T20:48:57.613311+0000","last_fullsized":"2023-12-16T20:48:57.613311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:58:31.980302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'120","reported_seq":147,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.507092+0000","last_change":"2023-12-16T20:21:40.757445+0000","last_active":"2023-12-16T20:48:41.507092+0000","last_peered":"2023-12-16T20:48:41.507092+0000","last_clean":"2023-12-16T20:48:41.507092+0000","last_became_active":"2023-12-16T20:21:40.756997+0000","last_became_peered":"2023-12-16T20:21:40.756997+0000","last_unstale":"2023-12-16T20:48:41.507092+0000","last_undegraded":"2023-12-16T20:48:41.507092+0000","last_fullsized":"2023-12-16T20:48:41.507092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:32.702839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":6714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'40","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.970714+0000","last_change":"2023-12-16T20:21:36.524943+0000","last_active":"2023-12-16T20:49:08.970714+0000","last_peered":"2023-12-16T20:49:08.970714+0000","last_clean":"2023-12-16T20:49:08.970714+0000","last_became_active":"2023-12-16T20:21:36.524703+0000","last_became_peered":"2023-12-16T20:21:36.524703+0000","last_unstale":"2023-12-16T20:49:08.970714+0000","last_undegraded":"2023-12-16T20:49:08.970714+0000","last_fullsized":"2023-12-16T20:49:08.970714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:00.760340+0000","last_change":"2023-12-16T20:21:35.428736+0000","last_active":"2023-12-16T20:49:00.760340+0000","last_peered":"2023-12-16T20:49:00.760340+0000","last_clean":"2023-12-16T20:49:00.760340+0000","last_became_active":"2023-12-16T20:21:35.428465+0000","last_became_peered":"2023-12-16T20:21:35.428465+0000","last_unstale":"2023-12-16T20:49:00.760340+0000","last_undegraded":"2023-12-16T20:49:00.760340+0000","last_fullsized":"2023-12-16T20:49:00.760340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'152","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.504901+0000","last_change":"2023-12-16T20:21:41.213330+0000","last_active":"2023-12-16T20:48:41.504901+0000","last_peered":"2023-12-16T20:48:41.504901+0000","last_clean":"2023-12-16T20:48:41.504901+0000","last_became_active":"2023-12-16T20:21:41.212976+0000","last_became_peered":"2023-12-16T20:21:41.212976+0000","last_unstale":"2023-12-16T20:48:41.504901+0000","last_undegraded":"2023-12-16T20:48:41.504901+0000","last_fullsized":"2023-12-16T20:48:41.504901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:32:02.178544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":10330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'37","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.797154+0000","last_change":"2023-12-16T20:21:36.518956+0000","last_active":"2023-12-16T20:49:08.797154+0000","last_peered":"2023-12-16T20:49:08.797154+0000","last_clean":"2023-12-16T20:49:08.797154+0000","last_became_active":"2023-12-16T20:21:36.518673+0000","last_became_peered":"2023-12-16T20:21:36.518673+0000","last_unstale":"2023-12-16T20:49:08.797154+0000","last_undegraded":"2023-12-16T20:49:08.797154+0000","last_fullsized":"2023-12-16T20:49:08.797154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'310","reported_seq":340,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:05.580922+0000","last_change":"2023-12-16T20:21:35.423292+0000","last_active":"2023-12-16T20:49:05.580922+0000","last_peered":"2023-12-16T20:49:05.580922+0000","last_clean":"2023-12-16T20:49:05.580922+0000","last_became_active":"2023-12-16T20:21:35.423045+0000","last_became_peered":"2023-12-16T20:21:35.423045+0000","last_unstale":"2023-12-16T20:49:05.580922+0000","last_undegraded":"2023-12-16T20:49:05.580922+0000","last_fullsized":"2023-12-16T20:49:05.580922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":886,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'156","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.361966+0000","last_change":"2023-12-16T20:21:41.216113+0000","last_active":"2023-12-16T20:48:39.361966+0000","last_peered":"2023-12-16T20:48:39.361966+0000","last_clean":"2023-12-16T20:48:39.361966+0000","last_became_active":"2023-12-16T20:21:41.215747+0000","last_became_peered":"2023-12-16T20:21:41.215747+0000","last_unstale":"2023-12-16T20:48:39.361966+0000","last_undegraded":"2023-12-16T20:48:39.361966+0000","last_fullsized":"2023-12-16T20:48:39.361966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:10:17.859148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'35","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796438+0000","last_change":"2023-12-16T20:21:36.451660+0000","last_active":"2023-12-16T20:49:08.796438+0000","last_peered":"2023-12-16T20:49:08.796438+0000","last_clean":"2023-12-16T20:49:08.796438+0000","last_became_active":"2023-12-16T20:21:36.451404+0000","last_became_peered":"2023-12-16T20:21:36.451404+0000","last_unstale":"2023-12-16T20:49:08.796438+0000","last_undegraded":"2023-12-16T20:49:08.796438+0000","last_fullsized":"2023-12-16T20:49:08.796438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:47.488000+0000","last_change":"2023-12-16T20:21:35.420184+0000","last_active":"2023-12-16T20:48:47.488000+0000","last_peered":"2023-12-16T20:48:47.488000+0000","last_clean":"2023-12-16T20:48:47.488000+0000","last_became_active":"2023-12-16T20:21:35.419917+0000","last_became_peered":"2023-12-16T20:21:35.419917+0000","last_unstale":"2023-12-16T20:48:47.488000+0000","last_undegraded":"2023-12-16T20:48:47.488000+0000","last_fullsized":"2023-12-16T20:48:47.488000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:19.491578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'136","reported_seq":164,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:40.297506+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:48:40.297506+0000","last_peered":"2023-12-16T20:48:40.297506+0000","last_clean":"2023-12-16T20:48:40.297506+0000","last_became_active":"2023-12-16T20:21:41.212704+0000","last_became_peered":"2023-12-16T20:21:41.212704+0000","last_unstale":"2023-12-16T20:48:40.297506+0000","last_undegraded":"2023-12-16T20:48:40.297506+0000","last_fullsized":"2023-12-16T20:48:40.297506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:11.201128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":9011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'38","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820634+0000","last_change":"2023-12-16T20:21:36.555288+0000","last_active":"2023-12-16T20:49:08.820634+0000","last_peered":"2023-12-16T20:49:08.820634+0000","last_clean":"2023-12-16T20:49:08.820634+0000","last_became_active":"2023-12-16T20:21:36.555011+0000","last_became_peered":"2023-12-16T20:21:36.555011+0000","last_unstale":"2023-12-16T20:49:08.820634+0000","last_undegraded":"2023-12-16T20:49:08.820634+0000","last_fullsized":"2023-12-16T20:49:08.820634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:06.805922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:58.651724+0000","last_change":"2023-12-16T20:21:35.417945+0000","last_active":"2023-12-16T20:48:58.651724+0000","last_peered":"2023-12-16T20:48:58.651724+0000","last_clean":"2023-12-16T20:48:58.651724+0000","last_became_active":"2023-12-16T20:21:35.417683+0000","last_became_peered":"2023-12-16T20:21:35.417683+0000","last_unstale":"2023-12-16T20:48:58.651724+0000","last_undegraded":"2023-12-16T20:48:58.651724+0000","last_fullsized":"2023-12-16T20:48:58.651724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:18.427670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'180","reported_seq":208,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.512687+0000","last_change":"2023-12-16T20:21:40.794299+0000","last_active":"2023-12-16T20:48:41.512687+0000","last_peered":"2023-12-16T20:48:41.512687+0000","last_clean":"2023-12-16T20:48:41.512687+0000","last_became_active":"2023-12-16T20:21:40.793754+0000","last_became_peered":"2023-12-16T20:21:40.793754+0000","last_unstale":"2023-12-16T20:48:41.512687+0000","last_undegraded":"2023-12-16T20:48:41.512687+0000","last_fullsized":"2023-12-16T20:48:41.512687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:10.036962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":10123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'33","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820560+0000","last_change":"2023-12-16T20:21:36.534278+0000","last_active":"2023-12-16T20:49:08.820560+0000","last_peered":"2023-12-16T20:49:08.820560+0000","last_clean":"2023-12-16T20:49:08.820560+0000","last_became_active":"2023-12-16T20:21:36.533651+0000","last_became_peered":"2023-12-16T20:21:36.533651+0000","last_unstale":"2023-12-16T20:49:08.820560+0000","last_undegraded":"2023-12-16T20:49:08.820560+0000","last_fullsized":"2023-12-16T20:49:08.820560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:58:33.098369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'7","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:55.659121+0000","last_change":"2023-12-16T20:21:35.422128+0000","last_active":"2023-12-16T20:48:55.659121+0000","last_peered":"2023-12-16T20:48:55.659121+0000","last_clean":"2023-12-16T20:48:55.659121+0000","last_became_active":"2023-12-16T20:21:35.421875+0000","last_became_peered":"2023-12-16T20:21:35.421875+0000","last_unstale":"2023-12-16T20:48:55.659121+0000","last_undegraded":"2023-12-16T20:48:55.659121+0000","last_fullsized":"2023-12-16T20:48:55.659121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:24.569380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'112","reported_seq":140,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:33.903590+0000","last_change":"2023-12-16T20:21:40.754363+0000","last_active":"2023-12-16T20:48:33.903590+0000","last_peered":"2023-12-16T20:48:33.903590+0000","last_clean":"2023-12-16T20:48:33.903590+0000","last_became_active":"2023-12-16T20:21:40.753994+0000","last_became_peered":"2023-12-16T20:21:40.753994+0000","last_unstale":"2023-12-16T20:48:33.903590+0000","last_undegraded":"2023-12-16T20:48:33.903590+0000","last_fullsized":"2023-12-16T20:48:33.903590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:07.939178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'33","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.793432+0000","last_change":"2023-12-16T20:21:36.451488+0000","last_active":"2023-12-16T20:49:08.793432+0000","last_peered":"2023-12-16T20:49:08.793432+0000","last_clean":"2023-12-16T20:49:08.793432+0000","last_became_active":"2023-12-16T20:21:36.451231+0000","last_became_peered":"2023-12-16T20:21:36.451231+0000","last_unstale":"2023-12-16T20:49:08.793432+0000","last_undegraded":"2023-12-16T20:49:08.793432+0000","last_fullsized":"2023-12-16T20:49:08.793432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'1042","reported_seq":2111,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:02.716494+0000","last_change":"2023-12-16T20:21:35.420494+0000","last_active":"2023-12-16T20:49:02.716494+0000","last_peered":"2023-12-16T20:49:02.716494+0000","last_clean":"2023-12-16T20:49:02.716494+0000","last_became_active":"2023-12-16T20:21:35.420236+0000","last_became_peered":"2023-12-16T20:21:35.420236+0000","last_unstale":"2023-12-16T20:49:02.716494+0000","last_undegraded":"2023-12-16T20:49:02.716494+0000","last_fullsized":"2023-12-16T20:49:02.716494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1042,"log_dups_size":0,"ondisk_log_size":1042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:55:54.489373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222889,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1038,"num_read_kb":1098,"num_write":1039,"num_write_kb":1099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'134","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.367416+0000","last_change":"2023-12-16T20:22:14.842642+0000","last_active":"2023-12-16T20:48:39.367416+0000","last_peered":"2023-12-16T20:48:39.367416+0000","last_clean":"2023-12-16T20:48:39.367416+0000","last_became_active":"2023-12-16T20:22:14.842220+0000","last_became_peered":"2023-12-16T20:22:14.842220+0000","last_unstale":"2023-12-16T20:48:39.367416+0000","last_undegraded":"2023-12-16T20:48:39.367416+0000","last_fullsized":"2023-12-16T20:48:39.367416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":9129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"27'27","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.971875+0000","last_change":"2023-12-16T20:21:36.535835+0000","last_active":"2023-12-16T20:49:08.971875+0000","last_peered":"2023-12-16T20:49:08.971875+0000","last_clean":"2023-12-16T20:49:08.971875+0000","last_became_active":"2023-12-16T20:21:36.535571+0000","last_became_peered":"2023-12-16T20:21:36.535571+0000","last_unstale":"2023-12-16T20:49:08.971875+0000","last_undegraded":"2023-12-16T20:49:08.971875+0000","last_fullsized":"2023-12-16T20:49:08.971875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:54.719426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'544","reported_seq":575,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:57.613647+0000","last_change":"2023-12-16T20:21:35.418993+0000","last_active":"2023-12-16T20:48:57.613647+0000","last_peered":"2023-12-16T20:48:57.613647+0000","last_clean":"2023-12-16T20:48:57.613647+0000","last_became_active":"2023-12-16T20:21:35.418751+0000","last_became_peered":"2023-12-16T20:21:35.418751+0000","last_unstale":"2023-12-16T20:48:57.613647+0000","last_undegraded":"2023-12-16T20:48:57.613647+0000","last_fullsized":"2023-12-16T20:48:57.613647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:18.391557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'129","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.361465+0000","last_change":"2023-12-16T20:21:41.214405+0000","last_active":"2023-12-16T20:48:39.361465+0000","last_peered":"2023-12-16T20:48:39.361465+0000","last_clean":"2023-12-16T20:48:39.361465+0000","last_became_active":"2023-12-16T20:21:41.213977+0000","last_became_peered":"2023-12-16T20:21:41.213977+0000","last_unstale":"2023-12-16T20:48:39.361465+0000","last_undegraded":"2023-12-16T20:48:39.361465+0000","last_fullsized":"2023-12-16T20:48:39.361465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:16.656597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":8382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'30","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.793277+0000","last_change":"2023-12-16T20:21:36.551240+0000","last_active":"2023-12-16T20:49:08.793277+0000","last_peered":"2023-12-16T20:49:08.793277+0000","last_clean":"2023-12-16T20:49:08.793277+0000","last_became_active":"2023-12-16T20:21:36.550997+0000","last_became_peered":"2023-12-16T20:21:36.550997+0000","last_unstale":"2023-12-16T20:49:08.793277+0000","last_undegraded":"2023-12-16T20:49:08.793277+0000","last_fullsized":"2023-12-16T20:49:08.793277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'4","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:53.546511+0000","last_change":"2023-12-16T20:21:35.416258+0000","last_active":"2023-12-16T20:48:53.546511+0000","last_peered":"2023-12-16T20:48:53.546511+0000","last_clean":"2023-12-16T20:48:53.546511+0000","last_became_active":"2023-12-16T20:21:35.415984+0000","last_became_peered":"2023-12-16T20:21:35.415984+0000","last_unstale":"2023-12-16T20:48:53.546511+0000","last_undegraded":"2023-12-16T20:48:53.546511+0000","last_fullsized":"2023-12-16T20:48:53.546511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:06.872220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:45:31.524454+0000","last_change":"2023-12-16T20:21:25.196796+0000","last_active":"2023-12-16T20:45:31.524454+0000","last_peered":"2023-12-16T20:45:31.524454+0000","last_clean":"2023-12-16T20:45:31.524454+0000","last_became_active":"2023-12-16T20:21:25.195675+0000","last_became_peered":"2023-12-16T20:21:25.195675+0000","last_unstale":"2023-12-16T20:45:31.524454+0000","last_undegraded":"2023-12-16T20:45:31.524454+0000","last_fullsized":"2023-12-16T20:45:31.524454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:23.008820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:23.008820+0000","last_clean_scrub_stamp":"2023-12-16T20:21:23.008820+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:46:02.232774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'192","reported_seq":220,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.474899+0000","last_change":"2023-12-16T20:21:41.214322+0000","last_active":"2023-12-16T20:48:41.474899+0000","last_peered":"2023-12-16T20:48:41.474899+0000","last_clean":"2023-12-16T20:48:41.474899+0000","last_became_active":"2023-12-16T20:21:41.214012+0000","last_became_peered":"2023-12-16T20:21:41.214012+0000","last_unstale":"2023-12-16T20:48:41.474899+0000","last_undegraded":"2023-12-16T20:48:41.474899+0000","last_fullsized":"2023-12-16T20:48:41.474899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:18.981353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":12745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'36","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.904272+0000","last_change":"2023-12-16T20:21:36.552920+0000","last_active":"2023-12-16T20:49:08.904272+0000","last_peered":"2023-12-16T20:49:08.904272+0000","last_clean":"2023-12-16T20:49:08.904272+0000","last_became_active":"2023-12-16T20:21:36.552619+0000","last_became_peered":"2023-12-16T20:21:36.552619+0000","last_unstale":"2023-12-16T20:49:08.904272+0000","last_undegraded":"2023-12-16T20:49:08.904272+0000","last_fullsized":"2023-12-16T20:49:08.904272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:14.586148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:48.478829+0000","last_change":"2023-12-16T20:21:35.413597+0000","last_active":"2023-12-16T20:48:48.478829+0000","last_peered":"2023-12-16T20:48:48.478829+0000","last_clean":"2023-12-16T20:48:48.478829+0000","last_became_active":"2023-12-16T20:21:35.413308+0000","last_became_peered":"2023-12-16T20:21:35.413308+0000","last_unstale":"2023-12-16T20:48:48.478829+0000","last_undegraded":"2023-12-16T20:48:48.478829+0000","last_fullsized":"2023-12-16T20:48:48.478829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:55:39.544748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'151","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:37.719915+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:48:37.719915+0000","last_peered":"2023-12-16T20:48:37.719915+0000","last_clean":"2023-12-16T20:48:37.719915+0000","last_became_active":"2023-12-16T20:21:41.212608+0000","last_became_peered":"2023-12-16T20:21:41.212608+0000","last_unstale":"2023-12-16T20:48:37.719915+0000","last_undegraded":"2023-12-16T20:48:37.719915+0000","last_fullsized":"2023-12-16T20:48:37.719915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":6553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'41","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820554+0000","last_change":"2023-12-16T20:21:36.555870+0000","last_active":"2023-12-16T20:49:08.820554+0000","last_peered":"2023-12-16T20:49:08.820554+0000","last_clean":"2023-12-16T20:49:08.820554+0000","last_became_active":"2023-12-16T20:21:36.555631+0000","last_became_peered":"2023-12-16T20:21:36.555631+0000","last_unstale":"2023-12-16T20:49:08.820554+0000","last_undegraded":"2023-12-16T20:49:08.820554+0000","last_fullsized":"2023-12-16T20:49:08.820554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:10.421516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:44.395512+0000","last_change":"2023-12-16T20:21:35.416140+0000","last_active":"2023-12-16T20:48:44.395512+0000","last_peered":"2023-12-16T20:48:44.395512+0000","last_clean":"2023-12-16T20:48:44.395512+0000","last_became_active":"2023-12-16T20:21:35.415810+0000","last_became_peered":"2023-12-16T20:21:35.415810+0000","last_unstale":"2023-12-16T20:48:44.395512+0000","last_undegraded":"2023-12-16T20:48:44.395512+0000","last_fullsized":"2023-12-16T20:48:44.395512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'169","reported_seq":205,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:40.297366+0000","last_change":"2023-12-16T20:22:14.842693+0000","last_active":"2023-12-16T20:48:40.297366+0000","last_peered":"2023-12-16T20:48:40.297366+0000","last_clean":"2023-12-16T20:48:40.297366+0000","last_became_active":"2023-12-16T20:22:14.842282+0000","last_became_peered":"2023-12-16T20:22:14.842282+0000","last_unstale":"2023-12-16T20:48:40.297366+0000","last_undegraded":"2023-12-16T20:48:40.297366+0000","last_fullsized":"2023-12-16T20:48:40.297366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:28:08.269032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":8236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'35","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.900402+0000","last_change":"2023-12-16T20:21:36.536346+0000","last_active":"2023-12-16T20:49:08.900402+0000","last_peered":"2023-12-16T20:49:08.900402+0000","last_clean":"2023-12-16T20:49:08.900402+0000","last_became_active":"2023-12-16T20:21:36.536093+0000","last_became_peered":"2023-12-16T20:21:36.536093+0000","last_unstale":"2023-12-16T20:49:08.900402+0000","last_undegraded":"2023-12-16T20:49:08.900402+0000","last_fullsized":"2023-12-16T20:49:08.900402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:12.261391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'7","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:02.737207+0000","last_change":"2023-12-16T20:21:35.420314+0000","last_active":"2023-12-16T20:49:02.737207+0000","last_peered":"2023-12-16T20:49:02.737207+0000","last_clean":"2023-12-16T20:49:02.737207+0000","last_became_active":"2023-12-16T20:21:35.420074+0000","last_became_peered":"2023-12-16T20:21:35.420074+0000","last_unstale":"2023-12-16T20:49:02.737207+0000","last_undegraded":"2023-12-16T20:49:02.737207+0000","last_fullsized":"2023-12-16T20:49:02.737207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:29.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'129","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.470922+0000","last_change":"2023-12-16T20:21:41.215282+0000","last_active":"2023-12-16T20:48:41.470922+0000","last_peered":"2023-12-16T20:48:41.470922+0000","last_clean":"2023-12-16T20:48:41.470922+0000","last_became_active":"2023-12-16T20:21:41.214939+0000","last_became_peered":"2023-12-16T20:21:41.214939+0000","last_unstale":"2023-12-16T20:48:41.470922+0000","last_undegraded":"2023-12-16T20:48:41.470922+0000","last_fullsized":"2023-12-16T20:48:41.470922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:06:12.245089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":12347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'21","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.902928+0000","last_change":"2023-12-16T20:21:36.534345+0000","last_active":"2023-12-16T20:49:08.902928+0000","last_peered":"2023-12-16T20:49:08.902928+0000","last_clean":"2023-12-16T20:49:08.902928+0000","last_became_active":"2023-12-16T20:21:36.534064+0000","last_became_peered":"2023-12-16T20:21:36.534064+0000","last_unstale":"2023-12-16T20:49:08.902928+0000","last_undegraded":"2023-12-16T20:49:08.902928+0000","last_fullsized":"2023-12-16T20:49:08.902928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:05.641757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:51.557836+0000","last_change":"2023-12-16T20:21:35.390941+0000","last_active":"2023-12-16T20:48:51.557836+0000","last_peered":"2023-12-16T20:48:51.557836+0000","last_clean":"2023-12-16T20:48:51.557836+0000","last_became_active":"2023-12-16T20:21:35.390740+0000","last_became_peered":"2023-12-16T20:21:35.390740+0000","last_unstale":"2023-12-16T20:48:51.557836+0000","last_undegraded":"2023-12-16T20:48:51.557836+0000","last_fullsized":"2023-12-16T20:48:51.557836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:00:44.009248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'180","reported_seq":207,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.239005+0000","last_change":"2023-12-16T20:21:40.754355+0000","last_active":"2023-12-16T20:48:39.239005+0000","last_peered":"2023-12-16T20:48:39.239005+0000","last_clean":"2023-12-16T20:48:39.239005+0000","last_became_active":"2023-12-16T20:21:40.753981+0000","last_became_peered":"2023-12-16T20:21:40.753981+0000","last_unstale":"2023-12-16T20:48:39.239005+0000","last_undegraded":"2023-12-16T20:48:39.239005+0000","last_fullsized":"2023-12-16T20:48:39.239005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:09.125671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":13396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'37","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.901207+0000","last_change":"2023-12-16T20:21:36.537080+0000","last_active":"2023-12-16T20:49:08.901207+0000","last_peered":"2023-12-16T20:49:08.901207+0000","last_clean":"2023-12-16T20:49:08.901207+0000","last_became_active":"2023-12-16T20:21:36.536822+0000","last_became_peered":"2023-12-16T20:21:36.536822+0000","last_unstale":"2023-12-16T20:49:08.901207+0000","last_undegraded":"2023-12-16T20:49:08.901207+0000","last_fullsized":"2023-12-16T20:49:08.901207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'9","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:47:16.371756+0000","last_change":"2023-12-16T20:21:35.417113+0000","last_active":"2023-12-16T20:47:16.371756+0000","last_peered":"2023-12-16T20:47:16.371756+0000","last_clean":"2023-12-16T20:47:16.371756+0000","last_became_active":"2023-12-16T20:21:35.416850+0000","last_became_peered":"2023-12-16T20:21:35.416850+0000","last_unstale":"2023-12-16T20:47:16.371756+0000","last_undegraded":"2023-12-16T20:47:16.371756+0000","last_fullsized":"2023-12-16T20:47:16.371756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:00:44.009248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'159","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:40.300399+0000","last_change":"2023-12-16T20:21:40.755436+0000","last_active":"2023-12-16T20:48:40.300399+0000","last_peered":"2023-12-16T20:48:40.300399+0000","last_clean":"2023-12-16T20:48:40.300399+0000","last_became_active":"2023-12-16T20:21:40.755041+0000","last_became_peered":"2023-12-16T20:21:40.755041+0000","last_unstale":"2023-12-16T20:48:40.300399+0000","last_undegraded":"2023-12-16T20:48:40.300399+0000","last_fullsized":"2023-12-16T20:48:40.300399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:07.939178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":9935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'32","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.886153+0000","last_change":"2023-12-16T20:21:36.541160+0000","last_active":"2023-12-16T20:49:08.886153+0000","last_peered":"2023-12-16T20:49:08.886153+0000","last_clean":"2023-12-16T20:49:08.886153+0000","last_became_active":"2023-12-16T20:21:36.540861+0000","last_became_peered":"2023-12-16T20:21:36.540861+0000","last_unstale":"2023-12-16T20:49:08.886153+0000","last_undegraded":"2023-12-16T20:49:08.886153+0000","last_fullsized":"2023-12-16T20:49:08.886153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.439148+0000","last_change":"2023-12-16T20:21:35.425071+0000","last_active":"2023-12-16T20:48:46.439148+0000","last_peered":"2023-12-16T20:48:46.439148+0000","last_clean":"2023-12-16T20:48:46.439148+0000","last_became_active":"2023-12-16T20:21:35.424822+0000","last_became_peered":"2023-12-16T20:21:35.424822+0000","last_unstale":"2023-12-16T20:48:46.439148+0000","last_undegraded":"2023-12-16T20:48:46.439148+0000","last_fullsized":"2023-12-16T20:48:46.439148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'130","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:38.768956+0000","last_change":"2023-12-16T20:21:41.215346+0000","last_active":"2023-12-16T20:48:38.768956+0000","last_peered":"2023-12-16T20:48:38.768956+0000","last_clean":"2023-12-16T20:48:38.768956+0000","last_became_active":"2023-12-16T20:21:41.215002+0000","last_became_peered":"2023-12-16T20:21:41.215002+0000","last_unstale":"2023-12-16T20:48:38.768956+0000","last_undegraded":"2023-12-16T20:48:38.768956+0000","last_fullsized":"2023-12-16T20:48:38.768956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:10:42.982067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":7078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'49","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.904907+0000","last_change":"2023-12-16T20:21:36.535791+0000","last_active":"2023-12-16T20:49:08.904907+0000","last_peered":"2023-12-16T20:49:08.904907+0000","last_clean":"2023-12-16T20:49:08.904907+0000","last_became_active":"2023-12-16T20:21:36.535447+0000","last_became_peered":"2023-12-16T20:21:36.535447+0000","last_unstale":"2023-12-16T20:49:08.904907+0000","last_undegraded":"2023-12-16T20:49:08.904907+0000","last_fullsized":"2023-12-16T20:49:08.904907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:28.307634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:55.659095+0000","last_change":"2023-12-16T20:21:35.423533+0000","last_active":"2023-12-16T20:48:55.659095+0000","last_peered":"2023-12-16T20:48:55.659095+0000","last_clean":"2023-12-16T20:48:55.659095+0000","last_became_active":"2023-12-16T20:21:35.423275+0000","last_became_peered":"2023-12-16T20:21:35.423275+0000","last_unstale":"2023-12-16T20:48:55.659095+0000","last_undegraded":"2023-12-16T20:48:55.659095+0000","last_fullsized":"2023-12-16T20:48:55.659095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:27.767422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'115","reported_seq":141,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.361695+0000","last_change":"2023-12-16T20:21:41.213083+0000","last_active":"2023-12-16T20:48:39.361695+0000","last_peered":"2023-12-16T20:48:39.361695+0000","last_clean":"2023-12-16T20:48:39.361695+0000","last_became_active":"2023-12-16T20:21:41.212699+0000","last_became_peered":"2023-12-16T20:21:41.212699+0000","last_unstale":"2023-12-16T20:48:39.361695+0000","last_undegraded":"2023-12-16T20:48:39.361695+0000","last_fullsized":"2023-12-16T20:48:39.361695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:14:45.966119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'45","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.971754+0000","last_change":"2023-12-16T20:21:36.523928+0000","last_active":"2023-12-16T20:49:08.971754+0000","last_peered":"2023-12-16T20:49:08.971754+0000","last_clean":"2023-12-16T20:49:08.971754+0000","last_became_active":"2023-12-16T20:21:36.523649+0000","last_became_peered":"2023-12-16T20:21:36.523649+0000","last_unstale":"2023-12-16T20:49:08.971754+0000","last_undegraded":"2023-12-16T20:49:08.971754+0000","last_fullsized":"2023-12-16T20:49:08.971754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:33.657782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'261","reported_seq":290,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.617486+0000","last_change":"2023-12-16T20:21:35.388611+0000","last_active":"2023-12-16T20:49:08.617486+0000","last_peered":"2023-12-16T20:49:08.617486+0000","last_clean":"2023-12-16T20:49:08.617486+0000","last_became_active":"2023-12-16T20:21:35.388392+0000","last_became_peered":"2023-12-16T20:21:35.388392+0000","last_unstale":"2023-12-16T20:49:08.617486+0000","last_undegraded":"2023-12-16T20:49:08.617486+0000","last_fullsized":"2023-12-16T20:49:08.617486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2496854,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":2582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'142","reported_seq":168,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.356577+0000","last_change":"2023-12-16T20:21:41.213106+0000","last_active":"2023-12-16T20:48:39.356577+0000","last_peered":"2023-12-16T20:48:39.356577+0000","last_clean":"2023-12-16T20:48:39.356577+0000","last_became_active":"2023-12-16T20:21:41.212721+0000","last_became_peered":"2023-12-16T20:21:41.212721+0000","last_unstale":"2023-12-16T20:48:39.356577+0000","last_undegraded":"2023-12-16T20:48:39.356577+0000","last_fullsized":"2023-12-16T20:48:39.356577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:47:15.750172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":13674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'36","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.902501+0000","last_change":"2023-12-16T20:21:36.519774+0000","last_active":"2023-12-16T20:49:08.902501+0000","last_peered":"2023-12-16T20:49:08.902501+0000","last_clean":"2023-12-16T20:49:08.902501+0000","last_became_active":"2023-12-16T20:21:36.519561+0000","last_became_peered":"2023-12-16T20:21:36.519561+0000","last_unstale":"2023-12-16T20:49:08.902501+0000","last_undegraded":"2023-12-16T20:49:08.902501+0000","last_fullsized":"2023-12-16T20:49:08.902501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:10.421516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'850","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:55.656917+0000","last_change":"2023-12-16T20:21:35.426168+0000","last_active":"2023-12-16T20:48:55.656917+0000","last_peered":"2023-12-16T20:48:55.656917+0000","last_clean":"2023-12-16T20:48:55.656917+0000","last_became_active":"2023-12-16T20:21:35.425929+0000","last_became_peered":"2023-12-16T20:21:35.425929+0000","last_unstale":"2023-12-16T20:48:55.656917+0000","last_undegraded":"2023-12-16T20:48:55.656917+0000","last_fullsized":"2023-12-16T20:48:55.656917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":4548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'165","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.358092+0000","last_change":"2023-12-16T20:21:40.754204+0000","last_active":"2023-12-16T20:48:39.358092+0000","last_peered":"2023-12-16T20:48:39.358092+0000","last_clean":"2023-12-16T20:48:39.358092+0000","last_became_active":"2023-12-16T20:21:40.753624+0000","last_became_peered":"2023-12-16T20:21:40.753624+0000","last_unstale":"2023-12-16T20:48:39.358092+0000","last_undegraded":"2023-12-16T20:48:39.358092+0000","last_fullsized":"2023-12-16T20:48:39.358092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:11.201128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":9759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'33","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.815896+0000","last_change":"2023-12-16T20:21:36.534827+0000","last_active":"2023-12-16T20:49:08.815896+0000","last_peered":"2023-12-16T20:49:08.815896+0000","last_clean":"2023-12-16T20:49:08.815896+0000","last_became_active":"2023-12-16T20:21:36.533790+0000","last_became_peered":"2023-12-16T20:21:36.533790+0000","last_unstale":"2023-12-16T20:49:08.815896+0000","last_undegraded":"2023-12-16T20:49:08.815896+0000","last_fullsized":"2023-12-16T20:49:08.815896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:19.545737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'706","reported_seq":735,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:01.717981+0000","last_change":"2023-12-16T20:21:35.416050+0000","last_active":"2023-12-16T20:49:01.717981+0000","last_peered":"2023-12-16T20:49:01.717981+0000","last_clean":"2023-12-16T20:49:01.717981+0000","last_became_active":"2023-12-16T20:21:35.415790+0000","last_became_peered":"2023-12-16T20:21:35.415790+0000","last_unstale":"2023-12-16T20:49:01.717981+0000","last_undegraded":"2023-12-16T20:49:01.717981+0000","last_fullsized":"2023-12-16T20:49:01.717981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":703,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'154","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.369610+0000","last_change":"2023-12-16T20:21:40.795197+0000","last_active":"2023-12-16T20:48:39.369610+0000","last_peered":"2023-12-16T20:48:39.369610+0000","last_clean":"2023-12-16T20:48:39.369610+0000","last_became_active":"2023-12-16T20:21:40.793667+0000","last_became_peered":"2023-12-16T20:21:40.793667+0000","last_unstale":"2023-12-16T20:48:39.369610+0000","last_undegraded":"2023-12-16T20:48:39.369610+0000","last_fullsized":"2023-12-16T20:48:39.369610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:32.304405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":20505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'40","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.969267+0000","last_change":"2023-12-16T20:21:36.552680+0000","last_active":"2023-12-16T20:49:08.969267+0000","last_peered":"2023-12-16T20:49:08.969267+0000","last_clean":"2023-12-16T20:49:08.969267+0000","last_became_active":"2023-12-16T20:21:36.552482+0000","last_became_peered":"2023-12-16T20:21:36.552482+0000","last_unstale":"2023-12-16T20:49:08.969267+0000","last_undegraded":"2023-12-16T20:49:08.969267+0000","last_fullsized":"2023-12-16T20:49:08.969267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:00.762391+0000","last_change":"2023-12-16T20:21:35.428379+0000","last_active":"2023-12-16T20:49:00.762391+0000","last_peered":"2023-12-16T20:49:00.762391+0000","last_clean":"2023-12-16T20:49:00.762391+0000","last_became_active":"2023-12-16T20:21:35.428100+0000","last_became_peered":"2023-12-16T20:21:35.428100+0000","last_unstale":"2023-12-16T20:49:00.762391+0000","last_undegraded":"2023-12-16T20:49:00.762391+0000","last_fullsized":"2023-12-16T20:49:00.762391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:44.330608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'126","reported_seq":152,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:40.295260+0000","last_change":"2023-12-16T20:21:40.753333+0000","last_active":"2023-12-16T20:48:40.295260+0000","last_peered":"2023-12-16T20:48:40.295260+0000","last_clean":"2023-12-16T20:48:40.295260+0000","last_became_active":"2023-12-16T20:21:40.752957+0000","last_became_peered":"2023-12-16T20:21:40.752957+0000","last_unstale":"2023-12-16T20:48:40.295260+0000","last_undegraded":"2023-12-16T20:48:40.295260+0000","last_fullsized":"2023-12-16T20:48:40.295260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:47:15.750172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":10032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'43","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.895340+0000","last_change":"2023-12-16T20:22:14.841007+0000","last_active":"2023-12-16T20:49:08.895340+0000","last_peered":"2023-12-16T20:49:08.895340+0000","last_clean":"2023-12-16T20:49:08.895340+0000","last_became_active":"2023-12-16T20:22:14.840679+0000","last_became_peered":"2023-12-16T20:22:14.840679+0000","last_unstale":"2023-12-16T20:49:08.895340+0000","last_undegraded":"2023-12-16T20:49:08.895340+0000","last_fullsized":"2023-12-16T20:49:08.895340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:48.476563+0000","last_change":"2023-12-16T20:21:35.430197+0000","last_active":"2023-12-16T20:48:48.476563+0000","last_peered":"2023-12-16T20:48:48.476563+0000","last_clean":"2023-12-16T20:48:48.476563+0000","last_became_active":"2023-12-16T20:21:35.429940+0000","last_became_peered":"2023-12-16T20:21:35.429940+0000","last_unstale":"2023-12-16T20:48:48.476563+0000","last_undegraded":"2023-12-16T20:48:48.476563+0000","last_fullsized":"2023-12-16T20:48:48.476563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'174","reported_seq":200,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.355965+0000","last_change":"2023-12-16T20:21:41.216238+0000","last_active":"2023-12-16T20:48:39.355965+0000","last_peered":"2023-12-16T20:48:39.355965+0000","last_clean":"2023-12-16T20:48:39.355965+0000","last_became_active":"2023-12-16T20:21:41.215893+0000","last_became_peered":"2023-12-16T20:21:41.215893+0000","last_unstale":"2023-12-16T20:48:39.355965+0000","last_undegraded":"2023-12-16T20:48:39.355965+0000","last_fullsized":"2023-12-16T20:48:39.355965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:06:12.245089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":9716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'144","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.358383+0000","last_change":"2023-12-16T20:21:41.215277+0000","last_active":"2023-12-16T20:48:39.358383+0000","last_peered":"2023-12-16T20:48:39.358383+0000","last_clean":"2023-12-16T20:48:39.358383+0000","last_became_active":"2023-12-16T20:21:41.214950+0000","last_became_peered":"2023-12-16T20:21:41.214950+0000","last_unstale":"2023-12-16T20:48:39.358383+0000","last_undegraded":"2023-12-16T20:48:39.358383+0000","last_fullsized":"2023-12-16T20:48:39.358383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:10.036962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":7732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'44","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.798823+0000","last_change":"2023-12-16T20:21:36.519789+0000","last_active":"2023-12-16T20:49:08.798823+0000","last_peered":"2023-12-16T20:49:08.798823+0000","last_clean":"2023-12-16T20:49:08.798823+0000","last_became_active":"2023-12-16T20:21:36.519476+0000","last_became_peered":"2023-12-16T20:21:36.519476+0000","last_unstale":"2023-12-16T20:49:08.798823+0000","last_undegraded":"2023-12-16T20:49:08.798823+0000","last_fullsized":"2023-12-16T20:49:08.798823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:51.515982+0000","last_change":"2023-12-16T20:21:35.415150+0000","last_active":"2023-12-16T20:48:51.515982+0000","last_peered":"2023-12-16T20:48:51.515982+0000","last_clean":"2023-12-16T20:48:51.515982+0000","last_became_active":"2023-12-16T20:21:35.414846+0000","last_became_peered":"2023-12-16T20:21:35.414846+0000","last_unstale":"2023-12-16T20:48:51.515982+0000","last_undegraded":"2023-12-16T20:48:51.515982+0000","last_fullsized":"2023-12-16T20:48:51.515982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:37.215505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'142","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.474966+0000","last_change":"2023-12-16T20:21:40.794438+0000","last_active":"2023-12-16T20:48:41.474966+0000","last_peered":"2023-12-16T20:48:41.474966+0000","last_clean":"2023-12-16T20:48:41.474966+0000","last_became_active":"2023-12-16T20:21:40.794073+0000","last_became_peered":"2023-12-16T20:21:40.794073+0000","last_unstale":"2023-12-16T20:48:41.474966+0000","last_undegraded":"2023-12-16T20:48:41.474966+0000","last_fullsized":"2023-12-16T20:48:41.474966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:32.702839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":21602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'45","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796450+0000","last_change":"2023-12-16T20:22:14.772045+0000","last_active":"2023-12-16T20:49:08.796450+0000","last_peered":"2023-12-16T20:49:08.796450+0000","last_clean":"2023-12-16T20:49:08.796450+0000","last_became_active":"2023-12-16T20:22:14.771747+0000","last_became_peered":"2023-12-16T20:22:14.771747+0000","last_unstale":"2023-12-16T20:49:08.796450+0000","last_undegraded":"2023-12-16T20:49:08.796450+0000","last_fullsized":"2023-12-16T20:49:08.796450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:00:27.390576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:45.442731+0000","last_change":"2023-12-16T20:21:35.422176+0000","last_active":"2023-12-16T20:48:45.442731+0000","last_peered":"2023-12-16T20:48:45.442731+0000","last_clean":"2023-12-16T20:48:45.442731+0000","last_became_active":"2023-12-16T20:21:35.421982+0000","last_became_peered":"2023-12-16T20:21:35.421982+0000","last_unstale":"2023-12-16T20:48:45.442731+0000","last_undegraded":"2023-12-16T20:48:45.442731+0000","last_fullsized":"2023-12-16T20:48:45.442731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'701","reported_seq":730,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:02.737447+0000","last_change":"2023-12-16T20:21:35.424509+0000","last_active":"2023-12-16T20:49:02.737447+0000","last_peered":"2023-12-16T20:49:02.737447+0000","last_clean":"2023-12-16T20:49:02.737447+0000","last_became_active":"2023-12-16T20:21:35.424254+0000","last_became_peered":"2023-12-16T20:21:35.424254+0000","last_unstale":"2023-12-16T20:49:02.737447+0000","last_undegraded":"2023-12-16T20:49:02.737447+0000","last_fullsized":"2023-12-16T20:49:02.737447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'39","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.972534+0000","last_change":"2023-12-16T20:21:36.533903+0000","last_active":"2023-12-16T20:49:08.972534+0000","last_peered":"2023-12-16T20:49:08.972534+0000","last_clean":"2023-12-16T20:49:08.972534+0000","last_became_active":"2023-12-16T20:21:36.533574+0000","last_became_peered":"2023-12-16T20:21:36.533574+0000","last_unstale":"2023-12-16T20:49:08.972534+0000","last_undegraded":"2023-12-16T20:49:08.972534+0000","last_fullsized":"2023-12-16T20:49:08.972534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'88","reported_seq":114,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:38.755640+0000","last_change":"2023-12-16T20:21:40.794426+0000","last_active":"2023-12-16T20:48:38.755640+0000","last_peered":"2023-12-16T20:48:38.755640+0000","last_clean":"2023-12-16T20:48:38.755640+0000","last_became_active":"2023-12-16T20:21:40.794082+0000","last_became_peered":"2023-12-16T20:21:40.794082+0000","last_unstale":"2023-12-16T20:48:38.755640+0000","last_undegraded":"2023-12-16T20:48:38.755640+0000","last_fullsized":"2023-12-16T20:48:38.755640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:39:04.889495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'686","reported_seq":715,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:00.757206+0000","last_change":"2023-12-16T20:21:35.419910+0000","last_active":"2023-12-16T20:49:00.757206+0000","last_peered":"2023-12-16T20:49:00.757206+0000","last_clean":"2023-12-16T20:49:00.757206+0000","last_became_active":"2023-12-16T20:21:35.419409+0000","last_became_peered":"2023-12-16T20:21:35.419409+0000","last_unstale":"2023-12-16T20:49:00.757206+0000","last_undegraded":"2023-12-16T20:49:00.757206+0000","last_fullsized":"2023-12-16T20:49:00.757206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":4443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'33","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.817786+0000","last_change":"2023-12-16T20:21:36.533684+0000","last_active":"2023-12-16T20:49:08.817786+0000","last_peered":"2023-12-16T20:49:08.817786+0000","last_clean":"2023-12-16T20:49:08.817786+0000","last_became_active":"2023-12-16T20:21:36.533325+0000","last_became_peered":"2023-12-16T20:21:36.533325+0000","last_unstale":"2023-12-16T20:49:08.817786+0000","last_undegraded":"2023-12-16T20:49:08.817786+0000","last_fullsized":"2023-12-16T20:49:08.817786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:30.795818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'165","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.472046+0000","last_change":"2023-12-16T20:21:40.745455+0000","last_active":"2023-12-16T20:48:41.472046+0000","last_peered":"2023-12-16T20:48:41.472046+0000","last_clean":"2023-12-16T20:48:41.472046+0000","last_became_active":"2023-12-16T20:21:40.744731+0000","last_became_peered":"2023-12-16T20:21:40.744731+0000","last_unstale":"2023-12-16T20:48:41.472046+0000","last_undegraded":"2023-12-16T20:48:41.472046+0000","last_fullsized":"2023-12-16T20:48:41.472046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:17:56.583460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":13136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'49","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.894941+0000","last_change":"2023-12-16T20:21:36.542529+0000","last_active":"2023-12-16T20:49:08.894941+0000","last_peered":"2023-12-16T20:49:08.894941+0000","last_clean":"2023-12-16T20:49:08.894941+0000","last_became_active":"2023-12-16T20:21:36.542287+0000","last_became_peered":"2023-12-16T20:21:36.542287+0000","last_unstale":"2023-12-16T20:49:08.894941+0000","last_undegraded":"2023-12-16T20:49:08.894941+0000","last_fullsized":"2023-12-16T20:49:08.894941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'51","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.887499+0000","last_change":"2023-12-16T20:21:36.551193+0000","last_active":"2023-12-16T20:49:08.887499+0000","last_peered":"2023-12-16T20:49:08.887499+0000","last_clean":"2023-12-16T20:49:08.887499+0000","last_became_active":"2023-12-16T20:21:36.550911+0000","last_became_peered":"2023-12-16T20:21:36.550911+0000","last_unstale":"2023-12-16T20:49:08.887499+0000","last_undegraded":"2023-12-16T20:49:08.887499+0000","last_fullsized":"2023-12-16T20:49:08.887499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:19.545737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'50","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820628+0000","last_change":"2023-12-16T20:21:36.556390+0000","last_active":"2023-12-16T20:49:08.820628+0000","last_peered":"2023-12-16T20:49:08.820628+0000","last_clean":"2023-12-16T20:49:08.820628+0000","last_became_active":"2023-12-16T20:21:36.555822+0000","last_became_peered":"2023-12-16T20:21:36.555822+0000","last_unstale":"2023-12-16T20:49:08.820628+0000","last_undegraded":"2023-12-16T20:49:08.820628+0000","last_fullsized":"2023-12-16T20:49:08.820628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:28.307634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'35","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.971561+0000","last_change":"2023-12-16T20:21:36.525171+0000","last_active":"2023-12-16T20:49:08.971561+0000","last_peered":"2023-12-16T20:49:08.971561+0000","last_clean":"2023-12-16T20:49:08.971561+0000","last_became_active":"2023-12-16T20:21:36.524747+0000","last_became_peered":"2023-12-16T20:21:36.524747+0000","last_unstale":"2023-12-16T20:49:08.971561+0000","last_undegraded":"2023-12-16T20:49:08.971561+0000","last_fullsized":"2023-12-16T20:49:08.971561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'29","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.800156+0000","last_change":"2023-12-16T20:21:36.533944+0000","last_active":"2023-12-16T20:49:08.800156+0000","last_peered":"2023-12-16T20:49:08.800156+0000","last_clean":"2023-12-16T20:49:08.800156+0000","last_became_active":"2023-12-16T20:21:36.533682+0000","last_became_peered":"2023-12-16T20:21:36.533682+0000","last_unstale":"2023-12-16T20:49:08.800156+0000","last_undegraded":"2023-12-16T20:49:08.800156+0000","last_fullsized":"2023-12-16T20:49:08.800156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:20.609645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'35","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796562+0000","last_change":"2023-12-16T20:21:36.519818+0000","last_active":"2023-12-16T20:49:08.796562+0000","last_peered":"2023-12-16T20:49:08.796562+0000","last_clean":"2023-12-16T20:49:08.796562+0000","last_became_active":"2023-12-16T20:21:36.519545+0000","last_became_peered":"2023-12-16T20:21:36.519545+0000","last_unstale":"2023-12-16T20:49:08.796562+0000","last_undegraded":"2023-12-16T20:49:08.796562+0000","last_fullsized":"2023-12-16T20:49:08.796562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.899167+0000","last_change":"2023-12-16T20:21:36.542706+0000","last_active":"2023-12-16T20:49:08.899167+0000","last_peered":"2023-12-16T20:49:08.899167+0000","last_clean":"2023-12-16T20:49:08.899167+0000","last_became_active":"2023-12-16T20:21:36.542184+0000","last_became_peered":"2023-12-16T20:21:36.542184+0000","last_unstale":"2023-12-16T20:49:08.899167+0000","last_undegraded":"2023-12-16T20:49:08.899167+0000","last_fullsized":"2023-12-16T20:49:08.899167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'32","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.790544+0000","last_change":"2023-12-16T20:21:36.536726+0000","last_active":"2023-12-16T20:49:08.790544+0000","last_peered":"2023-12-16T20:49:08.790544+0000","last_clean":"2023-12-16T20:49:08.790544+0000","last_became_active":"2023-12-16T20:21:36.536439+0000","last_became_peered":"2023-12-16T20:21:36.536439+0000","last_unstale":"2023-12-16T20:49:08.790544+0000","last_undegraded":"2023-12-16T20:49:08.790544+0000","last_fullsized":"2023-12-16T20:49:08.790544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'33","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820643+0000","last_change":"2023-12-16T20:21:36.555521+0000","last_active":"2023-12-16T20:49:08.820643+0000","last_peered":"2023-12-16T20:49:08.820643+0000","last_clean":"2023-12-16T20:49:08.820643+0000","last_became_active":"2023-12-16T20:21:36.555100+0000","last_became_peered":"2023-12-16T20:21:36.555100+0000","last_unstale":"2023-12-16T20:49:08.820643+0000","last_undegraded":"2023-12-16T20:49:08.820643+0000","last_fullsized":"2023-12-16T20:49:08.820643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796955+0000","last_change":"2023-12-16T20:21:36.535856+0000","last_active":"2023-12-16T20:49:08.796955+0000","last_peered":"2023-12-16T20:49:08.796955+0000","last_clean":"2023-12-16T20:49:08.796955+0000","last_became_active":"2023-12-16T20:21:36.535600+0000","last_became_peered":"2023-12-16T20:21:36.535600+0000","last_unstale":"2023-12-16T20:49:08.796955+0000","last_undegraded":"2023-12-16T20:49:08.796955+0000","last_fullsized":"2023-12-16T20:49:08.796955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'38","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820712+0000","last_change":"2023-12-16T20:21:36.553376+0000","last_active":"2023-12-16T20:49:08.820712+0000","last_peered":"2023-12-16T20:49:08.820712+0000","last_clean":"2023-12-16T20:49:08.820712+0000","last_became_active":"2023-12-16T20:21:36.553155+0000","last_became_peered":"2023-12-16T20:21:36.553155+0000","last_unstale":"2023-12-16T20:49:08.820712+0000","last_undegraded":"2023-12-16T20:49:08.820712+0000","last_fullsized":"2023-12-16T20:49:08.820712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'50","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.972124+0000","last_change":"2023-12-16T20:21:36.524517+0000","last_active":"2023-12-16T20:49:08.972124+0000","last_peered":"2023-12-16T20:49:08.972124+0000","last_clean":"2023-12-16T20:49:08.972124+0000","last_became_active":"2023-12-16T20:21:36.524166+0000","last_became_peered":"2023-12-16T20:21:36.524166+0000","last_unstale":"2023-12-16T20:49:08.972124+0000","last_undegraded":"2023-12-16T20:49:08.972124+0000","last_fullsized":"2023-12-16T20:49:08.972124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.890304+0000","last_change":"2023-12-16T20:21:36.542513+0000","last_active":"2023-12-16T20:49:08.890304+0000","last_peered":"2023-12-16T20:49:08.890304+0000","last_clean":"2023-12-16T20:49:08.890304+0000","last_became_active":"2023-12-16T20:21:36.542191+0000","last_became_peered":"2023-12-16T20:21:36.542191+0000","last_unstale":"2023-12-16T20:49:08.890304+0000","last_undegraded":"2023-12-16T20:49:08.890304+0000","last_fullsized":"2023-12-16T20:49:08.890304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'35","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.793533+0000","last_change":"2023-12-16T20:22:14.772163+0000","last_active":"2023-12-16T20:49:08.793533+0000","last_peered":"2023-12-16T20:49:08.793533+0000","last_clean":"2023-12-16T20:49:08.793533+0000","last_became_active":"2023-12-16T20:22:14.771830+0000","last_became_peered":"2023-12-16T20:22:14.771830+0000","last_unstale":"2023-12-16T20:49:08.793533+0000","last_undegraded":"2023-12-16T20:49:08.793533+0000","last_fullsized":"2023-12-16T20:49:08.793533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:28:03.873827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"27'47","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.896077+0000","last_change":"2023-12-16T20:21:36.544461+0000","last_active":"2023-12-16T20:49:08.896077+0000","last_peered":"2023-12-16T20:49:08.896077+0000","last_clean":"2023-12-16T20:49:08.896077+0000","last_became_active":"2023-12-16T20:21:36.544225+0000","last_became_peered":"2023-12-16T20:21:36.544225+0000","last_unstale":"2023-12-16T20:49:08.896077+0000","last_undegraded":"2023-12-16T20:49:08.896077+0000","last_fullsized":"2023-12-16T20:49:08.896077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:45:02.439240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'40","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820348+0000","last_change":"2023-12-16T20:21:36.554370+0000","last_active":"2023-12-16T20:49:08.820348+0000","last_peered":"2023-12-16T20:49:08.820348+0000","last_clean":"2023-12-16T20:49:08.820348+0000","last_became_active":"2023-12-16T20:21:36.554130+0000","last_became_peered":"2023-12-16T20:21:36.554130+0000","last_unstale":"2023-12-16T20:49:08.820348+0000","last_undegraded":"2023-12-16T20:49:08.820348+0000","last_fullsized":"2023-12-16T20:49:08.820348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:05.641757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'45","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.823702+0000","last_change":"2023-12-16T20:21:36.555346+0000","last_active":"2023-12-16T20:49:08.823702+0000","last_peered":"2023-12-16T20:49:08.823702+0000","last_clean":"2023-12-16T20:49:08.823702+0000","last_became_active":"2023-12-16T20:21:36.554772+0000","last_became_peered":"2023-12-16T20:21:36.554772+0000","last_unstale":"2023-12-16T20:49:08.823702+0000","last_undegraded":"2023-12-16T20:49:08.823702+0000","last_fullsized":"2023-12-16T20:49:08.823702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'44","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796645+0000","last_change":"2023-12-16T20:21:36.534502+0000","last_active":"2023-12-16T20:49:08.796645+0000","last_peered":"2023-12-16T20:49:08.796645+0000","last_clean":"2023-12-16T20:49:08.796645+0000","last_became_active":"2023-12-16T20:21:36.534307+0000","last_became_peered":"2023-12-16T20:21:36.534307+0000","last_unstale":"2023-12-16T20:49:08.796645+0000","last_undegraded":"2023-12-16T20:49:08.796645+0000","last_fullsized":"2023-12-16T20:49:08.796645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'40","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.971856+0000","last_change":"2023-12-16T20:21:36.525661+0000","last_active":"2023-12-16T20:49:08.971856+0000","last_peered":"2023-12-16T20:49:08.971856+0000","last_clean":"2023-12-16T20:49:08.971856+0000","last_became_active":"2023-12-16T20:21:36.525427+0000","last_became_peered":"2023-12-16T20:21:36.525427+0000","last_unstale":"2023-12-16T20:49:08.971856+0000","last_undegraded":"2023-12-16T20:49:08.971856+0000","last_fullsized":"2023-12-16T20:49:08.971856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:39:00.494290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'36","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.800124+0000","last_change":"2023-12-16T20:21:36.542756+0000","last_active":"2023-12-16T20:49:08.800124+0000","last_peered":"2023-12-16T20:49:08.800124+0000","last_clean":"2023-12-16T20:49:08.800124+0000","last_became_active":"2023-12-16T20:21:36.542513+0000","last_became_peered":"2023-12-16T20:21:36.542513+0000","last_unstale":"2023-12-16T20:49:08.800124+0000","last_undegraded":"2023-12-16T20:49:08.800124+0000","last_fullsized":"2023-12-16T20:49:08.800124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'30","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.814024+0000","last_change":"2023-12-16T20:21:36.544754+0000","last_active":"2023-12-16T20:49:08.814024+0000","last_peered":"2023-12-16T20:49:08.814024+0000","last_clean":"2023-12-16T20:49:08.814024+0000","last_became_active":"2023-12-16T20:21:36.544492+0000","last_became_peered":"2023-12-16T20:21:36.544492+0000","last_unstale":"2023-12-16T20:49:08.814024+0000","last_undegraded":"2023-12-16T20:49:08.814024+0000","last_fullsized":"2023-12-16T20:49:08.814024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:19.509623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'38","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.889041+0000","last_change":"2023-12-16T20:22:14.769644+0000","last_active":"2023-12-16T20:49:08.889041+0000","last_peered":"2023-12-16T20:49:08.889041+0000","last_clean":"2023-12-16T20:49:08.889041+0000","last_became_active":"2023-12-16T20:22:14.769348+0000","last_became_peered":"2023-12-16T20:22:14.769348+0000","last_unstale":"2023-12-16T20:49:08.889041+0000","last_undegraded":"2023-12-16T20:49:08.889041+0000","last_fullsized":"2023-12-16T20:49:08.889041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:17:52.188255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'50","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.894678+0000","last_change":"2023-12-16T20:21:36.551107+0000","last_active":"2023-12-16T20:49:08.894678+0000","last_peered":"2023-12-16T20:49:08.894678+0000","last_clean":"2023-12-16T20:49:08.894678+0000","last_became_active":"2023-12-16T20:21:36.550815+0000","last_became_peered":"2023-12-16T20:21:36.550815+0000","last_unstale":"2023-12-16T20:49:08.894678+0000","last_undegraded":"2023-12-16T20:49:08.894678+0000","last_fullsized":"2023-12-16T20:49:08.894678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'42","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.903770+0000","last_change":"2023-12-16T20:21:36.554041+0000","last_active":"2023-12-16T20:49:08.903770+0000","last_peered":"2023-12-16T20:49:08.903770+0000","last_clean":"2023-12-16T20:49:08.903770+0000","last_became_active":"2023-12-16T20:21:36.553708+0000","last_became_peered":"2023-12-16T20:21:36.553708+0000","last_unstale":"2023-12-16T20:49:08.903770+0000","last_undegraded":"2023-12-16T20:49:08.903770+0000","last_fullsized":"2023-12-16T20:49:08.903770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:36.868562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'29","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.799545+0000","last_change":"2023-12-16T20:21:36.551348+0000","last_active":"2023-12-16T20:49:08.799545+0000","last_peered":"2023-12-16T20:49:08.799545+0000","last_clean":"2023-12-16T20:49:08.799545+0000","last_became_active":"2023-12-16T20:21:36.551066+0000","last_became_peered":"2023-12-16T20:21:36.551066+0000","last_unstale":"2023-12-16T20:49:08.799545+0000","last_undegraded":"2023-12-16T20:49:08.799545+0000","last_fullsized":"2023-12-16T20:49:08.799545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'37","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.900820+0000","last_change":"2023-12-16T20:21:36.523828+0000","last_active":"2023-12-16T20:49:08.900820+0000","last_peered":"2023-12-16T20:49:08.900820+0000","last_clean":"2023-12-16T20:49:08.900820+0000","last_became_active":"2023-12-16T20:21:36.523604+0000","last_became_peered":"2023-12-16T20:21:36.523604+0000","last_unstale":"2023-12-16T20:49:08.900820+0000","last_undegraded":"2023-12-16T20:49:08.900820+0000","last_fullsized":"2023-12-16T20:49:08.900820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'39","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.823448+0000","last_change":"2023-12-16T20:21:36.556286+0000","last_active":"2023-12-16T20:49:08.823448+0000","last_peered":"2023-12-16T20:49:08.823448+0000","last_clean":"2023-12-16T20:49:08.823448+0000","last_became_active":"2023-12-16T20:21:36.556041+0000","last_became_peered":"2023-12-16T20:21:36.556041+0000","last_unstale":"2023-12-16T20:49:08.823448+0000","last_undegraded":"2023-12-16T20:49:08.823448+0000","last_fullsized":"2023-12-16T20:49:08.823448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'39","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.894521+0000","last_change":"2023-12-16T20:21:36.518408+0000","last_active":"2023-12-16T20:49:08.894521+0000","last_peered":"2023-12-16T20:49:08.894521+0000","last_clean":"2023-12-16T20:49:08.894521+0000","last_became_active":"2023-12-16T20:21:36.518138+0000","last_became_peered":"2023-12-16T20:21:36.518138+0000","last_unstale":"2023-12-16T20:49:08.894521+0000","last_undegraded":"2023-12-16T20:49:08.894521+0000","last_fullsized":"2023-12-16T20:49:08.894521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'24","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.823139+0000","last_change":"2023-12-16T20:21:36.555311+0000","last_active":"2023-12-16T20:49:08.823139+0000","last_peered":"2023-12-16T20:49:08.823139+0000","last_clean":"2023-12-16T20:49:08.823139+0000","last_became_active":"2023-12-16T20:21:36.555041+0000","last_became_peered":"2023-12-16T20:21:36.555041+0000","last_unstale":"2023-12-16T20:49:08.823139+0000","last_undegraded":"2023-12-16T20:49:08.823139+0000","last_fullsized":"2023-12-16T20:49:08.823139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:20.609645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'44","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.971833+0000","last_change":"2023-12-16T20:21:36.524036+0000","last_active":"2023-12-16T20:49:08.971833+0000","last_peered":"2023-12-16T20:49:08.971833+0000","last_clean":"2023-12-16T20:49:08.971833+0000","last_became_active":"2023-12-16T20:21:36.523784+0000","last_became_peered":"2023-12-16T20:21:36.523784+0000","last_unstale":"2023-12-16T20:49:08.971833+0000","last_undegraded":"2023-12-16T20:49:08.971833+0000","last_fullsized":"2023-12-16T20:49:08.971833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'36","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.793242+0000","last_change":"2023-12-16T20:21:36.526391+0000","last_active":"2023-12-16T20:49:08.793242+0000","last_peered":"2023-12-16T20:49:08.793242+0000","last_clean":"2023-12-16T20:49:08.793242+0000","last_became_active":"2023-12-16T20:21:36.526151+0000","last_became_peered":"2023-12-16T20:21:36.526151+0000","last_unstale":"2023-12-16T20:49:08.793242+0000","last_undegraded":"2023-12-16T20:49:08.793242+0000","last_fullsized":"2023-12-16T20:49:08.793242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'28","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.900106+0000","last_change":"2023-12-16T20:21:36.543566+0000","last_active":"2023-12-16T20:49:08.900106+0000","last_peered":"2023-12-16T20:49:08.900106+0000","last_clean":"2023-12-16T20:49:08.900106+0000","last_became_active":"2023-12-16T20:21:36.543306+0000","last_became_peered":"2023-12-16T20:21:36.543306+0000","last_unstale":"2023-12-16T20:49:08.900106+0000","last_undegraded":"2023-12-16T20:49:08.900106+0000","last_fullsized":"2023-12-16T20:49:08.900106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:03.543973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4117,"num_write_kb":324188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4666,"ondisk_log_size":4666,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2442,"ondisk_log_size":2442,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40469915,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1038,"num_read_kb":1098,"num_write":9075,"num_write_kb":44922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56229888,"data_stored":80939830,"data_compressed":7486620,"data_compressed_allocated":11714560,"data_compressed_original":36487168,"omap_allocated":0,"internal_metadata":0},"log_size":8615,"ondisk_log_size":8615,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65176,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575186,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84588,"kb_used_data":17316,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94287252,"statfs":{"total":96636764160,"available":96550146048,"internally_reserved":0,"allocated":17731584,"data_stored":25875293,"data_compressed":2385754,"data_compressed_allocated":3723264,"data_compressed_original":12046336,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40300000000000002,"15min":0.39800000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53300000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.41999999999999998,"15min":0.42299999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56000000000000005,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.747}]},{"osd":1,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42499999999999999,"15min":0.41999999999999998},"min":{"1min":0.35099999999999998,"5min":0.24399999999999999,"15min":0.23799999999999999},"max":{"1min":0.59099999999999997,"5min":0.67200000000000004,"15min":0.70999999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.28599999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.54800000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.51000000000000001}]},{"osd":2,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40799999999999997,"15min":0.41099999999999998},"min":{"1min":0.26800000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.54600000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.44400000000000001,"15min":0.44500000000000001},"min":{"1min":0.36899999999999999,"5min":0.29399999999999998,"15min":0.29099999999999998},"max":{"1min":0.58199999999999996,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.44900000000000001}]},{"osd":3,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.438,"15min":0.432},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28000000000000003},"max":{"1min":0.57899999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45500000000000002,"15min":0.45800000000000002},"min":{"1min":0.30099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58099999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.71399999999999997}]},{"osd":4,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.27100000000000002,"5min":0.23200000000000001,"15min":0.20499999999999999},"max":{"1min":0.48899999999999999,"5min":0.501,"15min":0.621},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38100000000000001,"15min":0.374},"min":{"1min":0.27800000000000002,"5min":0.219,"15min":0.20899999999999999},"max":{"1min":0.52900000000000003,"5min":0.58199999999999996,"15min":0.624},"last":0.60999999999999999}]},{"osd":5,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38800000000000001,"15min":0.38700000000000001},"min":{"1min":0.27400000000000002,"5min":0.24199999999999999,"15min":0.24099999999999999},"max":{"1min":0.54600000000000004,"5min":0.63900000000000001,"15min":0.72099999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.40500000000000003,"15min":0.40600000000000003},"min":{"1min":0.316,"5min":0.25900000000000001,"15min":0.255},"max":{"1min":0.51400000000000001,"5min":0.57299999999999995,"15min":0.65700000000000003},"last":0.55400000000000005}]},{"osd":6,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41399999999999998},"min":{"1min":0.34599999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51000000000000001,"5min":0.53700000000000003,"15min":0.69499999999999995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.436,"15min":0.441},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.52400000000000002,"5min":0.623,"15min":0.65200000000000002},"last":0.66100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575186,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57068,"kb_used_data":12004,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94314772,"statfs":{"total":96636764160,"available":96578326528,"internally_reserved":0,"allocated":12292096,"data_stored":16896407,"data_compressed":1393950,"data_compressed_allocated":2220032,"data_compressed_original":7004160,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38200000000000001,"15min":0.39800000000000002},"min":{"1min":0.251,"5min":0.23200000000000001,"15min":0.217},"max":{"1min":0.505,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.433},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.433,"15min":0.432},"min":{"1min":0.26700000000000002,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":0.52600000000000002,"5min":0.60799999999999998,"15min":0.67100000000000004},"last":0.42199999999999999}]},{"osd":1,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.40100000000000002,"15min":0.40799999999999997},"min":{"1min":0.27100000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51400000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42599999999999999,"15min":0.42399999999999999},"min":{"1min":0.29799999999999999,"5min":0.26500000000000001,"15min":0.26400000000000001},"max":{"1min":0.54400000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.46700000000000003}]},{"osd":2,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40999999999999998,"15min":0.41699999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.52100000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.495},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.253},"max":{"1min":0.51200000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47699999999999998}]},{"osd":3,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44800000000000001,"15min":0.437},"min":{"1min":0.371,"5min":0.30599999999999999,"15min":0.26500000000000001},"max":{"1min":0.57999999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.433,"15min":0.44400000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.52400000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.45800000000000002}]},{"osd":4,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.379,"15min":0.37},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.217},"max":{"1min":0.48699999999999999,"5min":0.59199999999999997,"15min":0.64000000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.38900000000000001,"15min":0.38700000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55800000000000005,"5min":0.64300000000000002,"15min":0.68700000000000006},"last":0.32300000000000001}]},{"osd":5,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.38600000000000001,"15min":0.377},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.22900000000000001},"max":{"1min":0.54600000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42199999999999999,"15min":0.42099999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.57799999999999996,"5min":0.60699999999999998,"15min":0.67200000000000004},"last":0.36099999999999999}]},{"osd":7,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.27800000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.65700000000000003,"15min":0.69899999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42399999999999999,"15min":0.43099999999999999},"min":{"1min":0.29299999999999998,"5min":0.28299999999999997,"15min":0.27200000000000002},"max":{"1min":0.53600000000000003,"5min":0.60599999999999998,"15min":0.747},"last":0.40600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575186,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":118609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.26100000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":0.58599999999999997,"15min":0.64200000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.39800000000000002,"15min":0.41099999999999998},"min":{"1min":0.255,"5min":0.252,"15min":0.24399999999999999},"max":{"1min":0.59299999999999997,"5min":0.61299999999999999,"15min":0.65200000000000002},"last":0.79700000000000004}]},{"osd":1,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40899999999999997,"15min":0.41599999999999998},"min":{"1min":0.33700000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.64400000000000002},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.41199999999999998,"15min":0.42299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.65900000000000003},"last":0.68700000000000006}]},{"osd":2,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.31900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.53300000000000003,"5min":0.65000000000000002,"15min":0.65200000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.42499999999999999,"15min":0.43099999999999999},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":0.60199999999999998,"5min":0.63,"15min":0.71999999999999997},"last":0.85399999999999998}]},{"osd":3,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42199999999999999,"15min":0.42999999999999999},"min":{"1min":0.309,"5min":0.29999999999999999,"15min":0.29499999999999998},"max":{"1min":0.54000000000000004,"5min":0.57099999999999995,"15min":0.64400000000000002},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.34699999999999998,"5min":0.312,"15min":0.28199999999999997},"max":{"1min":0.61399999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.75900000000000001}]},{"osd":4,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36899999999999999,"15min":0.36099999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.224},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.22600000000000001},"max":{"1min":0.50800000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.56699999999999995}]},{"osd":6,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.26500000000000001,"15min":0.24199999999999999},"max":{"1min":0.62,"5min":0.63300000000000001,"15min":0.68999999999999995},"last":0.626},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.433,"15min":0.41599999999999998},"min":{"1min":0.28699999999999998,"5min":0.28000000000000003,"15min":0.26700000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.72099999999999997},"last":0.66100000000000003}]},{"osd":7,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.51900000000000002,"5min":0.61799999999999999,"15min":0.66300000000000003},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.45900000000000002,"15min":0.44600000000000001},"min":{"1min":0.30099999999999999,"5min":0.26700000000000002,"15min":0.26600000000000001},"max":{"1min":0.56599999999999995,"5min":0.66800000000000004,"15min":0.72099999999999997},"last":0.91000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575186,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65112,"kb_used_data":7568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94306728,"statfs":{"total":96636764160,"available":96570089472,"internally_reserved":0,"allocated":7749632,"data_stored":11004073,"data_compressed":1082070,"data_compressed_allocated":1703936,"data_compressed_original":5144576,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.43099999999999999,"15min":0.42499999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.622,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.44400000000000001,"15min":0.434},"min":{"1min":0.32400000000000001,"5min":0.26600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.68899999999999995},"last":0.46400000000000002}]},{"osd":1,"last update":"Sat Dec 16 20:48:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.442,"15min":0.437},"min":{"1min":0.32200000000000001,"5min":0.29799999999999999,"15min":0.27900000000000003},"max":{"1min":0.58399999999999996,"5min":0.59599999999999997,"15min":0.67100000000000004},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.43099999999999999,"15min":0.42199999999999999},"min":{"1min":0.29599999999999999,"5min":0.28599999999999998,"15min":0.26600000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.66100000000000003},"last":0.41999999999999998}]},{"osd":2,"last update":"Sat Dec 16 20:48:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.433,"15min":0.42799999999999999},"min":{"1min":0.28299999999999997,"5min":0.255,"15min":0.255},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.45300000000000001},"min":{"1min":0.38600000000000001,"5min":0.311,"15min":0.309},"max":{"1min":0.56899999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.436}]},{"osd":3,"last update":"Sat Dec 16 20:48:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44600000000000001,"15min":0.43099999999999999},"min":{"1min":0.33900000000000002,"5min":0.309,"15min":0.27900000000000003},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.377,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.58999999999999997,"5min":0.68500000000000005,"15min":0.79400000000000004},"last":0.44600000000000001}]},{"osd":5,"last update":"Sat Dec 16 20:48:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.378,"15min":0.378},"min":{"1min":0.26400000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.60399999999999998},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.40600000000000003,"15min":0.39000000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.22},"max":{"1min":0.503,"5min":0.58999999999999997,"15min":0.63100000000000001},"last":0.33500000000000002}]},{"osd":6,"last update":"Sat Dec 16 20:48:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40100000000000002,"15min":0.39400000000000002},"min":{"1min":0.30399999999999999,"5min":0.27600000000000002,"15min":0.23799999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.75},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.44500000000000001,"15min":0.42999999999999999},"min":{"1min":0.30099999999999999,"5min":0.26400000000000001,"15min":0.22600000000000001},"max":{"1min":0.57799999999999996,"5min":0.59799999999999998,"15min":0.60899999999999999},"last":0.36599999999999999}]},{"osd":7,"last update":"Sat Dec 16 20:48:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.439,"15min":0.42799999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.25600000000000001},"max":{"1min":0.54700000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.46800000000000003,"15min":0.45600000000000002},"min":{"1min":0.318,"5min":0.308,"15min":0.27000000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.77600000000000002},"last":0.35499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575186,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58848,"kb_used_data":9624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312992,"statfs":{"total":96636764160,"available":96576503808,"internally_reserved":0,"allocated":9854976,"data_stored":12924992,"data_compressed":1002682,"data_compressed_allocated":1646592,"data_compressed_original":4898816,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.28999999999999998,"15min":0.28499999999999998},"min":{"1min":0.222,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":0.38300000000000001,"5min":0.48699999999999999,"15min":0.52600000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.317,"5min":0.30299999999999999,"15min":0.29699999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.46600000000000003,"5min":0.48899999999999999,"15min":0.56999999999999995},"last":0.31}]},{"osd":1,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29999999999999999},"min":{"1min":0.22700000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.434,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.317,"5min":0.32500000000000001,"15min":0.32300000000000001},"min":{"1min":0.245,"5min":0.21099999999999999,"15min":0.19900000000000001},"max":{"1min":0.40200000000000002,"5min":0.48299999999999998,"15min":0.56100000000000005},"last":0.36199999999999999}]},{"osd":2,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.33300000000000002,"15min":0.33400000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.222},"max":{"1min":0.443,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35299999999999998,"15min":0.35199999999999998},"min":{"1min":0.29899999999999999,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":0.44900000000000001,"5min":0.51100000000000001,"15min":0.53600000000000003},"last":0.32900000000000001}]},{"osd":4,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40500000000000003,"15min":0.41299999999999998},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.27600000000000002},"max":{"1min":0.52900000000000003,"5min":0.53000000000000003,"15min":0.69999999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.443,"15min":0.439},"min":{"1min":0.35199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56699999999999995,"5min":0.70399999999999996,"15min":0.72399999999999998},"last":0.433}]},{"osd":5,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.435,"15min":0.44},"min":{"1min":0.35399999999999998,"5min":0.31900000000000001,"15min":0.313},"max":{"1min":0.55200000000000005,"5min":0.68100000000000005,"15min":0.76900000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.45100000000000001,"15min":0.45400000000000001},"min":{"1min":0.38300000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.52400000000000002,"5min":0.61499999999999999,"15min":0.71599999999999997},"last":0.51900000000000002}]},{"osd":6,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44,"15min":0.44500000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.73599999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45600000000000002,"15min":0.46300000000000002},"min":{"1min":0.372,"5min":0.317,"15min":0.317},"max":{"1min":0.64100000000000001,"5min":0.66700000000000004,"15min":0.75},"last":0.54600000000000004}]},{"osd":7,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48299999999999998,"15min":0.48099999999999998},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.34000000000000002},"max":{"1min":0.57299999999999995,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44700000000000001,"15min":0.45700000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.56599999999999995,"5min":0.63400000000000001,"15min":0.68999999999999995},"last":0.53600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575186,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":341408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.309,"15min":0.30199999999999999},"min":{"1min":0.19500000000000001,"5min":0.18099999999999999,"15min":0.17000000000000001},"max":{"1min":0.51500000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.30099999999999999,"15min":0.30199999999999999},"min":{"1min":0.23100000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.49199999999999999,"5min":0.55800000000000005,"15min":0.623},"last":0.35399999999999998}]},{"osd":1,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.26200000000000001,"5min":0.23300000000000001,"15min":0.193},"max":{"1min":0.53200000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.32100000000000001,"15min":0.32700000000000001},"min":{"1min":0.254,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.45600000000000002,"5min":0.54700000000000004,"15min":0.54800000000000004},"last":0.38800000000000001}]},{"osd":3,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.23599999999999999,"5min":0.23100000000000001,"15min":0.214},"max":{"1min":0.47099999999999997,"5min":0.53800000000000003,"15min":0.58599999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.36399999999999999,"15min":0.36199999999999999},"min":{"1min":0.29099999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.60599999999999998},"last":0.41299999999999998}]},{"osd":4,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.42699999999999999},"min":{"1min":0.35499999999999998,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.58899999999999997,"5min":0.60699999999999998,"15min":0.66500000000000004},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42999999999999999},"min":{"1min":0.35499999999999998,"5min":0.314,"15min":0.29499999999999998},"max":{"1min":0.50600000000000001,"5min":0.59099999999999997,"15min":0.72899999999999998},"last":0.64900000000000002}]},{"osd":5,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.33400000000000002,"5min":0.311,"15min":0.30299999999999999},"max":{"1min":0.54300000000000004,"5min":0.61799999999999999,"15min":0.755},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.45300000000000001},"min":{"1min":0.38500000000000001,"5min":0.33600000000000002,"15min":0.33100000000000002},"max":{"1min":0.56699999999999995,"5min":0.65400000000000003,"15min":0.67000000000000004},"last":0.66000000000000003}]},{"osd":6,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.437,"15min":0.44600000000000001},"min":{"1min":0.34399999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.55100000000000005,"5min":0.67500000000000004,"15min":0.68400000000000005},"last":0.628},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47899999999999998,"15min":0.47599999999999998},"min":{"1min":0.374,"5min":0.36499999999999999,"15min":0.32500000000000001},"max":{"1min":0.60099999999999998,"5min":0.63600000000000001,"15min":0.77400000000000002},"last":0.66900000000000004}]},{"osd":7,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46999999999999997,"15min":0.47299999999999998},"min":{"1min":0.36399999999999999,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.61899999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.45000000000000001,"15min":0.46200000000000002},"min":{"1min":0.35599999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.65300000000000002},"last":0.68700000000000006}]}]},{"osd":1,"up_from":13,"seq":55834575186,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42460,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329380,"statfs":{"total":96636764160,"available":96593285120,"internally_reserved":0,"allocated":3035136,"data_stored":4312983,"data_compressed":488319,"data_compressed_allocated":745472,"data_compressed_original":2203648,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.27400000000000002,"15min":0.27600000000000002},"min":{"1min":0.20000000000000001,"5min":0.184,"15min":0.16800000000000001},"max":{"1min":0.42099999999999999,"5min":0.46100000000000002,"15min":0.61499999999999999},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.309,"5min":0.31,"15min":0.316},"min":{"1min":0.22600000000000001,"5min":0.218,"15min":0.21199999999999999},"max":{"1min":0.38300000000000001,"5min":0.55500000000000005,"15min":0.56499999999999995},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.29299999999999998,"5min":0.28499999999999998,"15min":0.29199999999999998},"min":{"1min":0.22600000000000001,"5min":0.20599999999999999,"15min":0.19},"max":{"1min":0.377,"5min":0.44,"15min":0.51200000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.32400000000000001,"15min":0.32000000000000001},"min":{"1min":0.245,"5min":0.221,"15min":0.20999999999999999},"max":{"1min":0.40200000000000002,"5min":0.56200000000000006,"15min":0.58499999999999996},"last":0.30299999999999999}]},{"osd":3,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.34599999999999997},"min":{"1min":0.28399999999999997,"5min":0.23200000000000001,"15min":0.223},"max":{"1min":0.40400000000000003,"5min":0.499,"15min":0.55800000000000005},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34200000000000003},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48099999999999998,"5min":0.52500000000000002,"15min":0.59699999999999998},"last":0.26900000000000002}]},{"osd":4,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40100000000000002,"15min":0.40600000000000003},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.64100000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.432,"15min":0.433},"min":{"1min":0.35499999999999998,"5min":0.32100000000000001,"15min":0.307},"max":{"1min":0.55800000000000005,"5min":0.57999999999999996,"15min":0.65400000000000003},"last":0.48699999999999999}]},{"osd":5,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42599999999999999,"15min":0.441},"min":{"1min":0.35599999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.64600000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.42799999999999999,"15min":0.436},"min":{"1min":0.34599999999999997,"5min":0.318,"15min":0.28100000000000003},"max":{"1min":0.57899999999999996,"5min":0.64500000000000002,"15min":0.69299999999999995},"last":0.47299999999999998}]},{"osd":6,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.39300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.58099999999999996,"5min":0.65800000000000003,"15min":0.754},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.36099999999999999,"5min":0.33300000000000002,"15min":0.29999999999999999},"max":{"1min":0.55500000000000005,"5min":0.628,"15min":0.73099999999999998},"last":0.5}]},{"osd":7,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.33700000000000002},"max":{"1min":0.60099999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.58299999999999996,"5min":0.64300000000000002,"15min":0.71799999999999997},"last":0.46300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575186,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60428,"kb_used_data":7044,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311412,"statfs":{"total":96636764160,"available":96574885888,"internally_reserved":0,"allocated":7213056,"data_stored":11594953,"data_compressed":1199021,"data_compressed_allocated":1765376,"data_compressed_original":6336512,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.27700000000000002,"5min":0.27900000000000003,"15min":0.28299999999999997},"min":{"1min":0.189,"5min":0.17299999999999999,"15min":0.17100000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.56799999999999995},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.317,"5min":0.316,"15min":0.307},"min":{"1min":0.22700000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.44,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.377}]},{"osd":2,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.308,"15min":0.30499999999999999},"min":{"1min":0.20300000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.45100000000000001,"5min":0.52300000000000002,"15min":0.54900000000000004},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.32600000000000001,"15min":0.32200000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.20300000000000001},"max":{"1min":0.42899999999999999,"5min":0.57899999999999996,"15min":0.66400000000000003},"last":0.35299999999999998}]},{"osd":3,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.20399999999999999},"max":{"1min":0.46700000000000003,"5min":0.52400000000000002,"15min":0.54100000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34000000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.224},"max":{"1min":0.45000000000000001,"5min":0.59199999999999997,"15min":0.60999999999999999},"last":0.39600000000000002}]},{"osd":4,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.433,"15min":0.434},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.54000000000000004,"5min":0.67900000000000005,"15min":0.69799999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.435},"min":{"1min":0.36299999999999999,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.56000000000000005,"5min":0.60399999999999998,"15min":0.64200000000000002},"last":0.53000000000000003}]},{"osd":5,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46100000000000002,"15min":0.443},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.29999999999999999},"max":{"1min":0.58499999999999996,"5min":0.67900000000000005,"15min":0.69899999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46600000000000003,"15min":0.46300000000000002},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.59399999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.623}]},{"osd":6,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.375,"5min":0.32600000000000001,"15min":0.31900000000000001},"max":{"1min":0.628,"5min":0.69199999999999995,"15min":0.71799999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.46000000000000002},"min":{"1min":0.38600000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.60899999999999999,"5min":0.70299999999999996,"15min":0.73499999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.40799999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65200000000000002,"5min":0.69999999999999996,"15min":0.73599999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.34000000000000002},"max":{"1min":0.66100000000000003,"5min":0.66800000000000004,"15min":0.69099999999999995},"last":0.56000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6856704,"data_stored":10886066,"data_compressed":1166433,"data_compressed_allocated":1720320,"data_compressed_original":5763072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2744320,"data_stored":4194464,"data_compressed":488319,"data_compressed_allocated":745472,"data_compressed_original":2203648,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":222889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9564160,"data_stored":12806473,"data_compressed":1002682,"data_compressed_allocated":1646592,"data_compressed_original":4898816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7458816,"data_stored":10885554,"data_compressed":1082070,"data_compressed_allocated":1703936,"data_compressed_original":5144576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12001280,"data_stored":16777888,"data_compressed":1393950,"data_compressed_allocated":2220032,"data_compressed_original":7004160,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17375232,"data_stored":25166406,"data_compressed":2353166,"data_compressed_allocated":3678208,"data_compressed_original":11472896,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T20:49:15.501 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T20:49:15.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.634+0000 7f4cb3cfc640 1 Processor -- start 2023-12-16T20:49:15.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.634+0000 7f4cb3cfc640 1 -- start start 2023-12-16T20:49:15.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.634+0000 7f4cb3cfc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac14fd70 0x7f4cac070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:15.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.634+0000 7f4cb3cfc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4cac071c40 0x7f4cac0c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:15.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.635+0000 7f4cb3cfc640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4cac0c7eb0 0x7f4cac159760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:15.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.635+0000 7f4cb3cfc640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cac0c82c0 con 0x7f4cac071c40 2023-12-16T20:49:15.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.635+0000 7f4cb3cfc640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cac155b20 con 0x7f4cac0c7eb0 2023-12-16T20:49:15.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.635+0000 7f4cb3cfc640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac071420 con 0x7f4cac14fd70 2023-12-16T20:49:15.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.635+0000 7f4cb1297640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4cac071c40 0x7f4cac0c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:15.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.635+0000 7f4cb1a98640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac14fd70 0x7f4cac070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:15.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.635+0000 7f4cb2299640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4cac0c7eb0 0x7f4cac159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:15.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.635+0000 7f4cb1297640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4cac071c40 0x7f4cac0c7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44714/0 (socket says 172.21.15.87:44714) 2023-12-16T20:49:15.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.635+0000 7f4cb1297640 1 -- 172.21.15.87:0/2717304916 learned_addr learned my addr 172.21.15.87:0/2717304916 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:15.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.638+0000 7f4cb1297640 1 -- 172.21.15.87:0/2717304916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac14fd70 msgr2=0x7f4cac070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:15.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.638+0000 7f4cb1297640 1 --2- 172.21.15.87:0/2717304916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac14fd70 0x7f4cac070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:15.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.638+0000 7f4cb1297640 1 -- 172.21.15.87:0/2717304916 >> v2:172.21.15.195:3300/0 conn(0x7f4cac0c7eb0 msgr2=0x7f4cac159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:15.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.638+0000 7f4cb1297640 1 --2- 172.21.15.87:0/2717304916 >> v2:172.21.15.195:3300/0 conn(0x7f4cac0c7eb0 0x7f4cac159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:15.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.638+0000 7f4cb1297640 1 -- 172.21.15.87:0/2717304916 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac1592d0 con 0x7f4cac071c40 2023-12-16T20:49:15.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.640+0000 7f4cb1297640 1 --2- 172.21.15.87:0/2717304916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cac071c40 0x7f4cac0c7970 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4cac0b0640 tx=0x7f4c9c02de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdfc79821d2bb74b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:15.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.643+0000 7f4cb0a96640 1 -- 172.21.15.87:0/2717304916 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c02ebc0 con 0x7f4cac071c40 2023-12-16T20:49:15.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.643+0000 7f4cb0a96640 1 -- 172.21.15.87:0/2717304916 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c032070 con 0x7f4cac071c40 2023-12-16T20:49:15.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.643+0000 7f4cb0a96640 1 -- 172.21.15.87:0/2717304916 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c038400 con 0x7f4cac071c40 2023-12-16T20:49:15.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.644+0000 7f4cb3cfc640 1 -- 172.21.15.87:0/2717304916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cac071c40 msgr2=0x7f4cac0c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:15.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.644+0000 7f4cb3cfc640 1 --2- 172.21.15.87:0/2717304916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cac071c40 0x7f4cac0c7970 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4cac0b0640 tx=0x7f4c9c02de10 comp rx=0 tx=0).stop 2023-12-16T20:49:15.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.644+0000 7f4cb3cfc640 1 -- 172.21.15.87:0/2717304916 shutdown_connections 2023-12-16T20:49:15.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.644+0000 7f4cb3cfc640 1 --2- 172.21.15.87:0/2717304916 >> v2:172.21.15.195:3300/0 conn(0x7f4cac0c7eb0 0x7f4cac159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:15.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.644+0000 7f4cb3cfc640 1 --2- 172.21.15.87:0/2717304916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cac071c40 0x7f4cac0c7970 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:15.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.644+0000 7f4cb3cfc640 1 --2- 172.21.15.87:0/2717304916 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac14fd70 0x7f4cac070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:15.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.644+0000 7f4cb3cfc640 1 -- 172.21.15.87:0/2717304916 >> 172.21.15.87:0/2717304916 conn(0x7f4cac06cd60 msgr2=0x7f4cac06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:15.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.644+0000 7f4cb3cfc640 1 -- 172.21.15.87:0/2717304916 shutdown_connections 2023-12-16T20:49:15.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.644+0000 7f4cb3cfc640 1 -- 172.21.15.87:0/2717304916 wait complete. 2023-12-16T20:49:15.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.645+0000 7f4cb3cfc640 1 Processor -- start 2023-12-16T20:49:15.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.645+0000 7f4cb3cfc640 1 -- start start 2023-12-16T20:49:15.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.646+0000 7f4cb3cfc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac071c40 0x7f4cac1442d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:15.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.646+0000 7f4cb3cfc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cac0c7eb0 0x7f4cac14b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:15.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.646+0000 7f4cb3cfc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cac14fd70 0x7f4cac13e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:15.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.646+0000 7f4cb3cfc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac0c98d0 con 0x7f4cac14fd70 2023-12-16T20:49:15.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.646+0000 7f4cb3cfc640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac0c8ce0 con 0x7f4cac0c7eb0 2023-12-16T20:49:15.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.646+0000 7f4cb3cfc640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac0ca770 con 0x7f4cac071c40 2023-12-16T20:49:15.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.646+0000 7f4cb2299640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cac14fd70 0x7f4cac13e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:15.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.646+0000 7f4cb1a98640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac071c40 0x7f4cac1442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:15.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.647+0000 7f4cb1297640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cac0c7eb0 0x7f4cac14b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:15.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.647+0000 7f4cb2299640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cac14fd70 0x7f4cac13e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44730/0 (socket says 172.21.15.87:44730) 2023-12-16T20:49:15.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.647+0000 7f4cb2299640 1 -- 172.21.15.87:0/1955540913 learned_addr learned my addr 172.21.15.87:0/1955540913 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:15.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.650+0000 7f4cb2299640 1 -- 172.21.15.87:0/1955540913 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac071c40 msgr2=0x7f4cac1442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:15.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.650+0000 7f4cb2299640 1 --2- 172.21.15.87:0/1955540913 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac071c40 0x7f4cac1442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:15.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.650+0000 7f4cb2299640 1 -- 172.21.15.87:0/1955540913 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cac0c7eb0 msgr2=0x7f4cac14b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:15.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.650+0000 7f4cb2299640 1 --2- 172.21.15.87:0/1955540913 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cac0c7eb0 0x7f4cac14b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:15.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.650+0000 7f4cb2299640 1 -- 172.21.15.87:0/1955540913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c00b760 con 0x7f4cac14fd70 2023-12-16T20:49:15.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.652+0000 7f4cb2299640 1 --2- 172.21.15.87:0/1955540913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cac14fd70 0x7f4cac13e810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800eed0 tx=0x7f4ca800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:15.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.655+0000 7f4ca27fc640 1 -- 172.21.15.87:0/1955540913 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8010040 con 0x7f4cac14fd70 2023-12-16T20:49:15.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.655+0000 7f4ca27fc640 1 -- 172.21.15.87:0/1955540913 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca8014400 con 0x7f4cac14fd70 2023-12-16T20:49:15.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.655+0000 7f4ca27fc640 1 -- 172.21.15.87:0/1955540913 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8009ea0 con 0x7f4cac14fd70 2023-12-16T20:49:15.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.655+0000 7f4cb3cfc640 1 -- 172.21.15.87:0/1955540913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cac0c9410 con 0x7f4cac14fd70 2023-12-16T20:49:15.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.656+0000 7f4cb3cfc640 1 -- 172.21.15.87:0/1955540913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cac14a1b0 con 0x7f4cac14fd70 2023-12-16T20:49:15.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.656+0000 7f4cb3cfc640 1 -- 172.21.15.87:0/1955540913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cac067500 con 0x7f4cac14fd70 2023-12-16T20:49:15.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.675+0000 7f4ca27fc640 1 -- 172.21.15.87:0/1955540913 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f4ca80147b0 con 0x7f4cac14fd70 2023-12-16T20:49:15.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.675+0000 7f4ca27fc640 1 --2- 172.21.15.87:0/1955540913 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f4c9006ae90 0x7f4c9006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:15.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.676+0000 7f4cb1a98640 1 --2- 172.21.15.87:0/1955540913 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f4c9006ae90 0x7f4c9006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:15.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.676+0000 7f4cb1a98640 1 --2- 172.21.15.87:0/1955540913 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f4c9006ae90 0x7f4c9006d350 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4009aa0 tx=0x7f4ca4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:15.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.913+0000 7f4ca27fc640 1 -- 172.21.15.87:0/1955540913 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f4ca80592c0 con 0x7f4cac14fd70 2023-12-16T20:49:15.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:15.913+0000 7f4ca27fc640 1 -- 172.21.15.87:0/1955540913 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f4ca8055600 con 0x7f4cac14fd70 2023-12-16T20:49:16.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.084+0000 7f4cb3cfc640 1 -- 172.21.15.87:0/1955540913 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4cac0c6bb0 con 0x7f4c9006ae90 2023-12-16T20:49:16.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.093+0000 7f4ca27fc640 1 -- 172.21.15.87:0/1955540913 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371496 (secure 0 0 0) 0x7f4ca4011a00 con 0x7f4c9006ae90 2023-12-16T20:49:16.098 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:49:16.101 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-12-16T20:49:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.096+0000 7f4cb3cfc640 1 -- 172.21.15.87:0/1955540913 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f4c9006ae90 msgr2=0x7f4c9006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.096+0000 7f4cb3cfc640 1 --2- 172.21.15.87:0/1955540913 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f4c9006ae90 0x7f4c9006d350 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4009aa0 tx=0x7f4ca4009190 comp rx=0 tx=0).stop 2023-12-16T20:49:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.096+0000 7f4cb3cfc640 1 -- 172.21.15.87:0/1955540913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cac14fd70 msgr2=0x7f4cac13e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.096+0000 7f4cb3cfc640 1 --2- 172.21.15.87:0/1955540913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cac14fd70 0x7f4cac13e810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800eed0 tx=0x7f4ca800b480 comp rx=0 tx=0).stop 2023-12-16T20:49:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.097+0000 7f4cb3cfc640 1 -- 172.21.15.87:0/1955540913 shutdown_connections 2023-12-16T20:49:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.097+0000 7f4cb3cfc640 1 --2- 172.21.15.87:0/1955540913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cac14fd70 0x7f4cac13e810 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.097+0000 7f4cb3cfc640 1 --2- 172.21.15.87:0/1955540913 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f4c9006ae90 0x7f4c9006d350 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.097+0000 7f4cb3cfc640 1 --2- 172.21.15.87:0/1955540913 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cac0c7eb0 0x7f4cac14b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.097+0000 7f4cb3cfc640 1 --2- 172.21.15.87:0/1955540913 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4cac071c40 0x7f4cac1442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.097+0000 7f4cb3cfc640 1 -- 172.21.15.87:0/1955540913 >> 172.21.15.87:0/1955540913 conn(0x7f4cac06cd60 msgr2=0x7f4cac14f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.097+0000 7f4cb3cfc640 1 -- 172.21.15.87:0/1955540913 shutdown_connections 2023-12-16T20:49:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.097+0000 7f4cb3cfc640 1 -- 172.21.15.87:0/1955540913 wait complete. 2023-12-16T20:49:16.109 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":857,"stamp":"2023-12-16T20:49:14.645981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41060283,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1154,"num_read_kb":1198,"num_write":13351,"num_write_kb":371526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15840,"ondisk_log_size":15840,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":431648,"kb_used_data":57312,"kb_used_omap":12,"kb_used_meta":374259,"kb_avail":754543072,"statfs":{"total":773094113280,"available":772652105728,"internally_reserved":0,"allocated":58687488,"data_stored":83068718,"data_compressed":7551796,"data_compressed_allocated":11804672,"data_compressed_original":37634048,"omap_allocated":12751,"internal_metadata":383241777},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19037,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":18,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003182"},"pg_stats":[{"pgid":"2.1f","version":"27'642","reported_seq":673,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:50.514980+0000","last_change":"2023-12-16T20:21:35.413343+0000","last_active":"2023-12-16T20:48:50.514980+0000","last_peered":"2023-12-16T20:48:50.514980+0000","last_clean":"2023-12-16T20:48:50.514980+0000","last_became_active":"2023-12-16T20:21:35.413075+0000","last_became_peered":"2023-12-16T20:21:35.413075+0000","last_unstale":"2023-12-16T20:48:50.514980+0000","last_undegraded":"2023-12-16T20:48:50.514980+0000","last_fullsized":"2023-12-16T20:48:50.514980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'31","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.790583+0000","last_change":"2023-12-16T20:21:36.542907+0000","last_active":"2023-12-16T20:49:08.790583+0000","last_peered":"2023-12-16T20:49:08.790583+0000","last_clean":"2023-12-16T20:49:08.790583+0000","last_became_active":"2023-12-16T20:21:36.542667+0000","last_became_peered":"2023-12-16T20:21:36.542667+0000","last_unstale":"2023-12-16T20:49:08.790583+0000","last_undegraded":"2023-12-16T20:49:08.790583+0000","last_fullsized":"2023-12-16T20:49:08.790583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'182","reported_seq":208,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.469341+0000","last_change":"2023-12-16T20:21:41.216466+0000","last_active":"2023-12-16T20:48:41.469341+0000","last_peered":"2023-12-16T20:48:41.469341+0000","last_clean":"2023-12-16T20:48:41.469341+0000","last_became_active":"2023-12-16T20:21:41.216062+0000","last_became_peered":"2023-12-16T20:21:41.216062+0000","last_unstale":"2023-12-16T20:48:41.469341+0000","last_undegraded":"2023-12-16T20:48:41.469341+0000","last_fullsized":"2023-12-16T20:48:41.469341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:33:01.663841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":13331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'710","reported_seq":741,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:47:41.528829+0000","last_change":"2023-12-16T20:21:35.420038+0000","last_active":"2023-12-16T20:47:41.528829+0000","last_peered":"2023-12-16T20:47:41.528829+0000","last_clean":"2023-12-16T20:47:41.528829+0000","last_became_active":"2023-12-16T20:21:35.419745+0000","last_became_peered":"2023-12-16T20:21:35.419745+0000","last_unstale":"2023-12-16T20:47:41.528829+0000","last_undegraded":"2023-12-16T20:47:41.528829+0000","last_fullsized":"2023-12-16T20:47:41.528829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'38","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.972297+0000","last_change":"2023-12-16T20:21:36.552916+0000","last_active":"2023-12-16T20:49:08.972297+0000","last_peered":"2023-12-16T20:49:08.972297+0000","last_clean":"2023-12-16T20:49:08.972297+0000","last_became_active":"2023-12-16T20:21:36.552621+0000","last_became_peered":"2023-12-16T20:21:36.552621+0000","last_unstale":"2023-12-16T20:49:08.972297+0000","last_undegraded":"2023-12-16T20:49:08.972297+0000","last_fullsized":"2023-12-16T20:49:08.972297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'122","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:38.770349+0000","last_change":"2023-12-16T20:21:40.754959+0000","last_active":"2023-12-16T20:48:38.770349+0000","last_peered":"2023-12-16T20:48:38.770349+0000","last_clean":"2023-12-16T20:48:38.770349+0000","last_became_active":"2023-12-16T20:21:40.754509+0000","last_became_peered":"2023-12-16T20:21:40.754509+0000","last_unstale":"2023-12-16T20:48:38.770349+0000","last_undegraded":"2023-12-16T20:48:38.770349+0000","last_fullsized":"2023-12-16T20:48:38.770349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:21.787809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1392","reported_seq":1421,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:01.711787+0000","last_change":"2023-12-16T20:21:35.427622+0000","last_active":"2023-12-16T20:49:01.711787+0000","last_peered":"2023-12-16T20:49:01.711787+0000","last_clean":"2023-12-16T20:49:01.711787+0000","last_became_active":"2023-12-16T20:21:35.427317+0000","last_became_peered":"2023-12-16T20:21:35.427317+0000","last_unstale":"2023-12-16T20:49:01.711787+0000","last_undegraded":"2023-12-16T20:49:01.711787+0000","last_fullsized":"2023-12-16T20:49:01.711787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1392,"log_dups_size":0,"ondisk_log_size":1392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":9004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'33","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.888259+0000","last_change":"2023-12-16T20:22:14.769257+0000","last_active":"2023-12-16T20:49:08.888259+0000","last_peered":"2023-12-16T20:49:08.888259+0000","last_clean":"2023-12-16T20:49:08.888259+0000","last_became_active":"2023-12-16T20:22:14.768968+0000","last_became_peered":"2023-12-16T20:22:14.768968+0000","last_unstale":"2023-12-16T20:49:08.888259+0000","last_undegraded":"2023-12-16T20:49:08.888259+0000","last_fullsized":"2023-12-16T20:49:08.888259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"27'156","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.509449+0000","last_change":"2023-12-16T20:22:14.820429+0000","last_active":"2023-12-16T20:48:41.509449+0000","last_peered":"2023-12-16T20:48:41.509449+0000","last_clean":"2023-12-16T20:48:41.509449+0000","last_became_active":"2023-12-16T20:22:14.819924+0000","last_became_peered":"2023-12-16T20:22:14.819924+0000","last_unstale":"2023-12-16T20:48:41.509449+0000","last_undegraded":"2023-12-16T20:48:41.509449+0000","last_fullsized":"2023-12-16T20:48:41.509449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:10:42.982067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":12476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:59.710315+0000","last_change":"2023-12-16T20:21:35.413521+0000","last_active":"2023-12-16T20:48:59.710315+0000","last_peered":"2023-12-16T20:48:59.710315+0000","last_clean":"2023-12-16T20:48:59.710315+0000","last_became_active":"2023-12-16T20:21:35.413234+0000","last_became_peered":"2023-12-16T20:21:35.413234+0000","last_unstale":"2023-12-16T20:48:59.710315+0000","last_undegraded":"2023-12-16T20:48:59.710315+0000","last_fullsized":"2023-12-16T20:48:59.710315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'49","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.819877+0000","last_change":"2023-12-16T20:21:36.554419+0000","last_active":"2023-12-16T20:49:08.819877+0000","last_peered":"2023-12-16T20:49:08.819877+0000","last_clean":"2023-12-16T20:49:08.819877+0000","last_became_active":"2023-12-16T20:21:36.554014+0000","last_became_peered":"2023-12-16T20:21:36.554014+0000","last_unstale":"2023-12-16T20:49:08.819877+0000","last_undegraded":"2023-12-16T20:49:08.819877+0000","last_fullsized":"2023-12-16T20:49:08.819877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:03.543973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'146","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.419020+0000","last_change":"2023-12-16T20:21:40.794852+0000","last_active":"2023-12-16T20:48:41.419020+0000","last_peered":"2023-12-16T20:48:41.419020+0000","last_clean":"2023-12-16T20:48:41.419020+0000","last_became_active":"2023-12-16T20:21:40.794471+0000","last_became_peered":"2023-12-16T20:21:40.794471+0000","last_unstale":"2023-12-16T20:48:41.419020+0000","last_undegraded":"2023-12-16T20:48:41.419020+0000","last_fullsized":"2023-12-16T20:48:41.419020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:25.004850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'39","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.890251+0000","last_change":"2023-12-16T20:21:36.542450+0000","last_active":"2023-12-16T20:49:08.890251+0000","last_peered":"2023-12-16T20:49:08.890251+0000","last_clean":"2023-12-16T20:49:08.890251+0000","last_became_active":"2023-12-16T20:21:36.542157+0000","last_became_peered":"2023-12-16T20:21:36.542157+0000","last_unstale":"2023-12-16T20:49:08.890251+0000","last_undegraded":"2023-12-16T20:49:08.890251+0000","last_fullsized":"2023-12-16T20:49:08.890251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'680","reported_seq":710,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:01.713499+0000","last_change":"2023-12-16T20:21:35.413681+0000","last_active":"2023-12-16T20:49:01.713499+0000","last_peered":"2023-12-16T20:49:01.713499+0000","last_clean":"2023-12-16T20:49:01.713499+0000","last_became_active":"2023-12-16T20:21:35.413400+0000","last_became_peered":"2023-12-16T20:21:35.413400+0000","last_unstale":"2023-12-16T20:49:01.713499+0000","last_undegraded":"2023-12-16T20:49:01.713499+0000","last_fullsized":"2023-12-16T20:49:01.713499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:27.767422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":4429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'121","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.504489+0000","last_change":"2023-12-16T20:21:40.745971+0000","last_active":"2023-12-16T20:48:41.504489+0000","last_peered":"2023-12-16T20:48:41.504489+0000","last_clean":"2023-12-16T20:48:41.504489+0000","last_became_active":"2023-12-16T20:21:40.745544+0000","last_became_peered":"2023-12-16T20:21:40.745544+0000","last_unstale":"2023-12-16T20:48:41.504489+0000","last_undegraded":"2023-12-16T20:48:41.504489+0000","last_fullsized":"2023-12-16T20:48:41.504489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:18.981353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":10860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'38","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796186+0000","last_change":"2023-12-16T20:21:36.526277+0000","last_active":"2023-12-16T20:49:08.796186+0000","last_peered":"2023-12-16T20:49:08.796186+0000","last_clean":"2023-12-16T20:49:08.796186+0000","last_became_active":"2023-12-16T20:21:36.525983+0000","last_became_peered":"2023-12-16T20:21:36.525983+0000","last_unstale":"2023-12-16T20:49:08.796186+0000","last_undegraded":"2023-12-16T20:49:08.796186+0000","last_fullsized":"2023-12-16T20:49:08.796186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:56.620523+0000","last_change":"2023-12-16T20:21:35.420017+0000","last_active":"2023-12-16T20:48:56.620523+0000","last_peered":"2023-12-16T20:48:56.620523+0000","last_clean":"2023-12-16T20:48:56.620523+0000","last_became_active":"2023-12-16T20:21:35.419731+0000","last_became_peered":"2023-12-16T20:21:35.419731+0000","last_unstale":"2023-12-16T20:48:56.620523+0000","last_undegraded":"2023-12-16T20:48:56.620523+0000","last_fullsized":"2023-12-16T20:48:56.620523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:29.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'169","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.507104+0000","last_change":"2023-12-16T20:21:40.755335+0000","last_active":"2023-12-16T20:48:41.507104+0000","last_peered":"2023-12-16T20:48:41.507104+0000","last_clean":"2023-12-16T20:48:41.507104+0000","last_became_active":"2023-12-16T20:21:40.754829+0000","last_became_peered":"2023-12-16T20:21:40.754829+0000","last_unstale":"2023-12-16T20:48:41.507104+0000","last_undegraded":"2023-12-16T20:48:41.507104+0000","last_fullsized":"2023-12-16T20:48:41.507104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":10412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'38","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.797002+0000","last_change":"2023-12-16T20:21:36.518939+0000","last_active":"2023-12-16T20:49:08.797002+0000","last_peered":"2023-12-16T20:49:08.797002+0000","last_clean":"2023-12-16T20:49:08.797002+0000","last_became_active":"2023-12-16T20:21:36.518686+0000","last_became_peered":"2023-12-16T20:21:36.518686+0000","last_unstale":"2023-12-16T20:49:08.797002+0000","last_undegraded":"2023-12-16T20:49:08.797002+0000","last_fullsized":"2023-12-16T20:49:08.797002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:44.395374+0000","last_change":"2023-12-16T20:21:35.416372+0000","last_active":"2023-12-16T20:48:44.395374+0000","last_peered":"2023-12-16T20:48:44.395374+0000","last_clean":"2023-12-16T20:48:44.395374+0000","last_became_active":"2023-12-16T20:21:35.416067+0000","last_became_peered":"2023-12-16T20:21:35.416067+0000","last_unstale":"2023-12-16T20:48:44.395374+0000","last_undegraded":"2023-12-16T20:48:44.395374+0000","last_fullsized":"2023-12-16T20:48:44.395374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:37.215505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'126","reported_seq":153,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:37.734776+0000","last_change":"2023-12-16T20:21:41.215250+0000","last_active":"2023-12-16T20:48:37.734776+0000","last_peered":"2023-12-16T20:48:37.734776+0000","last_clean":"2023-12-16T20:48:37.734776+0000","last_became_active":"2023-12-16T20:21:41.214198+0000","last_became_peered":"2023-12-16T20:21:41.214198+0000","last_unstale":"2023-12-16T20:48:37.734776+0000","last_undegraded":"2023-12-16T20:48:37.734776+0000","last_fullsized":"2023-12-16T20:48:37.734776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:41.263768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":7034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'34","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.238701+0000","last_change":"2023-12-16T20:21:36.536797+0000","last_active":"2023-12-16T20:48:39.238701+0000","last_peered":"2023-12-16T20:48:39.238701+0000","last_clean":"2023-12-16T20:48:39.238701+0000","last_became_active":"2023-12-16T20:21:36.536321+0000","last_became_peered":"2023-12-16T20:21:36.536321+0000","last_unstale":"2023-12-16T20:48:39.238701+0000","last_undegraded":"2023-12-16T20:48:39.238701+0000","last_fullsized":"2023-12-16T20:48:39.238701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:55:55.607439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:57.613311+0000","last_change":"2023-12-16T20:21:35.425939+0000","last_active":"2023-12-16T20:48:57.613311+0000","last_peered":"2023-12-16T20:48:57.613311+0000","last_clean":"2023-12-16T20:48:57.613311+0000","last_became_active":"2023-12-16T20:21:35.420547+0000","last_became_peered":"2023-12-16T20:21:35.420547+0000","last_unstale":"2023-12-16T20:48:57.613311+0000","last_undegraded":"2023-12-16T20:48:57.613311+0000","last_fullsized":"2023-12-16T20:48:57.613311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:58:31.980302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'120","reported_seq":147,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.507092+0000","last_change":"2023-12-16T20:21:40.757445+0000","last_active":"2023-12-16T20:48:41.507092+0000","last_peered":"2023-12-16T20:48:41.507092+0000","last_clean":"2023-12-16T20:48:41.507092+0000","last_became_active":"2023-12-16T20:21:40.756997+0000","last_became_peered":"2023-12-16T20:21:40.756997+0000","last_unstale":"2023-12-16T20:48:41.507092+0000","last_undegraded":"2023-12-16T20:48:41.507092+0000","last_fullsized":"2023-12-16T20:48:41.507092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:32.702839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":6714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'40","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.970714+0000","last_change":"2023-12-16T20:21:36.524943+0000","last_active":"2023-12-16T20:49:08.970714+0000","last_peered":"2023-12-16T20:49:08.970714+0000","last_clean":"2023-12-16T20:49:08.970714+0000","last_became_active":"2023-12-16T20:21:36.524703+0000","last_became_peered":"2023-12-16T20:21:36.524703+0000","last_unstale":"2023-12-16T20:49:08.970714+0000","last_undegraded":"2023-12-16T20:49:08.970714+0000","last_fullsized":"2023-12-16T20:49:08.970714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:00.760340+0000","last_change":"2023-12-16T20:21:35.428736+0000","last_active":"2023-12-16T20:49:00.760340+0000","last_peered":"2023-12-16T20:49:00.760340+0000","last_clean":"2023-12-16T20:49:00.760340+0000","last_became_active":"2023-12-16T20:21:35.428465+0000","last_became_peered":"2023-12-16T20:21:35.428465+0000","last_unstale":"2023-12-16T20:49:00.760340+0000","last_undegraded":"2023-12-16T20:49:00.760340+0000","last_fullsized":"2023-12-16T20:49:00.760340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'152","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.504901+0000","last_change":"2023-12-16T20:21:41.213330+0000","last_active":"2023-12-16T20:48:41.504901+0000","last_peered":"2023-12-16T20:48:41.504901+0000","last_clean":"2023-12-16T20:48:41.504901+0000","last_became_active":"2023-12-16T20:21:41.212976+0000","last_became_peered":"2023-12-16T20:21:41.212976+0000","last_unstale":"2023-12-16T20:48:41.504901+0000","last_undegraded":"2023-12-16T20:48:41.504901+0000","last_fullsized":"2023-12-16T20:48:41.504901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:32:02.178544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":10330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'37","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.797154+0000","last_change":"2023-12-16T20:21:36.518956+0000","last_active":"2023-12-16T20:49:08.797154+0000","last_peered":"2023-12-16T20:49:08.797154+0000","last_clean":"2023-12-16T20:49:08.797154+0000","last_became_active":"2023-12-16T20:21:36.518673+0000","last_became_peered":"2023-12-16T20:21:36.518673+0000","last_unstale":"2023-12-16T20:49:08.797154+0000","last_undegraded":"2023-12-16T20:49:08.797154+0000","last_fullsized":"2023-12-16T20:49:08.797154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'310","reported_seq":340,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:05.580922+0000","last_change":"2023-12-16T20:21:35.423292+0000","last_active":"2023-12-16T20:49:05.580922+0000","last_peered":"2023-12-16T20:49:05.580922+0000","last_clean":"2023-12-16T20:49:05.580922+0000","last_became_active":"2023-12-16T20:21:35.423045+0000","last_became_peered":"2023-12-16T20:21:35.423045+0000","last_unstale":"2023-12-16T20:49:05.580922+0000","last_undegraded":"2023-12-16T20:49:05.580922+0000","last_fullsized":"2023-12-16T20:49:05.580922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":886,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'156","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.361966+0000","last_change":"2023-12-16T20:21:41.216113+0000","last_active":"2023-12-16T20:48:39.361966+0000","last_peered":"2023-12-16T20:48:39.361966+0000","last_clean":"2023-12-16T20:48:39.361966+0000","last_became_active":"2023-12-16T20:21:41.215747+0000","last_became_peered":"2023-12-16T20:21:41.215747+0000","last_unstale":"2023-12-16T20:48:39.361966+0000","last_undegraded":"2023-12-16T20:48:39.361966+0000","last_fullsized":"2023-12-16T20:48:39.361966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:10:17.859148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'35","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796438+0000","last_change":"2023-12-16T20:21:36.451660+0000","last_active":"2023-12-16T20:49:08.796438+0000","last_peered":"2023-12-16T20:49:08.796438+0000","last_clean":"2023-12-16T20:49:08.796438+0000","last_became_active":"2023-12-16T20:21:36.451404+0000","last_became_peered":"2023-12-16T20:21:36.451404+0000","last_unstale":"2023-12-16T20:49:08.796438+0000","last_undegraded":"2023-12-16T20:49:08.796438+0000","last_fullsized":"2023-12-16T20:49:08.796438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:47.488000+0000","last_change":"2023-12-16T20:21:35.420184+0000","last_active":"2023-12-16T20:48:47.488000+0000","last_peered":"2023-12-16T20:48:47.488000+0000","last_clean":"2023-12-16T20:48:47.488000+0000","last_became_active":"2023-12-16T20:21:35.419917+0000","last_became_peered":"2023-12-16T20:21:35.419917+0000","last_unstale":"2023-12-16T20:48:47.488000+0000","last_undegraded":"2023-12-16T20:48:47.488000+0000","last_fullsized":"2023-12-16T20:48:47.488000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:19.491578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'136","reported_seq":164,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:40.297506+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:48:40.297506+0000","last_peered":"2023-12-16T20:48:40.297506+0000","last_clean":"2023-12-16T20:48:40.297506+0000","last_became_active":"2023-12-16T20:21:41.212704+0000","last_became_peered":"2023-12-16T20:21:41.212704+0000","last_unstale":"2023-12-16T20:48:40.297506+0000","last_undegraded":"2023-12-16T20:48:40.297506+0000","last_fullsized":"2023-12-16T20:48:40.297506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:11.201128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":9011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'38","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820634+0000","last_change":"2023-12-16T20:21:36.555288+0000","last_active":"2023-12-16T20:49:08.820634+0000","last_peered":"2023-12-16T20:49:08.820634+0000","last_clean":"2023-12-16T20:49:08.820634+0000","last_became_active":"2023-12-16T20:21:36.555011+0000","last_became_peered":"2023-12-16T20:21:36.555011+0000","last_unstale":"2023-12-16T20:49:08.820634+0000","last_undegraded":"2023-12-16T20:49:08.820634+0000","last_fullsized":"2023-12-16T20:49:08.820634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:06.805922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:58.651724+0000","last_change":"2023-12-16T20:21:35.417945+0000","last_active":"2023-12-16T20:48:58.651724+0000","last_peered":"2023-12-16T20:48:58.651724+0000","last_clean":"2023-12-16T20:48:58.651724+0000","last_became_active":"2023-12-16T20:21:35.417683+0000","last_became_peered":"2023-12-16T20:21:35.417683+0000","last_unstale":"2023-12-16T20:48:58.651724+0000","last_undegraded":"2023-12-16T20:48:58.651724+0000","last_fullsized":"2023-12-16T20:48:58.651724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:18.427670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'180","reported_seq":208,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.512687+0000","last_change":"2023-12-16T20:21:40.794299+0000","last_active":"2023-12-16T20:48:41.512687+0000","last_peered":"2023-12-16T20:48:41.512687+0000","last_clean":"2023-12-16T20:48:41.512687+0000","last_became_active":"2023-12-16T20:21:40.793754+0000","last_became_peered":"2023-12-16T20:21:40.793754+0000","last_unstale":"2023-12-16T20:48:41.512687+0000","last_undegraded":"2023-12-16T20:48:41.512687+0000","last_fullsized":"2023-12-16T20:48:41.512687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:10.036962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":10123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'33","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820560+0000","last_change":"2023-12-16T20:21:36.534278+0000","last_active":"2023-12-16T20:49:08.820560+0000","last_peered":"2023-12-16T20:49:08.820560+0000","last_clean":"2023-12-16T20:49:08.820560+0000","last_became_active":"2023-12-16T20:21:36.533651+0000","last_became_peered":"2023-12-16T20:21:36.533651+0000","last_unstale":"2023-12-16T20:49:08.820560+0000","last_undegraded":"2023-12-16T20:49:08.820560+0000","last_fullsized":"2023-12-16T20:49:08.820560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:58:33.098369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'7","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:55.659121+0000","last_change":"2023-12-16T20:21:35.422128+0000","last_active":"2023-12-16T20:48:55.659121+0000","last_peered":"2023-12-16T20:48:55.659121+0000","last_clean":"2023-12-16T20:48:55.659121+0000","last_became_active":"2023-12-16T20:21:35.421875+0000","last_became_peered":"2023-12-16T20:21:35.421875+0000","last_unstale":"2023-12-16T20:48:55.659121+0000","last_undegraded":"2023-12-16T20:48:55.659121+0000","last_fullsized":"2023-12-16T20:48:55.659121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:24.569380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'112","reported_seq":140,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:33.903590+0000","last_change":"2023-12-16T20:21:40.754363+0000","last_active":"2023-12-16T20:48:33.903590+0000","last_peered":"2023-12-16T20:48:33.903590+0000","last_clean":"2023-12-16T20:48:33.903590+0000","last_became_active":"2023-12-16T20:21:40.753994+0000","last_became_peered":"2023-12-16T20:21:40.753994+0000","last_unstale":"2023-12-16T20:48:33.903590+0000","last_undegraded":"2023-12-16T20:48:33.903590+0000","last_fullsized":"2023-12-16T20:48:33.903590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:07.939178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'33","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.793432+0000","last_change":"2023-12-16T20:21:36.451488+0000","last_active":"2023-12-16T20:49:08.793432+0000","last_peered":"2023-12-16T20:49:08.793432+0000","last_clean":"2023-12-16T20:49:08.793432+0000","last_became_active":"2023-12-16T20:21:36.451231+0000","last_became_peered":"2023-12-16T20:21:36.451231+0000","last_unstale":"2023-12-16T20:49:08.793432+0000","last_undegraded":"2023-12-16T20:49:08.793432+0000","last_fullsized":"2023-12-16T20:49:08.793432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'1042","reported_seq":2111,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:02.716494+0000","last_change":"2023-12-16T20:21:35.420494+0000","last_active":"2023-12-16T20:49:02.716494+0000","last_peered":"2023-12-16T20:49:02.716494+0000","last_clean":"2023-12-16T20:49:02.716494+0000","last_became_active":"2023-12-16T20:21:35.420236+0000","last_became_peered":"2023-12-16T20:21:35.420236+0000","last_unstale":"2023-12-16T20:49:02.716494+0000","last_undegraded":"2023-12-16T20:49:02.716494+0000","last_fullsized":"2023-12-16T20:49:02.716494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1042,"log_dups_size":0,"ondisk_log_size":1042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:55:54.489373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222889,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1038,"num_read_kb":1098,"num_write":1039,"num_write_kb":1099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'134","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.367416+0000","last_change":"2023-12-16T20:22:14.842642+0000","last_active":"2023-12-16T20:48:39.367416+0000","last_peered":"2023-12-16T20:48:39.367416+0000","last_clean":"2023-12-16T20:48:39.367416+0000","last_became_active":"2023-12-16T20:22:14.842220+0000","last_became_peered":"2023-12-16T20:22:14.842220+0000","last_unstale":"2023-12-16T20:48:39.367416+0000","last_undegraded":"2023-12-16T20:48:39.367416+0000","last_fullsized":"2023-12-16T20:48:39.367416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":9129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"27'27","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.971875+0000","last_change":"2023-12-16T20:21:36.535835+0000","last_active":"2023-12-16T20:49:08.971875+0000","last_peered":"2023-12-16T20:49:08.971875+0000","last_clean":"2023-12-16T20:49:08.971875+0000","last_became_active":"2023-12-16T20:21:36.535571+0000","last_became_peered":"2023-12-16T20:21:36.535571+0000","last_unstale":"2023-12-16T20:49:08.971875+0000","last_undegraded":"2023-12-16T20:49:08.971875+0000","last_fullsized":"2023-12-16T20:49:08.971875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:54.719426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'544","reported_seq":575,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:57.613647+0000","last_change":"2023-12-16T20:21:35.418993+0000","last_active":"2023-12-16T20:48:57.613647+0000","last_peered":"2023-12-16T20:48:57.613647+0000","last_clean":"2023-12-16T20:48:57.613647+0000","last_became_active":"2023-12-16T20:21:35.418751+0000","last_became_peered":"2023-12-16T20:21:35.418751+0000","last_unstale":"2023-12-16T20:48:57.613647+0000","last_undegraded":"2023-12-16T20:48:57.613647+0000","last_fullsized":"2023-12-16T20:48:57.613647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:18.391557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'129","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.361465+0000","last_change":"2023-12-16T20:21:41.214405+0000","last_active":"2023-12-16T20:48:39.361465+0000","last_peered":"2023-12-16T20:48:39.361465+0000","last_clean":"2023-12-16T20:48:39.361465+0000","last_became_active":"2023-12-16T20:21:41.213977+0000","last_became_peered":"2023-12-16T20:21:41.213977+0000","last_unstale":"2023-12-16T20:48:39.361465+0000","last_undegraded":"2023-12-16T20:48:39.361465+0000","last_fullsized":"2023-12-16T20:48:39.361465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:16.656597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":8382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'30","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.793277+0000","last_change":"2023-12-16T20:21:36.551240+0000","last_active":"2023-12-16T20:49:08.793277+0000","last_peered":"2023-12-16T20:49:08.793277+0000","last_clean":"2023-12-16T20:49:08.793277+0000","last_became_active":"2023-12-16T20:21:36.550997+0000","last_became_peered":"2023-12-16T20:21:36.550997+0000","last_unstale":"2023-12-16T20:49:08.793277+0000","last_undegraded":"2023-12-16T20:49:08.793277+0000","last_fullsized":"2023-12-16T20:49:08.793277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'4","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:53.546511+0000","last_change":"2023-12-16T20:21:35.416258+0000","last_active":"2023-12-16T20:48:53.546511+0000","last_peered":"2023-12-16T20:48:53.546511+0000","last_clean":"2023-12-16T20:48:53.546511+0000","last_became_active":"2023-12-16T20:21:35.415984+0000","last_became_peered":"2023-12-16T20:21:35.415984+0000","last_unstale":"2023-12-16T20:48:53.546511+0000","last_undegraded":"2023-12-16T20:48:53.546511+0000","last_fullsized":"2023-12-16T20:48:53.546511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:06.872220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:45:31.524454+0000","last_change":"2023-12-16T20:21:25.196796+0000","last_active":"2023-12-16T20:45:31.524454+0000","last_peered":"2023-12-16T20:45:31.524454+0000","last_clean":"2023-12-16T20:45:31.524454+0000","last_became_active":"2023-12-16T20:21:25.195675+0000","last_became_peered":"2023-12-16T20:21:25.195675+0000","last_unstale":"2023-12-16T20:45:31.524454+0000","last_undegraded":"2023-12-16T20:45:31.524454+0000","last_fullsized":"2023-12-16T20:45:31.524454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:23.008820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:23.008820+0000","last_clean_scrub_stamp":"2023-12-16T20:21:23.008820+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:46:02.232774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'192","reported_seq":220,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.474899+0000","last_change":"2023-12-16T20:21:41.214322+0000","last_active":"2023-12-16T20:48:41.474899+0000","last_peered":"2023-12-16T20:48:41.474899+0000","last_clean":"2023-12-16T20:48:41.474899+0000","last_became_active":"2023-12-16T20:21:41.214012+0000","last_became_peered":"2023-12-16T20:21:41.214012+0000","last_unstale":"2023-12-16T20:48:41.474899+0000","last_undegraded":"2023-12-16T20:48:41.474899+0000","last_fullsized":"2023-12-16T20:48:41.474899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:18.981353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":12745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'36","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.904272+0000","last_change":"2023-12-16T20:21:36.552920+0000","last_active":"2023-12-16T20:49:08.904272+0000","last_peered":"2023-12-16T20:49:08.904272+0000","last_clean":"2023-12-16T20:49:08.904272+0000","last_became_active":"2023-12-16T20:21:36.552619+0000","last_became_peered":"2023-12-16T20:21:36.552619+0000","last_unstale":"2023-12-16T20:49:08.904272+0000","last_undegraded":"2023-12-16T20:49:08.904272+0000","last_fullsized":"2023-12-16T20:49:08.904272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:14.586148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:48.478829+0000","last_change":"2023-12-16T20:21:35.413597+0000","last_active":"2023-12-16T20:48:48.478829+0000","last_peered":"2023-12-16T20:48:48.478829+0000","last_clean":"2023-12-16T20:48:48.478829+0000","last_became_active":"2023-12-16T20:21:35.413308+0000","last_became_peered":"2023-12-16T20:21:35.413308+0000","last_unstale":"2023-12-16T20:48:48.478829+0000","last_undegraded":"2023-12-16T20:48:48.478829+0000","last_fullsized":"2023-12-16T20:48:48.478829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:55:39.544748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'151","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:37.719915+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:48:37.719915+0000","last_peered":"2023-12-16T20:48:37.719915+0000","last_clean":"2023-12-16T20:48:37.719915+0000","last_became_active":"2023-12-16T20:21:41.212608+0000","last_became_peered":"2023-12-16T20:21:41.212608+0000","last_unstale":"2023-12-16T20:48:37.719915+0000","last_undegraded":"2023-12-16T20:48:37.719915+0000","last_fullsized":"2023-12-16T20:48:37.719915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":6553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'41","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820554+0000","last_change":"2023-12-16T20:21:36.555870+0000","last_active":"2023-12-16T20:49:08.820554+0000","last_peered":"2023-12-16T20:49:08.820554+0000","last_clean":"2023-12-16T20:49:08.820554+0000","last_became_active":"2023-12-16T20:21:36.555631+0000","last_became_peered":"2023-12-16T20:21:36.555631+0000","last_unstale":"2023-12-16T20:49:08.820554+0000","last_undegraded":"2023-12-16T20:49:08.820554+0000","last_fullsized":"2023-12-16T20:49:08.820554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:10.421516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:44.395512+0000","last_change":"2023-12-16T20:21:35.416140+0000","last_active":"2023-12-16T20:48:44.395512+0000","last_peered":"2023-12-16T20:48:44.395512+0000","last_clean":"2023-12-16T20:48:44.395512+0000","last_became_active":"2023-12-16T20:21:35.415810+0000","last_became_peered":"2023-12-16T20:21:35.415810+0000","last_unstale":"2023-12-16T20:48:44.395512+0000","last_undegraded":"2023-12-16T20:48:44.395512+0000","last_fullsized":"2023-12-16T20:48:44.395512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'169","reported_seq":205,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:40.297366+0000","last_change":"2023-12-16T20:22:14.842693+0000","last_active":"2023-12-16T20:48:40.297366+0000","last_peered":"2023-12-16T20:48:40.297366+0000","last_clean":"2023-12-16T20:48:40.297366+0000","last_became_active":"2023-12-16T20:22:14.842282+0000","last_became_peered":"2023-12-16T20:22:14.842282+0000","last_unstale":"2023-12-16T20:48:40.297366+0000","last_undegraded":"2023-12-16T20:48:40.297366+0000","last_fullsized":"2023-12-16T20:48:40.297366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:28:08.269032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":8236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'35","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.900402+0000","last_change":"2023-12-16T20:21:36.536346+0000","last_active":"2023-12-16T20:49:08.900402+0000","last_peered":"2023-12-16T20:49:08.900402+0000","last_clean":"2023-12-16T20:49:08.900402+0000","last_became_active":"2023-12-16T20:21:36.536093+0000","last_became_peered":"2023-12-16T20:21:36.536093+0000","last_unstale":"2023-12-16T20:49:08.900402+0000","last_undegraded":"2023-12-16T20:49:08.900402+0000","last_fullsized":"2023-12-16T20:49:08.900402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:12.261391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'7","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:02.737207+0000","last_change":"2023-12-16T20:21:35.420314+0000","last_active":"2023-12-16T20:49:02.737207+0000","last_peered":"2023-12-16T20:49:02.737207+0000","last_clean":"2023-12-16T20:49:02.737207+0000","last_became_active":"2023-12-16T20:21:35.420074+0000","last_became_peered":"2023-12-16T20:21:35.420074+0000","last_unstale":"2023-12-16T20:49:02.737207+0000","last_undegraded":"2023-12-16T20:49:02.737207+0000","last_fullsized":"2023-12-16T20:49:02.737207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:29.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'129","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.470922+0000","last_change":"2023-12-16T20:21:41.215282+0000","last_active":"2023-12-16T20:48:41.470922+0000","last_peered":"2023-12-16T20:48:41.470922+0000","last_clean":"2023-12-16T20:48:41.470922+0000","last_became_active":"2023-12-16T20:21:41.214939+0000","last_became_peered":"2023-12-16T20:21:41.214939+0000","last_unstale":"2023-12-16T20:48:41.470922+0000","last_undegraded":"2023-12-16T20:48:41.470922+0000","last_fullsized":"2023-12-16T20:48:41.470922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:06:12.245089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":12347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'21","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.902928+0000","last_change":"2023-12-16T20:21:36.534345+0000","last_active":"2023-12-16T20:49:08.902928+0000","last_peered":"2023-12-16T20:49:08.902928+0000","last_clean":"2023-12-16T20:49:08.902928+0000","last_became_active":"2023-12-16T20:21:36.534064+0000","last_became_peered":"2023-12-16T20:21:36.534064+0000","last_unstale":"2023-12-16T20:49:08.902928+0000","last_undegraded":"2023-12-16T20:49:08.902928+0000","last_fullsized":"2023-12-16T20:49:08.902928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:05.641757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:51.557836+0000","last_change":"2023-12-16T20:21:35.390941+0000","last_active":"2023-12-16T20:48:51.557836+0000","last_peered":"2023-12-16T20:48:51.557836+0000","last_clean":"2023-12-16T20:48:51.557836+0000","last_became_active":"2023-12-16T20:21:35.390740+0000","last_became_peered":"2023-12-16T20:21:35.390740+0000","last_unstale":"2023-12-16T20:48:51.557836+0000","last_undegraded":"2023-12-16T20:48:51.557836+0000","last_fullsized":"2023-12-16T20:48:51.557836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:00:44.009248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'180","reported_seq":207,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.239005+0000","last_change":"2023-12-16T20:21:40.754355+0000","last_active":"2023-12-16T20:48:39.239005+0000","last_peered":"2023-12-16T20:48:39.239005+0000","last_clean":"2023-12-16T20:48:39.239005+0000","last_became_active":"2023-12-16T20:21:40.753981+0000","last_became_peered":"2023-12-16T20:21:40.753981+0000","last_unstale":"2023-12-16T20:48:39.239005+0000","last_undegraded":"2023-12-16T20:48:39.239005+0000","last_fullsized":"2023-12-16T20:48:39.239005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:09.125671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":13396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'37","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.901207+0000","last_change":"2023-12-16T20:21:36.537080+0000","last_active":"2023-12-16T20:49:08.901207+0000","last_peered":"2023-12-16T20:49:08.901207+0000","last_clean":"2023-12-16T20:49:08.901207+0000","last_became_active":"2023-12-16T20:21:36.536822+0000","last_became_peered":"2023-12-16T20:21:36.536822+0000","last_unstale":"2023-12-16T20:49:08.901207+0000","last_undegraded":"2023-12-16T20:49:08.901207+0000","last_fullsized":"2023-12-16T20:49:08.901207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'9","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:47:16.371756+0000","last_change":"2023-12-16T20:21:35.417113+0000","last_active":"2023-12-16T20:47:16.371756+0000","last_peered":"2023-12-16T20:47:16.371756+0000","last_clean":"2023-12-16T20:47:16.371756+0000","last_became_active":"2023-12-16T20:21:35.416850+0000","last_became_peered":"2023-12-16T20:21:35.416850+0000","last_unstale":"2023-12-16T20:47:16.371756+0000","last_undegraded":"2023-12-16T20:47:16.371756+0000","last_fullsized":"2023-12-16T20:47:16.371756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:00:44.009248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'159","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:40.300399+0000","last_change":"2023-12-16T20:21:40.755436+0000","last_active":"2023-12-16T20:48:40.300399+0000","last_peered":"2023-12-16T20:48:40.300399+0000","last_clean":"2023-12-16T20:48:40.300399+0000","last_became_active":"2023-12-16T20:21:40.755041+0000","last_became_peered":"2023-12-16T20:21:40.755041+0000","last_unstale":"2023-12-16T20:48:40.300399+0000","last_undegraded":"2023-12-16T20:48:40.300399+0000","last_fullsized":"2023-12-16T20:48:40.300399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:07.939178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":9935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'32","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.886153+0000","last_change":"2023-12-16T20:21:36.541160+0000","last_active":"2023-12-16T20:49:08.886153+0000","last_peered":"2023-12-16T20:49:08.886153+0000","last_clean":"2023-12-16T20:49:08.886153+0000","last_became_active":"2023-12-16T20:21:36.540861+0000","last_became_peered":"2023-12-16T20:21:36.540861+0000","last_unstale":"2023-12-16T20:49:08.886153+0000","last_undegraded":"2023-12-16T20:49:08.886153+0000","last_fullsized":"2023-12-16T20:49:08.886153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.439148+0000","last_change":"2023-12-16T20:21:35.425071+0000","last_active":"2023-12-16T20:48:46.439148+0000","last_peered":"2023-12-16T20:48:46.439148+0000","last_clean":"2023-12-16T20:48:46.439148+0000","last_became_active":"2023-12-16T20:21:35.424822+0000","last_became_peered":"2023-12-16T20:21:35.424822+0000","last_unstale":"2023-12-16T20:48:46.439148+0000","last_undegraded":"2023-12-16T20:48:46.439148+0000","last_fullsized":"2023-12-16T20:48:46.439148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'130","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:38.768956+0000","last_change":"2023-12-16T20:21:41.215346+0000","last_active":"2023-12-16T20:48:38.768956+0000","last_peered":"2023-12-16T20:48:38.768956+0000","last_clean":"2023-12-16T20:48:38.768956+0000","last_became_active":"2023-12-16T20:21:41.215002+0000","last_became_peered":"2023-12-16T20:21:41.215002+0000","last_unstale":"2023-12-16T20:48:38.768956+0000","last_undegraded":"2023-12-16T20:48:38.768956+0000","last_fullsized":"2023-12-16T20:48:38.768956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:10:42.982067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":7078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'49","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.904907+0000","last_change":"2023-12-16T20:21:36.535791+0000","last_active":"2023-12-16T20:49:08.904907+0000","last_peered":"2023-12-16T20:49:08.904907+0000","last_clean":"2023-12-16T20:49:08.904907+0000","last_became_active":"2023-12-16T20:21:36.535447+0000","last_became_peered":"2023-12-16T20:21:36.535447+0000","last_unstale":"2023-12-16T20:49:08.904907+0000","last_undegraded":"2023-12-16T20:49:08.904907+0000","last_fullsized":"2023-12-16T20:49:08.904907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:28.307634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:55.659095+0000","last_change":"2023-12-16T20:21:35.423533+0000","last_active":"2023-12-16T20:48:55.659095+0000","last_peered":"2023-12-16T20:48:55.659095+0000","last_clean":"2023-12-16T20:48:55.659095+0000","last_became_active":"2023-12-16T20:21:35.423275+0000","last_became_peered":"2023-12-16T20:21:35.423275+0000","last_unstale":"2023-12-16T20:48:55.659095+0000","last_undegraded":"2023-12-16T20:48:55.659095+0000","last_fullsized":"2023-12-16T20:48:55.659095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:27.767422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'115","reported_seq":141,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.361695+0000","last_change":"2023-12-16T20:21:41.213083+0000","last_active":"2023-12-16T20:48:39.361695+0000","last_peered":"2023-12-16T20:48:39.361695+0000","last_clean":"2023-12-16T20:48:39.361695+0000","last_became_active":"2023-12-16T20:21:41.212699+0000","last_became_peered":"2023-12-16T20:21:41.212699+0000","last_unstale":"2023-12-16T20:48:39.361695+0000","last_undegraded":"2023-12-16T20:48:39.361695+0000","last_fullsized":"2023-12-16T20:48:39.361695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:14:45.966119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'45","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.971754+0000","last_change":"2023-12-16T20:21:36.523928+0000","last_active":"2023-12-16T20:49:08.971754+0000","last_peered":"2023-12-16T20:49:08.971754+0000","last_clean":"2023-12-16T20:49:08.971754+0000","last_became_active":"2023-12-16T20:21:36.523649+0000","last_became_peered":"2023-12-16T20:21:36.523649+0000","last_unstale":"2023-12-16T20:49:08.971754+0000","last_undegraded":"2023-12-16T20:49:08.971754+0000","last_fullsized":"2023-12-16T20:49:08.971754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:33.657782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'261","reported_seq":290,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.617486+0000","last_change":"2023-12-16T20:21:35.388611+0000","last_active":"2023-12-16T20:49:08.617486+0000","last_peered":"2023-12-16T20:49:08.617486+0000","last_clean":"2023-12-16T20:49:08.617486+0000","last_became_active":"2023-12-16T20:21:35.388392+0000","last_became_peered":"2023-12-16T20:21:35.388392+0000","last_unstale":"2023-12-16T20:49:08.617486+0000","last_undegraded":"2023-12-16T20:49:08.617486+0000","last_fullsized":"2023-12-16T20:49:08.617486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2496854,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":2582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'142","reported_seq":168,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.356577+0000","last_change":"2023-12-16T20:21:41.213106+0000","last_active":"2023-12-16T20:48:39.356577+0000","last_peered":"2023-12-16T20:48:39.356577+0000","last_clean":"2023-12-16T20:48:39.356577+0000","last_became_active":"2023-12-16T20:21:41.212721+0000","last_became_peered":"2023-12-16T20:21:41.212721+0000","last_unstale":"2023-12-16T20:48:39.356577+0000","last_undegraded":"2023-12-16T20:48:39.356577+0000","last_fullsized":"2023-12-16T20:48:39.356577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:47:15.750172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":13674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'36","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.902501+0000","last_change":"2023-12-16T20:21:36.519774+0000","last_active":"2023-12-16T20:49:08.902501+0000","last_peered":"2023-12-16T20:49:08.902501+0000","last_clean":"2023-12-16T20:49:08.902501+0000","last_became_active":"2023-12-16T20:21:36.519561+0000","last_became_peered":"2023-12-16T20:21:36.519561+0000","last_unstale":"2023-12-16T20:49:08.902501+0000","last_undegraded":"2023-12-16T20:49:08.902501+0000","last_fullsized":"2023-12-16T20:49:08.902501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:10.421516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'850","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:55.656917+0000","last_change":"2023-12-16T20:21:35.426168+0000","last_active":"2023-12-16T20:48:55.656917+0000","last_peered":"2023-12-16T20:48:55.656917+0000","last_clean":"2023-12-16T20:48:55.656917+0000","last_became_active":"2023-12-16T20:21:35.425929+0000","last_became_peered":"2023-12-16T20:21:35.425929+0000","last_unstale":"2023-12-16T20:48:55.656917+0000","last_undegraded":"2023-12-16T20:48:55.656917+0000","last_fullsized":"2023-12-16T20:48:55.656917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":4548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'165","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.358092+0000","last_change":"2023-12-16T20:21:40.754204+0000","last_active":"2023-12-16T20:48:39.358092+0000","last_peered":"2023-12-16T20:48:39.358092+0000","last_clean":"2023-12-16T20:48:39.358092+0000","last_became_active":"2023-12-16T20:21:40.753624+0000","last_became_peered":"2023-12-16T20:21:40.753624+0000","last_unstale":"2023-12-16T20:48:39.358092+0000","last_undegraded":"2023-12-16T20:48:39.358092+0000","last_fullsized":"2023-12-16T20:48:39.358092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:11.201128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":9759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'33","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.815896+0000","last_change":"2023-12-16T20:21:36.534827+0000","last_active":"2023-12-16T20:49:08.815896+0000","last_peered":"2023-12-16T20:49:08.815896+0000","last_clean":"2023-12-16T20:49:08.815896+0000","last_became_active":"2023-12-16T20:21:36.533790+0000","last_became_peered":"2023-12-16T20:21:36.533790+0000","last_unstale":"2023-12-16T20:49:08.815896+0000","last_undegraded":"2023-12-16T20:49:08.815896+0000","last_fullsized":"2023-12-16T20:49:08.815896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:19.545737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'706","reported_seq":735,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:01.717981+0000","last_change":"2023-12-16T20:21:35.416050+0000","last_active":"2023-12-16T20:49:01.717981+0000","last_peered":"2023-12-16T20:49:01.717981+0000","last_clean":"2023-12-16T20:49:01.717981+0000","last_became_active":"2023-12-16T20:21:35.415790+0000","last_became_peered":"2023-12-16T20:21:35.415790+0000","last_unstale":"2023-12-16T20:49:01.717981+0000","last_undegraded":"2023-12-16T20:49:01.717981+0000","last_fullsized":"2023-12-16T20:49:01.717981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":703,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'154","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.369610+0000","last_change":"2023-12-16T20:21:40.795197+0000","last_active":"2023-12-16T20:48:39.369610+0000","last_peered":"2023-12-16T20:48:39.369610+0000","last_clean":"2023-12-16T20:48:39.369610+0000","last_became_active":"2023-12-16T20:21:40.793667+0000","last_became_peered":"2023-12-16T20:21:40.793667+0000","last_unstale":"2023-12-16T20:48:39.369610+0000","last_undegraded":"2023-12-16T20:48:39.369610+0000","last_fullsized":"2023-12-16T20:48:39.369610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:32.304405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":20505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'40","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.969267+0000","last_change":"2023-12-16T20:21:36.552680+0000","last_active":"2023-12-16T20:49:08.969267+0000","last_peered":"2023-12-16T20:49:08.969267+0000","last_clean":"2023-12-16T20:49:08.969267+0000","last_became_active":"2023-12-16T20:21:36.552482+0000","last_became_peered":"2023-12-16T20:21:36.552482+0000","last_unstale":"2023-12-16T20:49:08.969267+0000","last_undegraded":"2023-12-16T20:49:08.969267+0000","last_fullsized":"2023-12-16T20:49:08.969267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:00.762391+0000","last_change":"2023-12-16T20:21:35.428379+0000","last_active":"2023-12-16T20:49:00.762391+0000","last_peered":"2023-12-16T20:49:00.762391+0000","last_clean":"2023-12-16T20:49:00.762391+0000","last_became_active":"2023-12-16T20:21:35.428100+0000","last_became_peered":"2023-12-16T20:21:35.428100+0000","last_unstale":"2023-12-16T20:49:00.762391+0000","last_undegraded":"2023-12-16T20:49:00.762391+0000","last_fullsized":"2023-12-16T20:49:00.762391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:44.330608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'126","reported_seq":152,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:40.295260+0000","last_change":"2023-12-16T20:21:40.753333+0000","last_active":"2023-12-16T20:48:40.295260+0000","last_peered":"2023-12-16T20:48:40.295260+0000","last_clean":"2023-12-16T20:48:40.295260+0000","last_became_active":"2023-12-16T20:21:40.752957+0000","last_became_peered":"2023-12-16T20:21:40.752957+0000","last_unstale":"2023-12-16T20:48:40.295260+0000","last_undegraded":"2023-12-16T20:48:40.295260+0000","last_fullsized":"2023-12-16T20:48:40.295260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:47:15.750172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":10032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'43","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.895340+0000","last_change":"2023-12-16T20:22:14.841007+0000","last_active":"2023-12-16T20:49:08.895340+0000","last_peered":"2023-12-16T20:49:08.895340+0000","last_clean":"2023-12-16T20:49:08.895340+0000","last_became_active":"2023-12-16T20:22:14.840679+0000","last_became_peered":"2023-12-16T20:22:14.840679+0000","last_unstale":"2023-12-16T20:49:08.895340+0000","last_undegraded":"2023-12-16T20:49:08.895340+0000","last_fullsized":"2023-12-16T20:49:08.895340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:48.476563+0000","last_change":"2023-12-16T20:21:35.430197+0000","last_active":"2023-12-16T20:48:48.476563+0000","last_peered":"2023-12-16T20:48:48.476563+0000","last_clean":"2023-12-16T20:48:48.476563+0000","last_became_active":"2023-12-16T20:21:35.429940+0000","last_became_peered":"2023-12-16T20:21:35.429940+0000","last_unstale":"2023-12-16T20:48:48.476563+0000","last_undegraded":"2023-12-16T20:48:48.476563+0000","last_fullsized":"2023-12-16T20:48:48.476563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'174","reported_seq":200,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.355965+0000","last_change":"2023-12-16T20:21:41.216238+0000","last_active":"2023-12-16T20:48:39.355965+0000","last_peered":"2023-12-16T20:48:39.355965+0000","last_clean":"2023-12-16T20:48:39.355965+0000","last_became_active":"2023-12-16T20:21:41.215893+0000","last_became_peered":"2023-12-16T20:21:41.215893+0000","last_unstale":"2023-12-16T20:48:39.355965+0000","last_undegraded":"2023-12-16T20:48:39.355965+0000","last_fullsized":"2023-12-16T20:48:39.355965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:06:12.245089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":9716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'144","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.358383+0000","last_change":"2023-12-16T20:21:41.215277+0000","last_active":"2023-12-16T20:48:39.358383+0000","last_peered":"2023-12-16T20:48:39.358383+0000","last_clean":"2023-12-16T20:48:39.358383+0000","last_became_active":"2023-12-16T20:21:41.214950+0000","last_became_peered":"2023-12-16T20:21:41.214950+0000","last_unstale":"2023-12-16T20:48:39.358383+0000","last_undegraded":"2023-12-16T20:48:39.358383+0000","last_fullsized":"2023-12-16T20:48:39.358383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:10.036962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":7732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'44","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.798823+0000","last_change":"2023-12-16T20:21:36.519789+0000","last_active":"2023-12-16T20:49:08.798823+0000","last_peered":"2023-12-16T20:49:08.798823+0000","last_clean":"2023-12-16T20:49:08.798823+0000","last_became_active":"2023-12-16T20:21:36.519476+0000","last_became_peered":"2023-12-16T20:21:36.519476+0000","last_unstale":"2023-12-16T20:49:08.798823+0000","last_undegraded":"2023-12-16T20:49:08.798823+0000","last_fullsized":"2023-12-16T20:49:08.798823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:51.515982+0000","last_change":"2023-12-16T20:21:35.415150+0000","last_active":"2023-12-16T20:48:51.515982+0000","last_peered":"2023-12-16T20:48:51.515982+0000","last_clean":"2023-12-16T20:48:51.515982+0000","last_became_active":"2023-12-16T20:21:35.414846+0000","last_became_peered":"2023-12-16T20:21:35.414846+0000","last_unstale":"2023-12-16T20:48:51.515982+0000","last_undegraded":"2023-12-16T20:48:51.515982+0000","last_fullsized":"2023-12-16T20:48:51.515982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:37.215505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'142","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.474966+0000","last_change":"2023-12-16T20:21:40.794438+0000","last_active":"2023-12-16T20:48:41.474966+0000","last_peered":"2023-12-16T20:48:41.474966+0000","last_clean":"2023-12-16T20:48:41.474966+0000","last_became_active":"2023-12-16T20:21:40.794073+0000","last_became_peered":"2023-12-16T20:21:40.794073+0000","last_unstale":"2023-12-16T20:48:41.474966+0000","last_undegraded":"2023-12-16T20:48:41.474966+0000","last_fullsized":"2023-12-16T20:48:41.474966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:32.702839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":21602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'45","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796450+0000","last_change":"2023-12-16T20:22:14.772045+0000","last_active":"2023-12-16T20:49:08.796450+0000","last_peered":"2023-12-16T20:49:08.796450+0000","last_clean":"2023-12-16T20:49:08.796450+0000","last_became_active":"2023-12-16T20:22:14.771747+0000","last_became_peered":"2023-12-16T20:22:14.771747+0000","last_unstale":"2023-12-16T20:49:08.796450+0000","last_undegraded":"2023-12-16T20:49:08.796450+0000","last_fullsized":"2023-12-16T20:49:08.796450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:00:27.390576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:45.442731+0000","last_change":"2023-12-16T20:21:35.422176+0000","last_active":"2023-12-16T20:48:45.442731+0000","last_peered":"2023-12-16T20:48:45.442731+0000","last_clean":"2023-12-16T20:48:45.442731+0000","last_became_active":"2023-12-16T20:21:35.421982+0000","last_became_peered":"2023-12-16T20:21:35.421982+0000","last_unstale":"2023-12-16T20:48:45.442731+0000","last_undegraded":"2023-12-16T20:48:45.442731+0000","last_fullsized":"2023-12-16T20:48:45.442731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'701","reported_seq":730,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:02.737447+0000","last_change":"2023-12-16T20:21:35.424509+0000","last_active":"2023-12-16T20:49:02.737447+0000","last_peered":"2023-12-16T20:49:02.737447+0000","last_clean":"2023-12-16T20:49:02.737447+0000","last_became_active":"2023-12-16T20:21:35.424254+0000","last_became_peered":"2023-12-16T20:21:35.424254+0000","last_unstale":"2023-12-16T20:49:02.737447+0000","last_undegraded":"2023-12-16T20:49:02.737447+0000","last_fullsized":"2023-12-16T20:49:02.737447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'39","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.972534+0000","last_change":"2023-12-16T20:21:36.533903+0000","last_active":"2023-12-16T20:49:08.972534+0000","last_peered":"2023-12-16T20:49:08.972534+0000","last_clean":"2023-12-16T20:49:08.972534+0000","last_became_active":"2023-12-16T20:21:36.533574+0000","last_became_peered":"2023-12-16T20:21:36.533574+0000","last_unstale":"2023-12-16T20:49:08.972534+0000","last_undegraded":"2023-12-16T20:49:08.972534+0000","last_fullsized":"2023-12-16T20:49:08.972534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'88","reported_seq":114,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:38.755640+0000","last_change":"2023-12-16T20:21:40.794426+0000","last_active":"2023-12-16T20:48:38.755640+0000","last_peered":"2023-12-16T20:48:38.755640+0000","last_clean":"2023-12-16T20:48:38.755640+0000","last_became_active":"2023-12-16T20:21:40.794082+0000","last_became_peered":"2023-12-16T20:21:40.794082+0000","last_unstale":"2023-12-16T20:48:38.755640+0000","last_undegraded":"2023-12-16T20:48:38.755640+0000","last_fullsized":"2023-12-16T20:48:38.755640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:39:04.889495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'686","reported_seq":715,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:00.757206+0000","last_change":"2023-12-16T20:21:35.419910+0000","last_active":"2023-12-16T20:49:00.757206+0000","last_peered":"2023-12-16T20:49:00.757206+0000","last_clean":"2023-12-16T20:49:00.757206+0000","last_became_active":"2023-12-16T20:21:35.419409+0000","last_became_peered":"2023-12-16T20:21:35.419409+0000","last_unstale":"2023-12-16T20:49:00.757206+0000","last_undegraded":"2023-12-16T20:49:00.757206+0000","last_fullsized":"2023-12-16T20:49:00.757206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":4443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'33","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.817786+0000","last_change":"2023-12-16T20:21:36.533684+0000","last_active":"2023-12-16T20:49:08.817786+0000","last_peered":"2023-12-16T20:49:08.817786+0000","last_clean":"2023-12-16T20:49:08.817786+0000","last_became_active":"2023-12-16T20:21:36.533325+0000","last_became_peered":"2023-12-16T20:21:36.533325+0000","last_unstale":"2023-12-16T20:49:08.817786+0000","last_undegraded":"2023-12-16T20:49:08.817786+0000","last_fullsized":"2023-12-16T20:49:08.817786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:30.795818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'165","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.472046+0000","last_change":"2023-12-16T20:21:40.745455+0000","last_active":"2023-12-16T20:48:41.472046+0000","last_peered":"2023-12-16T20:48:41.472046+0000","last_clean":"2023-12-16T20:48:41.472046+0000","last_became_active":"2023-12-16T20:21:40.744731+0000","last_became_peered":"2023-12-16T20:21:40.744731+0000","last_unstale":"2023-12-16T20:48:41.472046+0000","last_undegraded":"2023-12-16T20:48:41.472046+0000","last_fullsized":"2023-12-16T20:48:41.472046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:17:56.583460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":13136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'49","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.894941+0000","last_change":"2023-12-16T20:21:36.542529+0000","last_active":"2023-12-16T20:49:08.894941+0000","last_peered":"2023-12-16T20:49:08.894941+0000","last_clean":"2023-12-16T20:49:08.894941+0000","last_became_active":"2023-12-16T20:21:36.542287+0000","last_became_peered":"2023-12-16T20:21:36.542287+0000","last_unstale":"2023-12-16T20:49:08.894941+0000","last_undegraded":"2023-12-16T20:49:08.894941+0000","last_fullsized":"2023-12-16T20:49:08.894941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'51","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.887499+0000","last_change":"2023-12-16T20:21:36.551193+0000","last_active":"2023-12-16T20:49:08.887499+0000","last_peered":"2023-12-16T20:49:08.887499+0000","last_clean":"2023-12-16T20:49:08.887499+0000","last_became_active":"2023-12-16T20:21:36.550911+0000","last_became_peered":"2023-12-16T20:21:36.550911+0000","last_unstale":"2023-12-16T20:49:08.887499+0000","last_undegraded":"2023-12-16T20:49:08.887499+0000","last_fullsized":"2023-12-16T20:49:08.887499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:19.545737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'50","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820628+0000","last_change":"2023-12-16T20:21:36.556390+0000","last_active":"2023-12-16T20:49:08.820628+0000","last_peered":"2023-12-16T20:49:08.820628+0000","last_clean":"2023-12-16T20:49:08.820628+0000","last_became_active":"2023-12-16T20:21:36.555822+0000","last_became_peered":"2023-12-16T20:21:36.555822+0000","last_unstale":"2023-12-16T20:49:08.820628+0000","last_undegraded":"2023-12-16T20:49:08.820628+0000","last_fullsized":"2023-12-16T20:49:08.820628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:28.307634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'35","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.971561+0000","last_change":"2023-12-16T20:21:36.525171+0000","last_active":"2023-12-16T20:49:08.971561+0000","last_peered":"2023-12-16T20:49:08.971561+0000","last_clean":"2023-12-16T20:49:08.971561+0000","last_became_active":"2023-12-16T20:21:36.524747+0000","last_became_peered":"2023-12-16T20:21:36.524747+0000","last_unstale":"2023-12-16T20:49:08.971561+0000","last_undegraded":"2023-12-16T20:49:08.971561+0000","last_fullsized":"2023-12-16T20:49:08.971561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'29","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.800156+0000","last_change":"2023-12-16T20:21:36.533944+0000","last_active":"2023-12-16T20:49:08.800156+0000","last_peered":"2023-12-16T20:49:08.800156+0000","last_clean":"2023-12-16T20:49:08.800156+0000","last_became_active":"2023-12-16T20:21:36.533682+0000","last_became_peered":"2023-12-16T20:21:36.533682+0000","last_unstale":"2023-12-16T20:49:08.800156+0000","last_undegraded":"2023-12-16T20:49:08.800156+0000","last_fullsized":"2023-12-16T20:49:08.800156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:20.609645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'35","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796562+0000","last_change":"2023-12-16T20:21:36.519818+0000","last_active":"2023-12-16T20:49:08.796562+0000","last_peered":"2023-12-16T20:49:08.796562+0000","last_clean":"2023-12-16T20:49:08.796562+0000","last_became_active":"2023-12-16T20:21:36.519545+0000","last_became_peered":"2023-12-16T20:21:36.519545+0000","last_unstale":"2023-12-16T20:49:08.796562+0000","last_undegraded":"2023-12-16T20:49:08.796562+0000","last_fullsized":"2023-12-16T20:49:08.796562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.899167+0000","last_change":"2023-12-16T20:21:36.542706+0000","last_active":"2023-12-16T20:49:08.899167+0000","last_peered":"2023-12-16T20:49:08.899167+0000","last_clean":"2023-12-16T20:49:08.899167+0000","last_became_active":"2023-12-16T20:21:36.542184+0000","last_became_peered":"2023-12-16T20:21:36.542184+0000","last_unstale":"2023-12-16T20:49:08.899167+0000","last_undegraded":"2023-12-16T20:49:08.899167+0000","last_fullsized":"2023-12-16T20:49:08.899167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'32","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.790544+0000","last_change":"2023-12-16T20:21:36.536726+0000","last_active":"2023-12-16T20:49:08.790544+0000","last_peered":"2023-12-16T20:49:08.790544+0000","last_clean":"2023-12-16T20:49:08.790544+0000","last_became_active":"2023-12-16T20:21:36.536439+0000","last_became_peered":"2023-12-16T20:21:36.536439+0000","last_unstale":"2023-12-16T20:49:08.790544+0000","last_undegraded":"2023-12-16T20:49:08.790544+0000","last_fullsized":"2023-12-16T20:49:08.790544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'33","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820643+0000","last_change":"2023-12-16T20:21:36.555521+0000","last_active":"2023-12-16T20:49:08.820643+0000","last_peered":"2023-12-16T20:49:08.820643+0000","last_clean":"2023-12-16T20:49:08.820643+0000","last_became_active":"2023-12-16T20:21:36.555100+0000","last_became_peered":"2023-12-16T20:21:36.555100+0000","last_unstale":"2023-12-16T20:49:08.820643+0000","last_undegraded":"2023-12-16T20:49:08.820643+0000","last_fullsized":"2023-12-16T20:49:08.820643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796955+0000","last_change":"2023-12-16T20:21:36.535856+0000","last_active":"2023-12-16T20:49:08.796955+0000","last_peered":"2023-12-16T20:49:08.796955+0000","last_clean":"2023-12-16T20:49:08.796955+0000","last_became_active":"2023-12-16T20:21:36.535600+0000","last_became_peered":"2023-12-16T20:21:36.535600+0000","last_unstale":"2023-12-16T20:49:08.796955+0000","last_undegraded":"2023-12-16T20:49:08.796955+0000","last_fullsized":"2023-12-16T20:49:08.796955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'38","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820712+0000","last_change":"2023-12-16T20:21:36.553376+0000","last_active":"2023-12-16T20:49:08.820712+0000","last_peered":"2023-12-16T20:49:08.820712+0000","last_clean":"2023-12-16T20:49:08.820712+0000","last_became_active":"2023-12-16T20:21:36.553155+0000","last_became_peered":"2023-12-16T20:21:36.553155+0000","last_unstale":"2023-12-16T20:49:08.820712+0000","last_undegraded":"2023-12-16T20:49:08.820712+0000","last_fullsized":"2023-12-16T20:49:08.820712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'50","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.972124+0000","last_change":"2023-12-16T20:21:36.524517+0000","last_active":"2023-12-16T20:49:08.972124+0000","last_peered":"2023-12-16T20:49:08.972124+0000","last_clean":"2023-12-16T20:49:08.972124+0000","last_became_active":"2023-12-16T20:21:36.524166+0000","last_became_peered":"2023-12-16T20:21:36.524166+0000","last_unstale":"2023-12-16T20:49:08.972124+0000","last_undegraded":"2023-12-16T20:49:08.972124+0000","last_fullsized":"2023-12-16T20:49:08.972124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.890304+0000","last_change":"2023-12-16T20:21:36.542513+0000","last_active":"2023-12-16T20:49:08.890304+0000","last_peered":"2023-12-16T20:49:08.890304+0000","last_clean":"2023-12-16T20:49:08.890304+0000","last_became_active":"2023-12-16T20:21:36.542191+0000","last_became_peered":"2023-12-16T20:21:36.542191+0000","last_unstale":"2023-12-16T20:49:08.890304+0000","last_undegraded":"2023-12-16T20:49:08.890304+0000","last_fullsized":"2023-12-16T20:49:08.890304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'35","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.793533+0000","last_change":"2023-12-16T20:22:14.772163+0000","last_active":"2023-12-16T20:49:08.793533+0000","last_peered":"2023-12-16T20:49:08.793533+0000","last_clean":"2023-12-16T20:49:08.793533+0000","last_became_active":"2023-12-16T20:22:14.771830+0000","last_became_peered":"2023-12-16T20:22:14.771830+0000","last_unstale":"2023-12-16T20:49:08.793533+0000","last_undegraded":"2023-12-16T20:49:08.793533+0000","last_fullsized":"2023-12-16T20:49:08.793533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:28:03.873827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"27'47","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.896077+0000","last_change":"2023-12-16T20:21:36.544461+0000","last_active":"2023-12-16T20:49:08.896077+0000","last_peered":"2023-12-16T20:49:08.896077+0000","last_clean":"2023-12-16T20:49:08.896077+0000","last_became_active":"2023-12-16T20:21:36.544225+0000","last_became_peered":"2023-12-16T20:21:36.544225+0000","last_unstale":"2023-12-16T20:49:08.896077+0000","last_undegraded":"2023-12-16T20:49:08.896077+0000","last_fullsized":"2023-12-16T20:49:08.896077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:45:02.439240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'40","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820348+0000","last_change":"2023-12-16T20:21:36.554370+0000","last_active":"2023-12-16T20:49:08.820348+0000","last_peered":"2023-12-16T20:49:08.820348+0000","last_clean":"2023-12-16T20:49:08.820348+0000","last_became_active":"2023-12-16T20:21:36.554130+0000","last_became_peered":"2023-12-16T20:21:36.554130+0000","last_unstale":"2023-12-16T20:49:08.820348+0000","last_undegraded":"2023-12-16T20:49:08.820348+0000","last_fullsized":"2023-12-16T20:49:08.820348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:05.641757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'45","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.823702+0000","last_change":"2023-12-16T20:21:36.555346+0000","last_active":"2023-12-16T20:49:08.823702+0000","last_peered":"2023-12-16T20:49:08.823702+0000","last_clean":"2023-12-16T20:49:08.823702+0000","last_became_active":"2023-12-16T20:21:36.554772+0000","last_became_peered":"2023-12-16T20:21:36.554772+0000","last_unstale":"2023-12-16T20:49:08.823702+0000","last_undegraded":"2023-12-16T20:49:08.823702+0000","last_fullsized":"2023-12-16T20:49:08.823702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'44","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796645+0000","last_change":"2023-12-16T20:21:36.534502+0000","last_active":"2023-12-16T20:49:08.796645+0000","last_peered":"2023-12-16T20:49:08.796645+0000","last_clean":"2023-12-16T20:49:08.796645+0000","last_became_active":"2023-12-16T20:21:36.534307+0000","last_became_peered":"2023-12-16T20:21:36.534307+0000","last_unstale":"2023-12-16T20:49:08.796645+0000","last_undegraded":"2023-12-16T20:49:08.796645+0000","last_fullsized":"2023-12-16T20:49:08.796645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'40","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.971856+0000","last_change":"2023-12-16T20:21:36.525661+0000","last_active":"2023-12-16T20:49:08.971856+0000","last_peered":"2023-12-16T20:49:08.971856+0000","last_clean":"2023-12-16T20:49:08.971856+0000","last_became_active":"2023-12-16T20:21:36.525427+0000","last_became_peered":"2023-12-16T20:21:36.525427+0000","last_unstale":"2023-12-16T20:49:08.971856+0000","last_undegraded":"2023-12-16T20:49:08.971856+0000","last_fullsized":"2023-12-16T20:49:08.971856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:39:00.494290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'36","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.800124+0000","last_change":"2023-12-16T20:21:36.542756+0000","last_active":"2023-12-16T20:49:08.800124+0000","last_peered":"2023-12-16T20:49:08.800124+0000","last_clean":"2023-12-16T20:49:08.800124+0000","last_became_active":"2023-12-16T20:21:36.542513+0000","last_became_peered":"2023-12-16T20:21:36.542513+0000","last_unstale":"2023-12-16T20:49:08.800124+0000","last_undegraded":"2023-12-16T20:49:08.800124+0000","last_fullsized":"2023-12-16T20:49:08.800124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'30","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.814024+0000","last_change":"2023-12-16T20:21:36.544754+0000","last_active":"2023-12-16T20:49:08.814024+0000","last_peered":"2023-12-16T20:49:08.814024+0000","last_clean":"2023-12-16T20:49:08.814024+0000","last_became_active":"2023-12-16T20:21:36.544492+0000","last_became_peered":"2023-12-16T20:21:36.544492+0000","last_unstale":"2023-12-16T20:49:08.814024+0000","last_undegraded":"2023-12-16T20:49:08.814024+0000","last_fullsized":"2023-12-16T20:49:08.814024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:19.509623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'38","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.889041+0000","last_change":"2023-12-16T20:22:14.769644+0000","last_active":"2023-12-16T20:49:08.889041+0000","last_peered":"2023-12-16T20:49:08.889041+0000","last_clean":"2023-12-16T20:49:08.889041+0000","last_became_active":"2023-12-16T20:22:14.769348+0000","last_became_peered":"2023-12-16T20:22:14.769348+0000","last_unstale":"2023-12-16T20:49:08.889041+0000","last_undegraded":"2023-12-16T20:49:08.889041+0000","last_fullsized":"2023-12-16T20:49:08.889041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:17:52.188255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'50","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.894678+0000","last_change":"2023-12-16T20:21:36.551107+0000","last_active":"2023-12-16T20:49:08.894678+0000","last_peered":"2023-12-16T20:49:08.894678+0000","last_clean":"2023-12-16T20:49:08.894678+0000","last_became_active":"2023-12-16T20:21:36.550815+0000","last_became_peered":"2023-12-16T20:21:36.550815+0000","last_unstale":"2023-12-16T20:49:08.894678+0000","last_undegraded":"2023-12-16T20:49:08.894678+0000","last_fullsized":"2023-12-16T20:49:08.894678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'42","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.903770+0000","last_change":"2023-12-16T20:21:36.554041+0000","last_active":"2023-12-16T20:49:08.903770+0000","last_peered":"2023-12-16T20:49:08.903770+0000","last_clean":"2023-12-16T20:49:08.903770+0000","last_became_active":"2023-12-16T20:21:36.553708+0000","last_became_peered":"2023-12-16T20:21:36.553708+0000","last_unstale":"2023-12-16T20:49:08.903770+0000","last_undegraded":"2023-12-16T20:49:08.903770+0000","last_fullsized":"2023-12-16T20:49:08.903770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:36.868562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'29","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.799545+0000","last_change":"2023-12-16T20:21:36.551348+0000","last_active":"2023-12-16T20:49:08.799545+0000","last_peered":"2023-12-16T20:49:08.799545+0000","last_clean":"2023-12-16T20:49:08.799545+0000","last_became_active":"2023-12-16T20:21:36.551066+0000","last_became_peered":"2023-12-16T20:21:36.551066+0000","last_unstale":"2023-12-16T20:49:08.799545+0000","last_undegraded":"2023-12-16T20:49:08.799545+0000","last_fullsized":"2023-12-16T20:49:08.799545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'37","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.900820+0000","last_change":"2023-12-16T20:21:36.523828+0000","last_active":"2023-12-16T20:49:08.900820+0000","last_peered":"2023-12-16T20:49:08.900820+0000","last_clean":"2023-12-16T20:49:08.900820+0000","last_became_active":"2023-12-16T20:21:36.523604+0000","last_became_peered":"2023-12-16T20:21:36.523604+0000","last_unstale":"2023-12-16T20:49:08.900820+0000","last_undegraded":"2023-12-16T20:49:08.900820+0000","last_fullsized":"2023-12-16T20:49:08.900820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'39","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.823448+0000","last_change":"2023-12-16T20:21:36.556286+0000","last_active":"2023-12-16T20:49:08.823448+0000","last_peered":"2023-12-16T20:49:08.823448+0000","last_clean":"2023-12-16T20:49:08.823448+0000","last_became_active":"2023-12-16T20:21:36.556041+0000","last_became_peered":"2023-12-16T20:21:36.556041+0000","last_unstale":"2023-12-16T20:49:08.823448+0000","last_undegraded":"2023-12-16T20:49:08.823448+0000","last_fullsized":"2023-12-16T20:49:08.823448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'39","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.894521+0000","last_change":"2023-12-16T20:21:36.518408+0000","last_active":"2023-12-16T20:49:08.894521+0000","last_peered":"2023-12-16T20:49:08.894521+0000","last_clean":"2023-12-16T20:49:08.894521+0000","last_became_active":"2023-12-16T20:21:36.518138+0000","last_became_peered":"2023-12-16T20:21:36.518138+0000","last_unstale":"2023-12-16T20:49:08.894521+0000","last_undegraded":"2023-12-16T20:49:08.894521+0000","last_fullsized":"2023-12-16T20:49:08.894521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'24","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.823139+0000","last_change":"2023-12-16T20:21:36.555311+0000","last_active":"2023-12-16T20:49:08.823139+0000","last_peered":"2023-12-16T20:49:08.823139+0000","last_clean":"2023-12-16T20:49:08.823139+0000","last_became_active":"2023-12-16T20:21:36.555041+0000","last_became_peered":"2023-12-16T20:21:36.555041+0000","last_unstale":"2023-12-16T20:49:08.823139+0000","last_undegraded":"2023-12-16T20:49:08.823139+0000","last_fullsized":"2023-12-16T20:49:08.823139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:20.609645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'44","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.971833+0000","last_change":"2023-12-16T20:21:36.524036+0000","last_active":"2023-12-16T20:49:08.971833+0000","last_peered":"2023-12-16T20:49:08.971833+0000","last_clean":"2023-12-16T20:49:08.971833+0000","last_became_active":"2023-12-16T20:21:36.523784+0000","last_became_peered":"2023-12-16T20:21:36.523784+0000","last_unstale":"2023-12-16T20:49:08.971833+0000","last_undegraded":"2023-12-16T20:49:08.971833+0000","last_fullsized":"2023-12-16T20:49:08.971833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'36","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.793242+0000","last_change":"2023-12-16T20:21:36.526391+0000","last_active":"2023-12-16T20:49:08.793242+0000","last_peered":"2023-12-16T20:49:08.793242+0000","last_clean":"2023-12-16T20:49:08.793242+0000","last_became_active":"2023-12-16T20:21:36.526151+0000","last_became_peered":"2023-12-16T20:21:36.526151+0000","last_unstale":"2023-12-16T20:49:08.793242+0000","last_undegraded":"2023-12-16T20:49:08.793242+0000","last_fullsized":"2023-12-16T20:49:08.793242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'28","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.900106+0000","last_change":"2023-12-16T20:21:36.543566+0000","last_active":"2023-12-16T20:49:08.900106+0000","last_peered":"2023-12-16T20:49:08.900106+0000","last_clean":"2023-12-16T20:49:08.900106+0000","last_became_active":"2023-12-16T20:21:36.543306+0000","last_became_peered":"2023-12-16T20:21:36.543306+0000","last_unstale":"2023-12-16T20:49:08.900106+0000","last_undegraded":"2023-12-16T20:49:08.900106+0000","last_fullsized":"2023-12-16T20:49:08.900106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:03.543973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4117,"num_write_kb":324188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4666,"ondisk_log_size":4666,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2442,"ondisk_log_size":2442,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40469915,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1038,"num_read_kb":1098,"num_write":9075,"num_write_kb":44922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56229888,"data_stored":80939830,"data_compressed":7486620,"data_compressed_allocated":11714560,"data_compressed_original":36487168,"omap_allocated":0,"internal_metadata":0},"log_size":8615,"ondisk_log_size":8615,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65176,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575186,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84588,"kb_used_data":17316,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94287252,"statfs":{"total":96636764160,"available":96550146048,"internally_reserved":0,"allocated":17731584,"data_stored":25875293,"data_compressed":2385754,"data_compressed_allocated":3723264,"data_compressed_original":12046336,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40300000000000002,"15min":0.39800000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53300000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.41999999999999998,"15min":0.42299999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56000000000000005,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.747}]},{"osd":1,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42499999999999999,"15min":0.41999999999999998},"min":{"1min":0.35099999999999998,"5min":0.24399999999999999,"15min":0.23799999999999999},"max":{"1min":0.59099999999999997,"5min":0.67200000000000004,"15min":0.70999999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.28599999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.54800000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.51000000000000001}]},{"osd":2,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40799999999999997,"15min":0.41099999999999998},"min":{"1min":0.26800000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.54600000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.44400000000000001,"15min":0.44500000000000001},"min":{"1min":0.36899999999999999,"5min":0.29399999999999998,"15min":0.29099999999999998},"max":{"1min":0.58199999999999996,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.44900000000000001}]},{"osd":3,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.438,"15min":0.432},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28000000000000003},"max":{"1min":0.57899999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45500000000000002,"15min":0.45800000000000002},"min":{"1min":0.30099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58099999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.71399999999999997}]},{"osd":4,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.27100000000000002,"5min":0.23200000000000001,"15min":0.20499999999999999},"max":{"1min":0.48899999999999999,"5min":0.501,"15min":0.621},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38100000000000001,"15min":0.374},"min":{"1min":0.27800000000000002,"5min":0.219,"15min":0.20899999999999999},"max":{"1min":0.52900000000000003,"5min":0.58199999999999996,"15min":0.624},"last":0.60999999999999999}]},{"osd":5,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38800000000000001,"15min":0.38700000000000001},"min":{"1min":0.27400000000000002,"5min":0.24199999999999999,"15min":0.24099999999999999},"max":{"1min":0.54600000000000004,"5min":0.63900000000000001,"15min":0.72099999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.40500000000000003,"15min":0.40600000000000003},"min":{"1min":0.316,"5min":0.25900000000000001,"15min":0.255},"max":{"1min":0.51400000000000001,"5min":0.57299999999999995,"15min":0.65700000000000003},"last":0.55400000000000005}]},{"osd":6,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41399999999999998},"min":{"1min":0.34599999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51000000000000001,"5min":0.53700000000000003,"15min":0.69499999999999995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.436,"15min":0.441},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.52400000000000002,"5min":0.623,"15min":0.65200000000000002},"last":0.66100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575186,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57068,"kb_used_data":12004,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94314772,"statfs":{"total":96636764160,"available":96578326528,"internally_reserved":0,"allocated":12292096,"data_stored":16896407,"data_compressed":1393950,"data_compressed_allocated":2220032,"data_compressed_original":7004160,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38200000000000001,"15min":0.39800000000000002},"min":{"1min":0.251,"5min":0.23200000000000001,"15min":0.217},"max":{"1min":0.505,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.433},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.433,"15min":0.432},"min":{"1min":0.26700000000000002,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":0.52600000000000002,"5min":0.60799999999999998,"15min":0.67100000000000004},"last":0.42199999999999999}]},{"osd":1,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.40100000000000002,"15min":0.40799999999999997},"min":{"1min":0.27100000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51400000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42599999999999999,"15min":0.42399999999999999},"min":{"1min":0.29799999999999999,"5min":0.26500000000000001,"15min":0.26400000000000001},"max":{"1min":0.54400000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.46700000000000003}]},{"osd":2,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40999999999999998,"15min":0.41699999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.52100000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.495},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.253},"max":{"1min":0.51200000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47699999999999998}]},{"osd":3,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44800000000000001,"15min":0.437},"min":{"1min":0.371,"5min":0.30599999999999999,"15min":0.26500000000000001},"max":{"1min":0.57999999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.433,"15min":0.44400000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.52400000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.45800000000000002}]},{"osd":4,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.379,"15min":0.37},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.217},"max":{"1min":0.48699999999999999,"5min":0.59199999999999997,"15min":0.64000000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.38900000000000001,"15min":0.38700000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55800000000000005,"5min":0.64300000000000002,"15min":0.68700000000000006},"last":0.32300000000000001}]},{"osd":5,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.38600000000000001,"15min":0.377},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.22900000000000001},"max":{"1min":0.54600000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42199999999999999,"15min":0.42099999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.57799999999999996,"5min":0.60699999999999998,"15min":0.67200000000000004},"last":0.36099999999999999}]},{"osd":7,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.27800000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.65700000000000003,"15min":0.69899999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42399999999999999,"15min":0.43099999999999999},"min":{"1min":0.29299999999999998,"5min":0.28299999999999997,"15min":0.27200000000000002},"max":{"1min":0.53600000000000003,"5min":0.60599999999999998,"15min":0.747},"last":0.40600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575186,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":118609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.26100000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":0.58599999999999997,"15min":0.64200000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.39800000000000002,"15min":0.41099999999999998},"min":{"1min":0.255,"5min":0.252,"15min":0.24399999999999999},"max":{"1min":0.59299999999999997,"5min":0.61299999999999999,"15min":0.65200000000000002},"last":0.79700000000000004}]},{"osd":1,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40899999999999997,"15min":0.41599999999999998},"min":{"1min":0.33700000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.64400000000000002},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.41199999999999998,"15min":0.42299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.65900000000000003},"last":0.68700000000000006}]},{"osd":2,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.31900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.53300000000000003,"5min":0.65000000000000002,"15min":0.65200000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.42499999999999999,"15min":0.43099999999999999},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":0.60199999999999998,"5min":0.63,"15min":0.71999999999999997},"last":0.85399999999999998}]},{"osd":3,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42199999999999999,"15min":0.42999999999999999},"min":{"1min":0.309,"5min":0.29999999999999999,"15min":0.29499999999999998},"max":{"1min":0.54000000000000004,"5min":0.57099999999999995,"15min":0.64400000000000002},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.34699999999999998,"5min":0.312,"15min":0.28199999999999997},"max":{"1min":0.61399999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.75900000000000001}]},{"osd":4,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36899999999999999,"15min":0.36099999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.224},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.22600000000000001},"max":{"1min":0.50800000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.56699999999999995}]},{"osd":6,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.26500000000000001,"15min":0.24199999999999999},"max":{"1min":0.62,"5min":0.63300000000000001,"15min":0.68999999999999995},"last":0.626},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.433,"15min":0.41599999999999998},"min":{"1min":0.28699999999999998,"5min":0.28000000000000003,"15min":0.26700000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.72099999999999997},"last":0.66100000000000003}]},{"osd":7,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.51900000000000002,"5min":0.61799999999999999,"15min":0.66300000000000003},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.45900000000000002,"15min":0.44600000000000001},"min":{"1min":0.30099999999999999,"5min":0.26700000000000002,"15min":0.26600000000000001},"max":{"1min":0.56599999999999995,"5min":0.66800000000000004,"15min":0.72099999999999997},"last":0.91000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575186,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65112,"kb_used_data":7568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94306728,"statfs":{"total":96636764160,"available":96570089472,"internally_reserved":0,"allocated":7749632,"data_stored":11004073,"data_compressed":1082070,"data_compressed_allocated":1703936,"data_compressed_original":5144576,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.43099999999999999,"15min":0.42499999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.622,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.44400000000000001,"15min":0.434},"min":{"1min":0.32400000000000001,"5min":0.26600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.68899999999999995},"last":0.46400000000000002}]},{"osd":1,"last update":"Sat Dec 16 20:48:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.442,"15min":0.437},"min":{"1min":0.32200000000000001,"5min":0.29799999999999999,"15min":0.27900000000000003},"max":{"1min":0.58399999999999996,"5min":0.59599999999999997,"15min":0.67100000000000004},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.43099999999999999,"15min":0.42199999999999999},"min":{"1min":0.29599999999999999,"5min":0.28599999999999998,"15min":0.26600000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.66100000000000003},"last":0.41999999999999998}]},{"osd":2,"last update":"Sat Dec 16 20:48:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.433,"15min":0.42799999999999999},"min":{"1min":0.28299999999999997,"5min":0.255,"15min":0.255},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.45300000000000001},"min":{"1min":0.38600000000000001,"5min":0.311,"15min":0.309},"max":{"1min":0.56899999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.436}]},{"osd":3,"last update":"Sat Dec 16 20:48:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44600000000000001,"15min":0.43099999999999999},"min":{"1min":0.33900000000000002,"5min":0.309,"15min":0.27900000000000003},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.377,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.58999999999999997,"5min":0.68500000000000005,"15min":0.79400000000000004},"last":0.44600000000000001}]},{"osd":5,"last update":"Sat Dec 16 20:48:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.378,"15min":0.378},"min":{"1min":0.26400000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.60399999999999998},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.40600000000000003,"15min":0.39000000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.22},"max":{"1min":0.503,"5min":0.58999999999999997,"15min":0.63100000000000001},"last":0.33500000000000002}]},{"osd":6,"last update":"Sat Dec 16 20:48:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40100000000000002,"15min":0.39400000000000002},"min":{"1min":0.30399999999999999,"5min":0.27600000000000002,"15min":0.23799999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.75},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.44500000000000001,"15min":0.42999999999999999},"min":{"1min":0.30099999999999999,"5min":0.26400000000000001,"15min":0.22600000000000001},"max":{"1min":0.57799999999999996,"5min":0.59799999999999998,"15min":0.60899999999999999},"last":0.36599999999999999}]},{"osd":7,"last update":"Sat Dec 16 20:48:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.439,"15min":0.42799999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.25600000000000001},"max":{"1min":0.54700000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.46800000000000003,"15min":0.45600000000000002},"min":{"1min":0.318,"5min":0.308,"15min":0.27000000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.77600000000000002},"last":0.35499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575186,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58848,"kb_used_data":9624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312992,"statfs":{"total":96636764160,"available":96576503808,"internally_reserved":0,"allocated":9854976,"data_stored":12924992,"data_compressed":1002682,"data_compressed_allocated":1646592,"data_compressed_original":4898816,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.28999999999999998,"15min":0.28499999999999998},"min":{"1min":0.222,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":0.38300000000000001,"5min":0.48699999999999999,"15min":0.52600000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.317,"5min":0.30299999999999999,"15min":0.29699999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.46600000000000003,"5min":0.48899999999999999,"15min":0.56999999999999995},"last":0.31}]},{"osd":1,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29999999999999999},"min":{"1min":0.22700000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.434,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.317,"5min":0.32500000000000001,"15min":0.32300000000000001},"min":{"1min":0.245,"5min":0.21099999999999999,"15min":0.19900000000000001},"max":{"1min":0.40200000000000002,"5min":0.48299999999999998,"15min":0.56100000000000005},"last":0.36199999999999999}]},{"osd":2,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.33300000000000002,"15min":0.33400000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.222},"max":{"1min":0.443,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35299999999999998,"15min":0.35199999999999998},"min":{"1min":0.29899999999999999,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":0.44900000000000001,"5min":0.51100000000000001,"15min":0.53600000000000003},"last":0.32900000000000001}]},{"osd":4,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40500000000000003,"15min":0.41299999999999998},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.27600000000000002},"max":{"1min":0.52900000000000003,"5min":0.53000000000000003,"15min":0.69999999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.443,"15min":0.439},"min":{"1min":0.35199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56699999999999995,"5min":0.70399999999999996,"15min":0.72399999999999998},"last":0.433}]},{"osd":5,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.435,"15min":0.44},"min":{"1min":0.35399999999999998,"5min":0.31900000000000001,"15min":0.313},"max":{"1min":0.55200000000000005,"5min":0.68100000000000005,"15min":0.76900000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.45100000000000001,"15min":0.45400000000000001},"min":{"1min":0.38300000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.52400000000000002,"5min":0.61499999999999999,"15min":0.71599999999999997},"last":0.51900000000000002}]},{"osd":6,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44,"15min":0.44500000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.73599999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45600000000000002,"15min":0.46300000000000002},"min":{"1min":0.372,"5min":0.317,"15min":0.317},"max":{"1min":0.64100000000000001,"5min":0.66700000000000004,"15min":0.75},"last":0.54600000000000004}]},{"osd":7,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48299999999999998,"15min":0.48099999999999998},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.34000000000000002},"max":{"1min":0.57299999999999995,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44700000000000001,"15min":0.45700000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.56599999999999995,"5min":0.63400000000000001,"15min":0.68999999999999995},"last":0.53600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575186,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":341408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.309,"15min":0.30199999999999999},"min":{"1min":0.19500000000000001,"5min":0.18099999999999999,"15min":0.17000000000000001},"max":{"1min":0.51500000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.30099999999999999,"15min":0.30199999999999999},"min":{"1min":0.23100000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.49199999999999999,"5min":0.55800000000000005,"15min":0.623},"last":0.35399999999999998}]},{"osd":1,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.26200000000000001,"5min":0.23300000000000001,"15min":0.193},"max":{"1min":0.53200000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.32100000000000001,"15min":0.32700000000000001},"min":{"1min":0.254,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.45600000000000002,"5min":0.54700000000000004,"15min":0.54800000000000004},"last":0.38800000000000001}]},{"osd":3,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.23599999999999999,"5min":0.23100000000000001,"15min":0.214},"max":{"1min":0.47099999999999997,"5min":0.53800000000000003,"15min":0.58599999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.36399999999999999,"15min":0.36199999999999999},"min":{"1min":0.29099999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.60599999999999998},"last":0.41299999999999998}]},{"osd":4,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.42699999999999999},"min":{"1min":0.35499999999999998,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.58899999999999997,"5min":0.60699999999999998,"15min":0.66500000000000004},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42999999999999999},"min":{"1min":0.35499999999999998,"5min":0.314,"15min":0.29499999999999998},"max":{"1min":0.50600000000000001,"5min":0.59099999999999997,"15min":0.72899999999999998},"last":0.64900000000000002}]},{"osd":5,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.33400000000000002,"5min":0.311,"15min":0.30299999999999999},"max":{"1min":0.54300000000000004,"5min":0.61799999999999999,"15min":0.755},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.45300000000000001},"min":{"1min":0.38500000000000001,"5min":0.33600000000000002,"15min":0.33100000000000002},"max":{"1min":0.56699999999999995,"5min":0.65400000000000003,"15min":0.67000000000000004},"last":0.66000000000000003}]},{"osd":6,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.437,"15min":0.44600000000000001},"min":{"1min":0.34399999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.55100000000000005,"5min":0.67500000000000004,"15min":0.68400000000000005},"last":0.628},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47899999999999998,"15min":0.47599999999999998},"min":{"1min":0.374,"5min":0.36499999999999999,"15min":0.32500000000000001},"max":{"1min":0.60099999999999998,"5min":0.63600000000000001,"15min":0.77400000000000002},"last":0.66900000000000004}]},{"osd":7,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46999999999999997,"15min":0.47299999999999998},"min":{"1min":0.36399999999999999,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.61899999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.45000000000000001,"15min":0.46200000000000002},"min":{"1min":0.35599999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.65300000000000002},"last":0.68700000000000006}]}]},{"osd":1,"up_from":13,"seq":55834575186,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42460,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329380,"statfs":{"total":96636764160,"available":96593285120,"internally_reserved":0,"allocated":3035136,"data_stored":4312983,"data_compressed":488319,"data_compressed_allocated":745472,"data_compressed_original":2203648,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.27400000000000002,"15min":0.27600000000000002},"min":{"1min":0.20000000000000001,"5min":0.184,"15min":0.16800000000000001},"max":{"1min":0.42099999999999999,"5min":0.46100000000000002,"15min":0.61499999999999999},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.309,"5min":0.31,"15min":0.316},"min":{"1min":0.22600000000000001,"5min":0.218,"15min":0.21199999999999999},"max":{"1min":0.38300000000000001,"5min":0.55500000000000005,"15min":0.56499999999999995},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.29299999999999998,"5min":0.28499999999999998,"15min":0.29199999999999998},"min":{"1min":0.22600000000000001,"5min":0.20599999999999999,"15min":0.19},"max":{"1min":0.377,"5min":0.44,"15min":0.51200000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.32400000000000001,"15min":0.32000000000000001},"min":{"1min":0.245,"5min":0.221,"15min":0.20999999999999999},"max":{"1min":0.40200000000000002,"5min":0.56200000000000006,"15min":0.58499999999999996},"last":0.30299999999999999}]},{"osd":3,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.34599999999999997},"min":{"1min":0.28399999999999997,"5min":0.23200000000000001,"15min":0.223},"max":{"1min":0.40400000000000003,"5min":0.499,"15min":0.55800000000000005},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34200000000000003},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48099999999999998,"5min":0.52500000000000002,"15min":0.59699999999999998},"last":0.26900000000000002}]},{"osd":4,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40100000000000002,"15min":0.40600000000000003},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.64100000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.432,"15min":0.433},"min":{"1min":0.35499999999999998,"5min":0.32100000000000001,"15min":0.307},"max":{"1min":0.55800000000000005,"5min":0.57999999999999996,"15min":0.65400000000000003},"last":0.48699999999999999}]},{"osd":5,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42599999999999999,"15min":0.441},"min":{"1min":0.35599999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.64600000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.42799999999999999,"15min":0.436},"min":{"1min":0.34599999999999997,"5min":0.318,"15min":0.28100000000000003},"max":{"1min":0.57899999999999996,"5min":0.64500000000000002,"15min":0.69299999999999995},"last":0.47299999999999998}]},{"osd":6,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.39300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.58099999999999996,"5min":0.65800000000000003,"15min":0.754},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.36099999999999999,"5min":0.33300000000000002,"15min":0.29999999999999999},"max":{"1min":0.55500000000000005,"5min":0.628,"15min":0.73099999999999998},"last":0.5}]},{"osd":7,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.33700000000000002},"max":{"1min":0.60099999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.58299999999999996,"5min":0.64300000000000002,"15min":0.71799999999999997},"last":0.46300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575186,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60428,"kb_used_data":7044,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311412,"statfs":{"total":96636764160,"available":96574885888,"internally_reserved":0,"allocated":7213056,"data_stored":11594953,"data_compressed":1199021,"data_compressed_allocated":1765376,"data_compressed_original":6336512,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.27700000000000002,"5min":0.27900000000000003,"15min":0.28299999999999997},"min":{"1min":0.189,"5min":0.17299999999999999,"15min":0.17100000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.56799999999999995},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.317,"5min":0.316,"15min":0.307},"min":{"1min":0.22700000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.44,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.377}]},{"osd":2,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.308,"15min":0.30499999999999999},"min":{"1min":0.20300000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.45100000000000001,"5min":0.52300000000000002,"15min":0.54900000000000004},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.32600000000000001,"15min":0.32200000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.20300000000000001},"max":{"1min":0.42899999999999999,"5min":0.57899999999999996,"15min":0.66400000000000003},"last":0.35299999999999998}]},{"osd":3,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.20399999999999999},"max":{"1min":0.46700000000000003,"5min":0.52400000000000002,"15min":0.54100000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34000000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.224},"max":{"1min":0.45000000000000001,"5min":0.59199999999999997,"15min":0.60999999999999999},"last":0.39600000000000002}]},{"osd":4,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.433,"15min":0.434},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.54000000000000004,"5min":0.67900000000000005,"15min":0.69799999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.435},"min":{"1min":0.36299999999999999,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.56000000000000005,"5min":0.60399999999999998,"15min":0.64200000000000002},"last":0.53000000000000003}]},{"osd":5,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46100000000000002,"15min":0.443},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.29999999999999999},"max":{"1min":0.58499999999999996,"5min":0.67900000000000005,"15min":0.69899999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46600000000000003,"15min":0.46300000000000002},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.59399999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.623}]},{"osd":6,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.375,"5min":0.32600000000000001,"15min":0.31900000000000001},"max":{"1min":0.628,"5min":0.69199999999999995,"15min":0.71799999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.46000000000000002},"min":{"1min":0.38600000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.60899999999999999,"5min":0.70299999999999996,"15min":0.73499999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.40799999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65200000000000002,"5min":0.69999999999999996,"15min":0.73599999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.34000000000000002},"max":{"1min":0.66100000000000003,"5min":0.66800000000000004,"15min":0.69099999999999995},"last":0.56000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6856704,"data_stored":10886066,"data_compressed":1166433,"data_compressed_allocated":1720320,"data_compressed_original":5763072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2744320,"data_stored":4194464,"data_compressed":488319,"data_compressed_allocated":745472,"data_compressed_original":2203648,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":222889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9564160,"data_stored":12806473,"data_compressed":1002682,"data_compressed_allocated":1646592,"data_compressed_original":4898816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7458816,"data_stored":10885554,"data_compressed":1082070,"data_compressed_allocated":1703936,"data_compressed_original":5144576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12001280,"data_stored":16777888,"data_compressed":1393950,"data_compressed_allocated":2220032,"data_compressed_original":7004160,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17375232,"data_stored":25166406,"data_compressed":2353166,"data_compressed_allocated":3678208,"data_compressed_original":11472896,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T20:49:16.117 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-16T20:49:16.118 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T20:49:16.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.251+0000 7f9877ba5640 1 Processor -- start 2023-12-16T20:49:16.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.251+0000 7f9877ba5640 1 -- start start 2023-12-16T20:49:16.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.252+0000 7f9877ba5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98701504e0 0x7f987006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:16.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.252+0000 7f9877ba5640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f98700c7190 0x7f987006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:16.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.252+0000 7f9877ba5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f98700c7700 0x7f98700c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:16.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.252+0000 7f9877ba5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98700c5f60 con 0x7f98700c7700 2023-12-16T20:49:16.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.252+0000 7f9877ba5640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98700c2c60 con 0x7f98700c7190 2023-12-16T20:49:16.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.252+0000 7f9877ba5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98700c2f20 con 0x7f98701504e0 2023-12-16T20:49:16.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.253+0000 7f9876142640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f98700c7700 0x7f98700c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:16.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.253+0000 7f9875941640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98701504e0 0x7f987006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:16.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.253+0000 7f9875140640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f98700c7190 0x7f987006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:16.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.253+0000 7f9876142640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f98700c7700 0x7f98700c7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44736/0 (socket says 172.21.15.87:44736) 2023-12-16T20:49:16.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.253+0000 7f9876142640 1 -- 172.21.15.87:0/3827191870 learned_addr learned my addr 172.21.15.87:0/3827191870 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:16.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.255+0000 7f9876142640 1 -- 172.21.15.87:0/3827191870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98701504e0 msgr2=0x7f987006e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:16.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.255+0000 7f9876142640 1 --2- 172.21.15.87:0/3827191870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98701504e0 0x7f987006e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.255+0000 7f9876142640 1 -- 172.21.15.87:0/3827191870 >> v2:172.21.15.195:3300/0 conn(0x7f98700c7190 msgr2=0x7f987006e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:16.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.255+0000 7f9876142640 1 --2- 172.21.15.87:0/3827191870 >> v2:172.21.15.195:3300/0 conn(0x7f98700c7190 0x7f987006e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.255+0000 7f9876142640 1 -- 172.21.15.87:0/3827191870 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98700c61b0 con 0x7f98700c7700 2023-12-16T20:49:16.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.257+0000 7f9876142640 1 --2- 172.21.15.87:0/3827191870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98700c7700 0x7f98700c7ce0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f98700709c0 tx=0x7f986802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1858289226699e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:16.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.261+0000 7f987493f640 1 -- 172.21.15.87:0/3827191870 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986802c9e0 con 0x7f98700c7700 2023-12-16T20:49:16.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.261+0000 7f987493f640 1 -- 172.21.15.87:0/3827191870 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986802cb40 con 0x7f98700c7700 2023-12-16T20:49:16.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.261+0000 7f987493f640 1 -- 172.21.15.87:0/3827191870 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98680343f0 con 0x7f98700c7700 2023-12-16T20:49:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.262+0000 7f9877ba5640 1 -- 172.21.15.87:0/3827191870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98700c7700 msgr2=0x7f98700c7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.262+0000 7f9877ba5640 1 --2- 172.21.15.87:0/3827191870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98700c7700 0x7f98700c7ce0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f98700709c0 tx=0x7f986802be40 comp rx=0 tx=0).stop 2023-12-16T20:49:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.262+0000 7f9877ba5640 1 -- 172.21.15.87:0/3827191870 shutdown_connections 2023-12-16T20:49:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.262+0000 7f9877ba5640 1 --2- 172.21.15.87:0/3827191870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98700c7700 0x7f98700c7ce0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.262+0000 7f9877ba5640 1 --2- 172.21.15.87:0/3827191870 >> v2:172.21.15.195:3300/0 conn(0x7f98700c7190 0x7f987006e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.262+0000 7f9877ba5640 1 --2- 172.21.15.87:0/3827191870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98701504e0 0x7f987006e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.262+0000 7f9877ba5640 1 -- 172.21.15.87:0/3827191870 >> 172.21.15.87:0/3827191870 conn(0x7f98700cbef0 msgr2=0x7f98700cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:16.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.262+0000 7f9877ba5640 1 -- 172.21.15.87:0/3827191870 shutdown_connections 2023-12-16T20:49:16.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.262+0000 7f9877ba5640 1 -- 172.21.15.87:0/3827191870 wait complete. 2023-12-16T20:49:16.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.264+0000 7f9877ba5640 1 Processor -- start 2023-12-16T20:49:16.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.264+0000 7f9877ba5640 1 -- start start 2023-12-16T20:49:16.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.264+0000 7f9877ba5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98700c7190 0x7f98701e11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:16.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.264+0000 7f9877ba5640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98700c7700 0x7f987014ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:16.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.264+0000 7f9877ba5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98701504e0 0x7f9870159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:16.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.264+0000 7f9877ba5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98701e1710 con 0x7f98701504e0 2023-12-16T20:49:16.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.264+0000 7f9877ba5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9870159700 con 0x7f98700c7190 2023-12-16T20:49:16.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.264+0000 7f9877ba5640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98701eb890 con 0x7f98700c7700 2023-12-16T20:49:16.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.265+0000 7f9876142640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98701504e0 0x7f9870159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:16.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.265+0000 7f9875140640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98700c7700 0x7f987014ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:16.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.265+0000 7f9875941640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98700c7190 0x7f98701e11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:16.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.265+0000 7f9876142640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98701504e0 0x7f9870159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44748/0 (socket says 172.21.15.87:44748) 2023-12-16T20:49:16.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.265+0000 7f9876142640 1 -- 172.21.15.87:0/1502125922 learned_addr learned my addr 172.21.15.87:0/1502125922 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.268+0000 7f9876142640 1 -- 172.21.15.87:0/1502125922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98700c7700 msgr2=0x7f987014ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.268+0000 7f9876142640 1 --2- 172.21.15.87:0/1502125922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98700c7700 0x7f987014ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.268+0000 7f9876142640 1 -- 172.21.15.87:0/1502125922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98700c7190 msgr2=0x7f98701e11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.268+0000 7f9876142640 1 --2- 172.21.15.87:0/1502125922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98700c7190 0x7f98701e11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.268+0000 7f9876142640 1 -- 172.21.15.87:0/1502125922 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9868009b30 con 0x7f98701504e0 2023-12-16T20:49:16.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.271+0000 7f9876142640 1 --2- 172.21.15.87:0/1502125922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98701504e0 0x7f9870159b90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9868036040 tx=0x7f9868004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:16.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.274+0000 7f98667fc640 1 -- 172.21.15.87:0/1502125922 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9868007ea0 con 0x7f98701504e0 2023-12-16T20:49:16.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.274+0000 7f98667fc640 1 -- 172.21.15.87:0/1502125922 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986803e450 con 0x7f98701504e0 2023-12-16T20:49:16.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.274+0000 7f98667fc640 1 -- 172.21.15.87:0/1502125922 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986803e800 con 0x7f98701504e0 2023-12-16T20:49:16.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.274+0000 7f9877ba5640 1 -- 172.21.15.87:0/1502125922 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98701e2050 con 0x7f98701504e0 2023-12-16T20:49:16.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.274+0000 7f9877ba5640 1 -- 172.21.15.87:0/1502125922 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9870159390 con 0x7f98701504e0 2023-12-16T20:49:16.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.275+0000 7f9877ba5640 1 -- 172.21.15.87:0/1502125922 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9870159520 con 0x7f98701504e0 2023-12-16T20:49:16.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.532+0000 7f98667fc640 1 -- 172.21.15.87:0/1502125922 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f986803e960 con 0x7f98701504e0 2023-12-16T20:49:16.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.533+0000 7f98667fc640 1 --2- 172.21.15.87:0/1502125922 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f985406aec0 0x7f985406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:16.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.533+0000 7f9875941640 1 --2- 172.21.15.87:0/1502125922 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f985406aec0 0x7f985406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:16.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.534+0000 7f9875941640 1 --2- 172.21.15.87:0/1502125922 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f985406aec0 0x7f985406d380 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f986c009a20 tx=0x7f986c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:16.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.547+0000 7f98667fc640 1 -- 172.21.15.87:0/1502125922 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f986807b370 con 0x7f98701504e0 2023-12-16T20:49:16.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.547+0000 7f98667fc640 1 -- 172.21.15.87:0/1502125922 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f98680776b0 con 0x7f98701504e0 2023-12-16T20:49:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.735+0000 7f9877ba5640 1 -- 172.21.15.87:0/1502125922 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9870074360 con 0x7f985406aec0 2023-12-16T20:49:16.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.744+0000 7f98667fc640 1 -- 172.21.15.87:0/1502125922 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371164 (secure 0 0 0) 0x7f9870074360 con 0x7f985406aec0 2023-12-16T20:49:16.749 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:49:16.754 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-12-16T20:49:16.756 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.748+0000 7f9877ba5640 1 -- 172.21.15.87:0/1502125922 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f985406aec0 msgr2=0x7f985406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:16.756 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.748+0000 7f9877ba5640 1 --2- 172.21.15.87:0/1502125922 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f985406aec0 0x7f985406d380 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f986c009a20 tx=0x7f986c009190 comp rx=0 tx=0).stop 2023-12-16T20:49:16.756 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.748+0000 7f9877ba5640 1 -- 172.21.15.87:0/1502125922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98701504e0 msgr2=0x7f9870159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:16.756 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.748+0000 7f9877ba5640 1 --2- 172.21.15.87:0/1502125922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98701504e0 0x7f9870159b90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9868036040 tx=0x7f9868004a40 comp rx=0 tx=0).stop 2023-12-16T20:49:16.756 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.748+0000 7f9877ba5640 1 -- 172.21.15.87:0/1502125922 shutdown_connections 2023-12-16T20:49:16.756 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.748+0000 7f9877ba5640 1 --2- 172.21.15.87:0/1502125922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98701504e0 0x7f9870159b90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.756 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.748+0000 7f9877ba5640 1 --2- 172.21.15.87:0/1502125922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98700c7700 0x7f987014ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.756 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.748+0000 7f9877ba5640 1 --2- 172.21.15.87:0/1502125922 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f985406aec0 0x7f985406d380 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.756 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.748+0000 7f9877ba5640 1 --2- 172.21.15.87:0/1502125922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98700c7190 0x7f98701e11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.756 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.749+0000 7f9877ba5640 1 -- 172.21.15.87:0/1502125922 >> 172.21.15.87:0/1502125922 conn(0x7f98700cbef0 msgr2=0x7f987006df80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:16.756 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.749+0000 7f9877ba5640 1 -- 172.21.15.87:0/1502125922 shutdown_connections 2023-12-16T20:49:16.757 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.749+0000 7f9877ba5640 1 -- 172.21.15.87:0/1502125922 wait complete. 2023-12-16T20:49:16.761 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":858,"stamp":"2023-12-16T20:49:16.646369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41060283,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1154,"num_read_kb":1198,"num_write":13351,"num_write_kb":371526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15840,"ondisk_log_size":15840,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":431648,"kb_used_data":57312,"kb_used_omap":12,"kb_used_meta":374259,"kb_avail":754543072,"statfs":{"total":773094113280,"available":772652105728,"internally_reserved":0,"allocated":58687488,"data_stored":83068718,"data_compressed":7551796,"data_compressed_allocated":11804672,"data_compressed_original":37634048,"omap_allocated":12751,"internal_metadata":383241777},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19037,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":18,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002967"},"pg_stats":[{"pgid":"2.1f","version":"27'642","reported_seq":673,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:50.514980+0000","last_change":"2023-12-16T20:21:35.413343+0000","last_active":"2023-12-16T20:48:50.514980+0000","last_peered":"2023-12-16T20:48:50.514980+0000","last_clean":"2023-12-16T20:48:50.514980+0000","last_became_active":"2023-12-16T20:21:35.413075+0000","last_became_peered":"2023-12-16T20:21:35.413075+0000","last_unstale":"2023-12-16T20:48:50.514980+0000","last_undegraded":"2023-12-16T20:48:50.514980+0000","last_fullsized":"2023-12-16T20:48:50.514980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'31","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.790583+0000","last_change":"2023-12-16T20:21:36.542907+0000","last_active":"2023-12-16T20:49:08.790583+0000","last_peered":"2023-12-16T20:49:08.790583+0000","last_clean":"2023-12-16T20:49:08.790583+0000","last_became_active":"2023-12-16T20:21:36.542667+0000","last_became_peered":"2023-12-16T20:21:36.542667+0000","last_unstale":"2023-12-16T20:49:08.790583+0000","last_undegraded":"2023-12-16T20:49:08.790583+0000","last_fullsized":"2023-12-16T20:49:08.790583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'182","reported_seq":208,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.469341+0000","last_change":"2023-12-16T20:21:41.216466+0000","last_active":"2023-12-16T20:48:41.469341+0000","last_peered":"2023-12-16T20:48:41.469341+0000","last_clean":"2023-12-16T20:48:41.469341+0000","last_became_active":"2023-12-16T20:21:41.216062+0000","last_became_peered":"2023-12-16T20:21:41.216062+0000","last_unstale":"2023-12-16T20:48:41.469341+0000","last_undegraded":"2023-12-16T20:48:41.469341+0000","last_fullsized":"2023-12-16T20:48:41.469341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:33:01.663841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":13331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'710","reported_seq":741,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:47:41.528829+0000","last_change":"2023-12-16T20:21:35.420038+0000","last_active":"2023-12-16T20:47:41.528829+0000","last_peered":"2023-12-16T20:47:41.528829+0000","last_clean":"2023-12-16T20:47:41.528829+0000","last_became_active":"2023-12-16T20:21:35.419745+0000","last_became_peered":"2023-12-16T20:21:35.419745+0000","last_unstale":"2023-12-16T20:47:41.528829+0000","last_undegraded":"2023-12-16T20:47:41.528829+0000","last_fullsized":"2023-12-16T20:47:41.528829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'38","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.972297+0000","last_change":"2023-12-16T20:21:36.552916+0000","last_active":"2023-12-16T20:49:08.972297+0000","last_peered":"2023-12-16T20:49:08.972297+0000","last_clean":"2023-12-16T20:49:08.972297+0000","last_became_active":"2023-12-16T20:21:36.552621+0000","last_became_peered":"2023-12-16T20:21:36.552621+0000","last_unstale":"2023-12-16T20:49:08.972297+0000","last_undegraded":"2023-12-16T20:49:08.972297+0000","last_fullsized":"2023-12-16T20:49:08.972297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'122","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:38.770349+0000","last_change":"2023-12-16T20:21:40.754959+0000","last_active":"2023-12-16T20:48:38.770349+0000","last_peered":"2023-12-16T20:48:38.770349+0000","last_clean":"2023-12-16T20:48:38.770349+0000","last_became_active":"2023-12-16T20:21:40.754509+0000","last_became_peered":"2023-12-16T20:21:40.754509+0000","last_unstale":"2023-12-16T20:48:38.770349+0000","last_undegraded":"2023-12-16T20:48:38.770349+0000","last_fullsized":"2023-12-16T20:48:38.770349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:21.787809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1392","reported_seq":1421,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:01.711787+0000","last_change":"2023-12-16T20:21:35.427622+0000","last_active":"2023-12-16T20:49:01.711787+0000","last_peered":"2023-12-16T20:49:01.711787+0000","last_clean":"2023-12-16T20:49:01.711787+0000","last_became_active":"2023-12-16T20:21:35.427317+0000","last_became_peered":"2023-12-16T20:21:35.427317+0000","last_unstale":"2023-12-16T20:49:01.711787+0000","last_undegraded":"2023-12-16T20:49:01.711787+0000","last_fullsized":"2023-12-16T20:49:01.711787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1392,"log_dups_size":0,"ondisk_log_size":1392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":9004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'33","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.888259+0000","last_change":"2023-12-16T20:22:14.769257+0000","last_active":"2023-12-16T20:49:08.888259+0000","last_peered":"2023-12-16T20:49:08.888259+0000","last_clean":"2023-12-16T20:49:08.888259+0000","last_became_active":"2023-12-16T20:22:14.768968+0000","last_became_peered":"2023-12-16T20:22:14.768968+0000","last_unstale":"2023-12-16T20:49:08.888259+0000","last_undegraded":"2023-12-16T20:49:08.888259+0000","last_fullsized":"2023-12-16T20:49:08.888259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"27'156","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.509449+0000","last_change":"2023-12-16T20:22:14.820429+0000","last_active":"2023-12-16T20:48:41.509449+0000","last_peered":"2023-12-16T20:48:41.509449+0000","last_clean":"2023-12-16T20:48:41.509449+0000","last_became_active":"2023-12-16T20:22:14.819924+0000","last_became_peered":"2023-12-16T20:22:14.819924+0000","last_unstale":"2023-12-16T20:48:41.509449+0000","last_undegraded":"2023-12-16T20:48:41.509449+0000","last_fullsized":"2023-12-16T20:48:41.509449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:10:42.982067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":12476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:59.710315+0000","last_change":"2023-12-16T20:21:35.413521+0000","last_active":"2023-12-16T20:48:59.710315+0000","last_peered":"2023-12-16T20:48:59.710315+0000","last_clean":"2023-12-16T20:48:59.710315+0000","last_became_active":"2023-12-16T20:21:35.413234+0000","last_became_peered":"2023-12-16T20:21:35.413234+0000","last_unstale":"2023-12-16T20:48:59.710315+0000","last_undegraded":"2023-12-16T20:48:59.710315+0000","last_fullsized":"2023-12-16T20:48:59.710315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'49","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.819877+0000","last_change":"2023-12-16T20:21:36.554419+0000","last_active":"2023-12-16T20:49:08.819877+0000","last_peered":"2023-12-16T20:49:08.819877+0000","last_clean":"2023-12-16T20:49:08.819877+0000","last_became_active":"2023-12-16T20:21:36.554014+0000","last_became_peered":"2023-12-16T20:21:36.554014+0000","last_unstale":"2023-12-16T20:49:08.819877+0000","last_undegraded":"2023-12-16T20:49:08.819877+0000","last_fullsized":"2023-12-16T20:49:08.819877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:03.543973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'146","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.419020+0000","last_change":"2023-12-16T20:21:40.794852+0000","last_active":"2023-12-16T20:48:41.419020+0000","last_peered":"2023-12-16T20:48:41.419020+0000","last_clean":"2023-12-16T20:48:41.419020+0000","last_became_active":"2023-12-16T20:21:40.794471+0000","last_became_peered":"2023-12-16T20:21:40.794471+0000","last_unstale":"2023-12-16T20:48:41.419020+0000","last_undegraded":"2023-12-16T20:48:41.419020+0000","last_fullsized":"2023-12-16T20:48:41.419020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:25.004850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'39","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.890251+0000","last_change":"2023-12-16T20:21:36.542450+0000","last_active":"2023-12-16T20:49:08.890251+0000","last_peered":"2023-12-16T20:49:08.890251+0000","last_clean":"2023-12-16T20:49:08.890251+0000","last_became_active":"2023-12-16T20:21:36.542157+0000","last_became_peered":"2023-12-16T20:21:36.542157+0000","last_unstale":"2023-12-16T20:49:08.890251+0000","last_undegraded":"2023-12-16T20:49:08.890251+0000","last_fullsized":"2023-12-16T20:49:08.890251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'680","reported_seq":710,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:01.713499+0000","last_change":"2023-12-16T20:21:35.413681+0000","last_active":"2023-12-16T20:49:01.713499+0000","last_peered":"2023-12-16T20:49:01.713499+0000","last_clean":"2023-12-16T20:49:01.713499+0000","last_became_active":"2023-12-16T20:21:35.413400+0000","last_became_peered":"2023-12-16T20:21:35.413400+0000","last_unstale":"2023-12-16T20:49:01.713499+0000","last_undegraded":"2023-12-16T20:49:01.713499+0000","last_fullsized":"2023-12-16T20:49:01.713499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:27.767422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":4429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'121","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.504489+0000","last_change":"2023-12-16T20:21:40.745971+0000","last_active":"2023-12-16T20:48:41.504489+0000","last_peered":"2023-12-16T20:48:41.504489+0000","last_clean":"2023-12-16T20:48:41.504489+0000","last_became_active":"2023-12-16T20:21:40.745544+0000","last_became_peered":"2023-12-16T20:21:40.745544+0000","last_unstale":"2023-12-16T20:48:41.504489+0000","last_undegraded":"2023-12-16T20:48:41.504489+0000","last_fullsized":"2023-12-16T20:48:41.504489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:18.981353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":10860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'38","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796186+0000","last_change":"2023-12-16T20:21:36.526277+0000","last_active":"2023-12-16T20:49:08.796186+0000","last_peered":"2023-12-16T20:49:08.796186+0000","last_clean":"2023-12-16T20:49:08.796186+0000","last_became_active":"2023-12-16T20:21:36.525983+0000","last_became_peered":"2023-12-16T20:21:36.525983+0000","last_unstale":"2023-12-16T20:49:08.796186+0000","last_undegraded":"2023-12-16T20:49:08.796186+0000","last_fullsized":"2023-12-16T20:49:08.796186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:56.620523+0000","last_change":"2023-12-16T20:21:35.420017+0000","last_active":"2023-12-16T20:48:56.620523+0000","last_peered":"2023-12-16T20:48:56.620523+0000","last_clean":"2023-12-16T20:48:56.620523+0000","last_became_active":"2023-12-16T20:21:35.419731+0000","last_became_peered":"2023-12-16T20:21:35.419731+0000","last_unstale":"2023-12-16T20:48:56.620523+0000","last_undegraded":"2023-12-16T20:48:56.620523+0000","last_fullsized":"2023-12-16T20:48:56.620523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:29.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'169","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.507104+0000","last_change":"2023-12-16T20:21:40.755335+0000","last_active":"2023-12-16T20:48:41.507104+0000","last_peered":"2023-12-16T20:48:41.507104+0000","last_clean":"2023-12-16T20:48:41.507104+0000","last_became_active":"2023-12-16T20:21:40.754829+0000","last_became_peered":"2023-12-16T20:21:40.754829+0000","last_unstale":"2023-12-16T20:48:41.507104+0000","last_undegraded":"2023-12-16T20:48:41.507104+0000","last_fullsized":"2023-12-16T20:48:41.507104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":10412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'38","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.797002+0000","last_change":"2023-12-16T20:21:36.518939+0000","last_active":"2023-12-16T20:49:08.797002+0000","last_peered":"2023-12-16T20:49:08.797002+0000","last_clean":"2023-12-16T20:49:08.797002+0000","last_became_active":"2023-12-16T20:21:36.518686+0000","last_became_peered":"2023-12-16T20:21:36.518686+0000","last_unstale":"2023-12-16T20:49:08.797002+0000","last_undegraded":"2023-12-16T20:49:08.797002+0000","last_fullsized":"2023-12-16T20:49:08.797002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:44.395374+0000","last_change":"2023-12-16T20:21:35.416372+0000","last_active":"2023-12-16T20:48:44.395374+0000","last_peered":"2023-12-16T20:48:44.395374+0000","last_clean":"2023-12-16T20:48:44.395374+0000","last_became_active":"2023-12-16T20:21:35.416067+0000","last_became_peered":"2023-12-16T20:21:35.416067+0000","last_unstale":"2023-12-16T20:48:44.395374+0000","last_undegraded":"2023-12-16T20:48:44.395374+0000","last_fullsized":"2023-12-16T20:48:44.395374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:37.215505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'126","reported_seq":153,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:37.734776+0000","last_change":"2023-12-16T20:21:41.215250+0000","last_active":"2023-12-16T20:48:37.734776+0000","last_peered":"2023-12-16T20:48:37.734776+0000","last_clean":"2023-12-16T20:48:37.734776+0000","last_became_active":"2023-12-16T20:21:41.214198+0000","last_became_peered":"2023-12-16T20:21:41.214198+0000","last_unstale":"2023-12-16T20:48:37.734776+0000","last_undegraded":"2023-12-16T20:48:37.734776+0000","last_fullsized":"2023-12-16T20:48:37.734776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:41.263768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":7034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'34","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.238701+0000","last_change":"2023-12-16T20:21:36.536797+0000","last_active":"2023-12-16T20:48:39.238701+0000","last_peered":"2023-12-16T20:48:39.238701+0000","last_clean":"2023-12-16T20:48:39.238701+0000","last_became_active":"2023-12-16T20:21:36.536321+0000","last_became_peered":"2023-12-16T20:21:36.536321+0000","last_unstale":"2023-12-16T20:48:39.238701+0000","last_undegraded":"2023-12-16T20:48:39.238701+0000","last_fullsized":"2023-12-16T20:48:39.238701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:55:55.607439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:57.613311+0000","last_change":"2023-12-16T20:21:35.425939+0000","last_active":"2023-12-16T20:48:57.613311+0000","last_peered":"2023-12-16T20:48:57.613311+0000","last_clean":"2023-12-16T20:48:57.613311+0000","last_became_active":"2023-12-16T20:21:35.420547+0000","last_became_peered":"2023-12-16T20:21:35.420547+0000","last_unstale":"2023-12-16T20:48:57.613311+0000","last_undegraded":"2023-12-16T20:48:57.613311+0000","last_fullsized":"2023-12-16T20:48:57.613311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:58:31.980302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'120","reported_seq":147,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.507092+0000","last_change":"2023-12-16T20:21:40.757445+0000","last_active":"2023-12-16T20:48:41.507092+0000","last_peered":"2023-12-16T20:48:41.507092+0000","last_clean":"2023-12-16T20:48:41.507092+0000","last_became_active":"2023-12-16T20:21:40.756997+0000","last_became_peered":"2023-12-16T20:21:40.756997+0000","last_unstale":"2023-12-16T20:48:41.507092+0000","last_undegraded":"2023-12-16T20:48:41.507092+0000","last_fullsized":"2023-12-16T20:48:41.507092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:32.702839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":6714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'40","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.970714+0000","last_change":"2023-12-16T20:21:36.524943+0000","last_active":"2023-12-16T20:49:08.970714+0000","last_peered":"2023-12-16T20:49:08.970714+0000","last_clean":"2023-12-16T20:49:08.970714+0000","last_became_active":"2023-12-16T20:21:36.524703+0000","last_became_peered":"2023-12-16T20:21:36.524703+0000","last_unstale":"2023-12-16T20:49:08.970714+0000","last_undegraded":"2023-12-16T20:49:08.970714+0000","last_fullsized":"2023-12-16T20:49:08.970714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:00.760340+0000","last_change":"2023-12-16T20:21:35.428736+0000","last_active":"2023-12-16T20:49:00.760340+0000","last_peered":"2023-12-16T20:49:00.760340+0000","last_clean":"2023-12-16T20:49:00.760340+0000","last_became_active":"2023-12-16T20:21:35.428465+0000","last_became_peered":"2023-12-16T20:21:35.428465+0000","last_unstale":"2023-12-16T20:49:00.760340+0000","last_undegraded":"2023-12-16T20:49:00.760340+0000","last_fullsized":"2023-12-16T20:49:00.760340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'152","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.504901+0000","last_change":"2023-12-16T20:21:41.213330+0000","last_active":"2023-12-16T20:48:41.504901+0000","last_peered":"2023-12-16T20:48:41.504901+0000","last_clean":"2023-12-16T20:48:41.504901+0000","last_became_active":"2023-12-16T20:21:41.212976+0000","last_became_peered":"2023-12-16T20:21:41.212976+0000","last_unstale":"2023-12-16T20:48:41.504901+0000","last_undegraded":"2023-12-16T20:48:41.504901+0000","last_fullsized":"2023-12-16T20:48:41.504901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:32:02.178544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":10330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'37","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.797154+0000","last_change":"2023-12-16T20:21:36.518956+0000","last_active":"2023-12-16T20:49:08.797154+0000","last_peered":"2023-12-16T20:49:08.797154+0000","last_clean":"2023-12-16T20:49:08.797154+0000","last_became_active":"2023-12-16T20:21:36.518673+0000","last_became_peered":"2023-12-16T20:21:36.518673+0000","last_unstale":"2023-12-16T20:49:08.797154+0000","last_undegraded":"2023-12-16T20:49:08.797154+0000","last_fullsized":"2023-12-16T20:49:08.797154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'310","reported_seq":340,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:05.580922+0000","last_change":"2023-12-16T20:21:35.423292+0000","last_active":"2023-12-16T20:49:05.580922+0000","last_peered":"2023-12-16T20:49:05.580922+0000","last_clean":"2023-12-16T20:49:05.580922+0000","last_became_active":"2023-12-16T20:21:35.423045+0000","last_became_peered":"2023-12-16T20:21:35.423045+0000","last_unstale":"2023-12-16T20:49:05.580922+0000","last_undegraded":"2023-12-16T20:49:05.580922+0000","last_fullsized":"2023-12-16T20:49:05.580922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":886,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'156","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.361966+0000","last_change":"2023-12-16T20:21:41.216113+0000","last_active":"2023-12-16T20:48:39.361966+0000","last_peered":"2023-12-16T20:48:39.361966+0000","last_clean":"2023-12-16T20:48:39.361966+0000","last_became_active":"2023-12-16T20:21:41.215747+0000","last_became_peered":"2023-12-16T20:21:41.215747+0000","last_unstale":"2023-12-16T20:48:39.361966+0000","last_undegraded":"2023-12-16T20:48:39.361966+0000","last_fullsized":"2023-12-16T20:48:39.361966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:10:17.859148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'35","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796438+0000","last_change":"2023-12-16T20:21:36.451660+0000","last_active":"2023-12-16T20:49:08.796438+0000","last_peered":"2023-12-16T20:49:08.796438+0000","last_clean":"2023-12-16T20:49:08.796438+0000","last_became_active":"2023-12-16T20:21:36.451404+0000","last_became_peered":"2023-12-16T20:21:36.451404+0000","last_unstale":"2023-12-16T20:49:08.796438+0000","last_undegraded":"2023-12-16T20:49:08.796438+0000","last_fullsized":"2023-12-16T20:49:08.796438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:47.488000+0000","last_change":"2023-12-16T20:21:35.420184+0000","last_active":"2023-12-16T20:48:47.488000+0000","last_peered":"2023-12-16T20:48:47.488000+0000","last_clean":"2023-12-16T20:48:47.488000+0000","last_became_active":"2023-12-16T20:21:35.419917+0000","last_became_peered":"2023-12-16T20:21:35.419917+0000","last_unstale":"2023-12-16T20:48:47.488000+0000","last_undegraded":"2023-12-16T20:48:47.488000+0000","last_fullsized":"2023-12-16T20:48:47.488000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:19.491578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'136","reported_seq":164,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:40.297506+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:48:40.297506+0000","last_peered":"2023-12-16T20:48:40.297506+0000","last_clean":"2023-12-16T20:48:40.297506+0000","last_became_active":"2023-12-16T20:21:41.212704+0000","last_became_peered":"2023-12-16T20:21:41.212704+0000","last_unstale":"2023-12-16T20:48:40.297506+0000","last_undegraded":"2023-12-16T20:48:40.297506+0000","last_fullsized":"2023-12-16T20:48:40.297506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:11.201128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":9011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'38","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820634+0000","last_change":"2023-12-16T20:21:36.555288+0000","last_active":"2023-12-16T20:49:08.820634+0000","last_peered":"2023-12-16T20:49:08.820634+0000","last_clean":"2023-12-16T20:49:08.820634+0000","last_became_active":"2023-12-16T20:21:36.555011+0000","last_became_peered":"2023-12-16T20:21:36.555011+0000","last_unstale":"2023-12-16T20:49:08.820634+0000","last_undegraded":"2023-12-16T20:49:08.820634+0000","last_fullsized":"2023-12-16T20:49:08.820634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:06.805922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:58.651724+0000","last_change":"2023-12-16T20:21:35.417945+0000","last_active":"2023-12-16T20:48:58.651724+0000","last_peered":"2023-12-16T20:48:58.651724+0000","last_clean":"2023-12-16T20:48:58.651724+0000","last_became_active":"2023-12-16T20:21:35.417683+0000","last_became_peered":"2023-12-16T20:21:35.417683+0000","last_unstale":"2023-12-16T20:48:58.651724+0000","last_undegraded":"2023-12-16T20:48:58.651724+0000","last_fullsized":"2023-12-16T20:48:58.651724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:18.427670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'180","reported_seq":208,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.512687+0000","last_change":"2023-12-16T20:21:40.794299+0000","last_active":"2023-12-16T20:48:41.512687+0000","last_peered":"2023-12-16T20:48:41.512687+0000","last_clean":"2023-12-16T20:48:41.512687+0000","last_became_active":"2023-12-16T20:21:40.793754+0000","last_became_peered":"2023-12-16T20:21:40.793754+0000","last_unstale":"2023-12-16T20:48:41.512687+0000","last_undegraded":"2023-12-16T20:48:41.512687+0000","last_fullsized":"2023-12-16T20:48:41.512687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:10.036962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":10123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'33","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820560+0000","last_change":"2023-12-16T20:21:36.534278+0000","last_active":"2023-12-16T20:49:08.820560+0000","last_peered":"2023-12-16T20:49:08.820560+0000","last_clean":"2023-12-16T20:49:08.820560+0000","last_became_active":"2023-12-16T20:21:36.533651+0000","last_became_peered":"2023-12-16T20:21:36.533651+0000","last_unstale":"2023-12-16T20:49:08.820560+0000","last_undegraded":"2023-12-16T20:49:08.820560+0000","last_fullsized":"2023-12-16T20:49:08.820560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:58:33.098369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'7","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:55.659121+0000","last_change":"2023-12-16T20:21:35.422128+0000","last_active":"2023-12-16T20:48:55.659121+0000","last_peered":"2023-12-16T20:48:55.659121+0000","last_clean":"2023-12-16T20:48:55.659121+0000","last_became_active":"2023-12-16T20:21:35.421875+0000","last_became_peered":"2023-12-16T20:21:35.421875+0000","last_unstale":"2023-12-16T20:48:55.659121+0000","last_undegraded":"2023-12-16T20:48:55.659121+0000","last_fullsized":"2023-12-16T20:48:55.659121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:24.569380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'112","reported_seq":140,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:33.903590+0000","last_change":"2023-12-16T20:21:40.754363+0000","last_active":"2023-12-16T20:48:33.903590+0000","last_peered":"2023-12-16T20:48:33.903590+0000","last_clean":"2023-12-16T20:48:33.903590+0000","last_became_active":"2023-12-16T20:21:40.753994+0000","last_became_peered":"2023-12-16T20:21:40.753994+0000","last_unstale":"2023-12-16T20:48:33.903590+0000","last_undegraded":"2023-12-16T20:48:33.903590+0000","last_fullsized":"2023-12-16T20:48:33.903590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:07.939178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'33","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.793432+0000","last_change":"2023-12-16T20:21:36.451488+0000","last_active":"2023-12-16T20:49:08.793432+0000","last_peered":"2023-12-16T20:49:08.793432+0000","last_clean":"2023-12-16T20:49:08.793432+0000","last_became_active":"2023-12-16T20:21:36.451231+0000","last_became_peered":"2023-12-16T20:21:36.451231+0000","last_unstale":"2023-12-16T20:49:08.793432+0000","last_undegraded":"2023-12-16T20:49:08.793432+0000","last_fullsized":"2023-12-16T20:49:08.793432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'1042","reported_seq":2111,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:02.716494+0000","last_change":"2023-12-16T20:21:35.420494+0000","last_active":"2023-12-16T20:49:02.716494+0000","last_peered":"2023-12-16T20:49:02.716494+0000","last_clean":"2023-12-16T20:49:02.716494+0000","last_became_active":"2023-12-16T20:21:35.420236+0000","last_became_peered":"2023-12-16T20:21:35.420236+0000","last_unstale":"2023-12-16T20:49:02.716494+0000","last_undegraded":"2023-12-16T20:49:02.716494+0000","last_fullsized":"2023-12-16T20:49:02.716494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1042,"log_dups_size":0,"ondisk_log_size":1042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:55:54.489373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222889,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1038,"num_read_kb":1098,"num_write":1039,"num_write_kb":1099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'134","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.367416+0000","last_change":"2023-12-16T20:22:14.842642+0000","last_active":"2023-12-16T20:48:39.367416+0000","last_peered":"2023-12-16T20:48:39.367416+0000","last_clean":"2023-12-16T20:48:39.367416+0000","last_became_active":"2023-12-16T20:22:14.842220+0000","last_became_peered":"2023-12-16T20:22:14.842220+0000","last_unstale":"2023-12-16T20:48:39.367416+0000","last_undegraded":"2023-12-16T20:48:39.367416+0000","last_fullsized":"2023-12-16T20:48:39.367416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":9129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"27'27","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.971875+0000","last_change":"2023-12-16T20:21:36.535835+0000","last_active":"2023-12-16T20:49:08.971875+0000","last_peered":"2023-12-16T20:49:08.971875+0000","last_clean":"2023-12-16T20:49:08.971875+0000","last_became_active":"2023-12-16T20:21:36.535571+0000","last_became_peered":"2023-12-16T20:21:36.535571+0000","last_unstale":"2023-12-16T20:49:08.971875+0000","last_undegraded":"2023-12-16T20:49:08.971875+0000","last_fullsized":"2023-12-16T20:49:08.971875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:54.719426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'544","reported_seq":575,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:57.613647+0000","last_change":"2023-12-16T20:21:35.418993+0000","last_active":"2023-12-16T20:48:57.613647+0000","last_peered":"2023-12-16T20:48:57.613647+0000","last_clean":"2023-12-16T20:48:57.613647+0000","last_became_active":"2023-12-16T20:21:35.418751+0000","last_became_peered":"2023-12-16T20:21:35.418751+0000","last_unstale":"2023-12-16T20:48:57.613647+0000","last_undegraded":"2023-12-16T20:48:57.613647+0000","last_fullsized":"2023-12-16T20:48:57.613647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:18.391557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'129","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.361465+0000","last_change":"2023-12-16T20:21:41.214405+0000","last_active":"2023-12-16T20:48:39.361465+0000","last_peered":"2023-12-16T20:48:39.361465+0000","last_clean":"2023-12-16T20:48:39.361465+0000","last_became_active":"2023-12-16T20:21:41.213977+0000","last_became_peered":"2023-12-16T20:21:41.213977+0000","last_unstale":"2023-12-16T20:48:39.361465+0000","last_undegraded":"2023-12-16T20:48:39.361465+0000","last_fullsized":"2023-12-16T20:48:39.361465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:16.656597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":8382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'30","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.793277+0000","last_change":"2023-12-16T20:21:36.551240+0000","last_active":"2023-12-16T20:49:08.793277+0000","last_peered":"2023-12-16T20:49:08.793277+0000","last_clean":"2023-12-16T20:49:08.793277+0000","last_became_active":"2023-12-16T20:21:36.550997+0000","last_became_peered":"2023-12-16T20:21:36.550997+0000","last_unstale":"2023-12-16T20:49:08.793277+0000","last_undegraded":"2023-12-16T20:49:08.793277+0000","last_fullsized":"2023-12-16T20:49:08.793277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'4","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:53.546511+0000","last_change":"2023-12-16T20:21:35.416258+0000","last_active":"2023-12-16T20:48:53.546511+0000","last_peered":"2023-12-16T20:48:53.546511+0000","last_clean":"2023-12-16T20:48:53.546511+0000","last_became_active":"2023-12-16T20:21:35.415984+0000","last_became_peered":"2023-12-16T20:21:35.415984+0000","last_unstale":"2023-12-16T20:48:53.546511+0000","last_undegraded":"2023-12-16T20:48:53.546511+0000","last_fullsized":"2023-12-16T20:48:53.546511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:06.872220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:45:31.524454+0000","last_change":"2023-12-16T20:21:25.196796+0000","last_active":"2023-12-16T20:45:31.524454+0000","last_peered":"2023-12-16T20:45:31.524454+0000","last_clean":"2023-12-16T20:45:31.524454+0000","last_became_active":"2023-12-16T20:21:25.195675+0000","last_became_peered":"2023-12-16T20:21:25.195675+0000","last_unstale":"2023-12-16T20:45:31.524454+0000","last_undegraded":"2023-12-16T20:45:31.524454+0000","last_fullsized":"2023-12-16T20:45:31.524454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:23.008820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:23.008820+0000","last_clean_scrub_stamp":"2023-12-16T20:21:23.008820+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:46:02.232774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'192","reported_seq":220,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.474899+0000","last_change":"2023-12-16T20:21:41.214322+0000","last_active":"2023-12-16T20:48:41.474899+0000","last_peered":"2023-12-16T20:48:41.474899+0000","last_clean":"2023-12-16T20:48:41.474899+0000","last_became_active":"2023-12-16T20:21:41.214012+0000","last_became_peered":"2023-12-16T20:21:41.214012+0000","last_unstale":"2023-12-16T20:48:41.474899+0000","last_undegraded":"2023-12-16T20:48:41.474899+0000","last_fullsized":"2023-12-16T20:48:41.474899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:18.981353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":12745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'36","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.904272+0000","last_change":"2023-12-16T20:21:36.552920+0000","last_active":"2023-12-16T20:49:08.904272+0000","last_peered":"2023-12-16T20:49:08.904272+0000","last_clean":"2023-12-16T20:49:08.904272+0000","last_became_active":"2023-12-16T20:21:36.552619+0000","last_became_peered":"2023-12-16T20:21:36.552619+0000","last_unstale":"2023-12-16T20:49:08.904272+0000","last_undegraded":"2023-12-16T20:49:08.904272+0000","last_fullsized":"2023-12-16T20:49:08.904272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:14.586148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:48.478829+0000","last_change":"2023-12-16T20:21:35.413597+0000","last_active":"2023-12-16T20:48:48.478829+0000","last_peered":"2023-12-16T20:48:48.478829+0000","last_clean":"2023-12-16T20:48:48.478829+0000","last_became_active":"2023-12-16T20:21:35.413308+0000","last_became_peered":"2023-12-16T20:21:35.413308+0000","last_unstale":"2023-12-16T20:48:48.478829+0000","last_undegraded":"2023-12-16T20:48:48.478829+0000","last_fullsized":"2023-12-16T20:48:48.478829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:55:39.544748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'151","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:37.719915+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:48:37.719915+0000","last_peered":"2023-12-16T20:48:37.719915+0000","last_clean":"2023-12-16T20:48:37.719915+0000","last_became_active":"2023-12-16T20:21:41.212608+0000","last_became_peered":"2023-12-16T20:21:41.212608+0000","last_unstale":"2023-12-16T20:48:37.719915+0000","last_undegraded":"2023-12-16T20:48:37.719915+0000","last_fullsized":"2023-12-16T20:48:37.719915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":6553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'41","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820554+0000","last_change":"2023-12-16T20:21:36.555870+0000","last_active":"2023-12-16T20:49:08.820554+0000","last_peered":"2023-12-16T20:49:08.820554+0000","last_clean":"2023-12-16T20:49:08.820554+0000","last_became_active":"2023-12-16T20:21:36.555631+0000","last_became_peered":"2023-12-16T20:21:36.555631+0000","last_unstale":"2023-12-16T20:49:08.820554+0000","last_undegraded":"2023-12-16T20:49:08.820554+0000","last_fullsized":"2023-12-16T20:49:08.820554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:10.421516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:44.395512+0000","last_change":"2023-12-16T20:21:35.416140+0000","last_active":"2023-12-16T20:48:44.395512+0000","last_peered":"2023-12-16T20:48:44.395512+0000","last_clean":"2023-12-16T20:48:44.395512+0000","last_became_active":"2023-12-16T20:21:35.415810+0000","last_became_peered":"2023-12-16T20:21:35.415810+0000","last_unstale":"2023-12-16T20:48:44.395512+0000","last_undegraded":"2023-12-16T20:48:44.395512+0000","last_fullsized":"2023-12-16T20:48:44.395512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'169","reported_seq":205,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:40.297366+0000","last_change":"2023-12-16T20:22:14.842693+0000","last_active":"2023-12-16T20:48:40.297366+0000","last_peered":"2023-12-16T20:48:40.297366+0000","last_clean":"2023-12-16T20:48:40.297366+0000","last_became_active":"2023-12-16T20:22:14.842282+0000","last_became_peered":"2023-12-16T20:22:14.842282+0000","last_unstale":"2023-12-16T20:48:40.297366+0000","last_undegraded":"2023-12-16T20:48:40.297366+0000","last_fullsized":"2023-12-16T20:48:40.297366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:28:08.269032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":8236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'35","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.900402+0000","last_change":"2023-12-16T20:21:36.536346+0000","last_active":"2023-12-16T20:49:08.900402+0000","last_peered":"2023-12-16T20:49:08.900402+0000","last_clean":"2023-12-16T20:49:08.900402+0000","last_became_active":"2023-12-16T20:21:36.536093+0000","last_became_peered":"2023-12-16T20:21:36.536093+0000","last_unstale":"2023-12-16T20:49:08.900402+0000","last_undegraded":"2023-12-16T20:49:08.900402+0000","last_fullsized":"2023-12-16T20:49:08.900402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:12.261391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'7","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:02.737207+0000","last_change":"2023-12-16T20:21:35.420314+0000","last_active":"2023-12-16T20:49:02.737207+0000","last_peered":"2023-12-16T20:49:02.737207+0000","last_clean":"2023-12-16T20:49:02.737207+0000","last_became_active":"2023-12-16T20:21:35.420074+0000","last_became_peered":"2023-12-16T20:21:35.420074+0000","last_unstale":"2023-12-16T20:49:02.737207+0000","last_undegraded":"2023-12-16T20:49:02.737207+0000","last_fullsized":"2023-12-16T20:49:02.737207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:29.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'129","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.470922+0000","last_change":"2023-12-16T20:21:41.215282+0000","last_active":"2023-12-16T20:48:41.470922+0000","last_peered":"2023-12-16T20:48:41.470922+0000","last_clean":"2023-12-16T20:48:41.470922+0000","last_became_active":"2023-12-16T20:21:41.214939+0000","last_became_peered":"2023-12-16T20:21:41.214939+0000","last_unstale":"2023-12-16T20:48:41.470922+0000","last_undegraded":"2023-12-16T20:48:41.470922+0000","last_fullsized":"2023-12-16T20:48:41.470922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:06:12.245089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":12347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'21","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.902928+0000","last_change":"2023-12-16T20:21:36.534345+0000","last_active":"2023-12-16T20:49:08.902928+0000","last_peered":"2023-12-16T20:49:08.902928+0000","last_clean":"2023-12-16T20:49:08.902928+0000","last_became_active":"2023-12-16T20:21:36.534064+0000","last_became_peered":"2023-12-16T20:21:36.534064+0000","last_unstale":"2023-12-16T20:49:08.902928+0000","last_undegraded":"2023-12-16T20:49:08.902928+0000","last_fullsized":"2023-12-16T20:49:08.902928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:05.641757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:51.557836+0000","last_change":"2023-12-16T20:21:35.390941+0000","last_active":"2023-12-16T20:48:51.557836+0000","last_peered":"2023-12-16T20:48:51.557836+0000","last_clean":"2023-12-16T20:48:51.557836+0000","last_became_active":"2023-12-16T20:21:35.390740+0000","last_became_peered":"2023-12-16T20:21:35.390740+0000","last_unstale":"2023-12-16T20:48:51.557836+0000","last_undegraded":"2023-12-16T20:48:51.557836+0000","last_fullsized":"2023-12-16T20:48:51.557836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:00:44.009248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'180","reported_seq":207,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.239005+0000","last_change":"2023-12-16T20:21:40.754355+0000","last_active":"2023-12-16T20:48:39.239005+0000","last_peered":"2023-12-16T20:48:39.239005+0000","last_clean":"2023-12-16T20:48:39.239005+0000","last_became_active":"2023-12-16T20:21:40.753981+0000","last_became_peered":"2023-12-16T20:21:40.753981+0000","last_unstale":"2023-12-16T20:48:39.239005+0000","last_undegraded":"2023-12-16T20:48:39.239005+0000","last_fullsized":"2023-12-16T20:48:39.239005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:09.125671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":13396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'37","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.901207+0000","last_change":"2023-12-16T20:21:36.537080+0000","last_active":"2023-12-16T20:49:08.901207+0000","last_peered":"2023-12-16T20:49:08.901207+0000","last_clean":"2023-12-16T20:49:08.901207+0000","last_became_active":"2023-12-16T20:21:36.536822+0000","last_became_peered":"2023-12-16T20:21:36.536822+0000","last_unstale":"2023-12-16T20:49:08.901207+0000","last_undegraded":"2023-12-16T20:49:08.901207+0000","last_fullsized":"2023-12-16T20:49:08.901207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'9","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:47:16.371756+0000","last_change":"2023-12-16T20:21:35.417113+0000","last_active":"2023-12-16T20:47:16.371756+0000","last_peered":"2023-12-16T20:47:16.371756+0000","last_clean":"2023-12-16T20:47:16.371756+0000","last_became_active":"2023-12-16T20:21:35.416850+0000","last_became_peered":"2023-12-16T20:21:35.416850+0000","last_unstale":"2023-12-16T20:47:16.371756+0000","last_undegraded":"2023-12-16T20:47:16.371756+0000","last_fullsized":"2023-12-16T20:47:16.371756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:00:44.009248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'159","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:40.300399+0000","last_change":"2023-12-16T20:21:40.755436+0000","last_active":"2023-12-16T20:48:40.300399+0000","last_peered":"2023-12-16T20:48:40.300399+0000","last_clean":"2023-12-16T20:48:40.300399+0000","last_became_active":"2023-12-16T20:21:40.755041+0000","last_became_peered":"2023-12-16T20:21:40.755041+0000","last_unstale":"2023-12-16T20:48:40.300399+0000","last_undegraded":"2023-12-16T20:48:40.300399+0000","last_fullsized":"2023-12-16T20:48:40.300399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:07.939178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":9935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'32","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.886153+0000","last_change":"2023-12-16T20:21:36.541160+0000","last_active":"2023-12-16T20:49:08.886153+0000","last_peered":"2023-12-16T20:49:08.886153+0000","last_clean":"2023-12-16T20:49:08.886153+0000","last_became_active":"2023-12-16T20:21:36.540861+0000","last_became_peered":"2023-12-16T20:21:36.540861+0000","last_unstale":"2023-12-16T20:49:08.886153+0000","last_undegraded":"2023-12-16T20:49:08.886153+0000","last_fullsized":"2023-12-16T20:49:08.886153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.439148+0000","last_change":"2023-12-16T20:21:35.425071+0000","last_active":"2023-12-16T20:48:46.439148+0000","last_peered":"2023-12-16T20:48:46.439148+0000","last_clean":"2023-12-16T20:48:46.439148+0000","last_became_active":"2023-12-16T20:21:35.424822+0000","last_became_peered":"2023-12-16T20:21:35.424822+0000","last_unstale":"2023-12-16T20:48:46.439148+0000","last_undegraded":"2023-12-16T20:48:46.439148+0000","last_fullsized":"2023-12-16T20:48:46.439148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'130","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:38.768956+0000","last_change":"2023-12-16T20:21:41.215346+0000","last_active":"2023-12-16T20:48:38.768956+0000","last_peered":"2023-12-16T20:48:38.768956+0000","last_clean":"2023-12-16T20:48:38.768956+0000","last_became_active":"2023-12-16T20:21:41.215002+0000","last_became_peered":"2023-12-16T20:21:41.215002+0000","last_unstale":"2023-12-16T20:48:38.768956+0000","last_undegraded":"2023-12-16T20:48:38.768956+0000","last_fullsized":"2023-12-16T20:48:38.768956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:10:42.982067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":7078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'49","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.904907+0000","last_change":"2023-12-16T20:21:36.535791+0000","last_active":"2023-12-16T20:49:08.904907+0000","last_peered":"2023-12-16T20:49:08.904907+0000","last_clean":"2023-12-16T20:49:08.904907+0000","last_became_active":"2023-12-16T20:21:36.535447+0000","last_became_peered":"2023-12-16T20:21:36.535447+0000","last_unstale":"2023-12-16T20:49:08.904907+0000","last_undegraded":"2023-12-16T20:49:08.904907+0000","last_fullsized":"2023-12-16T20:49:08.904907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:28.307634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:55.659095+0000","last_change":"2023-12-16T20:21:35.423533+0000","last_active":"2023-12-16T20:48:55.659095+0000","last_peered":"2023-12-16T20:48:55.659095+0000","last_clean":"2023-12-16T20:48:55.659095+0000","last_became_active":"2023-12-16T20:21:35.423275+0000","last_became_peered":"2023-12-16T20:21:35.423275+0000","last_unstale":"2023-12-16T20:48:55.659095+0000","last_undegraded":"2023-12-16T20:48:55.659095+0000","last_fullsized":"2023-12-16T20:48:55.659095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:27.767422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'115","reported_seq":141,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.361695+0000","last_change":"2023-12-16T20:21:41.213083+0000","last_active":"2023-12-16T20:48:39.361695+0000","last_peered":"2023-12-16T20:48:39.361695+0000","last_clean":"2023-12-16T20:48:39.361695+0000","last_became_active":"2023-12-16T20:21:41.212699+0000","last_became_peered":"2023-12-16T20:21:41.212699+0000","last_unstale":"2023-12-16T20:48:39.361695+0000","last_undegraded":"2023-12-16T20:48:39.361695+0000","last_fullsized":"2023-12-16T20:48:39.361695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:14:45.966119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'45","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.971754+0000","last_change":"2023-12-16T20:21:36.523928+0000","last_active":"2023-12-16T20:49:08.971754+0000","last_peered":"2023-12-16T20:49:08.971754+0000","last_clean":"2023-12-16T20:49:08.971754+0000","last_became_active":"2023-12-16T20:21:36.523649+0000","last_became_peered":"2023-12-16T20:21:36.523649+0000","last_unstale":"2023-12-16T20:49:08.971754+0000","last_undegraded":"2023-12-16T20:49:08.971754+0000","last_fullsized":"2023-12-16T20:49:08.971754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:33.657782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'261","reported_seq":290,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.617486+0000","last_change":"2023-12-16T20:21:35.388611+0000","last_active":"2023-12-16T20:49:08.617486+0000","last_peered":"2023-12-16T20:49:08.617486+0000","last_clean":"2023-12-16T20:49:08.617486+0000","last_became_active":"2023-12-16T20:21:35.388392+0000","last_became_peered":"2023-12-16T20:21:35.388392+0000","last_unstale":"2023-12-16T20:49:08.617486+0000","last_undegraded":"2023-12-16T20:49:08.617486+0000","last_fullsized":"2023-12-16T20:49:08.617486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2496854,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":2582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'142","reported_seq":168,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.356577+0000","last_change":"2023-12-16T20:21:41.213106+0000","last_active":"2023-12-16T20:48:39.356577+0000","last_peered":"2023-12-16T20:48:39.356577+0000","last_clean":"2023-12-16T20:48:39.356577+0000","last_became_active":"2023-12-16T20:21:41.212721+0000","last_became_peered":"2023-12-16T20:21:41.212721+0000","last_unstale":"2023-12-16T20:48:39.356577+0000","last_undegraded":"2023-12-16T20:48:39.356577+0000","last_fullsized":"2023-12-16T20:48:39.356577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:47:15.750172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":13674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'36","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.902501+0000","last_change":"2023-12-16T20:21:36.519774+0000","last_active":"2023-12-16T20:49:08.902501+0000","last_peered":"2023-12-16T20:49:08.902501+0000","last_clean":"2023-12-16T20:49:08.902501+0000","last_became_active":"2023-12-16T20:21:36.519561+0000","last_became_peered":"2023-12-16T20:21:36.519561+0000","last_unstale":"2023-12-16T20:49:08.902501+0000","last_undegraded":"2023-12-16T20:49:08.902501+0000","last_fullsized":"2023-12-16T20:49:08.902501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:10.421516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'850","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:55.656917+0000","last_change":"2023-12-16T20:21:35.426168+0000","last_active":"2023-12-16T20:48:55.656917+0000","last_peered":"2023-12-16T20:48:55.656917+0000","last_clean":"2023-12-16T20:48:55.656917+0000","last_became_active":"2023-12-16T20:21:35.425929+0000","last_became_peered":"2023-12-16T20:21:35.425929+0000","last_unstale":"2023-12-16T20:48:55.656917+0000","last_undegraded":"2023-12-16T20:48:55.656917+0000","last_fullsized":"2023-12-16T20:48:55.656917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":4548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'165","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.358092+0000","last_change":"2023-12-16T20:21:40.754204+0000","last_active":"2023-12-16T20:48:39.358092+0000","last_peered":"2023-12-16T20:48:39.358092+0000","last_clean":"2023-12-16T20:48:39.358092+0000","last_became_active":"2023-12-16T20:21:40.753624+0000","last_became_peered":"2023-12-16T20:21:40.753624+0000","last_unstale":"2023-12-16T20:48:39.358092+0000","last_undegraded":"2023-12-16T20:48:39.358092+0000","last_fullsized":"2023-12-16T20:48:39.358092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:11.201128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":9759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'33","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.815896+0000","last_change":"2023-12-16T20:21:36.534827+0000","last_active":"2023-12-16T20:49:08.815896+0000","last_peered":"2023-12-16T20:49:08.815896+0000","last_clean":"2023-12-16T20:49:08.815896+0000","last_became_active":"2023-12-16T20:21:36.533790+0000","last_became_peered":"2023-12-16T20:21:36.533790+0000","last_unstale":"2023-12-16T20:49:08.815896+0000","last_undegraded":"2023-12-16T20:49:08.815896+0000","last_fullsized":"2023-12-16T20:49:08.815896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:19.545737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'706","reported_seq":735,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:01.717981+0000","last_change":"2023-12-16T20:21:35.416050+0000","last_active":"2023-12-16T20:49:01.717981+0000","last_peered":"2023-12-16T20:49:01.717981+0000","last_clean":"2023-12-16T20:49:01.717981+0000","last_became_active":"2023-12-16T20:21:35.415790+0000","last_became_peered":"2023-12-16T20:21:35.415790+0000","last_unstale":"2023-12-16T20:49:01.717981+0000","last_undegraded":"2023-12-16T20:49:01.717981+0000","last_fullsized":"2023-12-16T20:49:01.717981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":703,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'154","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.369610+0000","last_change":"2023-12-16T20:21:40.795197+0000","last_active":"2023-12-16T20:48:39.369610+0000","last_peered":"2023-12-16T20:48:39.369610+0000","last_clean":"2023-12-16T20:48:39.369610+0000","last_became_active":"2023-12-16T20:21:40.793667+0000","last_became_peered":"2023-12-16T20:21:40.793667+0000","last_unstale":"2023-12-16T20:48:39.369610+0000","last_undegraded":"2023-12-16T20:48:39.369610+0000","last_fullsized":"2023-12-16T20:48:39.369610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:32.304405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":20505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'40","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.969267+0000","last_change":"2023-12-16T20:21:36.552680+0000","last_active":"2023-12-16T20:49:08.969267+0000","last_peered":"2023-12-16T20:49:08.969267+0000","last_clean":"2023-12-16T20:49:08.969267+0000","last_became_active":"2023-12-16T20:21:36.552482+0000","last_became_peered":"2023-12-16T20:21:36.552482+0000","last_unstale":"2023-12-16T20:49:08.969267+0000","last_undegraded":"2023-12-16T20:49:08.969267+0000","last_fullsized":"2023-12-16T20:49:08.969267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:00.762391+0000","last_change":"2023-12-16T20:21:35.428379+0000","last_active":"2023-12-16T20:49:00.762391+0000","last_peered":"2023-12-16T20:49:00.762391+0000","last_clean":"2023-12-16T20:49:00.762391+0000","last_became_active":"2023-12-16T20:21:35.428100+0000","last_became_peered":"2023-12-16T20:21:35.428100+0000","last_unstale":"2023-12-16T20:49:00.762391+0000","last_undegraded":"2023-12-16T20:49:00.762391+0000","last_fullsized":"2023-12-16T20:49:00.762391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:44.330608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'126","reported_seq":152,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:40.295260+0000","last_change":"2023-12-16T20:21:40.753333+0000","last_active":"2023-12-16T20:48:40.295260+0000","last_peered":"2023-12-16T20:48:40.295260+0000","last_clean":"2023-12-16T20:48:40.295260+0000","last_became_active":"2023-12-16T20:21:40.752957+0000","last_became_peered":"2023-12-16T20:21:40.752957+0000","last_unstale":"2023-12-16T20:48:40.295260+0000","last_undegraded":"2023-12-16T20:48:40.295260+0000","last_fullsized":"2023-12-16T20:48:40.295260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:47:15.750172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":10032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'43","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.895340+0000","last_change":"2023-12-16T20:22:14.841007+0000","last_active":"2023-12-16T20:49:08.895340+0000","last_peered":"2023-12-16T20:49:08.895340+0000","last_clean":"2023-12-16T20:49:08.895340+0000","last_became_active":"2023-12-16T20:22:14.840679+0000","last_became_peered":"2023-12-16T20:22:14.840679+0000","last_unstale":"2023-12-16T20:49:08.895340+0000","last_undegraded":"2023-12-16T20:49:08.895340+0000","last_fullsized":"2023-12-16T20:49:08.895340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:48.476563+0000","last_change":"2023-12-16T20:21:35.430197+0000","last_active":"2023-12-16T20:48:48.476563+0000","last_peered":"2023-12-16T20:48:48.476563+0000","last_clean":"2023-12-16T20:48:48.476563+0000","last_became_active":"2023-12-16T20:21:35.429940+0000","last_became_peered":"2023-12-16T20:21:35.429940+0000","last_unstale":"2023-12-16T20:48:48.476563+0000","last_undegraded":"2023-12-16T20:48:48.476563+0000","last_fullsized":"2023-12-16T20:48:48.476563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'174","reported_seq":200,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.355965+0000","last_change":"2023-12-16T20:21:41.216238+0000","last_active":"2023-12-16T20:48:39.355965+0000","last_peered":"2023-12-16T20:48:39.355965+0000","last_clean":"2023-12-16T20:48:39.355965+0000","last_became_active":"2023-12-16T20:21:41.215893+0000","last_became_peered":"2023-12-16T20:21:41.215893+0000","last_unstale":"2023-12-16T20:48:39.355965+0000","last_undegraded":"2023-12-16T20:48:39.355965+0000","last_fullsized":"2023-12-16T20:48:39.355965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:06:12.245089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":9716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'144","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.358383+0000","last_change":"2023-12-16T20:21:41.215277+0000","last_active":"2023-12-16T20:48:39.358383+0000","last_peered":"2023-12-16T20:48:39.358383+0000","last_clean":"2023-12-16T20:48:39.358383+0000","last_became_active":"2023-12-16T20:21:41.214950+0000","last_became_peered":"2023-12-16T20:21:41.214950+0000","last_unstale":"2023-12-16T20:48:39.358383+0000","last_undegraded":"2023-12-16T20:48:39.358383+0000","last_fullsized":"2023-12-16T20:48:39.358383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:10.036962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":7732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'44","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.798823+0000","last_change":"2023-12-16T20:21:36.519789+0000","last_active":"2023-12-16T20:49:08.798823+0000","last_peered":"2023-12-16T20:49:08.798823+0000","last_clean":"2023-12-16T20:49:08.798823+0000","last_became_active":"2023-12-16T20:21:36.519476+0000","last_became_peered":"2023-12-16T20:21:36.519476+0000","last_unstale":"2023-12-16T20:49:08.798823+0000","last_undegraded":"2023-12-16T20:49:08.798823+0000","last_fullsized":"2023-12-16T20:49:08.798823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:51.515982+0000","last_change":"2023-12-16T20:21:35.415150+0000","last_active":"2023-12-16T20:48:51.515982+0000","last_peered":"2023-12-16T20:48:51.515982+0000","last_clean":"2023-12-16T20:48:51.515982+0000","last_became_active":"2023-12-16T20:21:35.414846+0000","last_became_peered":"2023-12-16T20:21:35.414846+0000","last_unstale":"2023-12-16T20:48:51.515982+0000","last_undegraded":"2023-12-16T20:48:51.515982+0000","last_fullsized":"2023-12-16T20:48:51.515982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:37.215505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'142","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.474966+0000","last_change":"2023-12-16T20:21:40.794438+0000","last_active":"2023-12-16T20:48:41.474966+0000","last_peered":"2023-12-16T20:48:41.474966+0000","last_clean":"2023-12-16T20:48:41.474966+0000","last_became_active":"2023-12-16T20:21:40.794073+0000","last_became_peered":"2023-12-16T20:21:40.794073+0000","last_unstale":"2023-12-16T20:48:41.474966+0000","last_undegraded":"2023-12-16T20:48:41.474966+0000","last_fullsized":"2023-12-16T20:48:41.474966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:32.702839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":21602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'45","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796450+0000","last_change":"2023-12-16T20:22:14.772045+0000","last_active":"2023-12-16T20:49:08.796450+0000","last_peered":"2023-12-16T20:49:08.796450+0000","last_clean":"2023-12-16T20:49:08.796450+0000","last_became_active":"2023-12-16T20:22:14.771747+0000","last_became_peered":"2023-12-16T20:22:14.771747+0000","last_unstale":"2023-12-16T20:49:08.796450+0000","last_undegraded":"2023-12-16T20:49:08.796450+0000","last_fullsized":"2023-12-16T20:49:08.796450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:00:27.390576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:45.442731+0000","last_change":"2023-12-16T20:21:35.422176+0000","last_active":"2023-12-16T20:48:45.442731+0000","last_peered":"2023-12-16T20:48:45.442731+0000","last_clean":"2023-12-16T20:48:45.442731+0000","last_became_active":"2023-12-16T20:21:35.421982+0000","last_became_peered":"2023-12-16T20:21:35.421982+0000","last_unstale":"2023-12-16T20:48:45.442731+0000","last_undegraded":"2023-12-16T20:48:45.442731+0000","last_fullsized":"2023-12-16T20:48:45.442731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'701","reported_seq":730,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:02.737447+0000","last_change":"2023-12-16T20:21:35.424509+0000","last_active":"2023-12-16T20:49:02.737447+0000","last_peered":"2023-12-16T20:49:02.737447+0000","last_clean":"2023-12-16T20:49:02.737447+0000","last_became_active":"2023-12-16T20:21:35.424254+0000","last_became_peered":"2023-12-16T20:21:35.424254+0000","last_unstale":"2023-12-16T20:49:02.737447+0000","last_undegraded":"2023-12-16T20:49:02.737447+0000","last_fullsized":"2023-12-16T20:49:02.737447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'39","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.972534+0000","last_change":"2023-12-16T20:21:36.533903+0000","last_active":"2023-12-16T20:49:08.972534+0000","last_peered":"2023-12-16T20:49:08.972534+0000","last_clean":"2023-12-16T20:49:08.972534+0000","last_became_active":"2023-12-16T20:21:36.533574+0000","last_became_peered":"2023-12-16T20:21:36.533574+0000","last_unstale":"2023-12-16T20:49:08.972534+0000","last_undegraded":"2023-12-16T20:49:08.972534+0000","last_fullsized":"2023-12-16T20:49:08.972534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'88","reported_seq":114,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:38.755640+0000","last_change":"2023-12-16T20:21:40.794426+0000","last_active":"2023-12-16T20:48:38.755640+0000","last_peered":"2023-12-16T20:48:38.755640+0000","last_clean":"2023-12-16T20:48:38.755640+0000","last_became_active":"2023-12-16T20:21:40.794082+0000","last_became_peered":"2023-12-16T20:21:40.794082+0000","last_unstale":"2023-12-16T20:48:38.755640+0000","last_undegraded":"2023-12-16T20:48:38.755640+0000","last_fullsized":"2023-12-16T20:48:38.755640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:39:04.889495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'686","reported_seq":715,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:00.757206+0000","last_change":"2023-12-16T20:21:35.419910+0000","last_active":"2023-12-16T20:49:00.757206+0000","last_peered":"2023-12-16T20:49:00.757206+0000","last_clean":"2023-12-16T20:49:00.757206+0000","last_became_active":"2023-12-16T20:21:35.419409+0000","last_became_peered":"2023-12-16T20:21:35.419409+0000","last_unstale":"2023-12-16T20:49:00.757206+0000","last_undegraded":"2023-12-16T20:49:00.757206+0000","last_fullsized":"2023-12-16T20:49:00.757206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":4443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'33","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.817786+0000","last_change":"2023-12-16T20:21:36.533684+0000","last_active":"2023-12-16T20:49:08.817786+0000","last_peered":"2023-12-16T20:49:08.817786+0000","last_clean":"2023-12-16T20:49:08.817786+0000","last_became_active":"2023-12-16T20:21:36.533325+0000","last_became_peered":"2023-12-16T20:21:36.533325+0000","last_unstale":"2023-12-16T20:49:08.817786+0000","last_undegraded":"2023-12-16T20:49:08.817786+0000","last_fullsized":"2023-12-16T20:49:08.817786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:30.795818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'165","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.472046+0000","last_change":"2023-12-16T20:21:40.745455+0000","last_active":"2023-12-16T20:48:41.472046+0000","last_peered":"2023-12-16T20:48:41.472046+0000","last_clean":"2023-12-16T20:48:41.472046+0000","last_became_active":"2023-12-16T20:21:40.744731+0000","last_became_peered":"2023-12-16T20:21:40.744731+0000","last_unstale":"2023-12-16T20:48:41.472046+0000","last_undegraded":"2023-12-16T20:48:41.472046+0000","last_fullsized":"2023-12-16T20:48:41.472046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:17:56.583460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":13136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'49","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.894941+0000","last_change":"2023-12-16T20:21:36.542529+0000","last_active":"2023-12-16T20:49:08.894941+0000","last_peered":"2023-12-16T20:49:08.894941+0000","last_clean":"2023-12-16T20:49:08.894941+0000","last_became_active":"2023-12-16T20:21:36.542287+0000","last_became_peered":"2023-12-16T20:21:36.542287+0000","last_unstale":"2023-12-16T20:49:08.894941+0000","last_undegraded":"2023-12-16T20:49:08.894941+0000","last_fullsized":"2023-12-16T20:49:08.894941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'51","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.887499+0000","last_change":"2023-12-16T20:21:36.551193+0000","last_active":"2023-12-16T20:49:08.887499+0000","last_peered":"2023-12-16T20:49:08.887499+0000","last_clean":"2023-12-16T20:49:08.887499+0000","last_became_active":"2023-12-16T20:21:36.550911+0000","last_became_peered":"2023-12-16T20:21:36.550911+0000","last_unstale":"2023-12-16T20:49:08.887499+0000","last_undegraded":"2023-12-16T20:49:08.887499+0000","last_fullsized":"2023-12-16T20:49:08.887499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:19.545737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'50","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820628+0000","last_change":"2023-12-16T20:21:36.556390+0000","last_active":"2023-12-16T20:49:08.820628+0000","last_peered":"2023-12-16T20:49:08.820628+0000","last_clean":"2023-12-16T20:49:08.820628+0000","last_became_active":"2023-12-16T20:21:36.555822+0000","last_became_peered":"2023-12-16T20:21:36.555822+0000","last_unstale":"2023-12-16T20:49:08.820628+0000","last_undegraded":"2023-12-16T20:49:08.820628+0000","last_fullsized":"2023-12-16T20:49:08.820628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:28.307634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'35","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.971561+0000","last_change":"2023-12-16T20:21:36.525171+0000","last_active":"2023-12-16T20:49:08.971561+0000","last_peered":"2023-12-16T20:49:08.971561+0000","last_clean":"2023-12-16T20:49:08.971561+0000","last_became_active":"2023-12-16T20:21:36.524747+0000","last_became_peered":"2023-12-16T20:21:36.524747+0000","last_unstale":"2023-12-16T20:49:08.971561+0000","last_undegraded":"2023-12-16T20:49:08.971561+0000","last_fullsized":"2023-12-16T20:49:08.971561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'29","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.800156+0000","last_change":"2023-12-16T20:21:36.533944+0000","last_active":"2023-12-16T20:49:08.800156+0000","last_peered":"2023-12-16T20:49:08.800156+0000","last_clean":"2023-12-16T20:49:08.800156+0000","last_became_active":"2023-12-16T20:21:36.533682+0000","last_became_peered":"2023-12-16T20:21:36.533682+0000","last_unstale":"2023-12-16T20:49:08.800156+0000","last_undegraded":"2023-12-16T20:49:08.800156+0000","last_fullsized":"2023-12-16T20:49:08.800156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:20.609645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'35","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796562+0000","last_change":"2023-12-16T20:21:36.519818+0000","last_active":"2023-12-16T20:49:08.796562+0000","last_peered":"2023-12-16T20:49:08.796562+0000","last_clean":"2023-12-16T20:49:08.796562+0000","last_became_active":"2023-12-16T20:21:36.519545+0000","last_became_peered":"2023-12-16T20:21:36.519545+0000","last_unstale":"2023-12-16T20:49:08.796562+0000","last_undegraded":"2023-12-16T20:49:08.796562+0000","last_fullsized":"2023-12-16T20:49:08.796562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.899167+0000","last_change":"2023-12-16T20:21:36.542706+0000","last_active":"2023-12-16T20:49:08.899167+0000","last_peered":"2023-12-16T20:49:08.899167+0000","last_clean":"2023-12-16T20:49:08.899167+0000","last_became_active":"2023-12-16T20:21:36.542184+0000","last_became_peered":"2023-12-16T20:21:36.542184+0000","last_unstale":"2023-12-16T20:49:08.899167+0000","last_undegraded":"2023-12-16T20:49:08.899167+0000","last_fullsized":"2023-12-16T20:49:08.899167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'32","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.790544+0000","last_change":"2023-12-16T20:21:36.536726+0000","last_active":"2023-12-16T20:49:08.790544+0000","last_peered":"2023-12-16T20:49:08.790544+0000","last_clean":"2023-12-16T20:49:08.790544+0000","last_became_active":"2023-12-16T20:21:36.536439+0000","last_became_peered":"2023-12-16T20:21:36.536439+0000","last_unstale":"2023-12-16T20:49:08.790544+0000","last_undegraded":"2023-12-16T20:49:08.790544+0000","last_fullsized":"2023-12-16T20:49:08.790544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'33","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820643+0000","last_change":"2023-12-16T20:21:36.555521+0000","last_active":"2023-12-16T20:49:08.820643+0000","last_peered":"2023-12-16T20:49:08.820643+0000","last_clean":"2023-12-16T20:49:08.820643+0000","last_became_active":"2023-12-16T20:21:36.555100+0000","last_became_peered":"2023-12-16T20:21:36.555100+0000","last_unstale":"2023-12-16T20:49:08.820643+0000","last_undegraded":"2023-12-16T20:49:08.820643+0000","last_fullsized":"2023-12-16T20:49:08.820643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796955+0000","last_change":"2023-12-16T20:21:36.535856+0000","last_active":"2023-12-16T20:49:08.796955+0000","last_peered":"2023-12-16T20:49:08.796955+0000","last_clean":"2023-12-16T20:49:08.796955+0000","last_became_active":"2023-12-16T20:21:36.535600+0000","last_became_peered":"2023-12-16T20:21:36.535600+0000","last_unstale":"2023-12-16T20:49:08.796955+0000","last_undegraded":"2023-12-16T20:49:08.796955+0000","last_fullsized":"2023-12-16T20:49:08.796955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'38","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820712+0000","last_change":"2023-12-16T20:21:36.553376+0000","last_active":"2023-12-16T20:49:08.820712+0000","last_peered":"2023-12-16T20:49:08.820712+0000","last_clean":"2023-12-16T20:49:08.820712+0000","last_became_active":"2023-12-16T20:21:36.553155+0000","last_became_peered":"2023-12-16T20:21:36.553155+0000","last_unstale":"2023-12-16T20:49:08.820712+0000","last_undegraded":"2023-12-16T20:49:08.820712+0000","last_fullsized":"2023-12-16T20:49:08.820712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'50","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.972124+0000","last_change":"2023-12-16T20:21:36.524517+0000","last_active":"2023-12-16T20:49:08.972124+0000","last_peered":"2023-12-16T20:49:08.972124+0000","last_clean":"2023-12-16T20:49:08.972124+0000","last_became_active":"2023-12-16T20:21:36.524166+0000","last_became_peered":"2023-12-16T20:21:36.524166+0000","last_unstale":"2023-12-16T20:49:08.972124+0000","last_undegraded":"2023-12-16T20:49:08.972124+0000","last_fullsized":"2023-12-16T20:49:08.972124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.890304+0000","last_change":"2023-12-16T20:21:36.542513+0000","last_active":"2023-12-16T20:49:08.890304+0000","last_peered":"2023-12-16T20:49:08.890304+0000","last_clean":"2023-12-16T20:49:08.890304+0000","last_became_active":"2023-12-16T20:21:36.542191+0000","last_became_peered":"2023-12-16T20:21:36.542191+0000","last_unstale":"2023-12-16T20:49:08.890304+0000","last_undegraded":"2023-12-16T20:49:08.890304+0000","last_fullsized":"2023-12-16T20:49:08.890304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'35","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.793533+0000","last_change":"2023-12-16T20:22:14.772163+0000","last_active":"2023-12-16T20:49:08.793533+0000","last_peered":"2023-12-16T20:49:08.793533+0000","last_clean":"2023-12-16T20:49:08.793533+0000","last_became_active":"2023-12-16T20:22:14.771830+0000","last_became_peered":"2023-12-16T20:22:14.771830+0000","last_unstale":"2023-12-16T20:49:08.793533+0000","last_undegraded":"2023-12-16T20:49:08.793533+0000","last_fullsized":"2023-12-16T20:49:08.793533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:28:03.873827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"27'47","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.896077+0000","last_change":"2023-12-16T20:21:36.544461+0000","last_active":"2023-12-16T20:49:08.896077+0000","last_peered":"2023-12-16T20:49:08.896077+0000","last_clean":"2023-12-16T20:49:08.896077+0000","last_became_active":"2023-12-16T20:21:36.544225+0000","last_became_peered":"2023-12-16T20:21:36.544225+0000","last_unstale":"2023-12-16T20:49:08.896077+0000","last_undegraded":"2023-12-16T20:49:08.896077+0000","last_fullsized":"2023-12-16T20:49:08.896077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:45:02.439240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'40","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820348+0000","last_change":"2023-12-16T20:21:36.554370+0000","last_active":"2023-12-16T20:49:08.820348+0000","last_peered":"2023-12-16T20:49:08.820348+0000","last_clean":"2023-12-16T20:49:08.820348+0000","last_became_active":"2023-12-16T20:21:36.554130+0000","last_became_peered":"2023-12-16T20:21:36.554130+0000","last_unstale":"2023-12-16T20:49:08.820348+0000","last_undegraded":"2023-12-16T20:49:08.820348+0000","last_fullsized":"2023-12-16T20:49:08.820348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:05.641757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'45","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.823702+0000","last_change":"2023-12-16T20:21:36.555346+0000","last_active":"2023-12-16T20:49:08.823702+0000","last_peered":"2023-12-16T20:49:08.823702+0000","last_clean":"2023-12-16T20:49:08.823702+0000","last_became_active":"2023-12-16T20:21:36.554772+0000","last_became_peered":"2023-12-16T20:21:36.554772+0000","last_unstale":"2023-12-16T20:49:08.823702+0000","last_undegraded":"2023-12-16T20:49:08.823702+0000","last_fullsized":"2023-12-16T20:49:08.823702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'44","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796645+0000","last_change":"2023-12-16T20:21:36.534502+0000","last_active":"2023-12-16T20:49:08.796645+0000","last_peered":"2023-12-16T20:49:08.796645+0000","last_clean":"2023-12-16T20:49:08.796645+0000","last_became_active":"2023-12-16T20:21:36.534307+0000","last_became_peered":"2023-12-16T20:21:36.534307+0000","last_unstale":"2023-12-16T20:49:08.796645+0000","last_undegraded":"2023-12-16T20:49:08.796645+0000","last_fullsized":"2023-12-16T20:49:08.796645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'40","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.971856+0000","last_change":"2023-12-16T20:21:36.525661+0000","last_active":"2023-12-16T20:49:08.971856+0000","last_peered":"2023-12-16T20:49:08.971856+0000","last_clean":"2023-12-16T20:49:08.971856+0000","last_became_active":"2023-12-16T20:21:36.525427+0000","last_became_peered":"2023-12-16T20:21:36.525427+0000","last_unstale":"2023-12-16T20:49:08.971856+0000","last_undegraded":"2023-12-16T20:49:08.971856+0000","last_fullsized":"2023-12-16T20:49:08.971856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:39:00.494290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'36","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.800124+0000","last_change":"2023-12-16T20:21:36.542756+0000","last_active":"2023-12-16T20:49:08.800124+0000","last_peered":"2023-12-16T20:49:08.800124+0000","last_clean":"2023-12-16T20:49:08.800124+0000","last_became_active":"2023-12-16T20:21:36.542513+0000","last_became_peered":"2023-12-16T20:21:36.542513+0000","last_unstale":"2023-12-16T20:49:08.800124+0000","last_undegraded":"2023-12-16T20:49:08.800124+0000","last_fullsized":"2023-12-16T20:49:08.800124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'30","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.814024+0000","last_change":"2023-12-16T20:21:36.544754+0000","last_active":"2023-12-16T20:49:08.814024+0000","last_peered":"2023-12-16T20:49:08.814024+0000","last_clean":"2023-12-16T20:49:08.814024+0000","last_became_active":"2023-12-16T20:21:36.544492+0000","last_became_peered":"2023-12-16T20:21:36.544492+0000","last_unstale":"2023-12-16T20:49:08.814024+0000","last_undegraded":"2023-12-16T20:49:08.814024+0000","last_fullsized":"2023-12-16T20:49:08.814024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:19.509623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'38","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.889041+0000","last_change":"2023-12-16T20:22:14.769644+0000","last_active":"2023-12-16T20:49:08.889041+0000","last_peered":"2023-12-16T20:49:08.889041+0000","last_clean":"2023-12-16T20:49:08.889041+0000","last_became_active":"2023-12-16T20:22:14.769348+0000","last_became_peered":"2023-12-16T20:22:14.769348+0000","last_unstale":"2023-12-16T20:49:08.889041+0000","last_undegraded":"2023-12-16T20:49:08.889041+0000","last_fullsized":"2023-12-16T20:49:08.889041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:17:52.188255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'50","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.894678+0000","last_change":"2023-12-16T20:21:36.551107+0000","last_active":"2023-12-16T20:49:08.894678+0000","last_peered":"2023-12-16T20:49:08.894678+0000","last_clean":"2023-12-16T20:49:08.894678+0000","last_became_active":"2023-12-16T20:21:36.550815+0000","last_became_peered":"2023-12-16T20:21:36.550815+0000","last_unstale":"2023-12-16T20:49:08.894678+0000","last_undegraded":"2023-12-16T20:49:08.894678+0000","last_fullsized":"2023-12-16T20:49:08.894678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'42","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.903770+0000","last_change":"2023-12-16T20:21:36.554041+0000","last_active":"2023-12-16T20:49:08.903770+0000","last_peered":"2023-12-16T20:49:08.903770+0000","last_clean":"2023-12-16T20:49:08.903770+0000","last_became_active":"2023-12-16T20:21:36.553708+0000","last_became_peered":"2023-12-16T20:21:36.553708+0000","last_unstale":"2023-12-16T20:49:08.903770+0000","last_undegraded":"2023-12-16T20:49:08.903770+0000","last_fullsized":"2023-12-16T20:49:08.903770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:36.868562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'29","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.799545+0000","last_change":"2023-12-16T20:21:36.551348+0000","last_active":"2023-12-16T20:49:08.799545+0000","last_peered":"2023-12-16T20:49:08.799545+0000","last_clean":"2023-12-16T20:49:08.799545+0000","last_became_active":"2023-12-16T20:21:36.551066+0000","last_became_peered":"2023-12-16T20:21:36.551066+0000","last_unstale":"2023-12-16T20:49:08.799545+0000","last_undegraded":"2023-12-16T20:49:08.799545+0000","last_fullsized":"2023-12-16T20:49:08.799545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'37","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.900820+0000","last_change":"2023-12-16T20:21:36.523828+0000","last_active":"2023-12-16T20:49:08.900820+0000","last_peered":"2023-12-16T20:49:08.900820+0000","last_clean":"2023-12-16T20:49:08.900820+0000","last_became_active":"2023-12-16T20:21:36.523604+0000","last_became_peered":"2023-12-16T20:21:36.523604+0000","last_unstale":"2023-12-16T20:49:08.900820+0000","last_undegraded":"2023-12-16T20:49:08.900820+0000","last_fullsized":"2023-12-16T20:49:08.900820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'39","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.823448+0000","last_change":"2023-12-16T20:21:36.556286+0000","last_active":"2023-12-16T20:49:08.823448+0000","last_peered":"2023-12-16T20:49:08.823448+0000","last_clean":"2023-12-16T20:49:08.823448+0000","last_became_active":"2023-12-16T20:21:36.556041+0000","last_became_peered":"2023-12-16T20:21:36.556041+0000","last_unstale":"2023-12-16T20:49:08.823448+0000","last_undegraded":"2023-12-16T20:49:08.823448+0000","last_fullsized":"2023-12-16T20:49:08.823448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'39","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.894521+0000","last_change":"2023-12-16T20:21:36.518408+0000","last_active":"2023-12-16T20:49:08.894521+0000","last_peered":"2023-12-16T20:49:08.894521+0000","last_clean":"2023-12-16T20:49:08.894521+0000","last_became_active":"2023-12-16T20:21:36.518138+0000","last_became_peered":"2023-12-16T20:21:36.518138+0000","last_unstale":"2023-12-16T20:49:08.894521+0000","last_undegraded":"2023-12-16T20:49:08.894521+0000","last_fullsized":"2023-12-16T20:49:08.894521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'24","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.823139+0000","last_change":"2023-12-16T20:21:36.555311+0000","last_active":"2023-12-16T20:49:08.823139+0000","last_peered":"2023-12-16T20:49:08.823139+0000","last_clean":"2023-12-16T20:49:08.823139+0000","last_became_active":"2023-12-16T20:21:36.555041+0000","last_became_peered":"2023-12-16T20:21:36.555041+0000","last_unstale":"2023-12-16T20:49:08.823139+0000","last_undegraded":"2023-12-16T20:49:08.823139+0000","last_fullsized":"2023-12-16T20:49:08.823139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:20.609645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'44","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.971833+0000","last_change":"2023-12-16T20:21:36.524036+0000","last_active":"2023-12-16T20:49:08.971833+0000","last_peered":"2023-12-16T20:49:08.971833+0000","last_clean":"2023-12-16T20:49:08.971833+0000","last_became_active":"2023-12-16T20:21:36.523784+0000","last_became_peered":"2023-12-16T20:21:36.523784+0000","last_unstale":"2023-12-16T20:49:08.971833+0000","last_undegraded":"2023-12-16T20:49:08.971833+0000","last_fullsized":"2023-12-16T20:49:08.971833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:28.885488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'36","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.793242+0000","last_change":"2023-12-16T20:21:36.526391+0000","last_active":"2023-12-16T20:49:08.793242+0000","last_peered":"2023-12-16T20:49:08.793242+0000","last_clean":"2023-12-16T20:49:08.793242+0000","last_became_active":"2023-12-16T20:21:36.526151+0000","last_became_peered":"2023-12-16T20:21:36.526151+0000","last_unstale":"2023-12-16T20:49:08.793242+0000","last_undegraded":"2023-12-16T20:49:08.793242+0000","last_fullsized":"2023-12-16T20:49:08.793242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'28","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.900106+0000","last_change":"2023-12-16T20:21:36.543566+0000","last_active":"2023-12-16T20:49:08.900106+0000","last_peered":"2023-12-16T20:49:08.900106+0000","last_clean":"2023-12-16T20:49:08.900106+0000","last_became_active":"2023-12-16T20:21:36.543306+0000","last_became_peered":"2023-12-16T20:21:36.543306+0000","last_unstale":"2023-12-16T20:49:08.900106+0000","last_undegraded":"2023-12-16T20:49:08.900106+0000","last_fullsized":"2023-12-16T20:49:08.900106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:03.543973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4117,"num_write_kb":324188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4666,"ondisk_log_size":4666,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2442,"ondisk_log_size":2442,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40469915,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1038,"num_read_kb":1098,"num_write":9075,"num_write_kb":44922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56229888,"data_stored":80939830,"data_compressed":7486620,"data_compressed_allocated":11714560,"data_compressed_original":36487168,"omap_allocated":0,"internal_metadata":0},"log_size":8615,"ondisk_log_size":8615,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65176,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575187,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84588,"kb_used_data":17316,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94287252,"statfs":{"total":96636764160,"available":96550146048,"internally_reserved":0,"allocated":17731584,"data_stored":25875293,"data_compressed":2385754,"data_compressed_allocated":3723264,"data_compressed_original":12046336,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40300000000000002,"15min":0.39800000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53300000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.434,"5min":0.41999999999999998,"15min":0.42299999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56000000000000005,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.65100000000000002}]},{"osd":1,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42499999999999999,"15min":0.41999999999999998},"min":{"1min":0.35099999999999998,"5min":0.24399999999999999,"15min":0.23799999999999999},"max":{"1min":0.59099999999999997,"5min":0.67200000000000004,"15min":0.70999999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.28599999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.54800000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.71699999999999997}]},{"osd":2,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40799999999999997,"15min":0.41099999999999998},"min":{"1min":0.26800000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.54600000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.44400000000000001,"15min":0.44500000000000001},"min":{"1min":0.36899999999999999,"5min":0.29399999999999998,"15min":0.29099999999999998},"max":{"1min":0.58199999999999996,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.58199999999999996}]},{"osd":3,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.438,"15min":0.432},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28000000000000003},"max":{"1min":0.57899999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45500000000000002,"15min":0.45800000000000002},"min":{"1min":0.30099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58099999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.77300000000000002}]},{"osd":4,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.27100000000000002,"5min":0.23200000000000001,"15min":0.20499999999999999},"max":{"1min":0.48899999999999999,"5min":0.501,"15min":0.621},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38100000000000001,"15min":0.374},"min":{"1min":0.27800000000000002,"5min":0.219,"15min":0.20899999999999999},"max":{"1min":0.52900000000000003,"5min":0.58199999999999996,"15min":0.624},"last":0.56499999999999995}]},{"osd":5,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38800000000000001,"15min":0.38700000000000001},"min":{"1min":0.27400000000000002,"5min":0.24199999999999999,"15min":0.24099999999999999},"max":{"1min":0.54600000000000004,"5min":0.63900000000000001,"15min":0.72099999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.40500000000000003,"15min":0.40600000000000003},"min":{"1min":0.316,"5min":0.25900000000000001,"15min":0.255},"max":{"1min":0.51400000000000001,"5min":0.57299999999999995,"15min":0.65700000000000003},"last":0.59899999999999998}]},{"osd":6,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41399999999999998},"min":{"1min":0.34599999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51000000000000001,"5min":0.53700000000000003,"15min":0.69499999999999995},"last":0.745},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.436,"15min":0.441},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.52400000000000002,"5min":0.623,"15min":0.65200000000000002},"last":0.75800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575187,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57068,"kb_used_data":12004,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94314772,"statfs":{"total":96636764160,"available":96578326528,"internally_reserved":0,"allocated":12292096,"data_stored":16896407,"data_compressed":1393950,"data_compressed_allocated":2220032,"data_compressed_original":7004160,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38200000000000001,"15min":0.39800000000000002},"min":{"1min":0.251,"5min":0.23200000000000001,"15min":0.217},"max":{"1min":0.505,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.433,"15min":0.432},"min":{"1min":0.26700000000000002,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":0.52600000000000002,"5min":0.60799999999999998,"15min":0.67100000000000004},"last":0.45600000000000002}]},{"osd":1,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.40100000000000002,"15min":0.40799999999999997},"min":{"1min":0.27100000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51400000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42599999999999999,"15min":0.42399999999999999},"min":{"1min":0.29799999999999999,"5min":0.26500000000000001,"15min":0.26400000000000001},"max":{"1min":0.54400000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65500000000000003}]},{"osd":2,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40999999999999998,"15min":0.41699999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.52100000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.253},"max":{"1min":0.51200000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.48299999999999998}]},{"osd":3,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44800000000000001,"15min":0.437},"min":{"1min":0.371,"5min":0.30599999999999999,"15min":0.26500000000000001},"max":{"1min":0.57999999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.433,"15min":0.44400000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.52400000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.56299999999999994}]},{"osd":4,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.379,"15min":0.37},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.217},"max":{"1min":0.48699999999999999,"5min":0.59199999999999997,"15min":0.64000000000000001},"last":0.625},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.38900000000000001,"15min":0.38700000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55800000000000005,"5min":0.64300000000000002,"15min":0.68700000000000006},"last":0.61399999999999999}]},{"osd":5,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.38600000000000001,"15min":0.377},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.22900000000000001},"max":{"1min":0.54600000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42199999999999999,"15min":0.42099999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.57799999999999996,"5min":0.60699999999999998,"15min":0.67200000000000004},"last":0.67800000000000005}]},{"osd":7,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.27800000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.65700000000000003,"15min":0.69899999999999995},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42399999999999999,"15min":0.43099999999999999},"min":{"1min":0.29299999999999998,"5min":0.28299999999999997,"15min":0.27200000000000002},"max":{"1min":0.53600000000000003,"5min":0.60599999999999998,"15min":0.747},"last":0.60099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575186,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":118609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.26100000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":0.58599999999999997,"15min":0.64200000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.39800000000000002,"15min":0.41099999999999998},"min":{"1min":0.255,"5min":0.252,"15min":0.24399999999999999},"max":{"1min":0.59299999999999997,"5min":0.61299999999999999,"15min":0.65200000000000002},"last":0.79700000000000004}]},{"osd":1,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40899999999999997,"15min":0.41599999999999998},"min":{"1min":0.33700000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.64400000000000002},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.41199999999999998,"15min":0.42299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.65900000000000003},"last":0.68700000000000006}]},{"osd":2,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.31900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.53300000000000003,"5min":0.65000000000000002,"15min":0.65200000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.42499999999999999,"15min":0.43099999999999999},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":0.60199999999999998,"5min":0.63,"15min":0.71999999999999997},"last":0.85399999999999998}]},{"osd":3,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42199999999999999,"15min":0.42999999999999999},"min":{"1min":0.309,"5min":0.29999999999999999,"15min":0.29499999999999998},"max":{"1min":0.54000000000000004,"5min":0.57099999999999995,"15min":0.64400000000000002},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.34699999999999998,"5min":0.312,"15min":0.28199999999999997},"max":{"1min":0.61399999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.75900000000000001}]},{"osd":4,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36899999999999999,"15min":0.36099999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.224},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.22600000000000001},"max":{"1min":0.50800000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.56699999999999995}]},{"osd":6,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.26500000000000001,"15min":0.24199999999999999},"max":{"1min":0.62,"5min":0.63300000000000001,"15min":0.68999999999999995},"last":0.626},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.433,"15min":0.41599999999999998},"min":{"1min":0.28699999999999998,"5min":0.28000000000000003,"15min":0.26700000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.72099999999999997},"last":0.66100000000000003}]},{"osd":7,"last update":"Sat Dec 16 20:48:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.51900000000000002,"5min":0.61799999999999999,"15min":0.66300000000000003},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.45900000000000002,"15min":0.44600000000000001},"min":{"1min":0.30099999999999999,"5min":0.26700000000000002,"15min":0.26600000000000001},"max":{"1min":0.56599999999999995,"5min":0.66800000000000004,"15min":0.72099999999999997},"last":0.91000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575187,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65112,"kb_used_data":7568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94306728,"statfs":{"total":96636764160,"available":96570089472,"internally_reserved":0,"allocated":7749632,"data_stored":11004073,"data_compressed":1082070,"data_compressed_allocated":1703936,"data_compressed_original":5144576,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.434,"15min":0.42199999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.441,"15min":0.432},"min":{"1min":0.34699999999999998,"5min":0.26600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57999999999999996,"5min":0.65300000000000002,"15min":0.68899999999999995},"last":0.54500000000000004}]},{"osd":1,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45300000000000001,"15min":0.439},"min":{"1min":0.32700000000000001,"5min":0.29799999999999999,"15min":0.27900000000000003},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42799999999999999,"15min":0.41999999999999998},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.26600000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.68500000000000005}]},{"osd":2,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.436,"15min":0.42799999999999999},"min":{"1min":0.29099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.379,"5min":0.311,"15min":0.309},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.69699999999999995}]},{"osd":3,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44500000000000001,"15min":0.43099999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.27900000000000003},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47299999999999998,"15min":0.46400000000000002},"min":{"1min":0.32500000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.79400000000000004},"last":0.65400000000000003}]},{"osd":5,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.377,"15min":0.38200000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.37,"5min":0.39700000000000002,"15min":0.39000000000000001},"min":{"1min":0.26600000000000001,"5min":0.26300000000000001,"15min":0.22},"max":{"1min":0.50800000000000001,"5min":0.58999999999999997,"15min":0.63100000000000001},"last":0.50800000000000001}]},{"osd":6,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39600000000000002,"15min":0.39500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23799999999999999},"max":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.75},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.443,"15min":0.435},"min":{"1min":0.29799999999999999,"5min":0.26400000000000001,"15min":0.22600000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.63}]},{"osd":7,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.432,"15min":0.42999999999999999},"min":{"1min":0.29999999999999999,"5min":0.28899999999999998,"15min":0.25600000000000001},"max":{"1min":0.60299999999999998,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46200000000000002,"15min":0.45900000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27000000000000002},"max":{"1min":0.59199999999999997,"5min":0.63400000000000001,"15min":0.77600000000000002},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575187,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58848,"kb_used_data":9624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312992,"statfs":{"total":96636764160,"available":96576503808,"internally_reserved":0,"allocated":9854976,"data_stored":12924992,"data_compressed":1002682,"data_compressed_allocated":1646592,"data_compressed_original":4898816,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.28999999999999998,"15min":0.28499999999999998},"min":{"1min":0.222,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":0.38300000000000001,"5min":0.48699999999999999,"15min":0.52600000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.317,"5min":0.30299999999999999,"15min":0.29699999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.46600000000000003,"5min":0.48899999999999999,"15min":0.56999999999999995},"last":0.32200000000000001}]},{"osd":1,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29999999999999999},"min":{"1min":0.22700000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.434,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.317,"5min":0.32500000000000001,"15min":0.32300000000000001},"min":{"1min":0.245,"5min":0.21099999999999999,"15min":0.19900000000000001},"max":{"1min":0.40200000000000002,"5min":0.48299999999999998,"15min":0.56100000000000005},"last":0.37}]},{"osd":2,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.33300000000000002,"15min":0.33400000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.222},"max":{"1min":0.443,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.308},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35299999999999998,"15min":0.35199999999999998},"min":{"1min":0.29899999999999999,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":0.44900000000000001,"5min":0.51100000000000001,"15min":0.53600000000000003},"last":0.42199999999999999}]},{"osd":4,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40500000000000003,"15min":0.41299999999999998},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.27600000000000002},"max":{"1min":0.52900000000000003,"5min":0.53000000000000003,"15min":0.69999999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.443,"15min":0.439},"min":{"1min":0.35199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56699999999999995,"5min":0.70399999999999996,"15min":0.72399999999999998},"last":0.436}]},{"osd":5,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.435,"15min":0.44},"min":{"1min":0.35399999999999998,"5min":0.31900000000000001,"15min":0.313},"max":{"1min":0.55200000000000005,"5min":0.68100000000000005,"15min":0.76900000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.45100000000000001,"15min":0.45400000000000001},"min":{"1min":0.38300000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.52400000000000002,"5min":0.61499999999999999,"15min":0.71599999999999997},"last":0.51300000000000001}]},{"osd":6,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44,"15min":0.44500000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.73599999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45600000000000002,"15min":0.46300000000000002},"min":{"1min":0.372,"5min":0.317,"15min":0.317},"max":{"1min":0.64100000000000001,"5min":0.66700000000000004,"15min":0.75},"last":0.46999999999999997}]},{"osd":7,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48299999999999998,"15min":0.48099999999999998},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.34000000000000002},"max":{"1min":0.57299999999999995,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44700000000000001,"15min":0.45700000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.56599999999999995,"5min":0.63400000000000001,"15min":0.68999999999999995},"last":0.48499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575187,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":341408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.309,"15min":0.30199999999999999},"min":{"1min":0.19500000000000001,"5min":0.18099999999999999,"15min":0.17000000000000001},"max":{"1min":0.51500000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.30099999999999999,"15min":0.30199999999999999},"min":{"1min":0.23100000000000001,"5min":0.189,"15min":0.189},"max":{"1min":0.49199999999999999,"5min":0.55800000000000005,"15min":0.623},"last":0.28199999999999997}]},{"osd":1,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.26200000000000001,"5min":0.23300000000000001,"15min":0.193},"max":{"1min":0.53200000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.318},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.32100000000000001,"15min":0.32700000000000001},"min":{"1min":0.254,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.45600000000000002,"5min":0.54700000000000004,"15min":0.54800000000000004},"last":0.29999999999999999}]},{"osd":3,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.23599999999999999,"5min":0.23100000000000001,"15min":0.214},"max":{"1min":0.47099999999999997,"5min":0.53800000000000003,"15min":0.58599999999999997},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.36399999999999999,"15min":0.36199999999999999},"min":{"1min":0.29099999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.60599999999999998},"last":0.33000000000000002}]},{"osd":4,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.42699999999999999},"min":{"1min":0.35499999999999998,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.58899999999999997,"5min":0.60699999999999998,"15min":0.66500000000000004},"last":0.376},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42999999999999999},"min":{"1min":0.35499999999999998,"5min":0.314,"15min":0.29499999999999998},"max":{"1min":0.50600000000000001,"5min":0.59099999999999997,"15min":0.72899999999999998},"last":0.47699999999999998}]},{"osd":5,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.33400000000000002,"5min":0.311,"15min":0.30299999999999999},"max":{"1min":0.54300000000000004,"5min":0.61799999999999999,"15min":0.755},"last":0.501},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.45300000000000001},"min":{"1min":0.38500000000000001,"5min":0.33600000000000002,"15min":0.33100000000000002},"max":{"1min":0.56699999999999995,"5min":0.65400000000000003,"15min":0.67000000000000004},"last":0.39600000000000002}]},{"osd":6,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.437,"15min":0.44600000000000001},"min":{"1min":0.34399999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.55100000000000005,"5min":0.67500000000000004,"15min":0.68400000000000005},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47899999999999998,"15min":0.47599999999999998},"min":{"1min":0.374,"5min":0.36499999999999999,"15min":0.32500000000000001},"max":{"1min":0.60099999999999998,"5min":0.63600000000000001,"15min":0.77400000000000002},"last":0.36399999999999999}]},{"osd":7,"last update":"Sat Dec 16 20:48:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46999999999999997,"15min":0.47299999999999998},"min":{"1min":0.36399999999999999,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.61899999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.45000000000000001,"15min":0.46200000000000002},"min":{"1min":0.35599999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.65300000000000002},"last":0.45800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575187,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42460,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329380,"statfs":{"total":96636764160,"available":96593285120,"internally_reserved":0,"allocated":3035136,"data_stored":4312983,"data_compressed":488319,"data_compressed_allocated":745472,"data_compressed_original":2203648,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.27400000000000002,"15min":0.27600000000000002},"min":{"1min":0.20000000000000001,"5min":0.184,"15min":0.16800000000000001},"max":{"1min":0.42099999999999999,"5min":0.46100000000000002,"15min":0.61499999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.309,"5min":0.31,"15min":0.316},"min":{"1min":0.22600000000000001,"5min":0.218,"15min":0.21199999999999999},"max":{"1min":0.38300000000000001,"5min":0.55500000000000005,"15min":0.56499999999999995},"last":0.307}]},{"osd":2,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.29299999999999998,"5min":0.28499999999999998,"15min":0.29199999999999998},"min":{"1min":0.22600000000000001,"5min":0.20599999999999999,"15min":0.19},"max":{"1min":0.377,"5min":0.44,"15min":0.51200000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.32400000000000001,"15min":0.32000000000000001},"min":{"1min":0.245,"5min":0.221,"15min":0.20999999999999999},"max":{"1min":0.40200000000000002,"5min":0.56200000000000006,"15min":0.58499999999999996},"last":0.33300000000000002}]},{"osd":3,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.34599999999999997},"min":{"1min":0.28399999999999997,"5min":0.23200000000000001,"15min":0.223},"max":{"1min":0.40400000000000003,"5min":0.499,"15min":0.55800000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34200000000000003},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48099999999999998,"5min":0.52500000000000002,"15min":0.59699999999999998},"last":0.24399999999999999}]},{"osd":4,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40100000000000002,"15min":0.40600000000000003},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.64100000000000001},"last":0.497},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.432,"15min":0.433},"min":{"1min":0.35499999999999998,"5min":0.32100000000000001,"15min":0.307},"max":{"1min":0.55800000000000005,"5min":0.57999999999999996,"15min":0.65400000000000003},"last":0.51300000000000001}]},{"osd":5,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42599999999999999,"15min":0.441},"min":{"1min":0.35599999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.64600000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.42799999999999999,"15min":0.436},"min":{"1min":0.34599999999999997,"5min":0.318,"15min":0.28100000000000003},"max":{"1min":0.57899999999999996,"5min":0.64500000000000002,"15min":0.69299999999999995},"last":0.44700000000000001}]},{"osd":6,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.39300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.58099999999999996,"5min":0.65800000000000003,"15min":0.754},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.36099999999999999,"5min":0.33300000000000002,"15min":0.29999999999999999},"max":{"1min":0.55500000000000005,"5min":0.628,"15min":0.73099999999999998},"last":0.46600000000000003}]},{"osd":7,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.33700000000000002},"max":{"1min":0.60099999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.58299999999999996,"5min":0.64300000000000002,"15min":0.71799999999999997},"last":0.505}]}]},{"osd":0,"up_from":13,"seq":55834575187,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60428,"kb_used_data":7044,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311412,"statfs":{"total":96636764160,"available":96574885888,"internally_reserved":0,"allocated":7213056,"data_stored":11594953,"data_compressed":1199021,"data_compressed_allocated":1765376,"data_compressed_original":6336512,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.27700000000000002,"5min":0.27900000000000003,"15min":0.28299999999999997},"min":{"1min":0.189,"5min":0.17299999999999999,"15min":0.17100000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.56799999999999995},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.316,"15min":0.307},"min":{"1min":0.22700000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.44,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.318}]},{"osd":2,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.308,"15min":0.30499999999999999},"min":{"1min":0.20300000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.45100000000000001,"5min":0.52300000000000002,"15min":0.54900000000000004},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.31,"5min":0.32600000000000001,"15min":0.32200000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.20300000000000001},"max":{"1min":0.42899999999999999,"5min":0.57899999999999996,"15min":0.66400000000000003},"last":0.30299999999999999}]},{"osd":3,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.20399999999999999},"max":{"1min":0.46700000000000003,"5min":0.52400000000000002,"15min":0.54100000000000004},"last":0.376},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34000000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.224},"max":{"1min":0.45000000000000001,"5min":0.59199999999999997,"15min":0.60999999999999999},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.433,"15min":0.434},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.54000000000000004,"5min":0.67900000000000005,"15min":0.69799999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.435},"min":{"1min":0.36299999999999999,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.56000000000000005,"5min":0.60399999999999998,"15min":0.64200000000000002},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46100000000000002,"15min":0.443},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.29999999999999999},"max":{"1min":0.58499999999999996,"5min":0.67900000000000005,"15min":0.69899999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46600000000000003,"15min":0.46300000000000002},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.59399999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.44700000000000001}]},{"osd":6,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.375,"5min":0.32600000000000001,"15min":0.31900000000000001},"max":{"1min":0.628,"5min":0.69199999999999995,"15min":0.71799999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.46000000000000002},"min":{"1min":0.38600000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.60899999999999999,"5min":0.70299999999999996,"15min":0.73499999999999999},"last":0.435}]},{"osd":7,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.40799999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65200000000000002,"5min":0.69999999999999996,"15min":0.73599999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.34000000000000002},"max":{"1min":0.66100000000000003,"5min":0.66800000000000004,"15min":0.69099999999999995},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6856704,"data_stored":10886066,"data_compressed":1166433,"data_compressed_allocated":1720320,"data_compressed_original":5763072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2744320,"data_stored":4194464,"data_compressed":488319,"data_compressed_allocated":745472,"data_compressed_original":2203648,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":222889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9564160,"data_stored":12806473,"data_compressed":1002682,"data_compressed_allocated":1646592,"data_compressed_original":4898816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7458816,"data_stored":10885554,"data_compressed":1082070,"data_compressed_allocated":1703936,"data_compressed_original":5144576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12001280,"data_stored":16777888,"data_compressed":1393950,"data_compressed_allocated":2220032,"data_compressed_original":7004160,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17375232,"data_stored":25166406,"data_compressed":2353166,"data_compressed_allocated":3678208,"data_compressed_original":11472896,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T20:49:16.767 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:49:16.905 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.904+0000 7fd0d0431640 1 Processor -- start 2023-12-16T20:49:16.905 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.904+0000 7fd0d0431640 1 -- start start 2023-12-16T20:49:16.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.905+0000 7fd0d0431640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd0c806f600 0x7fd0c80cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:16.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.905+0000 7fd0d0431640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0c806f0e0 0x7fd0c81533f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:16.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.905+0000 7fd0d0431640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c806b610 con 0x7fd0c806ed00 2023-12-16T20:49:16.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.905+0000 7fd0d0431640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c80703c0 con 0x7fd0c806f600 2023-12-16T20:49:16.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.905+0000 7fd0d0431640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c806b860 con 0x7fd0c806f0e0 2023-12-16T20:49:16.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.906+0000 7fd0cd9cc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd0c806f600 0x7fd0c80cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:16.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.906+0000 7fd0ce1cd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd0c806ed00 0x7fd0c815a010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:35662/0 (socket says 172.21.15.87:35662) 2023-12-16T20:49:16.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.906+0000 7fd0ce1cd640 1 -- 172.21.15.87:0/3949028341 learned_addr learned my addr 172.21.15.87:0/3949028341 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:49:16.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.906+0000 7fd0ce9ce640 1 --2- 172.21.15.87:0/3949028341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0c806f0e0 0x7fd0c81533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:16.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.909+0000 7fd0ce9ce640 1 -- 172.21.15.87:0/3949028341 >> v2:172.21.15.87:3300/0 conn(0x7fd0c806f600 msgr2=0x7fd0c80cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:16.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.909+0000 7fd0ce9ce640 1 --2- 172.21.15.87:0/3949028341 >> v2:172.21.15.87:3300/0 conn(0x7fd0c806f600 0x7fd0c80cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.909+0000 7fd0ce9ce640 1 -- 172.21.15.87:0/3949028341 >> v1:172.21.15.87:6789/0 conn(0x7fd0c806ed00 legacy=0x7fd0c815a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:16.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.909+0000 7fd0ce9ce640 1 -- 172.21.15.87:0/3949028341 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c806bb40 con 0x7fd0c806f0e0 2023-12-16T20:49:16.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.911+0000 7fd0ce9ce640 1 --2- 172.21.15.87:0/3949028341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0c806f0e0 0x7fd0c81533f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009dc0 tx=0x7fd0c002be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e06d354d41db8799 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:16.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.916+0000 7fd0cd1cb640 1 -- 172.21.15.87:0/3949028341 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c002cc40 con 0x7fd0c806f0e0 2023-12-16T20:49:16.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.916+0000 7fd0cd1cb640 1 -- 172.21.15.87:0/3949028341 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c002cda0 con 0x7fd0c806f0e0 2023-12-16T20:49:16.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.916+0000 7fd0cd1cb640 1 -- 172.21.15.87:0/3949028341 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0034660 con 0x7fd0c806f0e0 2023-12-16T20:49:16.918 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.917+0000 7fd0d0431640 1 -- 172.21.15.87:0/3949028341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0c806f0e0 msgr2=0x7fd0c81533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:16.918 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.917+0000 7fd0d0431640 1 --2- 172.21.15.87:0/3949028341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0c806f0e0 0x7fd0c81533f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009dc0 tx=0x7fd0c002be90 comp rx=0 tx=0).stop 2023-12-16T20:49:16.918 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.917+0000 7fd0d0431640 1 -- 172.21.15.87:0/3949028341 shutdown_connections 2023-12-16T20:49:16.918 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.917+0000 7fd0d0431640 1 --2- 172.21.15.87:0/3949028341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0c806f0e0 0x7fd0c81533f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.918 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.917+0000 7fd0d0431640 1 --2- 172.21.15.87:0/3949028341 >> v2:172.21.15.87:3300/0 conn(0x7fd0c806f600 0x7fd0c80cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.918 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.917+0000 7fd0d0431640 1 -- 172.21.15.87:0/3949028341 >> 172.21.15.87:0/3949028341 conn(0x7fd0c8061660 msgr2=0x7fd0c8070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:16.918 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.917+0000 7fd0d0431640 1 -- 172.21.15.87:0/3949028341 shutdown_connections 2023-12-16T20:49:16.918 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.917+0000 7fd0d0431640 1 -- 172.21.15.87:0/3949028341 wait complete. 2023-12-16T20:49:16.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.918+0000 7fd0d0431640 1 Processor -- start 2023-12-16T20:49:16.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.918+0000 7fd0d0431640 1 -- start start 2023-12-16T20:49:16.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.919+0000 7fd0d0431640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0c806ed00 0x7fd0c815a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:16.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.919+0000 7fd0d0431640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0c806f0e0 0x7fd0c8151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:16.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.919+0000 7fd0d0431640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0c806f600 0x7fd0c815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:16.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.919+0000 7fd0d0431640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c815b860 con 0x7fd0c806ed00 2023-12-16T20:49:16.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.919+0000 7fd0d0431640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c815c640 con 0x7fd0c806f0e0 2023-12-16T20:49:16.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.919+0000 7fd0d0431640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c81532b0 con 0x7fd0c806f600 2023-12-16T20:49:16.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.919+0000 7fd0ce1cd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0c806ed00 0x7fd0c815a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:16.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.920+0000 7fd0ce1cd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0c806ed00 0x7fd0c815a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44762/0 (socket says 172.21.15.87:44762) 2023-12-16T20:49:16.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.920+0000 7fd0ce1cd640 1 -- 172.21.15.87:0/4013512494 learned_addr learned my addr 172.21.15.87:0/4013512494 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:16.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.921+0000 7fd0ce9ce640 1 --2- 172.21.15.87:0/4013512494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0c806f600 0x7fd0c815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:16.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.922+0000 7fd0cd9cc640 1 --2- 172.21.15.87:0/4013512494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0c806f0e0 0x7fd0c8151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:16.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.923+0000 7fd0ce1cd640 1 -- 172.21.15.87:0/4013512494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0c806f600 msgr2=0x7fd0c815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:16.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.923+0000 7fd0ce1cd640 1 --2- 172.21.15.87:0/4013512494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0c806f600 0x7fd0c815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.923+0000 7fd0ce1cd640 1 -- 172.21.15.87:0/4013512494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0c806f0e0 msgr2=0x7fd0c8151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:16.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.923+0000 7fd0ce1cd640 1 --2- 172.21.15.87:0/4013512494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0c806f0e0 0x7fd0c8151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:16.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.923+0000 7fd0ce1cd640 1 -- 172.21.15.87:0/4013512494 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c0009a70 con 0x7fd0c806ed00 2023-12-16T20:49:16.927 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.926+0000 7fd0ce1cd640 1 --2- 172.21.15.87:0/4013512494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0c806ed00 0x7fd0c815a750 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800c430 tx=0x7fd0b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:16.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.932+0000 7fd0beffd640 1 -- 172.21.15.87:0/4013512494 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8005ce0 con 0x7fd0c806ed00 2023-12-16T20:49:16.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.932+0000 7fd0beffd640 1 -- 172.21.15.87:0/4013512494 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b8005e40 con 0x7fd0c806ed00 2023-12-16T20:49:16.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.932+0000 7fd0d0431640 1 -- 172.21.15.87:0/4013512494 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c8159fe0 con 0x7fd0c806ed00 2023-12-16T20:49:16.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.932+0000 7fd0beffd640 1 -- 172.21.15.87:0/4013512494 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b80072f0 con 0x7fd0c806ed00 2023-12-16T20:49:16.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.932+0000 7fd0d0431640 1 -- 172.21.15.87:0/4013512494 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c8152a10 con 0x7fd0c806ed00 2023-12-16T20:49:16.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:16.933+0000 7fd0d0431640 1 -- 172.21.15.87:0/4013512494 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c815c3f0 con 0x7fd0c806ed00 2023-12-16T20:49:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.186+0000 7fd0beffd640 1 -- 172.21.15.87:0/4013512494 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fd0b8007450 con 0x7fd0c806ed00 2023-12-16T20:49:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.187+0000 7fd0beffd640 1 --2- 172.21.15.87:0/4013512494 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd0ac06aec0 0x7fd0ac06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.187+0000 7fd0cd9cc640 1 --2- 172.21.15.87:0/4013512494 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd0ac06aec0 0x7fd0ac06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:17.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.187+0000 7fd0cd9cc640 1 --2- 172.21.15.87:0/4013512494 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd0ac06aec0 0x7fd0ac06d380 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd0c80ca8b0 tx=0x7fd0c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:17.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.202+0000 7fd0beffd640 1 -- 172.21.15.87:0/4013512494 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd0b8057dd0 con 0x7fd0c806ed00 2023-12-16T20:49:17.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.202+0000 7fd0beffd640 1 -- 172.21.15.87:0/4013512494 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fd0b8054110 con 0x7fd0c806ed00 2023-12-16T20:49:17.408 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.407+0000 7fd0d0431640 1 -- 172.21.15.87:0/4013512494 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0c8067500 con 0x7fd0c806ed00 2023-12-16T20:49:17.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.445+0000 7fd0beffd640 1 -- 172.21.15.87:0/4013512494 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18702 (secure 0 0 0) 0x7fd0b8017090 con 0x7fd0c806ed00 2023-12-16T20:49:17.446 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:49:17.446 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":27,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:22:14.653915+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:21:22.654341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T20:21:33.728787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T20:21:34.846119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T20:21:38.657738+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:49:17.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.447+0000 7fd0d0431640 1 -- 172.21.15.87:0/4013512494 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd0ac06aec0 msgr2=0x7fd0ac06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:17.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.447+0000 7fd0d0431640 1 --2- 172.21.15.87:0/4013512494 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd0ac06aec0 0x7fd0ac06d380 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd0c80ca8b0 tx=0x7fd0c4008040 comp rx=0 tx=0).stop 2023-12-16T20:49:17.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.447+0000 7fd0d0431640 1 -- 172.21.15.87:0/4013512494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0c806ed00 msgr2=0x7fd0c815a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:17.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.447+0000 7fd0d0431640 1 --2- 172.21.15.87:0/4013512494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0c806ed00 0x7fd0c815a750 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800c430 tx=0x7fd0b800c8f0 comp rx=0 tx=0).stop 2023-12-16T20:49:17.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.447+0000 7fd0d0431640 1 -- 172.21.15.87:0/4013512494 shutdown_connections 2023-12-16T20:49:17.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.447+0000 7fd0d0431640 1 --2- 172.21.15.87:0/4013512494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0c806f600 0x7fd0c815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:17.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.447+0000 7fd0d0431640 1 --2- 172.21.15.87:0/4013512494 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd0ac06aec0 0x7fd0ac06d380 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:17.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.447+0000 7fd0d0431640 1 --2- 172.21.15.87:0/4013512494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0c806f0e0 0x7fd0c8151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:17.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.447+0000 7fd0d0431640 1 --2- 172.21.15.87:0/4013512494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0c806ed00 0x7fd0c815a750 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:17.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.447+0000 7fd0d0431640 1 -- 172.21.15.87:0/4013512494 >> 172.21.15.87:0/4013512494 conn(0x7fd0c8061660 msgr2=0x7fd0c8157670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:17.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.447+0000 7fd0d0431640 1 -- 172.21.15.87:0/4013512494 shutdown_connections 2023-12-16T20:49:17.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:17.447+0000 7fd0d0431640 1 -- 172.21.15.87:0/4013512494 wait complete. 2023-12-16T20:49:18.460 INFO:tasks.ceph:Scrubbing osd.0 2023-12-16T20:49:18.460 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-16T20:49:18.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.564+0000 7f53fcc09640 1 Processor -- start 2023-12-16T20:49:18.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.564+0000 7f53fcc09640 1 -- start start 2023-12-16T20:49:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.565+0000 7f53fcc09640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f53f81507d0 0x7f53f80c3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.565+0000 7f53fcc09640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f53f80c2960 0x7f53f80c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.565+0000 7f53fcc09640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53f80c7af0 0x7f53f8156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.565+0000 7f53fcc09640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f80c5370 con 0x7f53f80c2960 2023-12-16T20:49:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.565+0000 7f53fcc09640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f80c5f00 con 0x7f53f81507d0 2023-12-16T20:49:18.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.565+0000 7f53fcc09640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f80c61a0 con 0x7f53f80c7af0 2023-12-16T20:49:18.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.566+0000 7f53f5d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f53f80c2960 0x7f53f80c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:18.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.566+0000 7f53f5d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f53f80c2960 0x7f53f80c38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44768/0 (socket says 172.21.15.87:44768) 2023-12-16T20:49:18.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.566+0000 7f53f5d9b640 1 -- 172.21.15.87:0/1189486276 learned_addr learned my addr 172.21.15.87:0/1189486276 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:18.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.566+0000 7f53f6d9d640 1 --2- 172.21.15.87:0/1189486276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53f80c7af0 0x7f53f8156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:18.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.566+0000 7f53f659c640 1 --2- 172.21.15.87:0/1189486276 >> v2:172.21.15.195:3300/0 conn(0x7f53f81507d0 0x7f53f80c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:18.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.568+0000 7f53f5d9b640 1 -- 172.21.15.87:0/1189486276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53f80c7af0 msgr2=0x7f53f8156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:18.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.568+0000 7f53f5d9b640 1 --2- 172.21.15.87:0/1189486276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53f80c7af0 0x7f53f8156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:18.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.568+0000 7f53f5d9b640 1 -- 172.21.15.87:0/1189486276 >> v2:172.21.15.195:3300/0 conn(0x7f53f81507d0 msgr2=0x7f53f80c3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:18.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.568+0000 7f53f5d9b640 1 --2- 172.21.15.87:0/1189486276 >> v2:172.21.15.195:3300/0 conn(0x7f53f81507d0 0x7f53f80c3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:18.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.568+0000 7f53f5d9b640 1 -- 172.21.15.87:0/1189486276 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f80c5570 con 0x7f53f80c2960 2023-12-16T20:49:18.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.570+0000 7f53f5d9b640 1 --2- 172.21.15.87:0/1189486276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f80c2960 0x7f53f80c38b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f53f80727e0 tx=0x7f53e002e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4f8711f71ee3f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:18.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.573+0000 7f53f559a640 1 -- 172.21.15.87:0/1189486276 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e0036440 con 0x7f53f80c2960 2023-12-16T20:49:18.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.574+0000 7f53f559a640 1 -- 172.21.15.87:0/1189486276 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e00365a0 con 0x7f53f80c2960 2023-12-16T20:49:18.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.574+0000 7f53f559a640 1 -- 172.21.15.87:0/1189486276 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e0036930 con 0x7f53f80c2960 2023-12-16T20:49:18.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.574+0000 7f53fcc09640 1 -- 172.21.15.87:0/1189486276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f80c2960 msgr2=0x7f53f80c38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:18.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.574+0000 7f53fcc09640 1 --2- 172.21.15.87:0/1189486276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f80c2960 0x7f53f80c38b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f53f80727e0 tx=0x7f53e002e170 comp rx=0 tx=0).stop 2023-12-16T20:49:18.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.574+0000 7f53fcc09640 1 -- 172.21.15.87:0/1189486276 shutdown_connections 2023-12-16T20:49:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.574+0000 7f53fcc09640 1 --2- 172.21.15.87:0/1189486276 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53f80c7af0 0x7f53f8156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.574+0000 7f53fcc09640 1 --2- 172.21.15.87:0/1189486276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f80c2960 0x7f53f80c38b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.574+0000 7f53fcc09640 1 --2- 172.21.15.87:0/1189486276 >> v2:172.21.15.195:3300/0 conn(0x7f53f81507d0 0x7f53f80c3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.574+0000 7f53fcc09640 1 -- 172.21.15.87:0/1189486276 >> 172.21.15.87:0/1189486276 conn(0x7f53f80c7f60 msgr2=0x7f53f80c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.574+0000 7f53fcc09640 1 -- 172.21.15.87:0/1189486276 shutdown_connections 2023-12-16T20:49:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.574+0000 7f53fcc09640 1 -- 172.21.15.87:0/1189486276 wait complete. 2023-12-16T20:49:18.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.576+0000 7f53fcc09640 1 Processor -- start 2023-12-16T20:49:18.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.576+0000 7f53fcc09640 1 -- start start 2023-12-16T20:49:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.576+0000 7f53fcc09640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53f80c2960 0x7f53f8155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.576+0000 7f53fcc09640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f80c7af0 0x7f53f80ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.576+0000 7f53fcc09640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53f81507d0 0x7f53f813dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.576+0000 7f53fcc09640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f81f2aa0 con 0x7f53f80c7af0 2023-12-16T20:49:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.576+0000 7f53fcc09640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f81554a0 con 0x7f53f81507d0 2023-12-16T20:49:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.576+0000 7f53fcc09640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f81f2d40 con 0x7f53f80c2960 2023-12-16T20:49:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.577+0000 7f53f5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f80c7af0 0x7f53f80ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.577+0000 7f53f659c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53f80c2960 0x7f53f8155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.577+0000 7f53f6d9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53f81507d0 0x7f53f813dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:18.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.577+0000 7f53f5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f80c7af0 0x7f53f80ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44782/0 (socket says 172.21.15.87:44782) 2023-12-16T20:49:18.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.577+0000 7f53f5d9b640 1 -- 172.21.15.87:0/3246762658 learned_addr learned my addr 172.21.15.87:0/3246762658 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:18.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.580+0000 7f53f5d9b640 1 -- 172.21.15.87:0/3246762658 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53f80c2960 msgr2=0x7f53f8155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:18.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.580+0000 7f53f5d9b640 1 --2- 172.21.15.87:0/3246762658 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53f80c2960 0x7f53f8155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:18.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.580+0000 7f53f5d9b640 1 -- 172.21.15.87:0/3246762658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53f81507d0 msgr2=0x7f53f813dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:18.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.580+0000 7f53f5d9b640 1 --2- 172.21.15.87:0/3246762658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53f81507d0 0x7f53f813dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:18.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.580+0000 7f53f5d9b640 1 -- 172.21.15.87:0/3246762658 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e000b770 con 0x7f53f80c7af0 2023-12-16T20:49:18.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.583+0000 7f53f5d9b640 1 --2- 172.21.15.87:0/3246762658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f80c7af0 0x7f53f80ca970 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f53e0000c00 tx=0x7f53e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:18.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.586+0000 7f53eeffd640 1 -- 172.21.15.87:0/3246762658 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e003f910 con 0x7f53f80c7af0 2023-12-16T20:49:18.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.586+0000 7f53eeffd640 1 -- 172.21.15.87:0/3246762658 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e003fa70 con 0x7f53f80c7af0 2023-12-16T20:49:18.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.586+0000 7f53eeffd640 1 -- 172.21.15.87:0/3246762658 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e003fe00 con 0x7f53f80c7af0 2023-12-16T20:49:18.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.586+0000 7f53fcc09640 1 -- 172.21.15.87:0/3246762658 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f81f3020 con 0x7f53f80c7af0 2023-12-16T20:49:18.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.586+0000 7f53fcc09640 1 -- 172.21.15.87:0/3246762658 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f81f35e0 con 0x7f53f80c7af0 2023-12-16T20:49:18.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.587+0000 7f53fcc09640 1 -- 172.21.15.87:0/3246762658 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f53f8150bb0 con 0x7f53f80c7af0 2023-12-16T20:49:18.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.606+0000 7f53eeffd640 1 -- 172.21.15.87:0/3246762658 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f53e003d070 con 0x7f53f80c7af0 2023-12-16T20:49:18.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.606+0000 7f53eeffd640 1 --2- 172.21.15.87:0/3246762658 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f53d806ae90 0x7f53d806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:18.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.606+0000 7f53f659c640 1 --2- 172.21.15.87:0/3246762658 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f53d806ae90 0x7f53d806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:18.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.607+0000 7f53f659c640 1 --2- 172.21.15.87:0/3246762658 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f53d806ae90 0x7f53d806d350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f53f0011340 tx=0x7f53f000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:18.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.609+0000 7f53eeffd640 1 -- 172.21.15.87:0/3246762658 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f53e007adc0 con 0x7f53f80c7af0 2023-12-16T20:49:18.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.610+0000 7f53eeffd640 1 --2- 172.21.15.87:0/3246762658 >> [v2:172.21.15.87:6810/2135560294,v1:172.21.15.87:6811/2135560294] conn(0x7f53d80747f0 0x7f53d8076c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:18.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.610+0000 7f53eeffd640 1 -- 172.21.15.87:0/3246762658 --> [v2:172.21.15.87:6810/2135560294,v1:172.21.15.87:6811/2135560294] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53d8077360 con 0x7f53d80747f0 2023-12-16T20:49:18.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.610+0000 7f53eeffd640 1 -- 172.21.15.87:0/3246762658 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53e0077100 con 0x7f53f80c7af0 2023-12-16T20:49:18.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.610+0000 7f53f6d9d640 1 --2- 172.21.15.87:0/3246762658 >> [v2:172.21.15.87:6810/2135560294,v1:172.21.15.87:6811/2135560294] conn(0x7f53d80747f0 0x7f53d8076c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:18.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.610+0000 7f53f6d9d640 1 --2- 172.21.15.87:0/3246762658 >> [v2:172.21.15.87:6810/2135560294,v1:172.21.15.87:6811/2135560294] conn(0x7f53d80747f0 0x7f53d8076c90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:18.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.611+0000 7f53eeffd640 1 -- 172.21.15.87:0/3246762658 <== osd.0 v2:172.21.15.87:6810/2135560294 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f53d8077360 con 0x7f53d80747f0 2023-12-16T20:49:18.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.623+0000 7f53fcc09640 1 -- 172.21.15.87:0/3246762658 --> [v2:172.21.15.87:6810/2135560294,v1:172.21.15.87:6811/2135560294] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f53f8156570 con 0x7f53d80747f0 2023-12-16T20:49:18.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.624+0000 7f53eeffd640 1 -- 172.21.15.87:0/3246762658 <== osd.0 v2:172.21.15.87:6810/2135560294 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f53e8009cd0 con 0x7f53d80747f0 2023-12-16T20:49:18.625 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-12-16T20:49:18.625 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T20:49:18.625 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-12-16T20:49:18.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.624+0000 7f53fcc09640 1 -- 172.21.15.87:0/3246762658 >> [v2:172.21.15.87:6810/2135560294,v1:172.21.15.87:6811/2135560294] conn(0x7f53d80747f0 msgr2=0x7f53d8076c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:18.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.624+0000 7f53fcc09640 1 --2- 172.21.15.87:0/3246762658 >> [v2:172.21.15.87:6810/2135560294,v1:172.21.15.87:6811/2135560294] conn(0x7f53d80747f0 0x7f53d8076c90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:18.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.624+0000 7f53fcc09640 1 -- 172.21.15.87:0/3246762658 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f53d806ae90 msgr2=0x7f53d806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:18.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.624+0000 7f53fcc09640 1 --2- 172.21.15.87:0/3246762658 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f53d806ae90 0x7f53d806d350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f53f0011340 tx=0x7f53f000b040 comp rx=0 tx=0).stop 2023-12-16T20:49:18.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.624+0000 7f53fcc09640 1 -- 172.21.15.87:0/3246762658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f80c7af0 msgr2=0x7f53f80ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:18.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.624+0000 7f53fcc09640 1 --2- 172.21.15.87:0/3246762658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f80c7af0 0x7f53f80ca970 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f53e0000c00 tx=0x7f53e00046c0 comp rx=0 tx=0).stop 2023-12-16T20:49:18.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.624+0000 7f53f6d9d640 1 -- 172.21.15.87:0/3246762658 reap_dead start 2023-12-16T20:49:18.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.624+0000 7f53fcc09640 1 -- 172.21.15.87:0/3246762658 shutdown_connections 2023-12-16T20:49:18.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.624+0000 7f53fcc09640 1 -- 172.21.15.87:0/3246762658 >> 172.21.15.87:0/3246762658 conn(0x7f53f80c7f60 msgr2=0x7f53f80c2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:18.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.624+0000 7f53fcc09640 1 -- 172.21.15.87:0/3246762658 shutdown_connections 2023-12-16T20:49:18.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.624+0000 7f53fcc09640 1 -- 172.21.15.87:0/3246762658 wait complete. 2023-12-16T20:49:18.635 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-16T20:49:18.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.736+0000 7f32871a9640 1 Processor -- start 2023-12-16T20:49:18.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.736+0000 7f32871a9640 1 -- start start 2023-12-16T20:49:18.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.737+0000 7f32871a9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f328006f160 0x7f3280159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:18.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.737+0000 7f32871a9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32800c2e40 0x7f328015a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:18.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.737+0000 7f32871a9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328006e0f0 con 0x7f32801537d0 2023-12-16T20:49:18.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.737+0000 7f32871a9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3280159710 con 0x7f328006f160 2023-12-16T20:49:18.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.737+0000 7f32871a9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32800c72d0 con 0x7f32800c2e40 2023-12-16T20:49:18.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.737+0000 7f3285746640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32800c2e40 0x7f328015a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:18.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.737+0000 7f3284f45640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f32801537d0 0x7f328006a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:35676/0 (socket says 172.21.15.87:35676) 2023-12-16T20:49:18.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.738+0000 7f3284f45640 1 -- 172.21.15.87:0/3451972558 learned_addr learned my addr 172.21.15.87:0/3451972558 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:49:18.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.738+0000 7f3277fff640 1 --2- 172.21.15.87:0/3451972558 >> v2:172.21.15.87:3300/0 conn(0x7f328006f160 0x7f3280159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:18.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.740+0000 7f3285746640 1 -- 172.21.15.87:0/3451972558 >> v2:172.21.15.87:3300/0 conn(0x7f328006f160 msgr2=0x7f3280159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:18.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.740+0000 7f3285746640 1 --2- 172.21.15.87:0/3451972558 >> v2:172.21.15.87:3300/0 conn(0x7f328006f160 0x7f3280159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:18.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.740+0000 7f3285746640 1 -- 172.21.15.87:0/3451972558 >> v1:172.21.15.87:6789/0 conn(0x7f32801537d0 legacy=0x7f328006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:18.741 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.740+0000 7f3285746640 1 -- 172.21.15.87:0/3451972558 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32800c7590 con 0x7f32800c2e40 2023-12-16T20:49:18.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.742+0000 7f3285746640 1 --2- 172.21.15.87:0/3451972558 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32800c2e40 0x7f328015a130 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3278009d90 tx=0x7f327802bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0478c6131878cc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:18.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.746+0000 7f32777fe640 1 -- 172.21.15.87:0/3451972558 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327802cce0 con 0x7f32800c2e40 2023-12-16T20:49:18.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.746+0000 7f32777fe640 1 -- 172.21.15.87:0/3451972558 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327802ce40 con 0x7f32800c2e40 2023-12-16T20:49:18.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.746+0000 7f32777fe640 1 -- 172.21.15.87:0/3451972558 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3278034660 con 0x7f32800c2e40 2023-12-16T20:49:18.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.747+0000 7f32871a9640 1 -- 172.21.15.87:0/3451972558 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32800c2e40 msgr2=0x7f328015a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:18.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.747+0000 7f32871a9640 1 --2- 172.21.15.87:0/3451972558 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32800c2e40 0x7f328015a130 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3278009d90 tx=0x7f327802bf30 comp rx=0 tx=0).stop 2023-12-16T20:49:18.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.747+0000 7f32871a9640 1 -- 172.21.15.87:0/3451972558 shutdown_connections 2023-12-16T20:49:18.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.747+0000 7f32871a9640 1 --2- 172.21.15.87:0/3451972558 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32800c2e40 0x7f328015a130 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:18.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.747+0000 7f32871a9640 1 --2- 172.21.15.87:0/3451972558 >> v2:172.21.15.87:3300/0 conn(0x7f328006f160 0x7f3280159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:18.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.747+0000 7f32871a9640 1 -- 172.21.15.87:0/3451972558 >> 172.21.15.87:0/3451972558 conn(0x7f32800cbf60 msgr2=0x7f32800cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:18.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.747+0000 7f32871a9640 1 -- 172.21.15.87:0/3451972558 shutdown_connections 2023-12-16T20:49:18.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.747+0000 7f32871a9640 1 -- 172.21.15.87:0/3451972558 wait complete. 2023-12-16T20:49:18.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.748+0000 7f32871a9640 1 Processor -- start 2023-12-16T20:49:18.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.748+0000 7f32871a9640 1 -- start start 2023-12-16T20:49:18.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.749+0000 7f32871a9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f328006f160 0x7f32800c36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:18.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.749+0000 7f32871a9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32800c2e40 0x7f32801519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:18.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.749+0000 7f32871a9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32801537d0 0x7f32801ef930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:18.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.749+0000 7f32871a9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32801544e0 con 0x7f32800c2e40 2023-12-16T20:49:18.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.749+0000 7f32871a9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32801e5680 con 0x7f32801537d0 2023-12-16T20:49:18.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.749+0000 7f32871a9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32801ef170 con 0x7f328006f160 2023-12-16T20:49:18.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.749+0000 7f3277fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32800c2e40 0x7f32801519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:18.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.749+0000 7f3284f45640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f328006f160 0x7f32800c36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:18.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.749+0000 7f3285746640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32801537d0 0x7f32801ef930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:18.751 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.750+0000 7f3277fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32800c2e40 0x7f32801519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44802/0 (socket says 172.21.15.87:44802) 2023-12-16T20:49:18.751 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.750+0000 7f3277fff640 1 -- 172.21.15.87:0/4057751445 learned_addr learned my addr 172.21.15.87:0/4057751445 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:18.753 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.753+0000 7f3277fff640 1 -- 172.21.15.87:0/4057751445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f328006f160 msgr2=0x7f32800c36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:18.753 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.753+0000 7f3277fff640 1 --2- 172.21.15.87:0/4057751445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f328006f160 0x7f32800c36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:18.753 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.753+0000 7f3277fff640 1 -- 172.21.15.87:0/4057751445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32801537d0 msgr2=0x7f32801ef930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:18.753 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.753+0000 7f3277fff640 1 --2- 172.21.15.87:0/4057751445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32801537d0 0x7f32801ef930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:18.754 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.753+0000 7f3277fff640 1 -- 172.21.15.87:0/4057751445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3278009a70 con 0x7f32800c2e40 2023-12-16T20:49:18.755 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.755+0000 7f3277fff640 1 --2- 172.21.15.87:0/4057751445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32800c2e40 0x7f32801519b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f327000e9b0 tx=0x7f327000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:18.759 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.758+0000 7f32757fa640 1 -- 172.21.15.87:0/4057751445 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270009670 con 0x7f32800c2e40 2023-12-16T20:49:18.759 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.758+0000 7f32757fa640 1 -- 172.21.15.87:0/4057751445 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327000c9a0 con 0x7f32800c2e40 2023-12-16T20:49:18.759 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.758+0000 7f32757fa640 1 -- 172.21.15.87:0/4057751445 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327000cd50 con 0x7f32800c2e40 2023-12-16T20:49:18.759 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.758+0000 7f32871a9640 1 -- 172.21.15.87:0/4057751445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32801f3180 con 0x7f32800c2e40 2023-12-16T20:49:18.759 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.758+0000 7f32871a9640 1 -- 172.21.15.87:0/4057751445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32801f3460 con 0x7f32800c2e40 2023-12-16T20:49:18.759 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.759+0000 7f32871a9640 1 -- 172.21.15.87:0/4057751445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3280067500 con 0x7f32800c2e40 2023-12-16T20:49:18.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.776+0000 7f32757fa640 1 -- 172.21.15.87:0/4057751445 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f3270013470 con 0x7f32800c2e40 2023-12-16T20:49:18.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.777+0000 7f32757fa640 1 --2- 172.21.15.87:0/4057751445 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f326c06ae90 0x7f326c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:18.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.777+0000 7f3284f45640 1 --2- 172.21.15.87:0/4057751445 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f326c06ae90 0x7f326c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:18.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.777+0000 7f3284f45640 1 --2- 172.21.15.87:0/4057751445 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f326c06ae90 0x7f326c06d350 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f327c007fd0 tx=0x7f327c007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:18.782 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:18.782+0000 7f32757fa640 1 -- 172.21.15.87:0/4057751445 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3270058d70 con 0x7f32800c2e40 2023-12-16T20:49:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.015+0000 7f32757fa640 1 -- 172.21.15.87:0/4057751445 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f32700550b0 con 0x7f32800c2e40 2023-12-16T20:49:19.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.183+0000 7f32871a9640 1 -- 172.21.15.87:0/4057751445 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f328006e730 con 0x7f326c06ae90 2023-12-16T20:49:19.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.184+0000 7f32757fa640 1 -- 172.21.15.87:0/4057751445 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f327c0013c0 con 0x7f326c06ae90 2023-12-16T20:49:19.184 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 0 to deep-scrub 2023-12-16T20:49:19.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.186+0000 7f32871a9640 1 -- 172.21.15.87:0/4057751445 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f326c06ae90 msgr2=0x7f326c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.186+0000 7f32871a9640 1 --2- 172.21.15.87:0/4057751445 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f326c06ae90 0x7f326c06d350 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f327c007fd0 tx=0x7f327c007e80 comp rx=0 tx=0).stop 2023-12-16T20:49:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.186+0000 7f32871a9640 1 -- 172.21.15.87:0/4057751445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32800c2e40 msgr2=0x7f32801519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.186+0000 7f32871a9640 1 --2- 172.21.15.87:0/4057751445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32800c2e40 0x7f32801519b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f327000e9b0 tx=0x7f327000ee70 comp rx=0 tx=0).stop 2023-12-16T20:49:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.186+0000 7f32871a9640 1 -- 172.21.15.87:0/4057751445 shutdown_connections 2023-12-16T20:49:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.186+0000 7f32871a9640 1 --2- 172.21.15.87:0/4057751445 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f326c06ae90 0x7f326c06d350 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.186+0000 7f32871a9640 1 --2- 172.21.15.87:0/4057751445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32801537d0 0x7f32801ef930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.186+0000 7f32871a9640 1 --2- 172.21.15.87:0/4057751445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32800c2e40 0x7f32801519b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.186+0000 7f32871a9640 1 --2- 172.21.15.87:0/4057751445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f328006f160 0x7f32800c36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.186+0000 7f32871a9640 1 -- 172.21.15.87:0/4057751445 >> 172.21.15.87:0/4057751445 conn(0x7f32800cbf60 msgr2=0x7f328006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.186+0000 7f32871a9640 1 -- 172.21.15.87:0/4057751445 shutdown_connections 2023-12-16T20:49:19.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.186+0000 7f32871a9640 1 -- 172.21.15.87:0/4057751445 wait complete. 2023-12-16T20:49:19.198 INFO:tasks.ceph:Scrubbing osd.1 2023-12-16T20:49:19.198 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-16T20:49:19.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.300+0000 7f5f6a7a9640 1 Processor -- start 2023-12-16T20:49:19.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.300+0000 7f5f6a7a9640 1 -- start start 2023-12-16T20:49:19.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.301+0000 7f5f6a7a9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5f6414fab0 0x7f5f6406f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:19.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.301+0000 7f5f6a7a9640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5f64070f50 0x7f5f64156100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:19.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.301+0000 7f5f6a7a9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f64156640 0x7f5f640c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:19.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.301+0000 7f5f6a7a9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f640c0a50 con 0x7f5f6414fab0 2023-12-16T20:49:19.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.301+0000 7f5f6a7a9640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f64155ce0 con 0x7f5f64070f50 2023-12-16T20:49:19.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.301+0000 7f5f6a7a9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6406f690 con 0x7f5f64156640 2023-12-16T20:49:19.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.301+0000 7f5f63fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5f6414fab0 0x7f5f6406f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:19.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.301+0000 7f5f637fe640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5f64070f50 0x7f5f64156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:19.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.301+0000 7f5f68d46640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f64156640 0x7f5f640c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:19.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.302+0000 7f5f63fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5f6414fab0 0x7f5f6406f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44812/0 (socket says 172.21.15.87:44812) 2023-12-16T20:49:19.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.302+0000 7f5f63fff640 1 -- 172.21.15.87:0/498239531 learned_addr learned my addr 172.21.15.87:0/498239531 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:19.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.304+0000 7f5f63fff640 1 -- 172.21.15.87:0/498239531 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f64156640 msgr2=0x7f5f640c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:19.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.304+0000 7f5f63fff640 1 --2- 172.21.15.87:0/498239531 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f64156640 0x7f5f640c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.304+0000 7f5f63fff640 1 -- 172.21.15.87:0/498239531 >> v2:172.21.15.195:3300/0 conn(0x7f5f64070f50 msgr2=0x7f5f64156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:19.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.304+0000 7f5f63fff640 1 --2- 172.21.15.87:0/498239531 >> v2:172.21.15.195:3300/0 conn(0x7f5f64070f50 0x7f5f64156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.304+0000 7f5f63fff640 1 -- 172.21.15.87:0/498239531 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f64156a70 con 0x7f5f6414fab0 2023-12-16T20:49:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.306+0000 7f5f63fff640 1 --2- 172.21.15.87:0/498239531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f6414fab0 0x7f5f6406f150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5f64156c00 tx=0x7f5f5402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71390400e78bb69 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:19.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.309+0000 7f5f62ffd640 1 -- 172.21.15.87:0/498239531 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54031640 con 0x7f5f6414fab0 2023-12-16T20:49:19.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.309+0000 7f5f62ffd640 1 -- 172.21.15.87:0/498239531 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f540317a0 con 0x7f5f6414fab0 2023-12-16T20:49:19.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.309+0000 7f5f62ffd640 1 -- 172.21.15.87:0/498239531 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54031b30 con 0x7f5f6414fab0 2023-12-16T20:49:19.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.310+0000 7f5f6a7a9640 1 -- 172.21.15.87:0/498239531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f6414fab0 msgr2=0x7f5f6406f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:19.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.310+0000 7f5f6a7a9640 1 --2- 172.21.15.87:0/498239531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f6414fab0 0x7f5f6406f150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5f64156c00 tx=0x7f5f5402b8f0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.310+0000 7f5f6a7a9640 1 -- 172.21.15.87:0/498239531 shutdown_connections 2023-12-16T20:49:19.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.310+0000 7f5f6a7a9640 1 --2- 172.21.15.87:0/498239531 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f64156640 0x7f5f640c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.310+0000 7f5f6a7a9640 1 --2- 172.21.15.87:0/498239531 >> v2:172.21.15.195:3300/0 conn(0x7f5f64070f50 0x7f5f64156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.310+0000 7f5f6a7a9640 1 --2- 172.21.15.87:0/498239531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f6414fab0 0x7f5f6406f150 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.310+0000 7f5f6a7a9640 1 -- 172.21.15.87:0/498239531 >> 172.21.15.87:0/498239531 conn(0x7f5f6406cd60 msgr2=0x7f5f6406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:19.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.310+0000 7f5f6a7a9640 1 -- 172.21.15.87:0/498239531 shutdown_connections 2023-12-16T20:49:19.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.310+0000 7f5f6a7a9640 1 -- 172.21.15.87:0/498239531 wait complete. 2023-12-16T20:49:19.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.311+0000 7f5f6a7a9640 1 Processor -- start 2023-12-16T20:49:19.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.311+0000 7f5f6a7a9640 1 -- start start 2023-12-16T20:49:19.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.312+0000 7f5f6a7a9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f64070f50 0x7f5f64151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:19.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.312+0000 7f5f6a7a9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f6414fab0 0x7f5f641f0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:19.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.312+0000 7f5f6a7a9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f64156640 0x7f5f641f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:19.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.312+0000 7f5f6a7a9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f64141160 con 0x7f5f6414fab0 2023-12-16T20:49:19.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.312+0000 7f5f6a7a9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6414a940 con 0x7f5f64156640 2023-12-16T20:49:19.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.312+0000 7f5f6a7a9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6414ac90 con 0x7f5f64070f50 2023-12-16T20:49:19.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.312+0000 7f5f637fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f6414fab0 0x7f5f641f0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:19.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.313+0000 7f5f637fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f6414fab0 0x7f5f641f0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44814/0 (socket says 172.21.15.87:44814) 2023-12-16T20:49:19.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.313+0000 7f5f637fe640 1 -- 172.21.15.87:0/3952114235 learned_addr learned my addr 172.21.15.87:0/3952114235 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:19.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.313+0000 7f5f63fff640 1 --2- 172.21.15.87:0/3952114235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f64070f50 0x7f5f64151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:19.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.313+0000 7f5f68d46640 1 --2- 172.21.15.87:0/3952114235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f64156640 0x7f5f641f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:19.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.316+0000 7f5f637fe640 1 -- 172.21.15.87:0/3952114235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f64070f50 msgr2=0x7f5f64151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:19.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.316+0000 7f5f637fe640 1 --2- 172.21.15.87:0/3952114235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f64070f50 0x7f5f64151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.316+0000 7f5f637fe640 1 -- 172.21.15.87:0/3952114235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f64156640 msgr2=0x7f5f641f0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:19.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.316+0000 7f5f637fe640 1 --2- 172.21.15.87:0/3952114235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f64156640 0x7f5f641f0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.316+0000 7f5f637fe640 1 -- 172.21.15.87:0/3952114235 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f540094d0 con 0x7f5f6414fab0 2023-12-16T20:49:19.319 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.319+0000 7f5f637fe640 1 --2- 172.21.15.87:0/3952114235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f6414fab0 0x7f5f641f0820 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800e8c0 tx=0x7f5f5800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.322+0000 7f5f60ff9640 1 -- 172.21.15.87:0/3952114235 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800c940 con 0x7f5f6414fab0 2023-12-16T20:49:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.322+0000 7f5f60ff9640 1 -- 172.21.15.87:0/3952114235 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5800caa0 con 0x7f5f6414fab0 2023-12-16T20:49:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.322+0000 7f5f60ff9640 1 -- 172.21.15.87:0/3952114235 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800ce30 con 0x7f5f6414fab0 2023-12-16T20:49:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.322+0000 7f5f6a7a9640 1 -- 172.21.15.87:0/3952114235 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6414a310 con 0x7f5f6414fab0 2023-12-16T20:49:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.322+0000 7f5f6a7a9640 1 -- 172.21.15.87:0/3952114235 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f64149d50 con 0x7f5f6414fab0 2023-12-16T20:49:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.323+0000 7f5f6a7a9640 1 -- 172.21.15.87:0/3952114235 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5f640c1380 con 0x7f5f6414fab0 2023-12-16T20:49:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.342+0000 7f5f60ff9640 1 -- 172.21.15.87:0/3952114235 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f5f58013470 con 0x7f5f6414fab0 2023-12-16T20:49:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.342+0000 7f5f60ff9640 1 --2- 172.21.15.87:0/3952114235 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f5f5006ae40 0x7f5f5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.343+0000 7f5f63fff640 1 --2- 172.21.15.87:0/3952114235 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f5f5006ae40 0x7f5f5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.343+0000 7f5f63fff640 1 --2- 172.21.15.87:0/3952114235 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f5f5006ae40 0x7f5f5006d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5f54036000 tx=0x7f5f5403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.346+0000 7f5f60ff9640 1 -- 172.21.15.87:0/3952114235 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5f58058890 con 0x7f5f6414fab0 2023-12-16T20:49:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.346+0000 7f5f60ff9640 1 --2- 172.21.15.87:0/3952114235 >> [v2:172.21.15.87:6826/1090792588,v1:172.21.15.87:6827/1090792588] conn(0x7f5f500746a0 0x7f5f50076b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.346+0000 7f5f60ff9640 1 -- 172.21.15.87:0/3952114235 --> [v2:172.21.15.87:6826/1090792588,v1:172.21.15.87:6827/1090792588] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5f50077210 con 0x7f5f500746a0 2023-12-16T20:49:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.346+0000 7f5f68d46640 1 --2- 172.21.15.87:0/3952114235 >> [v2:172.21.15.87:6826/1090792588,v1:172.21.15.87:6827/1090792588] conn(0x7f5f500746a0 0x7f5f50076b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.346+0000 7f5f68d46640 1 --2- 172.21.15.87:0/3952114235 >> [v2:172.21.15.87:6826/1090792588,v1:172.21.15.87:6827/1090792588] conn(0x7f5f500746a0 0x7f5f50076b40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:19.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.347+0000 7f5f60ff9640 1 -- 172.21.15.87:0/3952114235 <== osd.1 v2:172.21.15.87:6826/1090792588 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f5f50077210 con 0x7f5f500746a0 2023-12-16T20:49:19.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.348+0000 7f5f60ff9640 1 -- 172.21.15.87:0/3952114235 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f58054bd0 con 0x7f5f6414fab0 2023-12-16T20:49:19.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.360+0000 7f5f6a7a9640 1 -- 172.21.15.87:0/3952114235 --> [v2:172.21.15.87:6826/1090792588,v1:172.21.15.87:6827/1090792588] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5f640c8230 con 0x7f5f500746a0 2023-12-16T20:49:19.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.361+0000 7f5f60ff9640 1 -- 172.21.15.87:0/3952114235 <== osd.1 v2:172.21.15.87:6826/1090792588 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5f5c00f040 con 0x7f5f500746a0 2023-12-16T20:49:19.362 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-12-16T20:49:19.362 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T20:49:19.362 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-12-16T20:49:19.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.361+0000 7f5f6a7a9640 1 -- 172.21.15.87:0/3952114235 >> [v2:172.21.15.87:6826/1090792588,v1:172.21.15.87:6827/1090792588] conn(0x7f5f500746a0 msgr2=0x7f5f50076b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:19.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.361+0000 7f5f6a7a9640 1 --2- 172.21.15.87:0/3952114235 >> [v2:172.21.15.87:6826/1090792588,v1:172.21.15.87:6827/1090792588] conn(0x7f5f500746a0 0x7f5f50076b40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.361+0000 7f5f6a7a9640 1 -- 172.21.15.87:0/3952114235 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f5f5006ae40 msgr2=0x7f5f5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:19.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.361+0000 7f5f6a7a9640 1 --2- 172.21.15.87:0/3952114235 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f5f5006ae40 0x7f5f5006d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5f54036000 tx=0x7f5f5403c040 comp rx=0 tx=0).stop 2023-12-16T20:49:19.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.361+0000 7f5f6a7a9640 1 -- 172.21.15.87:0/3952114235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f6414fab0 msgr2=0x7f5f641f0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:19.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.361+0000 7f5f6a7a9640 1 --2- 172.21.15.87:0/3952114235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f6414fab0 0x7f5f641f0820 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800e8c0 tx=0x7f5f5800ed80 comp rx=0 tx=0).stop 2023-12-16T20:49:19.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.361+0000 7f5f68d46640 1 -- 172.21.15.87:0/3952114235 reap_dead start 2023-12-16T20:49:19.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.361+0000 7f5f6a7a9640 1 -- 172.21.15.87:0/3952114235 shutdown_connections 2023-12-16T20:49:19.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.361+0000 7f5f6a7a9640 1 -- 172.21.15.87:0/3952114235 >> 172.21.15.87:0/3952114235 conn(0x7f5f6406cd60 msgr2=0x7f5f64154a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:19.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.361+0000 7f5f6a7a9640 1 -- 172.21.15.87:0/3952114235 shutdown_connections 2023-12-16T20:49:19.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.361+0000 7f5f6a7a9640 1 -- 172.21.15.87:0/3952114235 wait complete. 2023-12-16T20:49:19.372 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-16T20:49:19.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.476+0000 7f49a6953640 1 Processor -- start 2023-12-16T20:49:19.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.476+0000 7f49a6953640 1 -- start start 2023-12-16T20:49:19.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.476+0000 7f49a6953640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49a0151130 0x7f49a006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:19.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.476+0000 7f49a6953640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a0157350 con 0x7f49a0151510 2023-12-16T20:49:19.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.476+0000 7f49a6953640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a00c8a20 con 0x7f49a00b2060 2023-12-16T20:49:19.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.476+0000 7f49a6953640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a01576a0 con 0x7f49a0151130 2023-12-16T20:49:19.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.482+0000 7f499ffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49a0151130 0x7f49a006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:19.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.482+0000 7f499ffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49a0151130 0x7f49a006f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:56810/0 (socket says 172.21.15.87:56810) 2023-12-16T20:49:19.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.482+0000 7f499ffff640 1 -- 172.21.15.87:0/2872580488 learned_addr learned my addr 172.21.15.87:0/2872580488 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:19.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.526+0000 7f499effd640 1 -- 172.21.15.87:0/2872580488 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814566306 0 0) 0x7f49a0157350 con 0x7f49a0151510 2023-12-16T20:49:19.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.526+0000 7f499effd640 1 -- 172.21.15.87:0/2872580488 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4988003520 con 0x7f49a0151510 2023-12-16T20:49:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.530+0000 7f499effd640 1 -- 172.21.15.87:0/2872580488 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3873756276 0 0) 0x7f4988003520 con 0x7f49a0151510 2023-12-16T20:49:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.530+0000 7f499effd640 1 -- 172.21.15.87:0/2872580488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49a0151130 msgr2=0x7f49a006f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.530+0000 7f499effd640 1 --2- 172.21.15.87:0/2872580488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49a0151130 0x7f49a006f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.530+0000 7f499effd640 1 -- 172.21.15.87:0/2872580488 >> v1:172.21.15.195:6789/0 conn(0x7f49a00b2060 legacy=0x7f49a0157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.530+0000 7f499effd640 1 -- 172.21.15.87:0/2872580488 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a00c8ce0 con 0x7f49a0151510 2023-12-16T20:49:19.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.530+0000 7f499effd640 1 -- 172.21.15.87:0/2872580488 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1165302485 0 0) 0x7f49980019f0 con 0x7f49a0151510 2023-12-16T20:49:19.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.530+0000 7f499effd640 1 -- 172.21.15.87:0/2872580488 >> v1:172.21.15.87:6789/0 conn(0x7f49a0151510 legacy=0x7f49a00ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:19.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.530+0000 7f499effd640 1 --2- 172.21.15.87:0/2872580488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49a0151130 0x7f49880039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:19.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.530+0000 7f499effd640 1 --2- 172.21.15.87:0/2872580488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988003f70 0x7f49880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:19.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.530+0000 7f499effd640 1 --2- 172.21.15.87:0/2872580488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4988004d00 0x7f4988005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:19.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.530+0000 7f499effd640 1 -- 172.21.15.87:0/2872580488 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a01576a0 con 0x7f4988003f70 2023-12-16T20:49:19.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.530+0000 7f499effd640 1 -- 172.21.15.87:0/2872580488 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498800bac0 con 0x7f4988004d00 2023-12-16T20:49:19.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.530+0000 7f499effd640 1 -- 172.21.15.87:0/2872580488 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498800bc80 con 0x7f49a0151130 2023-12-16T20:49:19.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.533+0000 7f499f7fe640 1 --2- 172.21.15.87:0/2872580488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988003f70 0x7f49880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.535+0000 7f499f7fe640 1 -- 172.21.15.87:0/2872580488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49a0151130 msgr2=0x7f49880039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.535+0000 7f499f7fe640 1 --2- 172.21.15.87:0/2872580488 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49a0151130 0x7f49880039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.535+0000 7f499f7fe640 1 -- 172.21.15.87:0/2872580488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4988004d00 msgr2=0x7f4988005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.535+0000 7f499f7fe640 1 --2- 172.21.15.87:0/2872580488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4988004d00 0x7f4988005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.535+0000 7f499f7fe640 1 -- 172.21.15.87:0/2872580488 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4988003520 con 0x7f4988003f70 2023-12-16T20:49:19.538 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.537+0000 7f499f7fe640 1 --2- 172.21.15.87:0/2872580488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988003f70 0x7f49880047c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4994001720 tx=0x7f49880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625112dce817f654 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:19.541 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.541+0000 7f499effd640 1 -- 172.21.15.87:0/2872580488 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49940052d0 con 0x7f4988003f70 2023-12-16T20:49:19.542 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.541+0000 7f499effd640 1 -- 172.21.15.87:0/2872580488 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499402e050 con 0x7f4988003f70 2023-12-16T20:49:19.542 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.541+0000 7f499effd640 1 -- 172.21.15.87:0/2872580488 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994003830 con 0x7f4988003f70 2023-12-16T20:49:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.542+0000 7f49a6953640 1 -- 172.21.15.87:0/2872580488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988003f70 msgr2=0x7f49880047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.542+0000 7f49a6953640 1 --2- 172.21.15.87:0/2872580488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988003f70 0x7f49880047c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4994001720 tx=0x7f49880057f0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.542+0000 7f49a4ef0640 1 -- 172.21.15.87:0/2872580488 reap_dead start 2023-12-16T20:49:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.542+0000 7f49a6953640 1 -- 172.21.15.87:0/2872580488 shutdown_connections 2023-12-16T20:49:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.542+0000 7f49a6953640 1 -- 172.21.15.87:0/2872580488 >> 172.21.15.87:0/2872580488 conn(0x7f49a0061100 msgr2=0x7f49a00614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.542+0000 7f49a6953640 1 -- 172.21.15.87:0/2872580488 shutdown_connections 2023-12-16T20:49:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.542+0000 7f49a6953640 1 -- 172.21.15.87:0/2872580488 wait complete. 2023-12-16T20:49:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.543+0000 7f49a6953640 1 Processor -- start 2023-12-16T20:49:19.544 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.543+0000 7f49a6953640 1 -- start start 2023-12-16T20:49:19.545 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.544+0000 7f49a6953640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988003f70 0x7f49a01592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:19.545 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.544+0000 7f49a6953640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49a0159ac0 0x7f49a01ee470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:19.545 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.544+0000 7f49a6953640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49a014a660 0x7f49a01ed000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:19.545 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.544+0000 7f49a6953640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a014dba0 con 0x7f4988003f70 2023-12-16T20:49:19.545 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.544+0000 7f49a6953640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a01ed8d0 con 0x7f49a014a660 2023-12-16T20:49:19.545 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.544+0000 7f49a6953640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a01edb90 con 0x7f49a0159ac0 2023-12-16T20:49:19.546 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.545+0000 7f499f7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49a0159ac0 0x7f49a01ee470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:19.546 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.545+0000 7f49a4ef0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49a014a660 0x7f49a01ed000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:19.546 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.545+0000 7f499f7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49a0159ac0 0x7f49a01ee470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:56828/0 (socket says 172.21.15.87:56828) 2023-12-16T20:49:19.546 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.545+0000 7f499f7fe640 1 -- 172.21.15.87:0/1883705073 learned_addr learned my addr 172.21.15.87:0/1883705073 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:19.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.549+0000 7f499f7fe640 1 -- 172.21.15.87:0/1883705073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49a014a660 msgr2=0x7f49a01ed000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:19.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.549+0000 7f499f7fe640 1 --2- 172.21.15.87:0/1883705073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49a014a660 0x7f49a01ed000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.549+0000 7f499f7fe640 1 -- 172.21.15.87:0/1883705073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988003f70 msgr2=0x7f49a01592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:19.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.549+0000 7f499f7fe640 1 --2- 172.21.15.87:0/1883705073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988003f70 0x7f49a01592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.549+0000 7f499f7fe640 1 -- 172.21.15.87:0/1883705073 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a01ede70 con 0x7f49a0159ac0 2023-12-16T20:49:19.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.552+0000 7f499f7fe640 1 --2- 172.21.15.87:0/1883705073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49a0159ac0 0x7f49a01ee470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4994005040 tx=0x7f4994001120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:19.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.556+0000 7f499cff9640 1 -- 172.21.15.87:0/1883705073 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994000ed0 con 0x7f49a0159ac0 2023-12-16T20:49:19.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.556+0000 7f499cff9640 1 -- 172.21.15.87:0/1883705073 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49940069e0 con 0x7f49a0159ac0 2023-12-16T20:49:19.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.556+0000 7f499cff9640 1 -- 172.21.15.87:0/1883705073 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994006d90 con 0x7f49a0159ac0 2023-12-16T20:49:19.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.556+0000 7f49a6953640 1 -- 172.21.15.87:0/1883705073 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a0158510 con 0x7f49a0159ac0 2023-12-16T20:49:19.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.556+0000 7f49a6953640 1 -- 172.21.15.87:0/1883705073 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a0158ad0 con 0x7f49a0159ac0 2023-12-16T20:49:19.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.557+0000 7f49a6953640 1 -- 172.21.15.87:0/1883705073 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a00740e0 con 0x7f49a0159ac0 2023-12-16T20:49:19.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.577+0000 7f499cff9640 1 -- 172.21.15.87:0/1883705073 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f49940035f0 con 0x7f49a0159ac0 2023-12-16T20:49:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.577+0000 7f499cff9640 1 --2- 172.21.15.87:0/1883705073 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f498c06ae90 0x7f498c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.577+0000 7f499ffff640 1 --2- 172.21.15.87:0/1883705073 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f498c06ae90 0x7f498c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.578+0000 7f499ffff640 1 --2- 172.21.15.87:0/1883705073 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f498c06ae90 0x7f498c06d350 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4990006f40 tx=0x7f4990006e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:19.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.806+0000 7f499cff9640 1 -- 172.21.15.87:0/1883705073 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f499407a740 con 0x7f49a0159ac0 2023-12-16T20:49:19.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.820+0000 7f499cff9640 1 -- 172.21.15.87:0/1883705073 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f4994076a80 con 0x7f49a0159ac0 2023-12-16T20:49:19.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.986+0000 7f49a6953640 1 -- 172.21.15.87:0/1883705073 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f49a0156830 con 0x7f498c06ae90 2023-12-16T20:49:19.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.987+0000 7f499cff9640 1 -- 172.21.15.87:0/1883705073 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f49a0156830 con 0x7f498c06ae90 2023-12-16T20:49:19.988 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 1 to deep-scrub 2023-12-16T20:49:19.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.989+0000 7f49a6953640 1 -- 172.21.15.87:0/1883705073 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f498c06ae90 msgr2=0x7f498c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:19.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.989+0000 7f49a6953640 1 --2- 172.21.15.87:0/1883705073 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f498c06ae90 0x7f498c06d350 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4990006f40 tx=0x7f4990006e90 comp rx=0 tx=0).stop 2023-12-16T20:49:19.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.989+0000 7f49a6953640 1 -- 172.21.15.87:0/1883705073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49a0159ac0 msgr2=0x7f49a01ee470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:19.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.989+0000 7f49a6953640 1 --2- 172.21.15.87:0/1883705073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49a0159ac0 0x7f49a01ee470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4994005040 tx=0x7f4994001120 comp rx=0 tx=0).stop 2023-12-16T20:49:19.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.989+0000 7f49a6953640 1 -- 172.21.15.87:0/1883705073 shutdown_connections 2023-12-16T20:49:19.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.989+0000 7f49a6953640 1 --2- 172.21.15.87:0/1883705073 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f498c06ae90 0x7f498c06d350 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.989+0000 7f49a6953640 1 --2- 172.21.15.87:0/1883705073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49a014a660 0x7f49a01ed000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.989+0000 7f49a6953640 1 --2- 172.21.15.87:0/1883705073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49a0159ac0 0x7f49a01ee470 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.989+0000 7f49a6953640 1 --2- 172.21.15.87:0/1883705073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4988003f70 0x7f49a01592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:19.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.989+0000 7f49a6953640 1 -- 172.21.15.87:0/1883705073 >> 172.21.15.87:0/1883705073 conn(0x7f49a0061100 msgr2=0x7f49a00cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:19.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.989+0000 7f49a6953640 1 -- 172.21.15.87:0/1883705073 shutdown_connections 2023-12-16T20:49:19.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:19.989+0000 7f49a6953640 1 -- 172.21.15.87:0/1883705073 wait complete. 2023-12-16T20:49:20.001 INFO:tasks.ceph:Scrubbing osd.2 2023-12-16T20:49:20.001 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-16T20:49:20.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.105+0000 7f859c5ea640 1 Processor -- start 2023-12-16T20:49:20.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.105+0000 7f859c5ea640 1 -- start start 2023-12-16T20:49:20.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.106+0000 7f859c5ea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8594157de0 0x7f85940c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.106+0000 7f859c5ea640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f85940c22f0 0x7f85940c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.106+0000 7f859c5ea640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8594151a40 con 0x7f8594151660 2023-12-16T20:49:20.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.106+0000 7f859c5ea640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85940c96b0 con 0x7f85940c22f0 2023-12-16T20:49:20.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.106+0000 7f859c5ea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8594158240 con 0x7f8594157de0 2023-12-16T20:49:20.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.107+0000 7f859ab87640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f85940c22f0 0x7f85940c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.107+0000 7f859a386640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8594151660 0x7f85940c8fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:35700/0 (socket says 172.21.15.87:35700) 2023-12-16T20:49:20.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.107+0000 7f859a386640 1 -- 172.21.15.87:0/3341290067 learned_addr learned my addr 172.21.15.87:0/3341290067 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:49:20.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.108+0000 7f8599b85640 1 --2- 172.21.15.87:0/3341290067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8594157de0 0x7f85940c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.110+0000 7f8599b85640 1 -- 172.21.15.87:0/3341290067 >> v2:172.21.15.87:3300/0 conn(0x7f85940c22f0 msgr2=0x7f85940c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:20.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.110+0000 7f8599b85640 1 --2- 172.21.15.87:0/3341290067 >> v2:172.21.15.87:3300/0 conn(0x7f85940c22f0 0x7f85940c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.110+0000 7f8599b85640 1 -- 172.21.15.87:0/3341290067 >> v1:172.21.15.87:6789/0 conn(0x7f8594151660 legacy=0x7f85940c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.110+0000 7f8599b85640 1 -- 172.21.15.87:0/3341290067 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85940c2c10 con 0x7f8594157de0 2023-12-16T20:49:20.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.113+0000 7f8599b85640 1 --2- 172.21.15.87:0/3341290067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8594157de0 0x7f85940c1db0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85900097a0 tx=0x7f859002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13a3365d31ffe553 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:20.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.118+0000 7f8599384640 1 -- 172.21.15.87:0/3341290067 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8590030610 con 0x7f8594157de0 2023-12-16T20:49:20.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.118+0000 7f8599384640 1 -- 172.21.15.87:0/3341290067 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8590030770 con 0x7f8594157de0 2023-12-16T20:49:20.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.118+0000 7f8599384640 1 -- 172.21.15.87:0/3341290067 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8590030b00 con 0x7f8594157de0 2023-12-16T20:49:20.120 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.119+0000 7f859c5ea640 1 -- 172.21.15.87:0/3341290067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8594157de0 msgr2=0x7f85940c1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.120 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.119+0000 7f859c5ea640 1 --2- 172.21.15.87:0/3341290067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8594157de0 0x7f85940c1db0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85900097a0 tx=0x7f859002b960 comp rx=0 tx=0).stop 2023-12-16T20:49:20.120 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.119+0000 7f859c5ea640 1 -- 172.21.15.87:0/3341290067 shutdown_connections 2023-12-16T20:49:20.120 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.119+0000 7f859c5ea640 1 --2- 172.21.15.87:0/3341290067 >> v2:172.21.15.87:3300/0 conn(0x7f85940c22f0 0x7f85940c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.120 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.119+0000 7f859c5ea640 1 --2- 172.21.15.87:0/3341290067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8594157de0 0x7f85940c1db0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.120 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.119+0000 7f859c5ea640 1 -- 172.21.15.87:0/3341290067 >> 172.21.15.87:0/3341290067 conn(0x7f85940ccd90 msgr2=0x7f85940cd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:20.121 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.119+0000 7f859c5ea640 1 -- 172.21.15.87:0/3341290067 shutdown_connections 2023-12-16T20:49:20.121 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.119+0000 7f859c5ea640 1 -- 172.21.15.87:0/3341290067 wait complete. 2023-12-16T20:49:20.121 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.120+0000 7f859c5ea640 1 Processor -- start 2023-12-16T20:49:20.121 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.120+0000 7f859c5ea640 1 -- start start 2023-12-16T20:49:20.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.121+0000 7f859c5ea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85940c22f0 0x7f85941f12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.121+0000 7f859c5ea640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8594151660 0x7f85940cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.121+0000 7f859c5ea640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8594157de0 0x7f85941eda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.121+0000 7f859c5ea640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85941f1830 con 0x7f8594157de0 2023-12-16T20:49:20.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.121+0000 7f859c5ea640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85941e3150 con 0x7f8594151660 2023-12-16T20:49:20.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.121+0000 7f859c5ea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85941ed5a0 con 0x7f85940c22f0 2023-12-16T20:49:20.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.122+0000 7f859ab87640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8594157de0 0x7f85941eda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.122+0000 7f859a386640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85940c22f0 0x7f85941f12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.122+0000 7f8599b85640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8594151660 0x7f85940cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.122+0000 7f859ab87640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8594157de0 0x7f85941eda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44844/0 (socket says 172.21.15.87:44844) 2023-12-16T20:49:20.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.122+0000 7f859ab87640 1 -- 172.21.15.87:0/764038592 learned_addr learned my addr 172.21.15.87:0/764038592 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:20.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.125+0000 7f859ab87640 1 -- 172.21.15.87:0/764038592 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85940c22f0 msgr2=0x7f85941f12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.125+0000 7f859ab87640 1 --2- 172.21.15.87:0/764038592 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85940c22f0 0x7f85941f12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.125+0000 7f859ab87640 1 -- 172.21.15.87:0/764038592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8594151660 msgr2=0x7f85940cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.125+0000 7f859ab87640 1 --2- 172.21.15.87:0/764038592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8594151660 0x7f85940cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.125+0000 7f859ab87640 1 -- 172.21.15.87:0/764038592 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8590009400 con 0x7f8594157de0 2023-12-16T20:49:20.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.127+0000 7f859ab87640 1 --2- 172.21.15.87:0/764038592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8594157de0 0x7f85941eda30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f858c00efc0 tx=0x7f858c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:20.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.131+0000 7f858affd640 1 -- 172.21.15.87:0/764038592 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c009ba0 con 0x7f8594157de0 2023-12-16T20:49:20.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.131+0000 7f858affd640 1 -- 172.21.15.87:0/764038592 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858c00f040 con 0x7f8594157de0 2023-12-16T20:49:20.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.131+0000 7f859c5ea640 1 -- 172.21.15.87:0/764038592 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85940c4760 con 0x7f8594157de0 2023-12-16T20:49:20.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.131+0000 7f858affd640 1 -- 172.21.15.87:0/764038592 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c0146c0 con 0x7f8594157de0 2023-12-16T20:49:20.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.131+0000 7f859c5ea640 1 -- 172.21.15.87:0/764038592 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85941e2b90 con 0x7f8594157de0 2023-12-16T20:49:20.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.131+0000 7f859c5ea640 1 -- 172.21.15.87:0/764038592 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85940b2410 con 0x7f8594157de0 2023-12-16T20:49:20.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.149+0000 7f858affd640 1 -- 172.21.15.87:0/764038592 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f858c014820 con 0x7f8594157de0 2023-12-16T20:49:20.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.149+0000 7f858affd640 1 --2- 172.21.15.87:0/764038592 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f857806ae40 0x7f857806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.150+0000 7f859a386640 1 --2- 172.21.15.87:0/764038592 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f857806ae40 0x7f857806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.150+0000 7f859a386640 1 --2- 172.21.15.87:0/764038592 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f857806ae40 0x7f857806d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8584007fd0 tx=0x7f8584007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:20.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.152+0000 7f858affd640 1 -- 172.21.15.87:0/764038592 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f858c059570 con 0x7f8594157de0 2023-12-16T20:49:20.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.152+0000 7f858affd640 1 --2- 172.21.15.87:0/764038592 >> [v2:172.21.15.87:6802/2637031951,v1:172.21.15.87:6803/2637031951] conn(0x7f85780746a0 0x7f8578076b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.152+0000 7f858affd640 1 -- 172.21.15.87:0/764038592 --> [v2:172.21.15.87:6802/2637031951,v1:172.21.15.87:6803/2637031951] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8578077210 con 0x7f85780746a0 2023-12-16T20:49:20.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.153+0000 7f8599b85640 1 --2- 172.21.15.87:0/764038592 >> [v2:172.21.15.87:6802/2637031951,v1:172.21.15.87:6803/2637031951] conn(0x7f85780746a0 0x7f8578076b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.153+0000 7f8599b85640 1 --2- 172.21.15.87:0/764038592 >> [v2:172.21.15.87:6802/2637031951,v1:172.21.15.87:6803/2637031951] conn(0x7f85780746a0 0x7f8578076b40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:20.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.154+0000 7f858affd640 1 -- 172.21.15.87:0/764038592 <== osd.2 v2:172.21.15.87:6802/2637031951 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8578077210 con 0x7f85780746a0 2023-12-16T20:49:20.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.154+0000 7f858affd640 1 -- 172.21.15.87:0/764038592 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f858c0558b0 con 0x7f8594157de0 2023-12-16T20:49:20.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.167+0000 7f859c5ea640 1 -- 172.21.15.87:0/764038592 --> [v2:172.21.15.87:6802/2637031951,v1:172.21.15.87:6803/2637031951] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f85940c3470 con 0x7f85780746a0 2023-12-16T20:49:20.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.167+0000 7f858affd640 1 -- 172.21.15.87:0/764038592 <== osd.2 v2:172.21.15.87:6802/2637031951 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f859003f040 con 0x7f85780746a0 2023-12-16T20:49:20.168 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-12-16T20:49:20.168 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T20:49:20.169 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-12-16T20:49:20.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.167+0000 7f859c5ea640 1 -- 172.21.15.87:0/764038592 >> [v2:172.21.15.87:6802/2637031951,v1:172.21.15.87:6803/2637031951] conn(0x7f85780746a0 msgr2=0x7f8578076b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.168+0000 7f859c5ea640 1 --2- 172.21.15.87:0/764038592 >> [v2:172.21.15.87:6802/2637031951,v1:172.21.15.87:6803/2637031951] conn(0x7f85780746a0 0x7f8578076b40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.168+0000 7f859c5ea640 1 -- 172.21.15.87:0/764038592 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f857806ae40 msgr2=0x7f857806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.168+0000 7f859c5ea640 1 --2- 172.21.15.87:0/764038592 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f857806ae40 0x7f857806d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8584007fd0 tx=0x7f8584007e80 comp rx=0 tx=0).stop 2023-12-16T20:49:20.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.168+0000 7f859c5ea640 1 -- 172.21.15.87:0/764038592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8594157de0 msgr2=0x7f85941eda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.168+0000 7f859c5ea640 1 --2- 172.21.15.87:0/764038592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8594157de0 0x7f85941eda30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f858c00efc0 tx=0x7f858c00c490 comp rx=0 tx=0).stop 2023-12-16T20:49:20.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.168+0000 7f859ab87640 1 -- 172.21.15.87:0/764038592 reap_dead start 2023-12-16T20:49:20.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.168+0000 7f859c5ea640 1 -- 172.21.15.87:0/764038592 shutdown_connections 2023-12-16T20:49:20.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.168+0000 7f859c5ea640 1 -- 172.21.15.87:0/764038592 >> 172.21.15.87:0/764038592 conn(0x7f85940ccd90 msgr2=0x7f859406ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:20.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.168+0000 7f859c5ea640 1 -- 172.21.15.87:0/764038592 shutdown_connections 2023-12-16T20:49:20.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.168+0000 7f859c5ea640 1 -- 172.21.15.87:0/764038592 wait complete. 2023-12-16T20:49:20.179 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-16T20:49:20.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.280+0000 7fee342e0640 1 Processor -- start 2023-12-16T20:49:20.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.280+0000 7fee342e0640 1 -- start start 2023-12-16T20:49:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.281+0000 7fee342e0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee2c153890 0x7fee2c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.281+0000 7fee342e0640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fee2c0ceef0 0x7fee2c0cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.281+0000 7fee342e0640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2c15a700 con 0x7fee2c153c70 2023-12-16T20:49:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.281+0000 7fee342e0640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2c0ca870 con 0x7fee2c0ceef0 2023-12-16T20:49:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.281+0000 7fee342e0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c159af0 con 0x7fee2c153890 2023-12-16T20:49:20.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.282+0000 7fee3287d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fee2c0ceef0 0x7fee2c0cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.282+0000 7fee3207c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee2c153890 0x7fee2c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.282+0000 7fee3207c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee2c153890 0x7fee2c15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:56854/0 (socket says 172.21.15.87:56854) 2023-12-16T20:49:20.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.282+0000 7fee3207c640 1 -- 172.21.15.87:0/1489093207 learned_addr learned my addr 172.21.15.87:0/1489093207 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:20.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.284+0000 7fee3207c640 1 -- 172.21.15.87:0/1489093207 >> v2:172.21.15.195:3300/0 conn(0x7fee2c0ceef0 msgr2=0x7fee2c0cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:20.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.284+0000 7fee3207c640 1 --2- 172.21.15.87:0/1489093207 >> v2:172.21.15.195:3300/0 conn(0x7fee2c0ceef0 0x7fee2c0cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.284+0000 7fee3207c640 1 -- 172.21.15.87:0/1489093207 >> v1:172.21.15.195:6789/0 conn(0x7fee2c153c70 legacy=0x7fee2c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.284+0000 7fee3207c640 1 -- 172.21.15.87:0/1489093207 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c159dd0 con 0x7fee2c153890 2023-12-16T20:49:20.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.287+0000 7fee3207c640 1 --2- 172.21.15.87:0/1489093207 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee2c153890 0x7fee2c15d950 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fee28009e50 tx=0x7fee2802bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f076ca8e4c01417c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:20.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.291+0000 7fee3107a640 1 -- 172.21.15.87:0/1489093207 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2802cb90 con 0x7fee2c153890 2023-12-16T20:49:20.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.291+0000 7fee3107a640 1 -- 172.21.15.87:0/1489093207 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2802ccf0 con 0x7fee2c153890 2023-12-16T20:49:20.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.291+0000 7fee3107a640 1 -- 172.21.15.87:0/1489093207 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28034610 con 0x7fee2c153890 2023-12-16T20:49:20.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.291+0000 7fee342e0640 1 -- 172.21.15.87:0/1489093207 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee2c153890 msgr2=0x7fee2c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.291+0000 7fee342e0640 1 --2- 172.21.15.87:0/1489093207 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee2c153890 0x7fee2c15d950 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fee28009e50 tx=0x7fee2802bff0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.291+0000 7fee342e0640 1 -- 172.21.15.87:0/1489093207 shutdown_connections 2023-12-16T20:49:20.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.291+0000 7fee342e0640 1 --2- 172.21.15.87:0/1489093207 >> v2:172.21.15.195:3300/0 conn(0x7fee2c0ceef0 0x7fee2c0cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.291+0000 7fee342e0640 1 --2- 172.21.15.87:0/1489093207 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee2c153890 0x7fee2c15d950 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.291+0000 7fee342e0640 1 -- 172.21.15.87:0/1489093207 >> 172.21.15.87:0/1489093207 conn(0x7fee2c06ba00 msgr2=0x7fee2c06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:20.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.291+0000 7fee342e0640 1 -- 172.21.15.87:0/1489093207 shutdown_connections 2023-12-16T20:49:20.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.291+0000 7fee342e0640 1 -- 172.21.15.87:0/1489093207 wait complete. 2023-12-16T20:49:20.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.292+0000 7fee342e0640 1 Processor -- start 2023-12-16T20:49:20.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.292+0000 7fee342e0640 1 -- start start 2023-12-16T20:49:20.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.293+0000 7fee342e0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee2c0ceef0 0x7fee2c14f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.293+0000 7fee342e0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee2c153890 0x7fee2c14e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.293+0000 7fee342e0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee2c153c70 0x7fee2c147850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.293+0000 7fee342e0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c0ce2c0 con 0x7fee2c153c70 2023-12-16T20:49:20.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.293+0000 7fee342e0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c14fae0 con 0x7fee2c153890 2023-12-16T20:49:20.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.293+0000 7fee342e0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c0ceac0 con 0x7fee2c0ceef0 2023-12-16T20:49:20.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.293+0000 7fee3187b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee2c153890 0x7fee2c14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.293+0000 7fee3207c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee2c0ceef0 0x7fee2c14f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.294+0000 7fee3287d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee2c153c70 0x7fee2c147850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.294+0000 7fee3207c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee2c0ceef0 0x7fee2c14f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:56864/0 (socket says 172.21.15.87:56864) 2023-12-16T20:49:20.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.294+0000 7fee3207c640 1 -- 172.21.15.87:0/4075101664 learned_addr learned my addr 172.21.15.87:0/4075101664 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:20.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.297+0000 7fee3187b640 1 -- 172.21.15.87:0/4075101664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee2c0ceef0 msgr2=0x7fee2c14f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.297+0000 7fee3187b640 1 --2- 172.21.15.87:0/4075101664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee2c0ceef0 0x7fee2c14f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.297+0000 7fee3187b640 1 -- 172.21.15.87:0/4075101664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee2c153c70 msgr2=0x7fee2c147850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.297+0000 7fee3187b640 1 --2- 172.21.15.87:0/4075101664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee2c153c70 0x7fee2c147850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.297+0000 7fee3187b640 1 -- 172.21.15.87:0/4075101664 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee28009b30 con 0x7fee2c153890 2023-12-16T20:49:20.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.299+0000 7fee3187b640 1 --2- 172.21.15.87:0/4075101664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee2c153890 0x7fee2c14e700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00c420 tx=0x7fee1c00c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:20.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.301+0000 7fee22ffd640 1 -- 172.21.15.87:0/4075101664 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0052d0 con 0x7fee2c153890 2023-12-16T20:49:20.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.301+0000 7fee342e0640 1 -- 172.21.15.87:0/4075101664 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2c0b4360 con 0x7fee2c153890 2023-12-16T20:49:20.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.302+0000 7fee342e0640 1 -- 172.21.15.87:0/4075101664 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2c14dc40 con 0x7fee2c153890 2023-12-16T20:49:20.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.302+0000 7fee342e0640 1 -- 172.21.15.87:0/4075101664 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2c15aeb0 con 0x7fee2c153890 2023-12-16T20:49:20.506 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.506+0000 7fee22ffd640 1 -- 172.21.15.87:0/4075101664 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c005430 con 0x7fee2c153890 2023-12-16T20:49:20.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.547+0000 7fee22ffd640 1 -- 172.21.15.87:0/4075101664 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c007220 con 0x7fee2c153890 2023-12-16T20:49:20.548 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.547+0000 7fee22ffd640 1 -- 172.21.15.87:0/4075101664 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fee1c0073c0 con 0x7fee2c153890 2023-12-16T20:49:20.548 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.547+0000 7fee22ffd640 1 --2- 172.21.15.87:0/4075101664 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fee1006ae40 0x7fee1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.548 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.548+0000 7fee3207c640 1 --2- 172.21.15.87:0/4075101664 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fee1006ae40 0x7fee1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.548 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.548+0000 7fee3207c640 1 --2- 172.21.15.87:0/4075101664 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fee1006ae40 0x7fee1006d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fee28009e50 tx=0x7fee28030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.551+0000 7fee22ffd640 1 -- 172.21.15.87:0/4075101664 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fee1c057a00 con 0x7fee2c153890 2023-12-16T20:49:20.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.562+0000 7fee22ffd640 1 -- 172.21.15.87:0/4075101664 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fee1c053d40 con 0x7fee2c153890 2023-12-16T20:49:20.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.751+0000 7fee342e0640 1 -- 172.21.15.87:0/4075101664 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fee2c1597a0 con 0x7fee1006ae40 2023-12-16T20:49:20.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.752+0000 7fee22ffd640 1 -- 172.21.15.87:0/4075101664 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fee2803f440 con 0x7fee1006ae40 2023-12-16T20:49:20.752 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 2 to deep-scrub 2023-12-16T20:49:20.755 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.754+0000 7fee342e0640 1 -- 172.21.15.87:0/4075101664 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fee1006ae40 msgr2=0x7fee1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.755 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.754+0000 7fee342e0640 1 --2- 172.21.15.87:0/4075101664 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fee1006ae40 0x7fee1006d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fee28009e50 tx=0x7fee28030000 comp rx=0 tx=0).stop 2023-12-16T20:49:20.755 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.754+0000 7fee342e0640 1 -- 172.21.15.87:0/4075101664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee2c153890 msgr2=0x7fee2c14e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.755 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.754+0000 7fee342e0640 1 --2- 172.21.15.87:0/4075101664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee2c153890 0x7fee2c14e700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00c420 tx=0x7fee1c00c8e0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.755 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.754+0000 7fee342e0640 1 -- 172.21.15.87:0/4075101664 shutdown_connections 2023-12-16T20:49:20.755 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.754+0000 7fee342e0640 1 --2- 172.21.15.87:0/4075101664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee2c153c70 0x7fee2c147850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.755 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.754+0000 7fee342e0640 1 --2- 172.21.15.87:0/4075101664 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fee1006ae40 0x7fee1006d300 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.755 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.754+0000 7fee342e0640 1 --2- 172.21.15.87:0/4075101664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee2c153890 0x7fee2c14e700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.755 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.754+0000 7fee342e0640 1 --2- 172.21.15.87:0/4075101664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee2c0ceef0 0x7fee2c14f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.755 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.754+0000 7fee342e0640 1 -- 172.21.15.87:0/4075101664 >> 172.21.15.87:0/4075101664 conn(0x7fee2c06ba00 msgr2=0x7fee2c15c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:20.755 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.754+0000 7fee342e0640 1 -- 172.21.15.87:0/4075101664 shutdown_connections 2023-12-16T20:49:20.756 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.754+0000 7fee342e0640 1 -- 172.21.15.87:0/4075101664 wait complete. 2023-12-16T20:49:20.765 INFO:tasks.ceph:Scrubbing osd.3 2023-12-16T20:49:20.765 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-16T20:49:20.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.869+0000 7f778d3c2640 1 Processor -- start 2023-12-16T20:49:20.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.869+0000 7f778d3c2640 1 -- start start 2023-12-16T20:49:20.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.869+0000 7f778d3c2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f778806f330 0x7f778806e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.869+0000 7f778d3c2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f778806eb90 0x7f77880c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.869+0000 7f778d3c2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77880c3190 con 0x7f77881539a0 2023-12-16T20:49:20.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.869+0000 7f778d3c2640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77880c9740 con 0x7f778806f330 2023-12-16T20:49:20.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.869+0000 7f778d3c2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77880c78c0 con 0x7f778806eb90 2023-12-16T20:49:20.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.870+0000 7f77877fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f778806eb90 0x7f77880c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.870+0000 7f777ffff640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f778806f330 0x7f778806e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.870+0000 7f77877fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f778806eb90 0x7f77880c7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:51840/0 (socket says 172.21.15.87:51840) 2023-12-16T20:49:20.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.870+0000 7f77877fe640 1 -- 172.21.15.87:0/3347747394 learned_addr learned my addr 172.21.15.87:0/3347747394 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:20.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.872+0000 7f77877fe640 1 -- 172.21.15.87:0/3347747394 >> v2:172.21.15.195:3300/0 conn(0x7f778806f330 msgr2=0x7f778806e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:20.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.872+0000 7f77877fe640 1 --2- 172.21.15.87:0/3347747394 >> v2:172.21.15.195:3300/0 conn(0x7f778806f330 0x7f778806e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.872+0000 7f77877fe640 1 -- 172.21.15.87:0/3347747394 >> v1:172.21.15.195:6789/0 conn(0x7f77881539a0 legacy=0x7f7788159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.872+0000 7f77877fe640 1 -- 172.21.15.87:0/3347747394 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77880c3470 con 0x7f778806eb90 2023-12-16T20:49:20.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.876+0000 7f77877fe640 1 --2- 172.21.15.87:0/3347747394 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f778806eb90 0x7f77880c7d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7780009e50 tx=0x7f778002bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1997544755df4f12 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:20.881 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.880+0000 7f77867fc640 1 -- 172.21.15.87:0/3347747394 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778002cb90 con 0x7f778806eb90 2023-12-16T20:49:20.881 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.880+0000 7f77867fc640 1 -- 172.21.15.87:0/3347747394 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778002ccf0 con 0x7f778806eb90 2023-12-16T20:49:20.881 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.880+0000 7f77867fc640 1 -- 172.21.15.87:0/3347747394 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780034610 con 0x7f778806eb90 2023-12-16T20:49:20.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.881+0000 7f778d3c2640 1 -- 172.21.15.87:0/3347747394 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f778806eb90 msgr2=0x7f77880c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.881+0000 7f778d3c2640 1 --2- 172.21.15.87:0/3347747394 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f778806eb90 0x7f77880c7d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7780009e50 tx=0x7f778002bff0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.881+0000 7f778d3c2640 1 -- 172.21.15.87:0/3347747394 shutdown_connections 2023-12-16T20:49:20.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.881+0000 7f778d3c2640 1 --2- 172.21.15.87:0/3347747394 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f778806eb90 0x7f77880c7d10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.881+0000 7f778d3c2640 1 --2- 172.21.15.87:0/3347747394 >> v2:172.21.15.195:3300/0 conn(0x7f778806f330 0x7f778806e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.881+0000 7f778d3c2640 1 -- 172.21.15.87:0/3347747394 >> 172.21.15.87:0/3347747394 conn(0x7f77880ccd90 msgr2=0x7f77880cd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:20.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.881+0000 7f778d3c2640 1 -- 172.21.15.87:0/3347747394 shutdown_connections 2023-12-16T20:49:20.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.881+0000 7f778d3c2640 1 -- 172.21.15.87:0/3347747394 wait complete. 2023-12-16T20:49:20.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.882+0000 7f778d3c2640 1 Processor -- start 2023-12-16T20:49:20.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.882+0000 7f778d3c2640 1 -- start start 2023-12-16T20:49:20.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.883+0000 7f778d3c2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f778806eb90 0x7f7788159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.883+0000 7f778d3c2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f778806f330 0x7f7788154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.883+0000 7f778d3c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77881539a0 0x7f778814c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.883+0000 7f778d3c2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77881f3690 con 0x7f77881539a0 2023-12-16T20:49:20.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.883+0000 7f778d3c2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7788155190 con 0x7f778806eb90 2023-12-16T20:49:20.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.883+0000 7f778d3c2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77881f27c0 con 0x7f778806f330 2023-12-16T20:49:20.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.884+0000 7f77877fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77881539a0 0x7f778814c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.884+0000 7f777ffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f778806f330 0x7f7788154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.884+0000 7f7786ffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f778806eb90 0x7f7788159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.884+0000 7f77877fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77881539a0 0x7f778814c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52318/0 (socket says 172.21.15.87:52318) 2023-12-16T20:49:20.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.884+0000 7f77877fe640 1 -- 172.21.15.87:0/2681201113 learned_addr learned my addr 172.21.15.87:0/2681201113 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:20.888 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.887+0000 7f77877fe640 1 -- 172.21.15.87:0/2681201113 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f778806f330 msgr2=0x7f7788154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.888 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.887+0000 7f77877fe640 1 --2- 172.21.15.87:0/2681201113 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f778806f330 0x7f7788154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.888 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.887+0000 7f77877fe640 1 -- 172.21.15.87:0/2681201113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f778806eb90 msgr2=0x7f7788159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.888 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.887+0000 7f77877fe640 1 --2- 172.21.15.87:0/2681201113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f778806eb90 0x7f7788159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.888 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.887+0000 7f77877fe640 1 -- 172.21.15.87:0/2681201113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7780009b30 con 0x7f77881539a0 2023-12-16T20:49:20.890 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.889+0000 7f77877fe640 1 --2- 172.21.15.87:0/2681201113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77881539a0 0x7f778814c760 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7780036040 tx=0x7f7780004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:20.893 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.893+0000 7f777f7fe640 1 -- 172.21.15.87:0/2681201113 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778003e450 con 0x7f77881539a0 2023-12-16T20:49:20.893 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.893+0000 7f777f7fe640 1 -- 172.21.15.87:0/2681201113 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778003e5b0 con 0x7f77881539a0 2023-12-16T20:49:20.894 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.893+0000 7f777f7fe640 1 -- 172.21.15.87:0/2681201113 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778003e960 con 0x7f77881539a0 2023-12-16T20:49:20.894 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.893+0000 7f778d3c2640 1 -- 172.21.15.87:0/2681201113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7788156e00 con 0x7f77881539a0 2023-12-16T20:49:20.894 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.893+0000 7f778d3c2640 1 -- 172.21.15.87:0/2681201113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77881f2cf0 con 0x7f77881539a0 2023-12-16T20:49:20.894 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.894+0000 7f778d3c2640 1 -- 172.21.15.87:0/2681201113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f77880c3d10 con 0x7f77881539a0 2023-12-16T20:49:20.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.912+0000 7f777f7fe640 1 -- 172.21.15.87:0/2681201113 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f778003eac0 con 0x7f77881539a0 2023-12-16T20:49:20.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.912+0000 7f777f7fe640 1 --2- 172.21.15.87:0/2681201113 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f776806ae90 0x7f776806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.912+0000 7f7786ffd640 1 --2- 172.21.15.87:0/2681201113 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f776806ae90 0x7f776806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.913+0000 7f7786ffd640 1 --2- 172.21.15.87:0/2681201113 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f776806ae90 0x7f776806d350 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7778001780 tx=0x7f7778009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.916+0000 7f777f7fe640 1 -- 172.21.15.87:0/2681201113 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f778007b270 con 0x7f77881539a0 2023-12-16T20:49:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.916+0000 7f777f7fe640 1 --2- 172.21.15.87:0/2681201113 >> [v2:172.21.15.87:6818/2356258495,v1:172.21.15.87:6819/2356258495] conn(0x7f77680747f0 0x7f7768076c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.916+0000 7f777f7fe640 1 -- 172.21.15.87:0/2681201113 --> [v2:172.21.15.87:6818/2356258495,v1:172.21.15.87:6819/2356258495] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7768077360 con 0x7f77680747f0 2023-12-16T20:49:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.916+0000 7f777f7fe640 1 -- 172.21.15.87:0/2681201113 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77800775b0 con 0x7f77881539a0 2023-12-16T20:49:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.916+0000 7f777ffff640 1 --2- 172.21.15.87:0/2681201113 >> [v2:172.21.15.87:6818/2356258495,v1:172.21.15.87:6819/2356258495] conn(0x7f77680747f0 0x7f7768076c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.916+0000 7f777ffff640 1 --2- 172.21.15.87:0/2681201113 >> [v2:172.21.15.87:6818/2356258495,v1:172.21.15.87:6819/2356258495] conn(0x7f77680747f0 0x7f7768076c90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.917+0000 7f777f7fe640 1 -- 172.21.15.87:0/2681201113 <== osd.3 v2:172.21.15.87:6818/2356258495 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7768077360 con 0x7f77680747f0 2023-12-16T20:49:20.930 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.930+0000 7f778d3c2640 1 -- 172.21.15.87:0/2681201113 --> [v2:172.21.15.87:6818/2356258495,v1:172.21.15.87:6819/2356258495] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f77880c3a30 con 0x7f77680747f0 2023-12-16T20:49:20.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.930+0000 7f777f7fe640 1 -- 172.21.15.87:0/2681201113 <== osd.3 v2:172.21.15.87:6818/2356258495 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7770009d50 con 0x7f77680747f0 2023-12-16T20:49:20.931 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-12-16T20:49:20.931 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T20:49:20.931 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-12-16T20:49:20.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.930+0000 7f778d3c2640 1 -- 172.21.15.87:0/2681201113 >> [v2:172.21.15.87:6818/2356258495,v1:172.21.15.87:6819/2356258495] conn(0x7f77680747f0 msgr2=0x7f7768076c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.930+0000 7f778d3c2640 1 --2- 172.21.15.87:0/2681201113 >> [v2:172.21.15.87:6818/2356258495,v1:172.21.15.87:6819/2356258495] conn(0x7f77680747f0 0x7f7768076c90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:20.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.930+0000 7f778d3c2640 1 -- 172.21.15.87:0/2681201113 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f776806ae90 msgr2=0x7f776806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.930+0000 7f778d3c2640 1 --2- 172.21.15.87:0/2681201113 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f776806ae90 0x7f776806d350 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7778001780 tx=0x7f7778009040 comp rx=0 tx=0).stop 2023-12-16T20:49:20.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.930+0000 7f778d3c2640 1 -- 172.21.15.87:0/2681201113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77881539a0 msgr2=0x7f778814c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:20.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.930+0000 7f778d3c2640 1 --2- 172.21.15.87:0/2681201113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77881539a0 0x7f778814c760 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7780036040 tx=0x7f7780004a40 comp rx=0 tx=0).stop 2023-12-16T20:49:20.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.930+0000 7f77877fe640 1 -- 172.21.15.87:0/2681201113 reap_dead start 2023-12-16T20:49:20.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.930+0000 7f778d3c2640 1 -- 172.21.15.87:0/2681201113 shutdown_connections 2023-12-16T20:49:20.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.930+0000 7f778d3c2640 1 -- 172.21.15.87:0/2681201113 >> 172.21.15.87:0/2681201113 conn(0x7f77880ccd90 msgr2=0x7f77880c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:20.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.930+0000 7f778d3c2640 1 -- 172.21.15.87:0/2681201113 shutdown_connections 2023-12-16T20:49:20.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:20.930+0000 7f778d3c2640 1 -- 172.21.15.87:0/2681201113 wait complete. 2023-12-16T20:49:20.942 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-16T20:49:21.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.043+0000 7fd35f568640 1 Processor -- start 2023-12-16T20:49:21.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.044+0000 7fd35f568640 1 -- start start 2023-12-16T20:49:21.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.044+0000 7fd35f568640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd35815d950 0x7fd35815aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.044+0000 7fd35f568640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35815a700 con 0x7fd358153890 2023-12-16T20:49:21.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.044+0000 7fd35f568640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3580ca870 con 0x7fd358153c70 2023-12-16T20:49:21.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.044+0000 7fd35f568640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35815dd60 con 0x7fd35815d950 2023-12-16T20:49:21.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.045+0000 7fd35d304640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd358153890 0x7fd3580c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34932/0 (socket says 172.21.15.87:34932) 2023-12-16T20:49:21.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.045+0000 7fd35d304640 1 -- 172.21.15.87:0/4112752401 learned_addr learned my addr 172.21.15.87:0/4112752401 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:49:21.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.045+0000 7fd35db05640 1 --2- 172.21.15.87:0/4112752401 >> v2:172.21.15.195:3300/0 conn(0x7fd35815d950 0x7fd35815aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:21.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.047+0000 7fd34ffff640 1 -- 172.21.15.87:0/4112752401 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223618958 0 0) 0x7fd35815a700 con 0x7fd358153890 2023-12-16T20:49:21.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.047+0000 7fd34ffff640 1 -- 172.21.15.87:0/4112752401 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd344003520 con 0x7fd358153890 2023-12-16T20:49:21.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.048+0000 7fd35db05640 1 -- 172.21.15.87:0/4112752401 >> v1:172.21.15.195:6789/0 conn(0x7fd358153c70 legacy=0x7fd3580ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:21.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.048+0000 7fd35db05640 1 -- 172.21.15.87:0/4112752401 >> v1:172.21.15.87:6789/0 conn(0x7fd358153890 legacy=0x7fd3580c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:21.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.048+0000 7fd35db05640 1 -- 172.21.15.87:0/4112752401 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd358159af0 con 0x7fd35815d950 2023-12-16T20:49:21.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.052+0000 7fd35db05640 1 --2- 172.21.15.87:0/4112752401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd35815d950 0x7fd35815aed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd3500097a0 tx=0x7fd35002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b797634b89abf29 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:21.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.055+0000 7fd34ffff640 1 -- 172.21.15.87:0/4112752401 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35002f810 con 0x7fd35815d950 2023-12-16T20:49:21.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.055+0000 7fd34ffff640 1 -- 172.21.15.87:0/4112752401 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35002f970 con 0x7fd35815d950 2023-12-16T20:49:21.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.055+0000 7fd34ffff640 1 -- 172.21.15.87:0/4112752401 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35002fd00 con 0x7fd35815d950 2023-12-16T20:49:21.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.056+0000 7fd35f568640 1 -- 172.21.15.87:0/4112752401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd35815d950 msgr2=0x7fd35815aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:21.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.056+0000 7fd35f568640 1 --2- 172.21.15.87:0/4112752401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd35815d950 0x7fd35815aed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd3500097a0 tx=0x7fd35002b9f0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.056+0000 7fd35f568640 1 -- 172.21.15.87:0/4112752401 shutdown_connections 2023-12-16T20:49:21.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.056+0000 7fd35f568640 1 --2- 172.21.15.87:0/4112752401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd35815d950 0x7fd35815aed0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.056+0000 7fd35f568640 1 -- 172.21.15.87:0/4112752401 >> 172.21.15.87:0/4112752401 conn(0x7fd35806ba00 msgr2=0x7fd35806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:21.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.056+0000 7fd35f568640 1 -- 172.21.15.87:0/4112752401 shutdown_connections 2023-12-16T20:49:21.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.056+0000 7fd35f568640 1 -- 172.21.15.87:0/4112752401 wait complete. 2023-12-16T20:49:21.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.057+0000 7fd35f568640 1 Processor -- start 2023-12-16T20:49:21.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.057+0000 7fd35f568640 1 -- start start 2023-12-16T20:49:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.058+0000 7fd35f568640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd358153890 0x7fd358149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.058+0000 7fd35f568640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd358153c70 0x7fd35814f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.058+0000 7fd35f568640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd35815d950 0x7fd35814de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.058+0000 7fd35f568640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35814a2a0 con 0x7fd35815d950 2023-12-16T20:49:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.058+0000 7fd35f568640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd358155f70 con 0x7fd358153c70 2023-12-16T20:49:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.058+0000 7fd35f568640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35814f180 con 0x7fd358153890 2023-12-16T20:49:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.058+0000 7fd35db05640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd35815d950 0x7fd35814de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.058+0000 7fd35cb03640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd358153c70 0x7fd35814f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.058+0000 7fd35d304640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd358153890 0x7fd358149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.058+0000 7fd35db05640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd35815d950 0x7fd35814de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52334/0 (socket says 172.21.15.87:52334) 2023-12-16T20:49:21.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.058+0000 7fd35db05640 1 -- 172.21.15.87:0/4211084516 learned_addr learned my addr 172.21.15.87:0/4211084516 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:21.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.062+0000 7fd35cb03640 1 -- 172.21.15.87:0/4211084516 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd358153890 msgr2=0x7fd358149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:21.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.062+0000 7fd35cb03640 1 --2- 172.21.15.87:0/4211084516 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd358153890 0x7fd358149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.062+0000 7fd35cb03640 1 -- 172.21.15.87:0/4211084516 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd35815d950 msgr2=0x7fd35814de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:21.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.062+0000 7fd35cb03640 1 --2- 172.21.15.87:0/4211084516 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd35815d950 0x7fd35814de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.062+0000 7fd35cb03640 1 -- 172.21.15.87:0/4211084516 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd350009400 con 0x7fd358153c70 2023-12-16T20:49:21.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.064+0000 7fd35cb03640 1 --2- 172.21.15.87:0/4211084516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd358153c70 0x7fd35814f660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd34800c370 tx=0x7fd34800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:21.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.068+0000 7fd34dffb640 1 -- 172.21.15.87:0/4211084516 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3480052d0 con 0x7fd358153c70 2023-12-16T20:49:21.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.068+0000 7fd34dffb640 1 -- 172.21.15.87:0/4211084516 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd348005450 con 0x7fd358153c70 2023-12-16T20:49:21.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.068+0000 7fd34dffb640 1 -- 172.21.15.87:0/4211084516 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348007260 con 0x7fd358153c70 2023-12-16T20:49:21.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.068+0000 7fd35f568640 1 -- 172.21.15.87:0/4211084516 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd358154580 con 0x7fd358153c70 2023-12-16T20:49:21.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.068+0000 7fd35f568640 1 -- 172.21.15.87:0/4211084516 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35814e850 con 0x7fd358153c70 2023-12-16T20:49:21.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.069+0000 7fd35f568640 1 -- 172.21.15.87:0/4211084516 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd358067500 con 0x7fd358153c70 2023-12-16T20:49:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.087+0000 7fd34dffb640 1 -- 172.21.15.87:0/4211084516 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fd3480073c0 con 0x7fd358153c70 2023-12-16T20:49:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.087+0000 7fd34dffb640 1 --2- 172.21.15.87:0/4211084516 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd33c06ae90 0x7fd33c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.087+0000 7fd35d304640 1 --2- 172.21.15.87:0/4211084516 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd33c06ae90 0x7fd33c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.088+0000 7fd35d304640 1 --2- 172.21.15.87:0/4211084516 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd33c06ae90 0x7fd33c06d350 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd354001560 tx=0x7fd3540019f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:21.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.090+0000 7fd34dffb640 1 -- 172.21.15.87:0/4211084516 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd348057bc0 con 0x7fd358153c70 2023-12-16T20:49:21.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.329+0000 7fd34dffb640 1 -- 172.21.15.87:0/4211084516 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fd348053f00 con 0x7fd358153c70 2023-12-16T20:49:21.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.493+0000 7fd35f568640 1 -- 172.21.15.87:0/4211084516 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3580c9d70 con 0x7fd33c06ae90 2023-12-16T20:49:21.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.494+0000 7fd34dffb640 1 -- 172.21.15.87:0/4211084516 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd3580c9d70 con 0x7fd33c06ae90 2023-12-16T20:49:21.495 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 3 to deep-scrub 2023-12-16T20:49:21.497 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.496+0000 7fd35f568640 1 -- 172.21.15.87:0/4211084516 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd33c06ae90 msgr2=0x7fd33c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:21.497 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.496+0000 7fd35f568640 1 --2- 172.21.15.87:0/4211084516 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd33c06ae90 0x7fd33c06d350 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd354001560 tx=0x7fd3540019f0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.497 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.496+0000 7fd35f568640 1 -- 172.21.15.87:0/4211084516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd358153c70 msgr2=0x7fd35814f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:21.497 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.496+0000 7fd35f568640 1 --2- 172.21.15.87:0/4211084516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd358153c70 0x7fd35814f660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd34800c370 tx=0x7fd34800c830 comp rx=0 tx=0).stop 2023-12-16T20:49:21.497 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.496+0000 7fd35f568640 1 -- 172.21.15.87:0/4211084516 shutdown_connections 2023-12-16T20:49:21.497 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.496+0000 7fd35f568640 1 --2- 172.21.15.87:0/4211084516 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd35815d950 0x7fd35814de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.498 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.496+0000 7fd35f568640 1 --2- 172.21.15.87:0/4211084516 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd33c06ae90 0x7fd33c06d350 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.498 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.496+0000 7fd35f568640 1 --2- 172.21.15.87:0/4211084516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd358153c70 0x7fd35814f660 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.498 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.496+0000 7fd35f568640 1 --2- 172.21.15.87:0/4211084516 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd358153890 0x7fd358149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.498 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.496+0000 7fd35f568640 1 -- 172.21.15.87:0/4211084516 >> 172.21.15.87:0/4211084516 conn(0x7fd35806ba00 msgr2=0x7fd35815b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:21.498 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.496+0000 7fd35f568640 1 -- 172.21.15.87:0/4211084516 shutdown_connections 2023-12-16T20:49:21.498 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.496+0000 7fd35f568640 1 -- 172.21.15.87:0/4211084516 wait complete. 2023-12-16T20:49:21.508 INFO:tasks.ceph:Scrubbing osd.4 2023-12-16T20:49:21.508 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-16T20:49:21.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.615+0000 7fef5d07c640 1 Processor -- start 2023-12-16T20:49:21.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.616+0000 7fef5d07c640 1 -- start start 2023-12-16T20:49:21.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.616+0000 7fef5d07c640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fef58151660 0x7fef58157de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.616+0000 7fef5d07c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fef580c8fa0 0x7fef580c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.616+0000 7fef5d07c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef580c9430 0x7fef580c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.616+0000 7fef5d07c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef58151a40 con 0x7fef580c8fa0 2023-12-16T20:49:21.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.616+0000 7fef5d07c640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef580c2c10 con 0x7fef58151660 2023-12-16T20:49:21.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.616+0000 7fef5d07c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef580c2eb0 con 0x7fef580c9430 2023-12-16T20:49:21.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.639+0000 7fef4ffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fef580c8fa0 0x7fef580c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:21.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.639+0000 7fef4ffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fef580c8fa0 0x7fef580c1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52344/0 (socket says 172.21.15.87:52344) 2023-12-16T20:49:21.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.639+0000 7fef4ffff640 1 -- 172.21.15.87:0/385537761 learned_addr learned my addr 172.21.15.87:0/385537761 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:21.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.641+0000 7fef4ffff640 1 -- 172.21.15.87:0/385537761 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef580c9430 msgr2=0x7fef580c22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:21.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.641+0000 7fef4ffff640 1 --2- 172.21.15.87:0/385537761 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef580c9430 0x7fef580c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.641+0000 7fef4ffff640 1 -- 172.21.15.87:0/385537761 >> v2:172.21.15.195:3300/0 conn(0x7fef58151660 msgr2=0x7fef58157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:21.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.641+0000 7fef4ffff640 1 --2- 172.21.15.87:0/385537761 >> v2:172.21.15.195:3300/0 conn(0x7fef58151660 0x7fef58157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.641+0000 7fef4ffff640 1 -- 172.21.15.87:0/385537761 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef580c3190 con 0x7fef580c8fa0 2023-12-16T20:49:21.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.643+0000 7fef4ffff640 1 --2- 172.21.15.87:0/385537761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef580c8fa0 0x7fef580c1db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fef58071a80 tx=0x7fef4002b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab27716ba8738853 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:21.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.647+0000 7fef5659c640 1 -- 172.21.15.87:0/385537761 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40030880 con 0x7fef580c8fa0 2023-12-16T20:49:21.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.647+0000 7fef5659c640 1 -- 172.21.15.87:0/385537761 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef400309e0 con 0x7fef580c8fa0 2023-12-16T20:49:21.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.647+0000 7fef5659c640 1 -- 172.21.15.87:0/385537761 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40030d70 con 0x7fef580c8fa0 2023-12-16T20:49:21.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.647+0000 7fef5d07c640 1 -- 172.21.15.87:0/385537761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef580c8fa0 msgr2=0x7fef580c1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:21.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.647+0000 7fef5d07c640 1 --2- 172.21.15.87:0/385537761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef580c8fa0 0x7fef580c1db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fef58071a80 tx=0x7fef4002b9c0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.647+0000 7fef5d07c640 1 -- 172.21.15.87:0/385537761 shutdown_connections 2023-12-16T20:49:21.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.647+0000 7fef5d07c640 1 --2- 172.21.15.87:0/385537761 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef580c9430 0x7fef580c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.647+0000 7fef5d07c640 1 --2- 172.21.15.87:0/385537761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef580c8fa0 0x7fef580c1db0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.647+0000 7fef5d07c640 1 --2- 172.21.15.87:0/385537761 >> v2:172.21.15.195:3300/0 conn(0x7fef58151660 0x7fef58157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.647+0000 7fef5d07c640 1 -- 172.21.15.87:0/385537761 >> 172.21.15.87:0/385537761 conn(0x7fef580ccd90 msgr2=0x7fef580cd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:21.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.648+0000 7fef5d07c640 1 -- 172.21.15.87:0/385537761 shutdown_connections 2023-12-16T20:49:21.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.648+0000 7fef5d07c640 1 -- 172.21.15.87:0/385537761 wait complete. 2023-12-16T20:49:21.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.649+0000 7fef5d07c640 1 Processor -- start 2023-12-16T20:49:21.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.649+0000 7fef5d07c640 1 -- start start 2023-12-16T20:49:21.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.650+0000 7fef5d07c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef580c8fa0 0x7fef581ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.650+0000 7fef5d07c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef580c9430 0x7fef58156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.650+0000 7fef5d07c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef58151660 0x7fef5815ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.650+0000 7fef5d07c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5814a600 con 0x7fef580c9430 2023-12-16T20:49:21.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.650+0000 7fef5d07c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef58157270 con 0x7fef58151660 2023-12-16T20:49:21.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.650+0000 7fef5d07c640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef58149cf0 con 0x7fef580c8fa0 2023-12-16T20:49:21.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.650+0000 7fef56d9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef580c8fa0 0x7fef581ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:21.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.650+0000 7fef5759e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef58151660 0x7fef5815ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:21.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.650+0000 7fef56d9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef580c8fa0 0x7fef581ed570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:51882/0 (socket says 172.21.15.87:51882) 2023-12-16T20:49:21.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.650+0000 7fef56d9d640 1 -- 172.21.15.87:0/2257301713 learned_addr learned my addr 172.21.15.87:0/2257301713 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:21.654 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.654+0000 7fef56d9d640 1 -- 172.21.15.87:0/2257301713 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef58151660 msgr2=0x7fef5815ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:21.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.654+0000 7fef56d9d640 1 --2- 172.21.15.87:0/2257301713 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef58151660 0x7fef5815ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.654+0000 7fef56d9d640 1 -- 172.21.15.87:0/2257301713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef580c9430 msgr2=0x7fef58156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:21.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.654+0000 7fef56d9d640 1 --2- 172.21.15.87:0/2257301713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef580c9430 0x7fef58156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.654+0000 7fef56d9d640 1 -- 172.21.15.87:0/2257301713 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef400094d0 con 0x7fef580c8fa0 2023-12-16T20:49:21.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.657+0000 7fef56d9d640 1 --2- 172.21.15.87:0/2257301713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef580c8fa0 0x7fef581ed570 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef4800b440 tx=0x7fef4800b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:21.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.659+0000 7fef4f7fe640 1 -- 172.21.15.87:0/2257301713 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48011830 con 0x7fef580c8fa0 2023-12-16T20:49:21.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.659+0000 7fef5d07c640 1 -- 172.21.15.87:0/2257301713 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef581edab0 con 0x7fef580c8fa0 2023-12-16T20:49:21.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.659+0000 7fef5d07c640 1 -- 172.21.15.87:0/2257301713 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef58155880 con 0x7fef580c8fa0 2023-12-16T20:49:21.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.660+0000 7fef5d07c640 1 -- 172.21.15.87:0/2257301713 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef580c74f0 con 0x7fef580c8fa0 2023-12-16T20:49:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.679+0000 7fef4f7fe640 1 -- 172.21.15.87:0/2257301713 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef580c74f0 con 0x7fef580c8fa0 2023-12-16T20:49:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.679+0000 7fef4f7fe640 1 -- 172.21.15.87:0/2257301713 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48011b90 con 0x7fef580c8fa0 2023-12-16T20:49:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.680+0000 7fef4f7fe640 1 -- 172.21.15.87:0/2257301713 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fef4801a400 con 0x7fef580c8fa0 2023-12-16T20:49:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.681+0000 7fef4f7fe640 1 --2- 172.21.15.87:0/2257301713 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fef3806ae40 0x7fef3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.681+0000 7fef4ffff640 1 --2- 172.21.15.87:0/2257301713 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fef3806ae40 0x7fef3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.681+0000 7fef4ffff640 1 --2- 172.21.15.87:0/2257301713 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fef3806ae40 0x7fef3806d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fef40036000 tx=0x7fef4003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:21.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.683+0000 7fef4f7fe640 1 -- 172.21.15.87:0/2257301713 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fef48059030 con 0x7fef580c8fa0 2023-12-16T20:49:21.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.683+0000 7fef4f7fe640 1 --2- 172.21.15.87:0/2257301713 >> [v2:172.21.15.195:6824/265859371,v1:172.21.15.195:6825/265859371] conn(0x7fef380746a0 0x7fef38076b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.683+0000 7fef4f7fe640 1 -- 172.21.15.87:0/2257301713 --> [v2:172.21.15.195:6824/265859371,v1:172.21.15.195:6825/265859371] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef38077210 con 0x7fef380746a0 2023-12-16T20:49:21.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.684+0000 7fef5759e640 1 --2- 172.21.15.87:0/2257301713 >> [v2:172.21.15.195:6824/265859371,v1:172.21.15.195:6825/265859371] conn(0x7fef380746a0 0x7fef38076b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:21.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.684+0000 7fef5759e640 1 --2- 172.21.15.87:0/2257301713 >> [v2:172.21.15.195:6824/265859371,v1:172.21.15.195:6825/265859371] conn(0x7fef380746a0 0x7fef38076b40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:21.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.685+0000 7fef4f7fe640 1 -- 172.21.15.87:0/2257301713 <== osd.4 v2:172.21.15.195:6824/265859371 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fef38077210 con 0x7fef380746a0 2023-12-16T20:49:21.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.698+0000 7fef5d07c640 1 -- 172.21.15.87:0/2257301713 --> [v2:172.21.15.195:6824/265859371,v1:172.21.15.195:6825/265859371] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fef580c3750 con 0x7fef380746a0 2023-12-16T20:49:21.699 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.698+0000 7fef4f7fe640 1 -- 172.21.15.87:0/2257301713 <== osd.4 v2:172.21.15.195:6824/265859371 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fef5000a4e0 con 0x7fef380746a0 2023-12-16T20:49:21.699 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-12-16T20:49:21.699 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T20:49:21.699 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-12-16T20:49:21.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.698+0000 7fef5d07c640 1 -- 172.21.15.87:0/2257301713 >> [v2:172.21.15.195:6824/265859371,v1:172.21.15.195:6825/265859371] conn(0x7fef380746a0 msgr2=0x7fef38076b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:21.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.698+0000 7fef5d07c640 1 --2- 172.21.15.87:0/2257301713 >> [v2:172.21.15.195:6824/265859371,v1:172.21.15.195:6825/265859371] conn(0x7fef380746a0 0x7fef38076b40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.699+0000 7fef5d07c640 1 -- 172.21.15.87:0/2257301713 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fef3806ae40 msgr2=0x7fef3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:21.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.699+0000 7fef5d07c640 1 --2- 172.21.15.87:0/2257301713 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fef3806ae40 0x7fef3806d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fef40036000 tx=0x7fef4003b040 comp rx=0 tx=0).stop 2023-12-16T20:49:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.699+0000 7fef5d07c640 1 -- 172.21.15.87:0/2257301713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef580c8fa0 msgr2=0x7fef581ed570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.699+0000 7fef5d07c640 1 --2- 172.21.15.87:0/2257301713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef580c8fa0 0x7fef581ed570 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef4800b440 tx=0x7fef4800b900 comp rx=0 tx=0).stop 2023-12-16T20:49:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.699+0000 7fef5759e640 1 -- 172.21.15.87:0/2257301713 reap_dead start 2023-12-16T20:49:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.699+0000 7fef5d07c640 1 -- 172.21.15.87:0/2257301713 shutdown_connections 2023-12-16T20:49:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.699+0000 7fef5d07c640 1 -- 172.21.15.87:0/2257301713 >> 172.21.15.87:0/2257301713 conn(0x7fef580ccd90 msgr2=0x7fef580cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.699+0000 7fef5d07c640 1 -- 172.21.15.87:0/2257301713 shutdown_connections 2023-12-16T20:49:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.699+0000 7fef5d07c640 1 -- 172.21.15.87:0/2257301713 wait complete. 2023-12-16T20:49:21.711 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-16T20:49:21.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.812+0000 7fcb5a60e640 1 Processor -- start 2023-12-16T20:49:21.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.812+0000 7fcb5a60e640 1 -- start start 2023-12-16T20:49:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.813+0000 7fcb5a60e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcb54153c70 0x7fcb5415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.813+0000 7fcb5a60e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb540ceef0 0x7fcb540cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.813+0000 7fcb5a60e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb5415a700 con 0x7fcb54153890 2023-12-16T20:49:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.813+0000 7fcb5a60e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb540ca870 con 0x7fcb54153c70 2023-12-16T20:49:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.813+0000 7fcb5a60e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb54159af0 con 0x7fcb540ceef0 2023-12-16T20:49:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.814+0000 7fcb53fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fcb54153890 0x7fcb540c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34936/0 (socket says 172.21.15.87:34936) 2023-12-16T20:49:21.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.814+0000 7fcb53fff640 1 -- 172.21.15.87:0/1011696695 learned_addr learned my addr 172.21.15.87:0/1011696695 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:49:21.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.814+0000 7fcb537fe640 1 --2- 172.21.15.87:0/1011696695 >> v2:172.21.15.195:3300/0 conn(0x7fcb54153c70 0x7fcb5415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:21.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.814+0000 7fcb58bab640 1 --2- 172.21.15.87:0/1011696695 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb540ceef0 0x7fcb540cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:21.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.816+0000 7fcb52ffd640 1 -- 172.21.15.87:0/1011696695 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877323733 0 0) 0x7fcb5415a700 con 0x7fcb54153890 2023-12-16T20:49:21.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.816+0000 7fcb52ffd640 1 -- 172.21.15.87:0/1011696695 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb40003520 con 0x7fcb54153890 2023-12-16T20:49:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.816+0000 7fcb58bab640 1 -- 172.21.15.87:0/1011696695 >> v2:172.21.15.195:3300/0 conn(0x7fcb54153c70 msgr2=0x7fcb5415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.816+0000 7fcb58bab640 1 --2- 172.21.15.87:0/1011696695 >> v2:172.21.15.195:3300/0 conn(0x7fcb54153c70 0x7fcb5415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.816+0000 7fcb58bab640 1 -- 172.21.15.87:0/1011696695 >> v1:172.21.15.87:6789/0 conn(0x7fcb54153890 legacy=0x7fcb540c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.816+0000 7fcb58bab640 1 -- 172.21.15.87:0/1011696695 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb54159dd0 con 0x7fcb540ceef0 2023-12-16T20:49:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.818+0000 7fcb58bab640 1 --2- 172.21.15.87:0/1011696695 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb540ceef0 0x7fcb540cf320 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009d90 tx=0x7fcb4c02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d6070ecd7ab51e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.822+0000 7fcb52ffd640 1 -- 172.21.15.87:0/1011696695 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c02cce0 con 0x7fcb540ceef0 2023-12-16T20:49:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.822+0000 7fcb52ffd640 1 -- 172.21.15.87:0/1011696695 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c02ce40 con 0x7fcb540ceef0 2023-12-16T20:49:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.822+0000 7fcb52ffd640 1 -- 172.21.15.87:0/1011696695 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c034660 con 0x7fcb540ceef0 2023-12-16T20:49:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.823+0000 7fcb5a60e640 1 -- 172.21.15.87:0/1011696695 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb540ceef0 msgr2=0x7fcb540cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.823+0000 7fcb5a60e640 1 --2- 172.21.15.87:0/1011696695 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb540ceef0 0x7fcb540cf320 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009d90 tx=0x7fcb4c02bf30 comp rx=0 tx=0).stop 2023-12-16T20:49:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.823+0000 7fcb5a60e640 1 -- 172.21.15.87:0/1011696695 shutdown_connections 2023-12-16T20:49:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.823+0000 7fcb5a60e640 1 --2- 172.21.15.87:0/1011696695 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb540ceef0 0x7fcb540cf320 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.823+0000 7fcb5a60e640 1 --2- 172.21.15.87:0/1011696695 >> v2:172.21.15.195:3300/0 conn(0x7fcb54153c70 0x7fcb5415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.823+0000 7fcb5a60e640 1 -- 172.21.15.87:0/1011696695 >> 172.21.15.87:0/1011696695 conn(0x7fcb5406ba00 msgr2=0x7fcb5406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.823+0000 7fcb5a60e640 1 -- 172.21.15.87:0/1011696695 shutdown_connections 2023-12-16T20:49:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.823+0000 7fcb5a60e640 1 -- 172.21.15.87:0/1011696695 wait complete. 2023-12-16T20:49:21.825 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.824+0000 7fcb5a60e640 1 Processor -- start 2023-12-16T20:49:21.825 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.824+0000 7fcb5a60e640 1 -- start start 2023-12-16T20:49:21.825 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.825+0000 7fcb5a60e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb540ceef0 0x7fcb540c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.825+0000 7fcb5a60e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb54153890 0x7fcb540cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.825+0000 7fcb5a60e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb54153c70 0x7fcb540cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.825+0000 7fcb5a60e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb541528d0 con 0x7fcb540ceef0 2023-12-16T20:49:21.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.825+0000 7fcb5a60e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb54152010 con 0x7fcb54153890 2023-12-16T20:49:21.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.825+0000 7fcb5a60e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540b4af0 con 0x7fcb54153c70 2023-12-16T20:49:21.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.825+0000 7fcb53fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb540ceef0 0x7fcb540c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:21.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.825+0000 7fcb58bab640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb54153c70 0x7fcb540cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:21.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.825+0000 7fcb537fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb54153890 0x7fcb540cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:21.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.825+0000 7fcb53fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb540ceef0 0x7fcb540c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52370/0 (socket says 172.21.15.87:52370) 2023-12-16T20:49:21.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.825+0000 7fcb53fff640 1 -- 172.21.15.87:0/1980644138 learned_addr learned my addr 172.21.15.87:0/1980644138 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:21.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.829+0000 7fcb53fff640 1 -- 172.21.15.87:0/1980644138 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb54153c70 msgr2=0x7fcb540cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:21.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.829+0000 7fcb53fff640 1 --2- 172.21.15.87:0/1980644138 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb54153c70 0x7fcb540cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.829+0000 7fcb53fff640 1 -- 172.21.15.87:0/1980644138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb54153890 msgr2=0x7fcb540cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:21.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.829+0000 7fcb53fff640 1 --2- 172.21.15.87:0/1980644138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb54153890 0x7fcb540cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:21.830 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.829+0000 7fcb53fff640 1 -- 172.21.15.87:0/1980644138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c009a70 con 0x7fcb540ceef0 2023-12-16T20:49:21.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.831+0000 7fcb53fff640 1 --2- 172.21.15.87:0/1980644138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb540ceef0 0x7fcb540c52d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00c430 tx=0x7fcb3c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:21.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.834+0000 7fcb50ff9640 1 -- 172.21.15.87:0/1980644138 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c005ce0 con 0x7fcb540ceef0 2023-12-16T20:49:21.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.835+0000 7fcb50ff9640 1 -- 172.21.15.87:0/1980644138 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c005e40 con 0x7fcb540ceef0 2023-12-16T20:49:21.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.835+0000 7fcb5a60e640 1 -- 172.21.15.87:0/1980644138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb540b4db0 con 0x7fcb540ceef0 2023-12-16T20:49:21.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.835+0000 7fcb50ff9640 1 -- 172.21.15.87:0/1980644138 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0072f0 con 0x7fcb540ceef0 2023-12-16T20:49:21.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.835+0000 7fcb5a60e640 1 -- 172.21.15.87:0/1980644138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb54152560 con 0x7fcb540ceef0 2023-12-16T20:49:21.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.836+0000 7fcb5a60e640 1 -- 172.21.15.87:0/1980644138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb54152720 con 0x7fcb540ceef0 2023-12-16T20:49:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.854+0000 7fcb50ff9640 1 -- 172.21.15.87:0/1980644138 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fcb3c007450 con 0x7fcb540ceef0 2023-12-16T20:49:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.855+0000 7fcb50ff9640 1 --2- 172.21.15.87:0/1980644138 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fcb3406ae90 0x7fcb3406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.855+0000 7fcb537fe640 1 --2- 172.21.15.87:0/1980644138 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fcb3406ae90 0x7fcb3406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:21.855+0000 7fcb537fe640 1 --2- 172.21.15.87:0/1980644138 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fcb3406ae90 0x7fcb3406d350 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcb540b5440 tx=0x7fcb44009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:22.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.088+0000 7fcb50ff9640 1 -- 172.21.15.87:0/1980644138 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fcb3c057ed0 con 0x7fcb540ceef0 2023-12-16T20:49:22.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.088+0000 7fcb50ff9640 1 -- 172.21.15.87:0/1980644138 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fcb3c054210 con 0x7fcb540ceef0 2023-12-16T20:49:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.259+0000 7fcb5a60e640 1 -- 172.21.15.87:0/1980644138 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb541597a0 con 0x7fcb3406ae90 2023-12-16T20:49:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.259+0000 7fcb50ff9640 1 -- 172.21.15.87:0/1980644138 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcb44004020 con 0x7fcb3406ae90 2023-12-16T20:49:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 4 to deep-scrub 2023-12-16T20:49:22.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.261+0000 7fcb5a60e640 1 -- 172.21.15.87:0/1980644138 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fcb3406ae90 msgr2=0x7fcb3406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:22.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.261+0000 7fcb5a60e640 1 --2- 172.21.15.87:0/1980644138 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fcb3406ae90 0x7fcb3406d350 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcb540b5440 tx=0x7fcb44009190 comp rx=0 tx=0).stop 2023-12-16T20:49:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.261+0000 7fcb5a60e640 1 -- 172.21.15.87:0/1980644138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb540ceef0 msgr2=0x7fcb540c52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.261+0000 7fcb5a60e640 1 --2- 172.21.15.87:0/1980644138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb540ceef0 0x7fcb540c52d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00c430 tx=0x7fcb3c00c8f0 comp rx=0 tx=0).stop 2023-12-16T20:49:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.261+0000 7fcb5a60e640 1 -- 172.21.15.87:0/1980644138 shutdown_connections 2023-12-16T20:49:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.261+0000 7fcb5a60e640 1 --2- 172.21.15.87:0/1980644138 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb54153c70 0x7fcb540cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.261+0000 7fcb5a60e640 1 --2- 172.21.15.87:0/1980644138 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fcb3406ae90 0x7fcb3406d350 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.261+0000 7fcb5a60e640 1 --2- 172.21.15.87:0/1980644138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb54153890 0x7fcb540cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.261+0000 7fcb5a60e640 1 --2- 172.21.15.87:0/1980644138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb540ceef0 0x7fcb540c52d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.261+0000 7fcb5a60e640 1 -- 172.21.15.87:0/1980644138 >> 172.21.15.87:0/1980644138 conn(0x7fcb5406ba00 msgr2=0x7fcb5415b250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.261+0000 7fcb5a60e640 1 -- 172.21.15.87:0/1980644138 shutdown_connections 2023-12-16T20:49:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.261+0000 7fcb5a60e640 1 -- 172.21.15.87:0/1980644138 wait complete. 2023-12-16T20:49:22.273 INFO:tasks.ceph:Scrubbing osd.5 2023-12-16T20:49:22.273 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-16T20:49:22.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.378+0000 7f58a9b25640 1 Processor -- start 2023-12-16T20:49:22.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.378+0000 7f58a9b25640 1 -- start start 2023-12-16T20:49:22.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.379+0000 7f58a9b25640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f58a40c85e0 0x7f58a406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:22.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.379+0000 7f58a9b25640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a40c3130 con 0x7f58a406dd70 2023-12-16T20:49:22.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.379+0000 7f58a9b25640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a40c8150 con 0x7f58a406ea30 2023-12-16T20:49:22.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.379+0000 7f58a9b25640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a406e690 con 0x7f58a40c85e0 2023-12-16T20:49:22.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.379+0000 7f58a37fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f58a406dd70 0x7f58a406f8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34944/0 (socket says 172.21.15.87:34944) 2023-12-16T20:49:22.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.379+0000 7f58a37fe640 1 -- 172.21.15.87:0/1693358205 learned_addr learned my addr 172.21.15.87:0/1693358205 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:49:22.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.380+0000 7f58a2ffd640 1 --2- 172.21.15.87:0/1693358205 >> v2:172.21.15.195:3300/0 conn(0x7f58a40c85e0 0x7f58a406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:22.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.382+0000 7f58a27fc640 1 -- 172.21.15.87:0/1693358205 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962502242 0 0) 0x7f58a40c3130 con 0x7f58a406dd70 2023-12-16T20:49:22.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.382+0000 7f58a27fc640 1 -- 172.21.15.87:0/1693358205 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f588c003520 con 0x7f58a406dd70 2023-12-16T20:49:22.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.383+0000 7f58a2ffd640 1 -- 172.21.15.87:0/1693358205 >> v1:172.21.15.195:6789/0 conn(0x7f58a406ea30 legacy=0x7f58a4163f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:22.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.383+0000 7f58a2ffd640 1 -- 172.21.15.87:0/1693358205 >> v1:172.21.15.87:6789/0 conn(0x7f58a406dd70 legacy=0x7f58a406f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:22.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.383+0000 7f58a2ffd640 1 -- 172.21.15.87:0/1693358205 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a40c2b70 con 0x7f58a40c85e0 2023-12-16T20:49:22.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.386+0000 7f58a2ffd640 1 --2- 172.21.15.87:0/1693358205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58a40c85e0 0x7f58a406e150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f58980097a0 tx=0x7f589802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aef74c9d1fb33d0b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:22.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.390+0000 7f58a27fc640 1 -- 172.21.15.87:0/1693358205 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898030610 con 0x7f58a40c85e0 2023-12-16T20:49:22.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.390+0000 7f58a27fc640 1 -- 172.21.15.87:0/1693358205 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5898030770 con 0x7f58a40c85e0 2023-12-16T20:49:22.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.390+0000 7f58a27fc640 1 -- 172.21.15.87:0/1693358205 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898030b00 con 0x7f58a40c85e0 2023-12-16T20:49:22.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.390+0000 7f58a9b25640 1 -- 172.21.15.87:0/1693358205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58a40c85e0 msgr2=0x7f58a406e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:22.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.390+0000 7f58a9b25640 1 --2- 172.21.15.87:0/1693358205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58a40c85e0 0x7f58a406e150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f58980097a0 tx=0x7f589802b960 comp rx=0 tx=0).stop 2023-12-16T20:49:22.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.391+0000 7f58a9b25640 1 -- 172.21.15.87:0/1693358205 shutdown_connections 2023-12-16T20:49:22.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.391+0000 7f58a9b25640 1 --2- 172.21.15.87:0/1693358205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58a40c85e0 0x7f58a406e150 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:22.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.391+0000 7f58a9b25640 1 -- 172.21.15.87:0/1693358205 >> 172.21.15.87:0/1693358205 conn(0x7f58a40cbf60 msgr2=0x7f58a40cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:22.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.391+0000 7f58a9b25640 1 -- 172.21.15.87:0/1693358205 shutdown_connections 2023-12-16T20:49:22.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.391+0000 7f58a9b25640 1 -- 172.21.15.87:0/1693358205 wait complete. 2023-12-16T20:49:22.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.392+0000 7f58a9b25640 1 Processor -- start 2023-12-16T20:49:22.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.392+0000 7f58a9b25640 1 -- start start 2023-12-16T20:49:22.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.393+0000 7f58a9b25640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58a406dd70 0x7f58a41efa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:22.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.393+0000 7f58a9b25640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58a406ea30 0x7f58a414e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:22.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.393+0000 7f58a9b25640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58a40c85e0 0x7f58a40c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:22.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.393+0000 7f58a9b25640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a41494d0 con 0x7f58a406ea30 2023-12-16T20:49:22.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.393+0000 7f58a9b25640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40c55d0 con 0x7f58a406dd70 2023-12-16T20:49:22.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.393+0000 7f58a9b25640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40c58b0 con 0x7f58a40c85e0 2023-12-16T20:49:22.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.393+0000 7f58a2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58a406ea30 0x7f58a414e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:22.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.393+0000 7f58a2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58a406ea30 0x7f58a414e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52386/0 (socket says 172.21.15.87:52386) 2023-12-16T20:49:22.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.393+0000 7f58a2ffd640 1 -- 172.21.15.87:0/601682467 learned_addr learned my addr 172.21.15.87:0/601682467 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:22.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.393+0000 7f58a3fff640 1 --2- 172.21.15.87:0/601682467 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58a40c85e0 0x7f58a40c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:22.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.393+0000 7f58a37fe640 1 --2- 172.21.15.87:0/601682467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58a406dd70 0x7f58a41efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:22.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.396+0000 7f58a2ffd640 1 -- 172.21.15.87:0/601682467 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58a40c85e0 msgr2=0x7f58a40c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:22.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.396+0000 7f58a2ffd640 1 --2- 172.21.15.87:0/601682467 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58a40c85e0 0x7f58a40c3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:22.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.396+0000 7f58a2ffd640 1 -- 172.21.15.87:0/601682467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58a406dd70 msgr2=0x7f58a41efa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:22.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.396+0000 7f58a2ffd640 1 --2- 172.21.15.87:0/601682467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58a406dd70 0x7f58a41efa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:22.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.396+0000 7f58a2ffd640 1 -- 172.21.15.87:0/601682467 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5898009400 con 0x7f58a406ea30 2023-12-16T20:49:22.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.399+0000 7f58a2ffd640 1 --2- 172.21.15.87:0/601682467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58a406ea30 0x7f58a414e270 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f58980098c0 tx=0x7f5898004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:22.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.402+0000 7f588bfff640 1 -- 172.21.15.87:0/601682467 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589803e040 con 0x7f58a406ea30 2023-12-16T20:49:22.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.402+0000 7f588bfff640 1 -- 172.21.15.87:0/601682467 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5898039c10 con 0x7f58a406ea30 2023-12-16T20:49:22.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.402+0000 7f588bfff640 1 -- 172.21.15.87:0/601682467 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58980443f0 con 0x7f58a406ea30 2023-12-16T20:49:22.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.402+0000 7f58a9b25640 1 -- 172.21.15.87:0/601682467 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a40c5b90 con 0x7f58a406ea30 2023-12-16T20:49:22.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.402+0000 7f58a9b25640 1 -- 172.21.15.87:0/601682467 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a40c6150 con 0x7f58a406ea30 2023-12-16T20:49:22.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.403+0000 7f58a9b25640 1 -- 172.21.15.87:0/601682467 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f58a40cccf0 con 0x7f58a406ea30 2023-12-16T20:49:22.421 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.421+0000 7f588bfff640 1 -- 172.21.15.87:0/601682467 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f589804d3b0 con 0x7f58a406ea30 2023-12-16T20:49:22.421 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.421+0000 7f588bfff640 1 --2- 172.21.15.87:0/601682467 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f589006ae90 0x7f589006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:22.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.421+0000 7f58a37fe640 1 --2- 172.21.15.87:0/601682467 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f589006ae90 0x7f589006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:22.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.421+0000 7f58a37fe640 1 --2- 172.21.15.87:0/601682467 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f589006ae90 0x7f589006d350 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f58940011e0 tx=0x7f5894007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:22.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.424+0000 7f588bfff640 1 -- 172.21.15.87:0/601682467 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f589807afb0 con 0x7f58a406ea30 2023-12-16T20:49:22.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.424+0000 7f588bfff640 1 --2- 172.21.15.87:0/601682467 >> [v2:172.21.15.195:6800/264039550,v1:172.21.15.195:6801/264039550] conn(0x7f5890074770 0x7f5890076c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:22.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.424+0000 7f588bfff640 1 -- 172.21.15.87:0/601682467 --> [v2:172.21.15.195:6800/264039550,v1:172.21.15.195:6801/264039550] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58900772e0 con 0x7f5890074770 2023-12-16T20:49:22.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.425+0000 7f58a3fff640 1 --2- 172.21.15.87:0/601682467 >> [v2:172.21.15.195:6800/264039550,v1:172.21.15.195:6801/264039550] conn(0x7f5890074770 0x7f5890076c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:22.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.425+0000 7f58a3fff640 1 --2- 172.21.15.87:0/601682467 >> [v2:172.21.15.195:6800/264039550,v1:172.21.15.195:6801/264039550] conn(0x7f5890074770 0x7f5890076c10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:22.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.426+0000 7f588bfff640 1 -- 172.21.15.87:0/601682467 <== osd.5 v2:172.21.15.195:6800/264039550 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f58900772e0 con 0x7f5890074770 2023-12-16T20:49:22.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.426+0000 7f588bfff640 1 -- 172.21.15.87:0/601682467 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58980772f0 con 0x7f58a406ea30 2023-12-16T20:49:22.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.439+0000 7f58a9b25640 1 -- 172.21.15.87:0/601682467 --> [v2:172.21.15.195:6800/264039550,v1:172.21.15.195:6801/264039550] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f58a40c1930 con 0x7f5890074770 2023-12-16T20:49:22.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.439+0000 7f588bfff640 1 -- 172.21.15.87:0/601682467 <== osd.5 v2:172.21.15.195:6800/264039550 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f58a40c1930 con 0x7f5890074770 2023-12-16T20:49:22.440 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-12-16T20:49:22.440 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T20:49:22.440 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-12-16T20:49:22.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.439+0000 7f58a9b25640 1 -- 172.21.15.87:0/601682467 >> [v2:172.21.15.195:6800/264039550,v1:172.21.15.195:6801/264039550] conn(0x7f5890074770 msgr2=0x7f5890076c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:22.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.439+0000 7f58a9b25640 1 --2- 172.21.15.87:0/601682467 >> [v2:172.21.15.195:6800/264039550,v1:172.21.15.195:6801/264039550] conn(0x7f5890074770 0x7f5890076c10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:22.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.439+0000 7f58a9b25640 1 -- 172.21.15.87:0/601682467 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f589006ae90 msgr2=0x7f589006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:22.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.439+0000 7f58a9b25640 1 --2- 172.21.15.87:0/601682467 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f589006ae90 0x7f589006d350 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f58940011e0 tx=0x7f5894007d30 comp rx=0 tx=0).stop 2023-12-16T20:49:22.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.439+0000 7f58a9b25640 1 -- 172.21.15.87:0/601682467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58a406ea30 msgr2=0x7f58a414e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:22.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.439+0000 7f58a9b25640 1 --2- 172.21.15.87:0/601682467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58a406ea30 0x7f58a414e270 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f58980098c0 tx=0x7f5898004730 comp rx=0 tx=0).stop 2023-12-16T20:49:22.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.439+0000 7f58a3fff640 1 -- 172.21.15.87:0/601682467 reap_dead start 2023-12-16T20:49:22.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.439+0000 7f58a9b25640 1 -- 172.21.15.87:0/601682467 shutdown_connections 2023-12-16T20:49:22.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.439+0000 7f58a9b25640 1 -- 172.21.15.87:0/601682467 >> 172.21.15.87:0/601682467 conn(0x7f58a40cbf60 msgr2=0x7f58a414f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:22.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.440+0000 7f58a9b25640 1 -- 172.21.15.87:0/601682467 shutdown_connections 2023-12-16T20:49:22.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.440+0000 7f58a9b25640 1 -- 172.21.15.87:0/601682467 wait complete. 2023-12-16T20:49:22.451 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-16T20:49:22.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.551+0000 7f0f5ba26640 1 Processor -- start 2023-12-16T20:49:22.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.551+0000 7f0f5ba26640 1 -- start start 2023-12-16T20:49:22.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.551+0000 7f0f5ba26640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0f54153be0 0x7f0f54159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:22.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.552+0000 7f0f5ba26640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0f5406fa00 0x7f0f540c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:22.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.552+0000 7f0f5ba26640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f54153fc0 con 0x7f0f540c5e60 2023-12-16T20:49:22.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.552+0000 7f0f5ba26640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f540c3340 con 0x7f0f54153be0 2023-12-16T20:49:22.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.552+0000 7f0f5ba26640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5406b7b0 con 0x7f0f5406fa00 2023-12-16T20:49:22.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.552+0000 7f0f59fc3640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f0f540c5e60 0x7f0f5406a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34956/0 (socket says 172.21.15.87:34956) 2023-12-16T20:49:22.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.552+0000 7f0f59fc3640 1 -- 172.21.15.87:0/1657742551 learned_addr learned my addr 172.21.15.87:0/1657742551 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:49:22.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.552+0000 7f0f58fc1640 1 --2- 172.21.15.87:0/1657742551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0f5406fa00 0x7f0f540c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:22.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.552+0000 7f0f597c2640 1 --2- 172.21.15.87:0/1657742551 >> v2:172.21.15.195:3300/0 conn(0x7f0f54153be0 0x7f0f54159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:22.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.555+0000 7f0f58fc1640 1 -- 172.21.15.87:0/1657742551 >> v2:172.21.15.195:3300/0 conn(0x7f0f54153be0 msgr2=0x7f0f54159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:22.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.555+0000 7f0f58fc1640 1 --2- 172.21.15.87:0/1657742551 >> v2:172.21.15.195:3300/0 conn(0x7f0f54153be0 0x7f0f54159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:22.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.555+0000 7f0f58fc1640 1 -- 172.21.15.87:0/1657742551 >> v1:172.21.15.87:6789/0 conn(0x7f0f540c5e60 legacy=0x7f0f5406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:22.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.555+0000 7f0f58fc1640 1 -- 172.21.15.87:0/1657742551 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5406ba90 con 0x7f0f5406fa00 2023-12-16T20:49:22.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.555+0000 7f0f4bfff640 1 -- 172.21.15.87:0/1657742551 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265912361 0 0) 0x7f0f54153fc0 con 0x7f0f540c5e60 2023-12-16T20:49:22.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.557+0000 7f0f58fc1640 1 --2- 172.21.15.87:0/1657742551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0f5406fa00 0x7f0f540c41b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0f440097a0 tx=0x7f0f4402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baa171a70fd61be6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.560+0000 7f0f4bfff640 1 -- 172.21.15.87:0/1657742551 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44031830 con 0x7f0f5406fa00 2023-12-16T20:49:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.560+0000 7f0f4bfff640 1 -- 172.21.15.87:0/1657742551 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f44031990 con 0x7f0f5406fa00 2023-12-16T20:49:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.560+0000 7f0f4bfff640 1 -- 172.21.15.87:0/1657742551 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44031d20 con 0x7f0f5406fa00 2023-12-16T20:49:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.561+0000 7f0f5ba26640 1 -- 172.21.15.87:0/1657742551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0f5406fa00 msgr2=0x7f0f540c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.561+0000 7f0f5ba26640 1 --2- 172.21.15.87:0/1657742551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0f5406fa00 0x7f0f540c41b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0f440097a0 tx=0x7f0f4402b8d0 comp rx=0 tx=0).stop 2023-12-16T20:49:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.561+0000 7f0f5ba26640 1 -- 172.21.15.87:0/1657742551 shutdown_connections 2023-12-16T20:49:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.561+0000 7f0f5ba26640 1 --2- 172.21.15.87:0/1657742551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0f5406fa00 0x7f0f540c41b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.561+0000 7f0f5ba26640 1 --2- 172.21.15.87:0/1657742551 >> v2:172.21.15.195:3300/0 conn(0x7f0f54153be0 0x7f0f54159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.561+0000 7f0f5ba26640 1 -- 172.21.15.87:0/1657742551 >> 172.21.15.87:0/1657742551 conn(0x7f0f540c7f60 msgr2=0x7f0f540c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.561+0000 7f0f5ba26640 1 -- 172.21.15.87:0/1657742551 shutdown_connections 2023-12-16T20:49:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.561+0000 7f0f5ba26640 1 -- 172.21.15.87:0/1657742551 wait complete. 2023-12-16T20:49:22.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.562+0000 7f0f5ba26640 1 Processor -- start 2023-12-16T20:49:22.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.562+0000 7f0f5ba26640 1 -- start start 2023-12-16T20:49:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.563+0000 7f0f5ba26640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f5406fa00 0x7f0f541efc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.563+0000 7f0f5ba26640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f540c5e60 0x7f0f54148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.563+0000 7f0f5ba26640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0f54153be0 0x7f0f541490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.563+0000 7f0f5ba26640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f541ef6e0 con 0x7f0f540c5e60 2023-12-16T20:49:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.563+0000 7f0f5ba26640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f54147370 con 0x7f0f5406fa00 2023-12-16T20:49:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.563+0000 7f0f5ba26640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f54146480 con 0x7f0f54153be0 2023-12-16T20:49:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.564+0000 7f0f58fc1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f540c5e60 0x7f0f54148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.564+0000 7f0f597c2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f5406fa00 0x7f0f541efc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.564+0000 7f0f59fc3640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0f54153be0 0x7f0f541490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.564+0000 7f0f58fc1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f540c5e60 0x7f0f54148ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52400/0 (socket says 172.21.15.87:52400) 2023-12-16T20:49:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.564+0000 7f0f58fc1640 1 -- 172.21.15.87:0/1671023003 learned_addr learned my addr 172.21.15.87:0/1671023003 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.567+0000 7f0f58fc1640 1 -- 172.21.15.87:0/1671023003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0f54153be0 msgr2=0x7f0f541490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.567+0000 7f0f58fc1640 1 --2- 172.21.15.87:0/1671023003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0f54153be0 0x7f0f541490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.567+0000 7f0f58fc1640 1 -- 172.21.15.87:0/1671023003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f5406fa00 msgr2=0x7f0f541efc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.567+0000 7f0f58fc1640 1 --2- 172.21.15.87:0/1671023003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f5406fa00 0x7f0f541efc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.567+0000 7f0f58fc1640 1 -- 172.21.15.87:0/1671023003 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f44009400 con 0x7f0f540c5e60 2023-12-16T20:49:22.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.569+0000 7f0f58fc1640 1 --2- 172.21.15.87:0/1671023003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f540c5e60 0x7f0f54148ba0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0f440098c0 tx=0x7f0f440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:22.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.573+0000 7f0f49ffb640 1 -- 172.21.15.87:0/1671023003 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4403b970 con 0x7f0f540c5e60 2023-12-16T20:49:22.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.573+0000 7f0f49ffb640 1 -- 172.21.15.87:0/1671023003 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4403baf0 con 0x7f0f540c5e60 2023-12-16T20:49:22.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.573+0000 7f0f5ba26640 1 -- 172.21.15.87:0/1671023003 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f54146760 con 0x7f0f540c5e60 2023-12-16T20:49:22.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.573+0000 7f0f49ffb640 1 -- 172.21.15.87:0/1671023003 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4403bea0 con 0x7f0f540c5e60 2023-12-16T20:49:22.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.573+0000 7f0f5ba26640 1 -- 172.21.15.87:0/1671023003 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f54146d20 con 0x7f0f540c5e60 2023-12-16T20:49:22.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.574+0000 7f0f5ba26640 1 -- 172.21.15.87:0/1671023003 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f541448a0 con 0x7f0f540c5e60 2023-12-16T20:49:22.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.819+0000 7f0f49ffb640 1 -- 172.21.15.87:0/1671023003 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f0f4404e450 con 0x7f0f540c5e60 2023-12-16T20:49:22.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.819+0000 7f0f49ffb640 1 --2- 172.21.15.87:0/1671023003 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0f3806ae90 0x7f0f3806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:22.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.820+0000 7f0f597c2640 1 --2- 172.21.15.87:0/1671023003 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0f3806ae90 0x7f0f3806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:22.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.820+0000 7f0f597c2640 1 --2- 172.21.15.87:0/1671023003 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0f3806ae90 0x7f0f3806d350 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009aa0 tx=0x7f0f50009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:22.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.849+0000 7f0f49ffb640 1 -- 172.21.15.87:0/1671023003 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f0f4407a6a0 con 0x7f0f540c5e60 2023-12-16T20:49:22.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:22.849+0000 7f0f49ffb640 1 -- 172.21.15.87:0/1671023003 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f0f440769e0 con 0x7f0f540c5e60 2023-12-16T20:49:23.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.045+0000 7f0f5ba26640 1 -- 172.21.15.87:0/1671023003 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f5406ef20 con 0x7f0f3806ae90 2023-12-16T20:49:23.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.045+0000 7f0f49ffb640 1 -- 172.21.15.87:0/1671023003 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0f50011a00 con 0x7f0f3806ae90 2023-12-16T20:49:23.046 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 5 to deep-scrub 2023-12-16T20:49:23.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.047+0000 7f0f5ba26640 1 -- 172.21.15.87:0/1671023003 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0f3806ae90 msgr2=0x7f0f3806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.047+0000 7f0f5ba26640 1 --2- 172.21.15.87:0/1671023003 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0f3806ae90 0x7f0f3806d350 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009aa0 tx=0x7f0f50009190 comp rx=0 tx=0).stop 2023-12-16T20:49:23.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.047+0000 7f0f5ba26640 1 -- 172.21.15.87:0/1671023003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f540c5e60 msgr2=0x7f0f54148ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.047+0000 7f0f5ba26640 1 --2- 172.21.15.87:0/1671023003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f540c5e60 0x7f0f54148ba0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0f440098c0 tx=0x7f0f440046c0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.047+0000 7f0f5ba26640 1 -- 172.21.15.87:0/1671023003 shutdown_connections 2023-12-16T20:49:23.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.047+0000 7f0f5ba26640 1 --2- 172.21.15.87:0/1671023003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0f54153be0 0x7f0f541490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.047+0000 7f0f5ba26640 1 --2- 172.21.15.87:0/1671023003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f540c5e60 0x7f0f54148ba0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.047+0000 7f0f5ba26640 1 --2- 172.21.15.87:0/1671023003 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f0f3806ae90 0x7f0f3806d350 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.047+0000 7f0f5ba26640 1 --2- 172.21.15.87:0/1671023003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f5406fa00 0x7f0f541efc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.047+0000 7f0f5ba26640 1 -- 172.21.15.87:0/1671023003 >> 172.21.15.87:0/1671023003 conn(0x7f0f540c7f60 msgr2=0x7f0f54152880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:23.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.048+0000 7f0f5ba26640 1 -- 172.21.15.87:0/1671023003 shutdown_connections 2023-12-16T20:49:23.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.048+0000 7f0f5ba26640 1 -- 172.21.15.87:0/1671023003 wait complete. 2023-12-16T20:49:23.059 INFO:tasks.ceph:Scrubbing osd.6 2023-12-16T20:49:23.060 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-16T20:49:23.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.165+0000 7f40a960e640 1 Processor -- start 2023-12-16T20:49:23.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.165+0000 7f40a960e640 1 -- start start 2023-12-16T20:49:23.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.166+0000 7f40a960e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f40a40c6a80 0x7f40a4159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.166+0000 7f40a960e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a406ac10 con 0x7f40a415a230 2023-12-16T20:49:23.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.166+0000 7f40a960e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a40c8800 con 0x7f40a4153aa0 2023-12-16T20:49:23.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.166+0000 7f40a960e640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a415a680 con 0x7f40a40c6a80 2023-12-16T20:49:23.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.167+0000 7f40a37fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f40a415a230 0x7f40a406aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34964/0 (socket says 172.21.15.87:34964) 2023-12-16T20:49:23.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.167+0000 7f40a37fe640 1 -- 172.21.15.87:0/2689755993 learned_addr learned my addr 172.21.15.87:0/2689755993 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:49:23.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.167+0000 7f40a27fc640 1 --2- 172.21.15.87:0/2689755993 >> v2:172.21.15.195:3300/0 conn(0x7f40a40c6a80 0x7f40a4159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.169+0000 7f40a1ffb640 1 -- 172.21.15.87:0/2689755993 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84080553 0 0) 0x7f40a406ac10 con 0x7f40a415a230 2023-12-16T20:49:23.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.169+0000 7f40a1ffb640 1 -- 172.21.15.87:0/2689755993 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f408c003520 con 0x7f40a415a230 2023-12-16T20:49:23.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.170+0000 7f40a27fc640 1 -- 172.21.15.87:0/2689755993 >> v1:172.21.15.195:6789/0 conn(0x7f40a4153aa0 legacy=0x7f40a406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.170+0000 7f40a27fc640 1 -- 172.21.15.87:0/2689755993 >> v1:172.21.15.87:6789/0 conn(0x7f40a415a230 legacy=0x7f40a406aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.171 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.170+0000 7f40a27fc640 1 -- 172.21.15.87:0/2689755993 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a4159810 con 0x7f40a40c6a80 2023-12-16T20:49:23.175 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.174+0000 7f40a27fc640 1 --2- 172.21.15.87:0/2689755993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40a40c6a80 0x7f40a4159cf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f40980097a0 tx=0x7f409802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa66efa68e674c9d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:23.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.178+0000 7f40a1ffb640 1 -- 172.21.15.87:0/2689755993 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098030610 con 0x7f40a40c6a80 2023-12-16T20:49:23.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.178+0000 7f40a1ffb640 1 -- 172.21.15.87:0/2689755993 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4098030770 con 0x7f40a40c6a80 2023-12-16T20:49:23.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.178+0000 7f40a1ffb640 1 -- 172.21.15.87:0/2689755993 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098030b00 con 0x7f40a40c6a80 2023-12-16T20:49:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.179+0000 7f40a960e640 1 -- 172.21.15.87:0/2689755993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40a40c6a80 msgr2=0x7f40a4159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.179+0000 7f40a960e640 1 --2- 172.21.15.87:0/2689755993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40a40c6a80 0x7f40a4159cf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f40980097a0 tx=0x7f409802b960 comp rx=0 tx=0).stop 2023-12-16T20:49:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.179+0000 7f40a960e640 1 -- 172.21.15.87:0/2689755993 shutdown_connections 2023-12-16T20:49:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.179+0000 7f40a960e640 1 --2- 172.21.15.87:0/2689755993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40a40c6a80 0x7f40a4159cf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.179+0000 7f40a960e640 1 -- 172.21.15.87:0/2689755993 >> 172.21.15.87:0/2689755993 conn(0x7f40a4072260 msgr2=0x7f40a40cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.179+0000 7f40a960e640 1 -- 172.21.15.87:0/2689755993 shutdown_connections 2023-12-16T20:49:23.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.179+0000 7f40a960e640 1 -- 172.21.15.87:0/2689755993 wait complete. 2023-12-16T20:49:23.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.180+0000 7f40a960e640 1 Processor -- start 2023-12-16T20:49:23.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.180+0000 7f40a960e640 1 -- start start 2023-12-16T20:49:23.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.181+0000 7f40a960e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40a40c6a80 0x7f40a41587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.181+0000 7f40a960e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40a4153aa0 0x7f40a4149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.181+0000 7f40a960e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40a415a230 0x7f40a414a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.181+0000 7f40a960e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a414d500 con 0x7f40a415a230 2023-12-16T20:49:23.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.181+0000 7f40a960e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a414d7a0 con 0x7f40a40c6a80 2023-12-16T20:49:23.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.181+0000 7f40a960e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a414da80 con 0x7f40a4153aa0 2023-12-16T20:49:23.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.181+0000 7f40a37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40a415a230 0x7f40a414a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.182+0000 7f40a2ffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40a40c6a80 0x7f40a41587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.182+0000 7f40a27fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40a4153aa0 0x7f40a4149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.182+0000 7f40a37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40a415a230 0x7f40a414a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52408/0 (socket says 172.21.15.87:52408) 2023-12-16T20:49:23.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.182+0000 7f40a37fe640 1 -- 172.21.15.87:0/918155103 learned_addr learned my addr 172.21.15.87:0/918155103 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:23.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.185+0000 7f40a37fe640 1 -- 172.21.15.87:0/918155103 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40a4153aa0 msgr2=0x7f40a4149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.185+0000 7f40a37fe640 1 --2- 172.21.15.87:0/918155103 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40a4153aa0 0x7f40a4149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.185+0000 7f40a37fe640 1 -- 172.21.15.87:0/918155103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40a40c6a80 msgr2=0x7f40a41587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.185+0000 7f40a37fe640 1 --2- 172.21.15.87:0/918155103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40a40c6a80 0x7f40a41587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.185+0000 7f40a37fe640 1 -- 172.21.15.87:0/918155103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4098009400 con 0x7f40a415a230 2023-12-16T20:49:23.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.187+0000 7f40a37fe640 1 --2- 172.21.15.87:0/918155103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40a415a230 0x7f40a414a100 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f409c00c430 tx=0x7f409c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:23.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.189+0000 7f408b7fe640 1 -- 172.21.15.87:0/918155103 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c005ce0 con 0x7f40a415a230 2023-12-16T20:49:23.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.189+0000 7f40a960e640 1 -- 172.21.15.87:0/918155103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a414dd60 con 0x7f40a415a230 2023-12-16T20:49:23.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.189+0000 7f40a960e640 1 -- 172.21.15.87:0/918155103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a40c97f0 con 0x7f40a415a230 2023-12-16T20:49:23.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.190+0000 7f40a960e640 1 -- 172.21.15.87:0/918155103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f40a414dbf0 con 0x7f40a415a230 2023-12-16T20:49:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.209+0000 7f408b7fe640 1 -- 172.21.15.87:0/918155103 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a414dbf0 con 0x7f40a415a230 2023-12-16T20:49:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.209+0000 7f408b7fe640 1 -- 172.21.15.87:0/918155103 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c007270 con 0x7f40a415a230 2023-12-16T20:49:23.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.210+0000 7f408b7fe640 1 -- 172.21.15.87:0/918155103 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f409c007490 con 0x7f40a415a230 2023-12-16T20:49:23.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.211+0000 7f408b7fe640 1 --2- 172.21.15.87:0/918155103 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f409006ae40 0x7f409006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.211+0000 7f40a2ffd640 1 --2- 172.21.15.87:0/918155103 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f409006ae40 0x7f409006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.212+0000 7f40a2ffd640 1 --2- 172.21.15.87:0/918155103 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f409006ae40 0x7f409006d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4094001f10 tx=0x7f4094009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.215+0000 7f408b7fe640 1 -- 172.21.15.87:0/918155103 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f409c005e40 con 0x7f40a415a230 2023-12-16T20:49:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.215+0000 7f408b7fe640 1 --2- 172.21.15.87:0/918155103 >> [v2:172.21.15.195:6816/2911660280,v1:172.21.15.195:6817/2911660280] conn(0x7f4090074720 0x7f4090076bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.215+0000 7f408b7fe640 1 -- 172.21.15.87:0/918155103 --> [v2:172.21.15.195:6816/2911660280,v1:172.21.15.195:6817/2911660280] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4090077290 con 0x7f4090074720 2023-12-16T20:49:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.215+0000 7f408b7fe640 1 -- 172.21.15.87:0/918155103 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f409c054380 con 0x7f40a415a230 2023-12-16T20:49:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.215+0000 7f40a27fc640 1 --2- 172.21.15.87:0/918155103 >> [v2:172.21.15.195:6816/2911660280,v1:172.21.15.195:6817/2911660280] conn(0x7f4090074720 0x7f4090076bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.216+0000 7f40a27fc640 1 --2- 172.21.15.87:0/918155103 >> [v2:172.21.15.195:6816/2911660280,v1:172.21.15.195:6817/2911660280] conn(0x7f4090074720 0x7f4090076bc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:23.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.216+0000 7f408b7fe640 1 -- 172.21.15.87:0/918155103 <== osd.6 v2:172.21.15.195:6816/2911660280 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4090077290 con 0x7f4090074720 2023-12-16T20:49:23.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.229+0000 7f40a960e640 1 -- 172.21.15.87:0/918155103 --> [v2:172.21.15.195:6816/2911660280,v1:172.21.15.195:6817/2911660280] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f40a40c8240 con 0x7f4090074720 2023-12-16T20:49:23.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.230+0000 7f408b7fe640 1 -- 172.21.15.87:0/918155103 <== osd.6 v2:172.21.15.195:6816/2911660280 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f409803f040 con 0x7f4090074720 2023-12-16T20:49:23.231 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-12-16T20:49:23.231 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T20:49:23.231 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-12-16T20:49:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.230+0000 7f40a960e640 1 -- 172.21.15.87:0/918155103 >> [v2:172.21.15.195:6816/2911660280,v1:172.21.15.195:6817/2911660280] conn(0x7f4090074720 msgr2=0x7f4090076bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.230+0000 7f40a960e640 1 --2- 172.21.15.87:0/918155103 >> [v2:172.21.15.195:6816/2911660280,v1:172.21.15.195:6817/2911660280] conn(0x7f4090074720 0x7f4090076bc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.230+0000 7f40a960e640 1 -- 172.21.15.87:0/918155103 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f409006ae40 msgr2=0x7f409006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.230+0000 7f40a960e640 1 --2- 172.21.15.87:0/918155103 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f409006ae40 0x7f409006d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4094001f10 tx=0x7f4094009040 comp rx=0 tx=0).stop 2023-12-16T20:49:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.230+0000 7f40a960e640 1 -- 172.21.15.87:0/918155103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40a415a230 msgr2=0x7f40a414a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.230+0000 7f40a960e640 1 --2- 172.21.15.87:0/918155103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40a415a230 0x7f40a414a100 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f409c00c430 tx=0x7f409c00c8f0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.230+0000 7f40a37fe640 1 -- 172.21.15.87:0/918155103 reap_dead start 2023-12-16T20:49:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.230+0000 7f40a960e640 1 -- 172.21.15.87:0/918155103 shutdown_connections 2023-12-16T20:49:23.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.230+0000 7f40a960e640 1 -- 172.21.15.87:0/918155103 >> 172.21.15.87:0/918155103 conn(0x7f40a4072260 msgr2=0x7f40a4152810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:23.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.230+0000 7f40a960e640 1 -- 172.21.15.87:0/918155103 shutdown_connections 2023-12-16T20:49:23.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.230+0000 7f40a960e640 1 -- 172.21.15.87:0/918155103 wait complete. 2023-12-16T20:49:23.242 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-16T20:49:23.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.343+0000 7faaf3c1e640 1 Processor -- start 2023-12-16T20:49:23.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.343+0000 7faaf3c1e640 1 -- start start 2023-12-16T20:49:23.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.344+0000 7faaf3c1e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaec0c6050 0x7faaec0c6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.344+0000 7faaf3c1e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaec0c58e0 con 0x7faaec06f460 2023-12-16T20:49:23.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.344+0000 7faaf3c1e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaec0c69c0 con 0x7faaec151690 2023-12-16T20:49:23.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.344+0000 7faaf3c1e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaec0c7610 con 0x7faaec0c6050 2023-12-16T20:49:23.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.344+0000 7faaf11b9640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7faaec06f460 0x7faaec0cae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34970/0 (socket says 172.21.15.87:34970) 2023-12-16T20:49:23.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.344+0000 7faaf11b9640 1 -- 172.21.15.87:0/263590517 learned_addr learned my addr 172.21.15.87:0/263590517 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:49:23.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.344+0000 7faaf21bb640 1 --2- 172.21.15.87:0/263590517 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaec0c6050 0x7faaec0c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.347+0000 7faaf09b8640 1 -- 172.21.15.87:0/263590517 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759566518 0 0) 0x7faaec0c58e0 con 0x7faaec06f460 2023-12-16T20:49:23.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.347+0000 7faaf09b8640 1 -- 172.21.15.87:0/263590517 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faad8003520 con 0x7faaec06f460 2023-12-16T20:49:23.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.347+0000 7faaf21bb640 1 -- 172.21.15.87:0/263590517 >> v1:172.21.15.195:6789/0 conn(0x7faaec151690 legacy=0x7faaec157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.347+0000 7faaf21bb640 1 -- 172.21.15.87:0/263590517 >> v1:172.21.15.87:6789/0 conn(0x7faaec06f460 legacy=0x7faaec0cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.347+0000 7faaf21bb640 1 -- 172.21.15.87:0/263590517 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec151a70 con 0x7faaec0c6050 2023-12-16T20:49:23.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.349+0000 7faaf21bb640 1 --2- 172.21.15.87:0/263590517 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaec0c6050 0x7faaec0c6480 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faae4009dc0 tx=0x7faae402be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66ee86d34ff2a3d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:23.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.353+0000 7faaf09b8640 1 -- 172.21.15.87:0/263590517 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae402cc40 con 0x7faaec0c6050 2023-12-16T20:49:23.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.353+0000 7faaf09b8640 1 -- 172.21.15.87:0/263590517 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae402cda0 con 0x7faaec0c6050 2023-12-16T20:49:23.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.353+0000 7faaf09b8640 1 -- 172.21.15.87:0/263590517 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae4034660 con 0x7faaec0c6050 2023-12-16T20:49:23.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.354+0000 7faaf3c1e640 1 -- 172.21.15.87:0/263590517 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaec0c6050 msgr2=0x7faaec0c6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.354+0000 7faaf3c1e640 1 --2- 172.21.15.87:0/263590517 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaec0c6050 0x7faaec0c6480 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faae4009dc0 tx=0x7faae402be90 comp rx=0 tx=0).stop 2023-12-16T20:49:23.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.354+0000 7faaf3c1e640 1 -- 172.21.15.87:0/263590517 shutdown_connections 2023-12-16T20:49:23.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.354+0000 7faaf3c1e640 1 --2- 172.21.15.87:0/263590517 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaec0c6050 0x7faaec0c6480 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.354+0000 7faaf3c1e640 1 -- 172.21.15.87:0/263590517 >> 172.21.15.87:0/263590517 conn(0x7faaec06cd60 msgr2=0x7faaec06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:23.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.354+0000 7faaf3c1e640 1 -- 172.21.15.87:0/263590517 shutdown_connections 2023-12-16T20:49:23.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.354+0000 7faaf3c1e640 1 -- 172.21.15.87:0/263590517 wait complete. 2023-12-16T20:49:23.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.355+0000 7faaf3c1e640 1 Processor -- start 2023-12-16T20:49:23.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.355+0000 7faaf3c1e640 1 -- start start 2023-12-16T20:49:23.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.355+0000 7faaf3c1e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaec06f460 0x7faaec145630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.355+0000 7faaf3c1e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaec0c6050 0x7faaec1ed760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.355+0000 7faaf3c1e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaec151690 0x7faaec1544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.356+0000 7faaf3c1e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec146040 con 0x7faaec0c6050 2023-12-16T20:49:23.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.356+0000 7faaf3c1e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec145b70 con 0x7faaec06f460 2023-12-16T20:49:23.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.356+0000 7faaf3c1e640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaec153430 con 0x7faaec151690 2023-12-16T20:49:23.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.356+0000 7faaf11b9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaec0c6050 0x7faaec1ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.356+0000 7faaf21bb640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaec151690 0x7faaec1544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.356+0000 7faaf19ba640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaec06f460 0x7faaec145630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.356+0000 7faaf11b9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaec0c6050 0x7faaec1ed760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52410/0 (socket says 172.21.15.87:52410) 2023-12-16T20:49:23.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.356+0000 7faaf11b9640 1 -- 172.21.15.87:0/3487859922 learned_addr learned my addr 172.21.15.87:0/3487859922 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:23.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.359+0000 7faaf11b9640 1 -- 172.21.15.87:0/3487859922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaec151690 msgr2=0x7faaec1544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.359+0000 7faaf11b9640 1 --2- 172.21.15.87:0/3487859922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaec151690 0x7faaec1544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.359+0000 7faaf11b9640 1 -- 172.21.15.87:0/3487859922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaec06f460 msgr2=0x7faaec145630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.359+0000 7faaf11b9640 1 --2- 172.21.15.87:0/3487859922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaec06f460 0x7faaec145630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.359+0000 7faaf11b9640 1 -- 172.21.15.87:0/3487859922 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae4009a70 con 0x7faaec0c6050 2023-12-16T20:49:23.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.362+0000 7faaf11b9640 1 --2- 172.21.15.87:0/3487859922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaec0c6050 0x7faaec1ed760 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faadc00c530 tx=0x7faadc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:23.366 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.365+0000 7faae27fc640 1 -- 172.21.15.87:0/3487859922 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc005ce0 con 0x7faaec0c6050 2023-12-16T20:49:23.366 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.365+0000 7faae27fc640 1 -- 172.21.15.87:0/3487859922 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faadc005e40 con 0x7faaec0c6050 2023-12-16T20:49:23.366 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.365+0000 7faae27fc640 1 -- 172.21.15.87:0/3487859922 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc0072b0 con 0x7faaec0c6050 2023-12-16T20:49:23.366 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.365+0000 7faaf3c1e640 1 -- 172.21.15.87:0/3487859922 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaec153710 con 0x7faaec0c6050 2023-12-16T20:49:23.366 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.365+0000 7faaf3c1e640 1 -- 172.21.15.87:0/3487859922 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaec1ecf60 con 0x7faaec0c6050 2023-12-16T20:49:23.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.366+0000 7faaf3c1e640 1 -- 172.21.15.87:0/3487859922 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaec072b80 con 0x7faaec0c6050 2023-12-16T20:49:23.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.385+0000 7faae27fc640 1 -- 172.21.15.87:0/3487859922 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7faadc007410 con 0x7faaec0c6050 2023-12-16T20:49:23.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.385+0000 7faae27fc640 1 --2- 172.21.15.87:0/3487859922 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7faad006ae90 0x7faad006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.385+0000 7faaf19ba640 1 --2- 172.21.15.87:0/3487859922 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7faad006ae90 0x7faad006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.385+0000 7faaf19ba640 1 --2- 172.21.15.87:0/3487859922 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7faad006ae90 0x7faad006d350 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faae80016e0 tx=0x7faae8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:23.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.619+0000 7faae27fc640 1 -- 172.21.15.87:0/3487859922 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7faadc057f00 con 0x7faaec0c6050 2023-12-16T20:49:23.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.619+0000 7faae27fc640 1 -- 172.21.15.87:0/3487859922 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7faadc054240 con 0x7faaec0c6050 2023-12-16T20:49:23.789 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.788+0000 7faaf3c1e640 1 -- 172.21.15.87:0/3487859922 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7faaec0718f0 con 0x7faad006ae90 2023-12-16T20:49:23.789 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.788+0000 7faae27fc640 1 -- 172.21.15.87:0/3487859922 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faae8001cc0 con 0x7faad006ae90 2023-12-16T20:49:23.789 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 6 to deep-scrub 2023-12-16T20:49:23.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.790+0000 7faaf3c1e640 1 -- 172.21.15.87:0/3487859922 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7faad006ae90 msgr2=0x7faad006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.790+0000 7faaf3c1e640 1 --2- 172.21.15.87:0/3487859922 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7faad006ae90 0x7faad006d350 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faae80016e0 tx=0x7faae8009040 comp rx=0 tx=0).stop 2023-12-16T20:49:23.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.790+0000 7faaf3c1e640 1 -- 172.21.15.87:0/3487859922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaec0c6050 msgr2=0x7faaec1ed760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.790+0000 7faaf3c1e640 1 --2- 172.21.15.87:0/3487859922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaec0c6050 0x7faaec1ed760 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faadc00c530 tx=0x7faadc00c9f0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.790+0000 7faaf3c1e640 1 -- 172.21.15.87:0/3487859922 shutdown_connections 2023-12-16T20:49:23.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.790+0000 7faaf3c1e640 1 --2- 172.21.15.87:0/3487859922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaec151690 0x7faaec1544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.790+0000 7faaf3c1e640 1 --2- 172.21.15.87:0/3487859922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaec0c6050 0x7faaec1ed760 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.790+0000 7faaf3c1e640 1 --2- 172.21.15.87:0/3487859922 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7faad006ae90 0x7faad006d350 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.790+0000 7faaf3c1e640 1 --2- 172.21.15.87:0/3487859922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaec06f460 0x7faaec145630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.790+0000 7faaf3c1e640 1 -- 172.21.15.87:0/3487859922 >> 172.21.15.87:0/3487859922 conn(0x7faaec06cd60 msgr2=0x7faaec14c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:23.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.790+0000 7faaf3c1e640 1 -- 172.21.15.87:0/3487859922 shutdown_connections 2023-12-16T20:49:23.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.790+0000 7faaf3c1e640 1 -- 172.21.15.87:0/3487859922 wait complete. 2023-12-16T20:49:23.802 INFO:tasks.ceph:Scrubbing osd.7 2023-12-16T20:49:23.802 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-16T20:49:23.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.907+0000 7fa764725640 1 Processor -- start 2023-12-16T20:49:23.908 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.907+0000 7fa764725640 1 -- start start 2023-12-16T20:49:23.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.908+0000 7fa764725640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa75c151860 0x7fa75c0b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.908+0000 7fa764725640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa75c06a500 0x7fa75c06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.908+0000 7fa764725640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75c157e20 con 0x7fa75c0cbcd0 2023-12-16T20:49:23.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.908+0000 7fa764725640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75c157300 con 0x7fa75c06a500 2023-12-16T20:49:23.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.908+0000 7fa764725640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c0cc480 con 0x7fa75c151860 2023-12-16T20:49:23.928 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.928+0000 7fa761cc0640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa75c0cbcd0 0x7fa75c06b140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34980/0 (socket says 172.21.15.87:34980) 2023-12-16T20:49:23.929 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.928+0000 7fa761cc0640 1 -- 172.21.15.87:0/2545652443 learned_addr learned my addr 172.21.15.87:0/2545652443 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:49:23.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.930+0000 7fa7614bf640 1 -- 172.21.15.87:0/2545652443 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577572431 0 0) 0x7fa75c157e20 con 0x7fa75c0cbcd0 2023-12-16T20:49:23.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.930+0000 7fa7614bf640 1 -- 172.21.15.87:0/2545652443 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa748003520 con 0x7fa75c0cbcd0 2023-12-16T20:49:23.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.932+0000 7fa7624c1640 1 --2- 172.21.15.87:0/2545652443 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa75c151860 0x7fa75c0b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.933+0000 7fa7614bf640 1 -- 172.21.15.87:0/2545652443 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 12942089 0 0) 0x7fa748003520 con 0x7fa75c0cbcd0 2023-12-16T20:49:23.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.933+0000 7fa7614bf640 1 -- 172.21.15.87:0/2545652443 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa75c151860 msgr2=0x7fa75c0b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:23.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.933+0000 7fa7614bf640 1 --2- 172.21.15.87:0/2545652443 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa75c151860 0x7fa75c0b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.933+0000 7fa7614bf640 1 -- 172.21.15.87:0/2545652443 >> v2:172.21.15.195:3300/0 conn(0x7fa75c06a500 msgr2=0x7fa75c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:23.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.933+0000 7fa7614bf640 1 --2- 172.21.15.87:0/2545652443 >> v2:172.21.15.195:3300/0 conn(0x7fa75c06a500 0x7fa75c06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.933+0000 7fa7614bf640 1 -- 172.21.15.87:0/2545652443 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c1574f0 con 0x7fa75c0cbcd0 2023-12-16T20:49:23.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.933+0000 7fa7614bf640 1 -- 172.21.15.87:0/2545652443 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1165302485 0 0) 0x7fa74c001670 con 0x7fa75c0cbcd0 2023-12-16T20:49:23.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.933+0000 7fa7614bf640 1 -- 172.21.15.87:0/2545652443 >> v1:172.21.15.87:6789/0 conn(0x7fa75c0cbcd0 legacy=0x7fa75c06b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.933+0000 7fa7614bf640 1 --2- 172.21.15.87:0/2545652443 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa75c151860 0x7fa748003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.933+0000 7fa7614bf640 1 --2- 172.21.15.87:0/2545652443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa748003f40 0x7fa7480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.933+0000 7fa7614bf640 1 --2- 172.21.15.87:0/2545652443 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa748004d00 0x7fa748005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.933+0000 7fa7614bf640 1 -- 172.21.15.87:0/2545652443 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c0cc480 con 0x7fa748003f40 2023-12-16T20:49:23.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.933+0000 7fa7614bf640 1 -- 172.21.15.87:0/2545652443 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74800bb20 con 0x7fa748004d00 2023-12-16T20:49:23.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.933+0000 7fa7614bf640 1 -- 172.21.15.87:0/2545652443 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74800bce0 con 0x7fa75c151860 2023-12-16T20:49:23.937 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.936+0000 7fa761cc0640 1 --2- 172.21.15.87:0/2545652443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa748003f40 0x7fa7480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.938 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.937+0000 7fa762cc2640 1 --2- 172.21.15.87:0/2545652443 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa748004d00 0x7fa748005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.939+0000 7fa7624c1640 1 --2- 172.21.15.87:0/2545652443 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa75c151860 0x7fa748003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.940+0000 7fa761cc0640 1 -- 172.21.15.87:0/2545652443 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa75c151860 msgr2=0x7fa748003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:23.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.940+0000 7fa761cc0640 1 --2- 172.21.15.87:0/2545652443 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa75c151860 0x7fa748003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.940+0000 7fa761cc0640 1 -- 172.21.15.87:0/2545652443 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa748004d00 msgr2=0x7fa748005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:23.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.940+0000 7fa761cc0640 1 --2- 172.21.15.87:0/2545652443 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa748004d00 0x7fa748005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.940+0000 7fa761cc0640 1 -- 172.21.15.87:0/2545652443 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa748003520 con 0x7fa748003f40 2023-12-16T20:49:23.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.942+0000 7fa761cc0640 1 --2- 172.21.15.87:0/2545652443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa748003f40 0x7fa7480047c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa74c001050 tx=0x7fa7480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78090a8bd30473d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:23.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.946+0000 7fa7614bf640 1 -- 172.21.15.87:0/2545652443 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c005ad0 con 0x7fa748003f40 2023-12-16T20:49:23.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.946+0000 7fa7614bf640 1 -- 172.21.15.87:0/2545652443 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c005c30 con 0x7fa748003f40 2023-12-16T20:49:23.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.946+0000 7fa7614bf640 1 -- 172.21.15.87:0/2545652443 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c02ca20 con 0x7fa748003f40 2023-12-16T20:49:23.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.947+0000 7fa764725640 1 -- 172.21.15.87:0/2545652443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa748003f40 msgr2=0x7fa7480047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.947+0000 7fa764725640 1 --2- 172.21.15.87:0/2545652443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa748003f40 0x7fa7480047c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa74c001050 tx=0x7fa7480057f0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.947+0000 7fa762cc2640 1 -- 172.21.15.87:0/2545652443 reap_dead start 2023-12-16T20:49:23.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.947+0000 7fa764725640 1 -- 172.21.15.87:0/2545652443 shutdown_connections 2023-12-16T20:49:23.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.947+0000 7fa764725640 1 -- 172.21.15.87:0/2545652443 >> 172.21.15.87:0/2545652443 conn(0x7fa75c06fa00 msgr2=0x7fa75c06fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:23.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.947+0000 7fa764725640 1 -- 172.21.15.87:0/2545652443 shutdown_connections 2023-12-16T20:49:23.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.947+0000 7fa764725640 1 -- 172.21.15.87:0/2545652443 wait complete. 2023-12-16T20:49:23.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.949+0000 7fa764725640 1 Processor -- start 2023-12-16T20:49:23.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.949+0000 7fa764725640 1 -- start start 2023-12-16T20:49:23.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.949+0000 7fa764725640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa748003f40 0x7fa75c0c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.949+0000 7fa764725640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa75c0c59e0 0x7fa75c1ed440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.949+0000 7fa764725640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa75c0c5e20 0x7fa75c143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.949+0000 7fa764725640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c151c70 con 0x7fa75c0c5e20 2023-12-16T20:49:23.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.949+0000 7fa764725640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c1ecd10 con 0x7fa75c0c59e0 2023-12-16T20:49:23.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.949+0000 7fa764725640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c0c4600 con 0x7fa748003f40 2023-12-16T20:49:23.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.950+0000 7fa762cc2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa75c0c5e20 0x7fa75c143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.950+0000 7fa7624c1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa748003f40 0x7fa75c0c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.950+0000 7fa761cc0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa75c0c59e0 0x7fa75c1ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.950+0000 7fa762cc2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa75c0c5e20 0x7fa75c143530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52434/0 (socket says 172.21.15.87:52434) 2023-12-16T20:49:23.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.950+0000 7fa762cc2640 1 -- 172.21.15.87:0/1306120955 learned_addr learned my addr 172.21.15.87:0/1306120955 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:23.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.953+0000 7fa762cc2640 1 -- 172.21.15.87:0/1306120955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa748003f40 msgr2=0x7fa75c0c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.953+0000 7fa762cc2640 1 --2- 172.21.15.87:0/1306120955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa748003f40 0x7fa75c0c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.953+0000 7fa762cc2640 1 -- 172.21.15.87:0/1306120955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa75c0c59e0 msgr2=0x7fa75c1ed440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.953+0000 7fa762cc2640 1 --2- 172.21.15.87:0/1306120955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa75c0c59e0 0x7fa75c1ed440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.953+0000 7fa762cc2640 1 -- 172.21.15.87:0/1306120955 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c1f06c0 con 0x7fa75c0c5e20 2023-12-16T20:49:23.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.955+0000 7fa762cc2640 1 --2- 172.21.15.87:0/1306120955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa75c0c5e20 0x7fa75c143530 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0cc970 tx=0x7fa75400ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:23.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.959+0000 7fa752ffd640 1 -- 172.21.15.87:0/1306120955 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75400cda0 con 0x7fa75c0c5e20 2023-12-16T20:49:23.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.959+0000 7fa752ffd640 1 -- 172.21.15.87:0/1306120955 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa754016420 con 0x7fa75c0c5e20 2023-12-16T20:49:23.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.959+0000 7fa752ffd640 1 -- 172.21.15.87:0/1306120955 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7540167d0 con 0x7fa75c0c5e20 2023-12-16T20:49:23.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.959+0000 7fa764725640 1 -- 172.21.15.87:0/1306120955 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75c1f09a0 con 0x7fa75c0c5e20 2023-12-16T20:49:23.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.959+0000 7fa764725640 1 -- 172.21.15.87:0/1306120955 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75c1f0f60 con 0x7fa75c0c5e20 2023-12-16T20:49:23.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.960+0000 7fa764725640 1 -- 172.21.15.87:0/1306120955 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa75c0c75b0 con 0x7fa75c0c5e20 2023-12-16T20:49:23.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.977+0000 7fa752ffd640 1 -- 172.21.15.87:0/1306120955 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fa754016930 con 0x7fa75c0c5e20 2023-12-16T20:49:23.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.978+0000 7fa752ffd640 1 --2- 172.21.15.87:0/1306120955 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa74006ae90 0x7fa74006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.979 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.978+0000 7fa7624c1640 1 --2- 172.21.15.87:0/1306120955 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa74006ae90 0x7fa74006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.979 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.978+0000 7fa7624c1640 1 --2- 172.21.15.87:0/1306120955 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa74006ae90 0x7fa74006d350 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa758009ac0 tx=0x7fa758008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:23.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.982+0000 7fa752ffd640 1 -- 172.21.15.87:0/1306120955 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fa754008030 con 0x7fa75c0c5e20 2023-12-16T20:49:23.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.982+0000 7fa752ffd640 1 --2- 172.21.15.87:0/1306120955 >> [v2:172.21.15.195:6808/529094727,v1:172.21.15.195:6809/529094727] conn(0x7fa740074770 0x7fa740076c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:23.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.982+0000 7fa752ffd640 1 -- 172.21.15.87:0/1306120955 --> [v2:172.21.15.195:6808/529094727,v1:172.21.15.195:6809/529094727] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7400772e0 con 0x7fa740074770 2023-12-16T20:49:23.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.982+0000 7fa761cc0640 1 --2- 172.21.15.87:0/1306120955 >> [v2:172.21.15.195:6808/529094727,v1:172.21.15.195:6809/529094727] conn(0x7fa740074770 0x7fa740076c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:23.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.982+0000 7fa761cc0640 1 --2- 172.21.15.87:0/1306120955 >> [v2:172.21.15.195:6808/529094727,v1:172.21.15.195:6809/529094727] conn(0x7fa740074770 0x7fa740076c10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:23.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.983+0000 7fa752ffd640 1 -- 172.21.15.87:0/1306120955 <== osd.7 v2:172.21.15.195:6808/529094727 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa7400772e0 con 0x7fa740074770 2023-12-16T20:49:23.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.983+0000 7fa752ffd640 1 -- 172.21.15.87:0/1306120955 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa754055630 con 0x7fa75c0c5e20 2023-12-16T20:49:23.997 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.996+0000 7fa764725640 1 -- 172.21.15.87:0/1306120955 --> [v2:172.21.15.195:6808/529094727,v1:172.21.15.195:6809/529094727] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa75c0c7bc0 con 0x7fa740074770 2023-12-16T20:49:23.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.997+0000 7fa752ffd640 1 -- 172.21.15.87:0/1306120955 <== osd.7 v2:172.21.15.195:6808/529094727 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa74c001430 con 0x7fa740074770 2023-12-16T20:49:23.998 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-12-16T20:49:23.998 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T20:49:23.998 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-12-16T20:49:23.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.997+0000 7fa764725640 1 -- 172.21.15.87:0/1306120955 >> [v2:172.21.15.195:6808/529094727,v1:172.21.15.195:6809/529094727] conn(0x7fa740074770 msgr2=0x7fa740076c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.997+0000 7fa764725640 1 --2- 172.21.15.87:0/1306120955 >> [v2:172.21.15.195:6808/529094727,v1:172.21.15.195:6809/529094727] conn(0x7fa740074770 0x7fa740076c10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:23.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.997+0000 7fa764725640 1 -- 172.21.15.87:0/1306120955 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa74006ae90 msgr2=0x7fa74006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.997+0000 7fa764725640 1 --2- 172.21.15.87:0/1306120955 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fa74006ae90 0x7fa74006d350 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa758009ac0 tx=0x7fa758008040 comp rx=0 tx=0).stop 2023-12-16T20:49:23.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.997+0000 7fa764725640 1 -- 172.21.15.87:0/1306120955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa75c0c5e20 msgr2=0x7fa75c143530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:23.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.997+0000 7fa764725640 1 --2- 172.21.15.87:0/1306120955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa75c0c5e20 0x7fa75c143530 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0cc970 tx=0x7fa75400ede0 comp rx=0 tx=0).stop 2023-12-16T20:49:24.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.997+0000 7fa762cc2640 1 -- 172.21.15.87:0/1306120955 reap_dead start 2023-12-16T20:49:24.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.997+0000 7fa764725640 1 -- 172.21.15.87:0/1306120955 shutdown_connections 2023-12-16T20:49:24.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.997+0000 7fa764725640 1 -- 172.21.15.87:0/1306120955 >> 172.21.15.87:0/1306120955 conn(0x7fa75c06fa00 msgr2=0x7fa75c0ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:24.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.997+0000 7fa764725640 1 -- 172.21.15.87:0/1306120955 shutdown_connections 2023-12-16T20:49:24.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:23.997+0000 7fa764725640 1 -- 172.21.15.87:0/1306120955 wait complete. 2023-12-16T20:49:24.009 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-16T20:49:24.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.114+0000 7ff606ada640 1 Processor -- start 2023-12-16T20:49:24.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.115+0000 7ff606ada640 1 -- start start 2023-12-16T20:49:24.116 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.115+0000 7ff606ada640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff600153c70 0x7ff60015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:24.116 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.115+0000 7ff606ada640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60015a700 con 0x7ff600153890 2023-12-16T20:49:24.116 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.115+0000 7ff606ada640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6000ca870 con 0x7ff6000ceef0 2023-12-16T20:49:24.116 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.115+0000 7ff606ada640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff600159af0 con 0x7ff600153c70 2023-12-16T20:49:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.116+0000 7ff5fffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff600153c70 0x7ff60015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.116+0000 7ff605077640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7ff6000ceef0 0x7ff60015aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:55182/0 (socket says 172.21.15.87:55182) 2023-12-16T20:49:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.116+0000 7ff605077640 1 -- 172.21.15.87:0/2383538720 learned_addr learned my addr 172.21.15.87:0/2383538720 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:49:24.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.118+0000 7ff5ff7fe640 1 -- 172.21.15.87:0/2383538720 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34646869 0 0) 0x7ff6000ca870 con 0x7ff6000ceef0 2023-12-16T20:49:24.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.118+0000 7ff5ff7fe640 1 -- 172.21.15.87:0/2383538720 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5f0003520 con 0x7ff6000ceef0 2023-12-16T20:49:24.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.119+0000 7ff5fffff640 1 -- 172.21.15.87:0/2383538720 >> v1:172.21.15.195:6789/0 conn(0x7ff6000ceef0 legacy=0x7ff60015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:24.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.119+0000 7ff5fffff640 1 -- 172.21.15.87:0/2383538720 >> v1:172.21.15.87:6789/0 conn(0x7ff600153890 legacy=0x7ff6000c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:24.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.119+0000 7ff5fffff640 1 -- 172.21.15.87:0/2383538720 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff600159dd0 con 0x7ff600153c70 2023-12-16T20:49:24.121 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.121+0000 7ff5fffff640 1 --2- 172.21.15.87:0/2383538720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff600153c70 0x7ff60015d950 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0097d0 tx=0x7ff5ec02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0f1f19f74983fe4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:24.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.124+0000 7ff5ff7fe640 1 -- 172.21.15.87:0/2383538720 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec031890 con 0x7ff600153c70 2023-12-16T20:49:24.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.124+0000 7ff5ff7fe640 1 -- 172.21.15.87:0/2383538720 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec0319f0 con 0x7ff600153c70 2023-12-16T20:49:24.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.124+0000 7ff5ff7fe640 1 -- 172.21.15.87:0/2383538720 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec031d80 con 0x7ff600153c70 2023-12-16T20:49:24.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.125+0000 7ff606ada640 1 -- 172.21.15.87:0/2383538720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff600153c70 msgr2=0x7ff60015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:24.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.125+0000 7ff606ada640 1 --2- 172.21.15.87:0/2383538720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff600153c70 0x7ff60015d950 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0097d0 tx=0x7ff5ec02b930 comp rx=0 tx=0).stop 2023-12-16T20:49:24.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.125+0000 7ff606ada640 1 -- 172.21.15.87:0/2383538720 shutdown_connections 2023-12-16T20:49:24.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.125+0000 7ff606ada640 1 --2- 172.21.15.87:0/2383538720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff600153c70 0x7ff60015d950 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:24.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.125+0000 7ff606ada640 1 -- 172.21.15.87:0/2383538720 >> 172.21.15.87:0/2383538720 conn(0x7ff60006ba00 msgr2=0x7ff60006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:24.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.125+0000 7ff606ada640 1 -- 172.21.15.87:0/2383538720 shutdown_connections 2023-12-16T20:49:24.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.125+0000 7ff606ada640 1 -- 172.21.15.87:0/2383538720 wait complete. 2023-12-16T20:49:24.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.126+0000 7ff606ada640 1 Processor -- start 2023-12-16T20:49:24.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.126+0000 7ff606ada640 1 -- start start 2023-12-16T20:49:24.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.127+0000 7ff606ada640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6000ceef0 0x7ff6000ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:24.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.127+0000 7ff606ada640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff600153890 0x7ff6001550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:24.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.127+0000 7ff606ada640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff600153c70 0x7ff6001f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:24.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.127+0000 7ff606ada640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff600154670 con 0x7ff600153890 2023-12-16T20:49:24.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.127+0000 7ff606ada640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6001efe90 con 0x7ff600153c70 2023-12-16T20:49:24.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.127+0000 7ff606ada640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6001e5a10 con 0x7ff6000ceef0 2023-12-16T20:49:24.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.128+0000 7ff605077640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff600153c70 0x7ff6001f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:24.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.128+0000 7ff605077640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff600153c70 0x7ff6001f1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:42626/0 (socket says 172.21.15.87:42626) 2023-12-16T20:49:24.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.128+0000 7ff605077640 1 -- 172.21.15.87:0/907683843 learned_addr learned my addr 172.21.15.87:0/907683843 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:24.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.128+0000 7ff604876640 1 --2- 172.21.15.87:0/907683843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6000ceef0 0x7ff6000ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:24.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.128+0000 7ff5fffff640 1 --2- 172.21.15.87:0/907683843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff600153890 0x7ff6001550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:24.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.131+0000 7ff605077640 1 -- 172.21.15.87:0/907683843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6000ceef0 msgr2=0x7ff6000ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:24.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.131+0000 7ff605077640 1 --2- 172.21.15.87:0/907683843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6000ceef0 0x7ff6000ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:24.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.132+0000 7ff605077640 1 -- 172.21.15.87:0/907683843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff600153890 msgr2=0x7ff6001550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:24.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.132+0000 7ff605077640 1 --2- 172.21.15.87:0/907683843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff600153890 0x7ff6001550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:24.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.132+0000 7ff605077640 1 -- 172.21.15.87:0/907683843 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec009400 con 0x7ff600153c70 2023-12-16T20:49:24.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.134+0000 7ff605077640 1 --2- 172.21.15.87:0/907683843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff600153c70 0x7ff6001f1c70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff5f800cb40 tx=0x7ff5f800a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:24.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.138+0000 7ff5fd7fa640 1 -- 172.21.15.87:0/907683843 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f800aca0 con 0x7ff600153c70 2023-12-16T20:49:24.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.138+0000 7ff5fd7fa640 1 -- 172.21.15.87:0/907683843 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f800ae00 con 0x7ff600153c70 2023-12-16T20:49:24.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.138+0000 7ff606ada640 1 -- 172.21.15.87:0/907683843 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6001e5230 con 0x7ff600153c70 2023-12-16T20:49:24.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.138+0000 7ff5fd7fa640 1 -- 172.21.15.87:0/907683843 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8012620 con 0x7ff600153c70 2023-12-16T20:49:24.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.138+0000 7ff606ada640 1 -- 172.21.15.87:0/907683843 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6001548c0 con 0x7ff600153c70 2023-12-16T20:49:24.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.139+0000 7ff606ada640 1 -- 172.21.15.87:0/907683843 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff600067500 con 0x7ff600153c70 2023-12-16T20:49:24.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.157+0000 7ff5fd7fa640 1 -- 172.21.15.87:0/907683843 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ff5f8007070 con 0x7ff600153c70 2023-12-16T20:49:24.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.158+0000 7ff5fd7fa640 1 --2- 172.21.15.87:0/907683843 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff5e406ae40 0x7ff5e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:24.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.158+0000 7ff604876640 1 --2- 172.21.15.87:0/907683843 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff5e406ae40 0x7ff5e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:24.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.158+0000 7ff604876640 1 --2- 172.21.15.87:0/907683843 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff5e406ae40 0x7ff5e406d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40017f0 tx=0x7ff5f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:24.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.385+0000 7ff5fd7fa640 1 -- 172.21.15.87:0/907683843 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff5f80588c0 con 0x7ff600153c70 2023-12-16T20:49:24.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.395+0000 7ff5fd7fa640 1 -- 172.21.15.87:0/907683843 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ff5f8054c00 con 0x7ff600153c70 2023-12-16T20:49:24.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.562+0000 7ff606ada640 1 -- 172.21.15.87:0/907683843 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6001597a0 con 0x7ff5e406ae40 2023-12-16T20:49:24.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.562+0000 7ff5fd7fa640 1 -- 172.21.15.87:0/907683843 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff5f4001440 con 0x7ff5e406ae40 2023-12-16T20:49:24.563 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 7 to deep-scrub 2023-12-16T20:49:24.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.564+0000 7ff606ada640 1 -- 172.21.15.87:0/907683843 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff5e406ae40 msgr2=0x7ff5e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:24.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.564+0000 7ff606ada640 1 --2- 172.21.15.87:0/907683843 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff5e406ae40 0x7ff5e406d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40017f0 tx=0x7ff5f4009040 comp rx=0 tx=0).stop 2023-12-16T20:49:24.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.564+0000 7ff606ada640 1 -- 172.21.15.87:0/907683843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff600153c70 msgr2=0x7ff6001f1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:24.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.564+0000 7ff606ada640 1 --2- 172.21.15.87:0/907683843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff600153c70 0x7ff6001f1c70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff5f800cb40 tx=0x7ff5f800a060 comp rx=0 tx=0).stop 2023-12-16T20:49:24.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.564+0000 7ff606ada640 1 -- 172.21.15.87:0/907683843 shutdown_connections 2023-12-16T20:49:24.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.564+0000 7ff606ada640 1 --2- 172.21.15.87:0/907683843 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff5e406ae40 0x7ff5e406d300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:24.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.564+0000 7ff606ada640 1 --2- 172.21.15.87:0/907683843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff600153c70 0x7ff6001f1c70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:24.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.564+0000 7ff606ada640 1 --2- 172.21.15.87:0/907683843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff600153890 0x7ff6001550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:24.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.564+0000 7ff606ada640 1 --2- 172.21.15.87:0/907683843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6000ceef0 0x7ff6000ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:24.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.564+0000 7ff606ada640 1 -- 172.21.15.87:0/907683843 >> 172.21.15.87:0/907683843 conn(0x7ff60006ba00 msgr2=0x7ff6000cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:24.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.564+0000 7ff606ada640 1 -- 172.21.15.87:0/907683843 shutdown_connections 2023-12-16T20:49:24.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.564+0000 7ff606ada640 1 -- 172.21.15.87:0/907683843 wait complete. 2023-12-16T20:49:24.576 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T20:49:24.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.677+0000 7fc40855a640 1 Processor -- start 2023-12-16T20:49:24.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.677+0000 7fc40855a640 1 -- start start 2023-12-16T20:49:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.678+0000 7fc40855a640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc4001516f0 0x7fc4000c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.678+0000 7fc40855a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc400157e80 0x7fc4000ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.678+0000 7fc40855a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4000c8520 con 0x7fc4000ca400 2023-12-16T20:49:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.678+0000 7fc40855a640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4000c8db0 con 0x7fc4001516f0 2023-12-16T20:49:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.678+0000 7fc40855a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4000c9080 con 0x7fc400157e80 2023-12-16T20:49:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.678+0000 7fc405af5640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc4000ca400 0x7fc4000b0dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:35000/0 (socket says 172.21.15.87:35000) 2023-12-16T20:49:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.678+0000 7fc405af5640 1 -- 172.21.15.87:0/526922389 learned_addr learned my addr 172.21.15.87:0/526922389 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:49:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.678+0000 7fc4062f6640 1 --2- 172.21.15.87:0/526922389 >> v2:172.21.15.195:3300/0 conn(0x7fc4001516f0 0x7fc4000c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:24.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.679+0000 7fc406af7640 1 --2- 172.21.15.87:0/526922389 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc400157e80 0x7fc4000ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.681+0000 7fc4052f4640 1 -- 172.21.15.87:0/526922389 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830685553 0 0) 0x7fc4000c8520 con 0x7fc4000ca400 2023-12-16T20:49:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.681+0000 7fc4052f4640 1 -- 172.21.15.87:0/526922389 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3ec003520 con 0x7fc4000ca400 2023-12-16T20:49:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.681+0000 7fc406af7640 1 -- 172.21.15.87:0/526922389 >> v2:172.21.15.195:3300/0 conn(0x7fc4001516f0 msgr2=0x7fc4000c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.681+0000 7fc406af7640 1 --2- 172.21.15.87:0/526922389 >> v2:172.21.15.195:3300/0 conn(0x7fc4001516f0 0x7fc4000c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.681+0000 7fc406af7640 1 -- 172.21.15.87:0/526922389 >> v1:172.21.15.87:6789/0 conn(0x7fc4000ca400 legacy=0x7fc4000b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.681+0000 7fc406af7640 1 -- 172.21.15.87:0/526922389 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4000c9360 con 0x7fc400157e80 2023-12-16T20:49:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.681+0000 7fc4062f6640 1 --2- 172.21.15.87:0/526922389 >> v2:172.21.15.195:3300/0 conn(0x7fc4001516f0 0x7fc4000c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T20:49:24.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.683+0000 7fc406af7640 1 --2- 172.21.15.87:0/526922389 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc400157e80 0x7fc4000ccd20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8009d90 tx=0x7fc3f802bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bd1bd5bde883560 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:24.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.686+0000 7fc4052f4640 1 -- 172.21.15.87:0/526922389 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f802cce0 con 0x7fc400157e80 2023-12-16T20:49:24.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.686+0000 7fc4052f4640 1 -- 172.21.15.87:0/526922389 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f802ce40 con 0x7fc400157e80 2023-12-16T20:49:24.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.686+0000 7fc4052f4640 1 -- 172.21.15.87:0/526922389 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8034660 con 0x7fc400157e80 2023-12-16T20:49:24.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.687+0000 7fc40855a640 1 -- 172.21.15.87:0/526922389 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc400157e80 msgr2=0x7fc4000ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:24.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.687+0000 7fc40855a640 1 --2- 172.21.15.87:0/526922389 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc400157e80 0x7fc4000ccd20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8009d90 tx=0x7fc3f802bf30 comp rx=0 tx=0).stop 2023-12-16T20:49:24.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.687+0000 7fc40855a640 1 -- 172.21.15.87:0/526922389 shutdown_connections 2023-12-16T20:49:24.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.687+0000 7fc40855a640 1 --2- 172.21.15.87:0/526922389 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc400157e80 0x7fc4000ccd20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:24.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.687+0000 7fc40855a640 1 --2- 172.21.15.87:0/526922389 >> v2:172.21.15.195:3300/0 conn(0x7fc4001516f0 0x7fc4000c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:24.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.687+0000 7fc40855a640 1 -- 172.21.15.87:0/526922389 >> 172.21.15.87:0/526922389 conn(0x7fc400060f20 msgr2=0x7fc400061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:24.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.687+0000 7fc40855a640 1 -- 172.21.15.87:0/526922389 shutdown_connections 2023-12-16T20:49:24.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.687+0000 7fc40855a640 1 -- 172.21.15.87:0/526922389 wait complete. 2023-12-16T20:49:24.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.688+0000 7fc40855a640 1 Processor -- start 2023-12-16T20:49:24.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.688+0000 7fc40855a640 1 -- start start 2023-12-16T20:49:24.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.689+0000 7fc40855a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4000ca400 0x7fc400153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:24.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.689+0000 7fc40855a640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc4001516f0 0x7fc4000c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:24.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.689+0000 7fc40855a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc400157e80 0x7fc400153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:24.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.689+0000 7fc40855a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc400153640 con 0x7fc4000ca400 2023-12-16T20:49:24.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.689+0000 7fc40855a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc400156510 con 0x7fc400157e80 2023-12-16T20:49:24.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.689+0000 7fc40855a640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4001eec00 con 0x7fc4001516f0 2023-12-16T20:49:24.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.690+0000 7fc4062f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4000ca400 0x7fc400153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:24.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.690+0000 7fc4062f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4000ca400 0x7fc400153100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52440/0 (socket says 172.21.15.87:52440) 2023-12-16T20:49:24.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.690+0000 7fc4062f6640 1 -- 172.21.15.87:0/2053141286 learned_addr learned my addr 172.21.15.87:0/2053141286 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:24.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.690+0000 7fc405af5640 1 --2- 172.21.15.87:0/2053141286 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc4001516f0 0x7fc4000c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:24.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.690+0000 7fc406af7640 1 --2- 172.21.15.87:0/2053141286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc400157e80 0x7fc400153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:24.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.693+0000 7fc4062f6640 1 -- 172.21.15.87:0/2053141286 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc4001516f0 msgr2=0x7fc4000c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:24.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.693+0000 7fc4062f6640 1 --2- 172.21.15.87:0/2053141286 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc4001516f0 0x7fc4000c65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:24.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.693+0000 7fc4062f6640 1 -- 172.21.15.87:0/2053141286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc400157e80 msgr2=0x7fc400153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:24.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.693+0000 7fc4062f6640 1 --2- 172.21.15.87:0/2053141286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc400157e80 0x7fc400153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:24.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.693+0000 7fc4062f6640 1 -- 172.21.15.87:0/2053141286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc009400 con 0x7fc4000ca400 2023-12-16T20:49:24.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.696+0000 7fc4062f6640 1 --2- 172.21.15.87:0/2053141286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4000ca400 0x7fc400153100 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc00ebe0 tx=0x7fc3fc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:24.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.700+0000 7fc3f6ffd640 1 -- 172.21.15.87:0/2053141286 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc009760 con 0x7fc4000ca400 2023-12-16T20:49:24.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.700+0000 7fc3f6ffd640 1 -- 172.21.15.87:0/2053141286 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc00cc30 con 0x7fc4000ca400 2023-12-16T20:49:24.701 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.700+0000 7fc3f6ffd640 1 -- 172.21.15.87:0/2053141286 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc00eee0 con 0x7fc4000ca400 2023-12-16T20:49:24.701 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.700+0000 7fc40855a640 1 -- 172.21.15.87:0/2053141286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f8009a70 con 0x7fc4000ca400 2023-12-16T20:49:24.701 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.700+0000 7fc40855a640 1 -- 172.21.15.87:0/2053141286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4001ef1a0 con 0x7fc4000ca400 2023-12-16T20:49:24.701 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.701+0000 7fc40855a640 1 -- 172.21.15.87:0/2053141286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc400067500 con 0x7fc4000ca400 2023-12-16T20:49:24.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.942+0000 7fc3f6ffd640 1 -- 172.21.15.87:0/2053141286 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fc3fc013470 con 0x7fc4000ca400 2023-12-16T20:49:24.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.942+0000 7fc3f6ffd640 1 --2- 172.21.15.87:0/2053141286 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc3e406ae70 0x7fc3e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:24.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.942+0000 7fc405af5640 1 --2- 172.21.15.87:0/2053141286 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc3e406ae70 0x7fc3e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:24.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.943+0000 7fc405af5640 1 --2- 172.21.15.87:0/2053141286 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc3e406ae70 0x7fc3e406d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc4000afd20 tx=0x7fc3f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:24.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.955+0000 7fc3f6ffd640 1 -- 172.21.15.87:0/2053141286 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc3fc058e60 con 0x7fc4000ca400 2023-12-16T20:49:24.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:24.955+0000 7fc3f6ffd640 1 -- 172.21.15.87:0/2053141286 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fc3fc0551a0 con 0x7fc4000ca400 2023-12-16T20:49:25.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:25.125+0000 7fc40855a640 1 -- 172.21.15.87:0/2053141286 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4000c9c00 con 0x7fc3e406ae70 2023-12-16T20:49:25.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:25.135+0000 7fc3f6ffd640 1 -- 172.21.15.87:0/2053141286 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368735 (secure 0 0 0) 0x7fc3f000f820 con 0x7fc3e406ae70 2023-12-16T20:49:25.140 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:49:25.142 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-12-16T20:49:25.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:25.138+0000 7fc40855a640 1 -- 172.21.15.87:0/2053141286 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc3e406ae70 msgr2=0x7fc3e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:25.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:25.138+0000 7fc40855a640 1 --2- 172.21.15.87:0/2053141286 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc3e406ae70 0x7fc3e406d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc4000afd20 tx=0x7fc3f0009040 comp rx=0 tx=0).stop 2023-12-16T20:49:25.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:25.139+0000 7fc40855a640 1 -- 172.21.15.87:0/2053141286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4000ca400 msgr2=0x7fc400153100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:25.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:25.139+0000 7fc40855a640 1 --2- 172.21.15.87:0/2053141286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4000ca400 0x7fc400153100 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc00ebe0 tx=0x7fc3fc00c520 comp rx=0 tx=0).stop 2023-12-16T20:49:25.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:25.139+0000 7fc40855a640 1 -- 172.21.15.87:0/2053141286 shutdown_connections 2023-12-16T20:49:25.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:25.139+0000 7fc40855a640 1 --2- 172.21.15.87:0/2053141286 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fc3e406ae70 0x7fc3e406d330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:25.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:25.139+0000 7fc40855a640 1 --2- 172.21.15.87:0/2053141286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc400157e80 0x7fc400153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:25.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:25.139+0000 7fc40855a640 1 --2- 172.21.15.87:0/2053141286 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc4001516f0 0x7fc4000c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:25.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:25.139+0000 7fc40855a640 1 --2- 172.21.15.87:0/2053141286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4000ca400 0x7fc400153100 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:25.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:25.139+0000 7fc40855a640 1 -- 172.21.15.87:0/2053141286 >> 172.21.15.87:0/2053141286 conn(0x7fc400060f20 msgr2=0x7fc400156dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:25.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:25.139+0000 7fc40855a640 1 -- 172.21.15.87:0/2053141286 shutdown_connections 2023-12-16T20:49:25.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:25.139+0000 7fc40855a640 1 -- 172.21.15.87:0/2053141286 wait complete. 2023-12-16T20:49:25.153 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":862,"stamp":"2023-12-16T20:49:24.648140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41060283,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1154,"num_read_kb":1198,"num_write":13351,"num_write_kb":371526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15842,"ondisk_log_size":15842,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":431648,"kb_used_data":57312,"kb_used_omap":12,"kb_used_meta":374259,"kb_avail":754543072,"statfs":{"total":773094113280,"available":772652105728,"internally_reserved":0,"allocated":58687488,"data_stored":83068718,"data_compressed":7551796,"data_compressed_allocated":11804672,"data_compressed_original":37634048,"omap_allocated":12751,"internal_metadata":383241777},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002857"},"pg_stats":[{"pgid":"2.1f","version":"27'642","reported_seq":674,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:55.656821+0000","last_change":"2023-12-16T20:21:35.413343+0000","last_active":"2023-12-16T20:48:55.656821+0000","last_peered":"2023-12-16T20:48:55.656821+0000","last_clean":"2023-12-16T20:48:55.656821+0000","last_became_active":"2023-12-16T20:21:35.413075+0000","last_became_peered":"2023-12-16T20:21:35.413075+0000","last_unstale":"2023-12-16T20:48:55.656821+0000","last_undegraded":"2023-12-16T20:48:55.656821+0000","last_fullsized":"2023-12-16T20:48:55.656821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'31","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796992+0000","last_change":"2023-12-16T20:21:36.542907+0000","last_active":"2023-12-16T20:49:08.796992+0000","last_peered":"2023-12-16T20:49:08.796992+0000","last_clean":"2023-12-16T20:49:08.796992+0000","last_became_active":"2023-12-16T20:21:36.542667+0000","last_became_peered":"2023-12-16T20:21:36.542667+0000","last_unstale":"2023-12-16T20:49:08.796992+0000","last_undegraded":"2023-12-16T20:49:08.796992+0000","last_fullsized":"2023-12-16T20:49:08.796992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'182","reported_seq":209,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.469524+0000","last_change":"2023-12-16T20:21:41.216466+0000","last_active":"2023-12-16T20:48:41.469524+0000","last_peered":"2023-12-16T20:48:41.469524+0000","last_clean":"2023-12-16T20:48:41.469524+0000","last_became_active":"2023-12-16T20:21:41.216062+0000","last_became_peered":"2023-12-16T20:21:41.216062+0000","last_unstale":"2023-12-16T20:48:41.469524+0000","last_undegraded":"2023-12-16T20:48:41.469524+0000","last_fullsized":"2023-12-16T20:48:41.469524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":13331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'710","reported_seq":742,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:52.554810+0000","last_change":"2023-12-16T20:21:35.420038+0000","last_active":"2023-12-16T20:48:52.554810+0000","last_peered":"2023-12-16T20:48:52.554810+0000","last_clean":"2023-12-16T20:48:52.554810+0000","last_became_active":"2023-12-16T20:21:35.419745+0000","last_became_peered":"2023-12-16T20:21:35.419745+0000","last_unstale":"2023-12-16T20:48:52.554810+0000","last_undegraded":"2023-12-16T20:48:52.554810+0000","last_fullsized":"2023-12-16T20:48:52.554810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'38","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:20.169422+0000","last_change":"2023-12-16T20:49:20.169443+0000","last_active":"2023-12-16T20:49:20.169422+0000","last_peered":"2023-12-16T20:49:20.169422+0000","last_clean":"2023-12-16T20:49:20.169422+0000","last_became_active":"2023-12-16T20:21:36.552621+0000","last_became_peered":"2023-12-16T20:21:36.552621+0000","last_unstale":"2023-12-16T20:49:20.169422+0000","last_undegraded":"2023-12-16T20:49:20.169422+0000","last_fullsized":"2023-12-16T20:49:20.169422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:20.169357+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:20.169357+0000","last_clean_scrub_stamp":"2023-12-16T20:49:20.169357+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:05:52.134660+0000","scrub_duration":0.001403729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'122","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:38.770349+0000","last_change":"2023-12-16T20:21:40.754959+0000","last_active":"2023-12-16T20:48:38.770349+0000","last_peered":"2023-12-16T20:48:38.770349+0000","last_clean":"2023-12-16T20:48:38.770349+0000","last_became_active":"2023-12-16T20:21:40.754509+0000","last_became_peered":"2023-12-16T20:21:40.754509+0000","last_unstale":"2023-12-16T20:48:38.770349+0000","last_undegraded":"2023-12-16T20:48:38.770349+0000","last_fullsized":"2023-12-16T20:48:38.770349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:21.787809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1392","reported_seq":1421,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:01.711787+0000","last_change":"2023-12-16T20:21:35.427622+0000","last_active":"2023-12-16T20:49:01.711787+0000","last_peered":"2023-12-16T20:49:01.711787+0000","last_clean":"2023-12-16T20:49:01.711787+0000","last_became_active":"2023-12-16T20:21:35.427317+0000","last_became_peered":"2023-12-16T20:21:35.427317+0000","last_unstale":"2023-12-16T20:49:01.711787+0000","last_undegraded":"2023-12-16T20:49:01.711787+0000","last_fullsized":"2023-12-16T20:49:01.711787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1392,"log_dups_size":0,"ondisk_log_size":1392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":9004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'33","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.888700+0000","last_change":"2023-12-16T20:22:14.769257+0000","last_active":"2023-12-16T20:49:08.888700+0000","last_peered":"2023-12-16T20:49:08.888700+0000","last_clean":"2023-12-16T20:49:08.888700+0000","last_became_active":"2023-12-16T20:22:14.768968+0000","last_became_peered":"2023-12-16T20:22:14.768968+0000","last_unstale":"2023-12-16T20:49:08.888700+0000","last_undegraded":"2023-12-16T20:49:08.888700+0000","last_fullsized":"2023-12-16T20:49:08.888700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"27'156","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.509449+0000","last_change":"2023-12-16T20:22:14.820429+0000","last_active":"2023-12-16T20:48:41.509449+0000","last_peered":"2023-12-16T20:48:41.509449+0000","last_clean":"2023-12-16T20:48:41.509449+0000","last_became_active":"2023-12-16T20:22:14.819924+0000","last_became_peered":"2023-12-16T20:22:14.819924+0000","last_unstale":"2023-12-16T20:48:41.509449+0000","last_undegraded":"2023-12-16T20:48:41.509449+0000","last_fullsized":"2023-12-16T20:48:41.509449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:10:42.982067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":12476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:59.710315+0000","last_change":"2023-12-16T20:21:35.413521+0000","last_active":"2023-12-16T20:48:59.710315+0000","last_peered":"2023-12-16T20:48:59.710315+0000","last_clean":"2023-12-16T20:48:59.710315+0000","last_became_active":"2023-12-16T20:21:35.413234+0000","last_became_peered":"2023-12-16T20:21:35.413234+0000","last_unstale":"2023-12-16T20:48:59.710315+0000","last_undegraded":"2023-12-16T20:48:59.710315+0000","last_fullsized":"2023-12-16T20:48:59.710315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'49","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.819877+0000","last_change":"2023-12-16T20:21:36.554419+0000","last_active":"2023-12-16T20:49:08.819877+0000","last_peered":"2023-12-16T20:49:08.819877+0000","last_clean":"2023-12-16T20:49:08.819877+0000","last_became_active":"2023-12-16T20:21:36.554014+0000","last_became_peered":"2023-12-16T20:21:36.554014+0000","last_unstale":"2023-12-16T20:49:08.819877+0000","last_undegraded":"2023-12-16T20:49:08.819877+0000","last_fullsized":"2023-12-16T20:49:08.819877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:03.543973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'146","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.419020+0000","last_change":"2023-12-16T20:21:40.794852+0000","last_active":"2023-12-16T20:48:41.419020+0000","last_peered":"2023-12-16T20:48:41.419020+0000","last_clean":"2023-12-16T20:48:41.419020+0000","last_became_active":"2023-12-16T20:21:40.794471+0000","last_became_peered":"2023-12-16T20:21:40.794471+0000","last_unstale":"2023-12-16T20:48:41.419020+0000","last_undegraded":"2023-12-16T20:48:41.419020+0000","last_fullsized":"2023-12-16T20:48:41.419020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:25.004850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'39","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.890251+0000","last_change":"2023-12-16T20:21:36.542450+0000","last_active":"2023-12-16T20:49:08.890251+0000","last_peered":"2023-12-16T20:49:08.890251+0000","last_clean":"2023-12-16T20:49:08.890251+0000","last_became_active":"2023-12-16T20:21:36.542157+0000","last_became_peered":"2023-12-16T20:21:36.542157+0000","last_unstale":"2023-12-16T20:49:08.890251+0000","last_undegraded":"2023-12-16T20:49:08.890251+0000","last_fullsized":"2023-12-16T20:49:08.890251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:45.448675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'680","reported_seq":710,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:01.713499+0000","last_change":"2023-12-16T20:21:35.413681+0000","last_active":"2023-12-16T20:49:01.713499+0000","last_peered":"2023-12-16T20:49:01.713499+0000","last_clean":"2023-12-16T20:49:01.713499+0000","last_became_active":"2023-12-16T20:21:35.413400+0000","last_became_peered":"2023-12-16T20:21:35.413400+0000","last_unstale":"2023-12-16T20:49:01.713499+0000","last_undegraded":"2023-12-16T20:49:01.713499+0000","last_fullsized":"2023-12-16T20:49:01.713499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:27.767422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":4429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'121","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.504489+0000","last_change":"2023-12-16T20:21:40.745971+0000","last_active":"2023-12-16T20:48:41.504489+0000","last_peered":"2023-12-16T20:48:41.504489+0000","last_clean":"2023-12-16T20:48:41.504489+0000","last_became_active":"2023-12-16T20:21:40.745544+0000","last_became_peered":"2023-12-16T20:21:40.745544+0000","last_unstale":"2023-12-16T20:48:41.504489+0000","last_undegraded":"2023-12-16T20:48:41.504489+0000","last_fullsized":"2023-12-16T20:48:41.504489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:18.981353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":10860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'38","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.802637+0000","last_change":"2023-12-16T20:21:36.526277+0000","last_active":"2023-12-16T20:49:08.802637+0000","last_peered":"2023-12-16T20:49:08.802637+0000","last_clean":"2023-12-16T20:49:08.802637+0000","last_became_active":"2023-12-16T20:21:36.525983+0000","last_became_peered":"2023-12-16T20:21:36.525983+0000","last_unstale":"2023-12-16T20:49:08.802637+0000","last_undegraded":"2023-12-16T20:49:08.802637+0000","last_fullsized":"2023-12-16T20:49:08.802637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:00.763597+0000","last_change":"2023-12-16T20:21:35.420017+0000","last_active":"2023-12-16T20:49:00.763597+0000","last_peered":"2023-12-16T20:49:00.763597+0000","last_clean":"2023-12-16T20:49:00.763597+0000","last_became_active":"2023-12-16T20:21:35.419731+0000","last_became_peered":"2023-12-16T20:21:35.419731+0000","last_unstale":"2023-12-16T20:49:00.763597+0000","last_undegraded":"2023-12-16T20:49:00.763597+0000","last_fullsized":"2023-12-16T20:49:00.763597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'169","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.507104+0000","last_change":"2023-12-16T20:21:40.755335+0000","last_active":"2023-12-16T20:48:41.507104+0000","last_peered":"2023-12-16T20:48:41.507104+0000","last_clean":"2023-12-16T20:48:41.507104+0000","last_became_active":"2023-12-16T20:21:40.754829+0000","last_became_peered":"2023-12-16T20:21:40.754829+0000","last_unstale":"2023-12-16T20:48:41.507104+0000","last_undegraded":"2023-12-16T20:48:41.507104+0000","last_fullsized":"2023-12-16T20:48:41.507104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":10412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'38","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.799347+0000","last_change":"2023-12-16T20:21:36.518939+0000","last_active":"2023-12-16T20:49:08.799347+0000","last_peered":"2023-12-16T20:49:08.799347+0000","last_clean":"2023-12-16T20:49:08.799347+0000","last_became_active":"2023-12-16T20:21:36.518686+0000","last_became_peered":"2023-12-16T20:21:36.518686+0000","last_unstale":"2023-12-16T20:49:08.799347+0000","last_undegraded":"2023-12-16T20:49:08.799347+0000","last_fullsized":"2023-12-16T20:49:08.799347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:53.547506+0000","last_change":"2023-12-16T20:21:35.416372+0000","last_active":"2023-12-16T20:48:53.547506+0000","last_peered":"2023-12-16T20:48:53.547506+0000","last_clean":"2023-12-16T20:48:53.547506+0000","last_became_active":"2023-12-16T20:21:35.416067+0000","last_became_peered":"2023-12-16T20:21:35.416067+0000","last_unstale":"2023-12-16T20:48:53.547506+0000","last_undegraded":"2023-12-16T20:48:53.547506+0000","last_fullsized":"2023-12-16T20:48:53.547506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'126","reported_seq":154,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.483608+0000","last_change":"2023-12-16T20:21:41.215250+0000","last_active":"2023-12-16T20:48:46.483608+0000","last_peered":"2023-12-16T20:48:46.483608+0000","last_clean":"2023-12-16T20:48:46.483608+0000","last_became_active":"2023-12-16T20:21:41.214198+0000","last_became_peered":"2023-12-16T20:21:41.214198+0000","last_unstale":"2023-12-16T20:48:46.483608+0000","last_undegraded":"2023-12-16T20:48:46.483608+0000","last_fullsized":"2023-12-16T20:48:46.483608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":7034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'34","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.238701+0000","last_change":"2023-12-16T20:21:36.536797+0000","last_active":"2023-12-16T20:48:39.238701+0000","last_peered":"2023-12-16T20:48:39.238701+0000","last_clean":"2023-12-16T20:48:39.238701+0000","last_became_active":"2023-12-16T20:21:36.536321+0000","last_became_peered":"2023-12-16T20:21:36.536321+0000","last_unstale":"2023-12-16T20:48:39.238701+0000","last_undegraded":"2023-12-16T20:48:39.238701+0000","last_fullsized":"2023-12-16T20:48:39.238701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:55:55.607439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'6","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:57.613311+0000","last_change":"2023-12-16T20:21:35.425939+0000","last_active":"2023-12-16T20:48:57.613311+0000","last_peered":"2023-12-16T20:48:57.613311+0000","last_clean":"2023-12-16T20:48:57.613311+0000","last_became_active":"2023-12-16T20:21:35.420547+0000","last_became_peered":"2023-12-16T20:21:35.420547+0000","last_unstale":"2023-12-16T20:48:57.613311+0000","last_undegraded":"2023-12-16T20:48:57.613311+0000","last_fullsized":"2023-12-16T20:48:57.613311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:58:31.980302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'120","reported_seq":147,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.507092+0000","last_change":"2023-12-16T20:21:40.757445+0000","last_active":"2023-12-16T20:48:41.507092+0000","last_peered":"2023-12-16T20:48:41.507092+0000","last_clean":"2023-12-16T20:48:41.507092+0000","last_became_active":"2023-12-16T20:21:40.756997+0000","last_became_peered":"2023-12-16T20:21:40.756997+0000","last_unstale":"2023-12-16T20:48:41.507092+0000","last_undegraded":"2023-12-16T20:48:41.507092+0000","last_fullsized":"2023-12-16T20:48:41.507092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:32.702839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":6714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'40","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.973265+0000","last_change":"2023-12-16T20:21:36.524943+0000","last_active":"2023-12-16T20:49:08.973265+0000","last_peered":"2023-12-16T20:49:08.973265+0000","last_clean":"2023-12-16T20:49:08.973265+0000","last_became_active":"2023-12-16T20:21:36.524703+0000","last_became_peered":"2023-12-16T20:21:36.524703+0000","last_unstale":"2023-12-16T20:49:08.973265+0000","last_undegraded":"2023-12-16T20:49:08.973265+0000","last_fullsized":"2023-12-16T20:49:08.973265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:00.760340+0000","last_change":"2023-12-16T20:21:35.428736+0000","last_active":"2023-12-16T20:49:00.760340+0000","last_peered":"2023-12-16T20:49:00.760340+0000","last_clean":"2023-12-16T20:49:00.760340+0000","last_became_active":"2023-12-16T20:21:35.428465+0000","last_became_peered":"2023-12-16T20:21:35.428465+0000","last_unstale":"2023-12-16T20:49:00.760340+0000","last_undegraded":"2023-12-16T20:49:00.760340+0000","last_fullsized":"2023-12-16T20:49:00.760340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:34:32.539715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'152","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.504901+0000","last_change":"2023-12-16T20:21:41.213330+0000","last_active":"2023-12-16T20:48:41.504901+0000","last_peered":"2023-12-16T20:48:41.504901+0000","last_clean":"2023-12-16T20:48:41.504901+0000","last_became_active":"2023-12-16T20:21:41.212976+0000","last_became_peered":"2023-12-16T20:21:41.212976+0000","last_unstale":"2023-12-16T20:48:41.504901+0000","last_undegraded":"2023-12-16T20:48:41.504901+0000","last_fullsized":"2023-12-16T20:48:41.504901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:32:02.178544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":10330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'37","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.799385+0000","last_change":"2023-12-16T20:21:36.518956+0000","last_active":"2023-12-16T20:49:08.799385+0000","last_peered":"2023-12-16T20:49:08.799385+0000","last_clean":"2023-12-16T20:49:08.799385+0000","last_became_active":"2023-12-16T20:21:36.518673+0000","last_became_peered":"2023-12-16T20:21:36.518673+0000","last_unstale":"2023-12-16T20:49:08.799385+0000","last_undegraded":"2023-12-16T20:49:08.799385+0000","last_fullsized":"2023-12-16T20:49:08.799385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'310","reported_seq":341,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:10.565043+0000","last_change":"2023-12-16T20:21:35.423292+0000","last_active":"2023-12-16T20:49:10.565043+0000","last_peered":"2023-12-16T20:49:10.565043+0000","last_clean":"2023-12-16T20:49:10.565043+0000","last_became_active":"2023-12-16T20:21:35.423045+0000","last_became_peered":"2023-12-16T20:21:35.423045+0000","last_unstale":"2023-12-16T20:49:10.565043+0000","last_undegraded":"2023-12-16T20:49:10.565043+0000","last_fullsized":"2023-12-16T20:49:10.565043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":886,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'156","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.465959+0000","last_change":"2023-12-16T20:21:41.216113+0000","last_active":"2023-12-16T20:48:41.465959+0000","last_peered":"2023-12-16T20:48:41.465959+0000","last_clean":"2023-12-16T20:48:41.465959+0000","last_became_active":"2023-12-16T20:21:41.215747+0000","last_became_peered":"2023-12-16T20:21:41.215747+0000","last_unstale":"2023-12-16T20:48:41.465959+0000","last_undegraded":"2023-12-16T20:48:41.465959+0000","last_fullsized":"2023-12-16T20:48:41.465959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'35","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796509+0000","last_change":"2023-12-16T20:21:36.451660+0000","last_active":"2023-12-16T20:49:08.796509+0000","last_peered":"2023-12-16T20:49:08.796509+0000","last_clean":"2023-12-16T20:49:08.796509+0000","last_became_active":"2023-12-16T20:21:36.451404+0000","last_became_peered":"2023-12-16T20:21:36.451404+0000","last_unstale":"2023-12-16T20:49:08.796509+0000","last_undegraded":"2023-12-16T20:49:08.796509+0000","last_fullsized":"2023-12-16T20:49:08.796509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:47.488000+0000","last_change":"2023-12-16T20:21:35.420184+0000","last_active":"2023-12-16T20:48:47.488000+0000","last_peered":"2023-12-16T20:48:47.488000+0000","last_clean":"2023-12-16T20:48:47.488000+0000","last_became_active":"2023-12-16T20:21:35.419917+0000","last_became_peered":"2023-12-16T20:21:35.419917+0000","last_unstale":"2023-12-16T20:48:47.488000+0000","last_undegraded":"2023-12-16T20:48:47.488000+0000","last_fullsized":"2023-12-16T20:48:47.488000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:19.491578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'136","reported_seq":165,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.501274+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:48:46.501274+0000","last_peered":"2023-12-16T20:48:46.501274+0000","last_clean":"2023-12-16T20:48:46.501274+0000","last_became_active":"2023-12-16T20:21:41.212704+0000","last_became_peered":"2023-12-16T20:21:41.212704+0000","last_unstale":"2023-12-16T20:48:46.501274+0000","last_undegraded":"2023-12-16T20:48:46.501274+0000","last_fullsized":"2023-12-16T20:48:46.501274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":9011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'38","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820634+0000","last_change":"2023-12-16T20:21:36.555288+0000","last_active":"2023-12-16T20:49:08.820634+0000","last_peered":"2023-12-16T20:49:08.820634+0000","last_clean":"2023-12-16T20:49:08.820634+0000","last_became_active":"2023-12-16T20:21:36.555011+0000","last_became_peered":"2023-12-16T20:21:36.555011+0000","last_unstale":"2023-12-16T20:49:08.820634+0000","last_undegraded":"2023-12-16T20:49:08.820634+0000","last_fullsized":"2023-12-16T20:49:08.820634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:43:06.805922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'5","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:00.763563+0000","last_change":"2023-12-16T20:21:35.417945+0000","last_active":"2023-12-16T20:49:00.763563+0000","last_peered":"2023-12-16T20:49:00.763563+0000","last_clean":"2023-12-16T20:49:00.763563+0000","last_became_active":"2023-12-16T20:21:35.417683+0000","last_became_peered":"2023-12-16T20:21:35.417683+0000","last_unstale":"2023-12-16T20:49:00.763563+0000","last_undegraded":"2023-12-16T20:49:00.763563+0000","last_fullsized":"2023-12-16T20:49:00.763563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'180","reported_seq":209,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.483523+0000","last_change":"2023-12-16T20:21:40.794299+0000","last_active":"2023-12-16T20:48:46.483523+0000","last_peered":"2023-12-16T20:48:46.483523+0000","last_clean":"2023-12-16T20:48:46.483523+0000","last_became_active":"2023-12-16T20:21:40.793754+0000","last_became_peered":"2023-12-16T20:21:40.793754+0000","last_unstale":"2023-12-16T20:48:46.483523+0000","last_undegraded":"2023-12-16T20:48:46.483523+0000","last_fullsized":"2023-12-16T20:48:46.483523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":10123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'33","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820560+0000","last_change":"2023-12-16T20:21:36.534278+0000","last_active":"2023-12-16T20:49:08.820560+0000","last_peered":"2023-12-16T20:49:08.820560+0000","last_clean":"2023-12-16T20:49:08.820560+0000","last_became_active":"2023-12-16T20:21:36.533651+0000","last_became_peered":"2023-12-16T20:21:36.533651+0000","last_unstale":"2023-12-16T20:49:08.820560+0000","last_undegraded":"2023-12-16T20:49:08.820560+0000","last_fullsized":"2023-12-16T20:49:08.820560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:58:33.098369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'7","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:55.659121+0000","last_change":"2023-12-16T20:21:35.422128+0000","last_active":"2023-12-16T20:48:55.659121+0000","last_peered":"2023-12-16T20:48:55.659121+0000","last_clean":"2023-12-16T20:48:55.659121+0000","last_became_active":"2023-12-16T20:21:35.421875+0000","last_became_peered":"2023-12-16T20:21:35.421875+0000","last_unstale":"2023-12-16T20:48:55.659121+0000","last_undegraded":"2023-12-16T20:48:55.659121+0000","last_fullsized":"2023-12-16T20:48:55.659121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:24.569380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'112","reported_seq":141,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.483549+0000","last_change":"2023-12-16T20:21:40.754363+0000","last_active":"2023-12-16T20:48:46.483549+0000","last_peered":"2023-12-16T20:48:46.483549+0000","last_clean":"2023-12-16T20:48:46.483549+0000","last_became_active":"2023-12-16T20:21:40.753994+0000","last_became_peered":"2023-12-16T20:21:40.753994+0000","last_unstale":"2023-12-16T20:48:46.483549+0000","last_undegraded":"2023-12-16T20:48:46.483549+0000","last_fullsized":"2023-12-16T20:48:46.483549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'33","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796532+0000","last_change":"2023-12-16T20:21:36.451488+0000","last_active":"2023-12-16T20:49:08.796532+0000","last_peered":"2023-12-16T20:49:08.796532+0000","last_clean":"2023-12-16T20:49:08.796532+0000","last_became_active":"2023-12-16T20:21:36.451231+0000","last_became_peered":"2023-12-16T20:21:36.451231+0000","last_unstale":"2023-12-16T20:49:08.796532+0000","last_undegraded":"2023-12-16T20:49:08.796532+0000","last_fullsized":"2023-12-16T20:49:08.796532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'1042","reported_seq":2112,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:02.727007+0000","last_change":"2023-12-16T20:21:35.420494+0000","last_active":"2023-12-16T20:49:02.727007+0000","last_peered":"2023-12-16T20:49:02.727007+0000","last_clean":"2023-12-16T20:49:02.727007+0000","last_became_active":"2023-12-16T20:21:35.420236+0000","last_became_peered":"2023-12-16T20:21:35.420236+0000","last_unstale":"2023-12-16T20:49:02.727007+0000","last_undegraded":"2023-12-16T20:49:02.727007+0000","last_fullsized":"2023-12-16T20:49:02.727007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":1042,"log_dups_size":0,"ondisk_log_size":1042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222889,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1038,"num_read_kb":1098,"num_write":1039,"num_write_kb":1099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'134","reported_seq":159,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.484635+0000","last_change":"2023-12-16T20:22:14.842642+0000","last_active":"2023-12-16T20:48:41.484635+0000","last_peered":"2023-12-16T20:48:41.484635+0000","last_clean":"2023-12-16T20:48:41.484635+0000","last_became_active":"2023-12-16T20:22:14.842220+0000","last_became_peered":"2023-12-16T20:22:14.842220+0000","last_unstale":"2023-12-16T20:48:41.484635+0000","last_undegraded":"2023-12-16T20:48:41.484635+0000","last_fullsized":"2023-12-16T20:48:41.484635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":9129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"27'27","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.972439+0000","last_change":"2023-12-16T20:21:36.535835+0000","last_active":"2023-12-16T20:49:08.972439+0000","last_peered":"2023-12-16T20:49:08.972439+0000","last_clean":"2023-12-16T20:49:08.972439+0000","last_became_active":"2023-12-16T20:21:36.535571+0000","last_became_peered":"2023-12-16T20:21:36.535571+0000","last_unstale":"2023-12-16T20:49:08.972439+0000","last_undegraded":"2023-12-16T20:49:08.972439+0000","last_fullsized":"2023-12-16T20:49:08.972439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'544","reported_seq":575,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:57.613647+0000","last_change":"2023-12-16T20:21:35.418993+0000","last_active":"2023-12-16T20:48:57.613647+0000","last_peered":"2023-12-16T20:48:57.613647+0000","last_clean":"2023-12-16T20:48:57.613647+0000","last_became_active":"2023-12-16T20:21:35.418751+0000","last_became_peered":"2023-12-16T20:21:35.418751+0000","last_unstale":"2023-12-16T20:48:57.613647+0000","last_undegraded":"2023-12-16T20:48:57.613647+0000","last_fullsized":"2023-12-16T20:48:57.613647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:18.391557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'129","reported_seq":157,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:40.300141+0000","last_change":"2023-12-16T20:21:41.214405+0000","last_active":"2023-12-16T20:48:40.300141+0000","last_peered":"2023-12-16T20:48:40.300141+0000","last_clean":"2023-12-16T20:48:40.300141+0000","last_became_active":"2023-12-16T20:21:41.213977+0000","last_became_peered":"2023-12-16T20:21:41.213977+0000","last_unstale":"2023-12-16T20:48:40.300141+0000","last_undegraded":"2023-12-16T20:48:40.300141+0000","last_fullsized":"2023-12-16T20:48:40.300141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":8382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'30","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796326+0000","last_change":"2023-12-16T20:21:36.551240+0000","last_active":"2023-12-16T20:49:08.796326+0000","last_peered":"2023-12-16T20:49:08.796326+0000","last_clean":"2023-12-16T20:49:08.796326+0000","last_became_active":"2023-12-16T20:21:36.550997+0000","last_became_peered":"2023-12-16T20:21:36.550997+0000","last_unstale":"2023-12-16T20:49:08.796326+0000","last_undegraded":"2023-12-16T20:49:08.796326+0000","last_fullsized":"2023-12-16T20:49:08.796326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'4","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:53.546511+0000","last_change":"2023-12-16T20:21:35.416258+0000","last_active":"2023-12-16T20:48:53.546511+0000","last_peered":"2023-12-16T20:48:53.546511+0000","last_clean":"2023-12-16T20:48:53.546511+0000","last_became_active":"2023-12-16T20:21:35.415984+0000","last_became_peered":"2023-12-16T20:21:35.415984+0000","last_unstale":"2023-12-16T20:48:53.546511+0000","last_undegraded":"2023-12-16T20:48:53.546511+0000","last_fullsized":"2023-12-16T20:48:53.546511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:06.872220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:45:31.524454+0000","last_change":"2023-12-16T20:21:25.196796+0000","last_active":"2023-12-16T20:45:31.524454+0000","last_peered":"2023-12-16T20:45:31.524454+0000","last_clean":"2023-12-16T20:45:31.524454+0000","last_became_active":"2023-12-16T20:21:25.195675+0000","last_became_peered":"2023-12-16T20:21:25.195675+0000","last_unstale":"2023-12-16T20:45:31.524454+0000","last_undegraded":"2023-12-16T20:45:31.524454+0000","last_fullsized":"2023-12-16T20:45:31.524454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:23.008820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:23.008820+0000","last_clean_scrub_stamp":"2023-12-16T20:21:23.008820+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:46:02.232774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'192","reported_seq":220,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.474899+0000","last_change":"2023-12-16T20:21:41.214322+0000","last_active":"2023-12-16T20:48:41.474899+0000","last_peered":"2023-12-16T20:48:41.474899+0000","last_clean":"2023-12-16T20:48:41.474899+0000","last_became_active":"2023-12-16T20:21:41.214012+0000","last_became_peered":"2023-12-16T20:21:41.214012+0000","last_unstale":"2023-12-16T20:48:41.474899+0000","last_undegraded":"2023-12-16T20:48:41.474899+0000","last_fullsized":"2023-12-16T20:48:41.474899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:18.981353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":12745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'36","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.904272+0000","last_change":"2023-12-16T20:21:36.552920+0000","last_active":"2023-12-16T20:49:08.904272+0000","last_peered":"2023-12-16T20:49:08.904272+0000","last_clean":"2023-12-16T20:49:08.904272+0000","last_became_active":"2023-12-16T20:21:36.552619+0000","last_became_peered":"2023-12-16T20:21:36.552619+0000","last_unstale":"2023-12-16T20:49:08.904272+0000","last_undegraded":"2023-12-16T20:49:08.904272+0000","last_fullsized":"2023-12-16T20:49:08.904272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:05:14.586148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:51.557075+0000","last_change":"2023-12-16T20:21:35.413597+0000","last_active":"2023-12-16T20:48:51.557075+0000","last_peered":"2023-12-16T20:48:51.557075+0000","last_clean":"2023-12-16T20:48:51.557075+0000","last_became_active":"2023-12-16T20:21:35.413308+0000","last_became_peered":"2023-12-16T20:21:35.413308+0000","last_unstale":"2023-12-16T20:48:51.557075+0000","last_undegraded":"2023-12-16T20:48:51.557075+0000","last_fullsized":"2023-12-16T20:48:51.557075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'151","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:37.719915+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:48:37.719915+0000","last_peered":"2023-12-16T20:48:37.719915+0000","last_clean":"2023-12-16T20:48:37.719915+0000","last_became_active":"2023-12-16T20:21:41.212608+0000","last_became_peered":"2023-12-16T20:21:41.212608+0000","last_unstale":"2023-12-16T20:48:37.719915+0000","last_undegraded":"2023-12-16T20:48:37.719915+0000","last_fullsized":"2023-12-16T20:48:37.719915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:14.816721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":6553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'41","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820554+0000","last_change":"2023-12-16T20:21:36.555870+0000","last_active":"2023-12-16T20:49:08.820554+0000","last_peered":"2023-12-16T20:49:08.820554+0000","last_clean":"2023-12-16T20:49:08.820554+0000","last_became_active":"2023-12-16T20:21:36.555631+0000","last_became_peered":"2023-12-16T20:21:36.555631+0000","last_unstale":"2023-12-16T20:49:08.820554+0000","last_undegraded":"2023-12-16T20:49:08.820554+0000","last_fullsized":"2023-12-16T20:49:08.820554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:10.421516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'4","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:59.707658+0000","last_change":"2023-12-16T20:21:35.416140+0000","last_active":"2023-12-16T20:48:59.707658+0000","last_peered":"2023-12-16T20:48:59.707658+0000","last_clean":"2023-12-16T20:48:59.707658+0000","last_became_active":"2023-12-16T20:21:35.415810+0000","last_became_peered":"2023-12-16T20:21:35.415810+0000","last_unstale":"2023-12-16T20:48:59.707658+0000","last_undegraded":"2023-12-16T20:48:59.707658+0000","last_fullsized":"2023-12-16T20:48:59.707658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'169","reported_seq":206,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.500821+0000","last_change":"2023-12-16T20:22:14.842693+0000","last_active":"2023-12-16T20:48:41.500821+0000","last_peered":"2023-12-16T20:48:41.500821+0000","last_clean":"2023-12-16T20:48:41.500821+0000","last_became_active":"2023-12-16T20:22:14.842282+0000","last_became_peered":"2023-12-16T20:22:14.842282+0000","last_unstale":"2023-12-16T20:48:41.500821+0000","last_undegraded":"2023-12-16T20:48:41.500821+0000","last_fullsized":"2023-12-16T20:48:41.500821+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":8236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'35","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.900402+0000","last_change":"2023-12-16T20:21:36.536346+0000","last_active":"2023-12-16T20:49:08.900402+0000","last_peered":"2023-12-16T20:49:08.900402+0000","last_clean":"2023-12-16T20:49:08.900402+0000","last_became_active":"2023-12-16T20:21:36.536093+0000","last_became_peered":"2023-12-16T20:21:36.536093+0000","last_unstale":"2023-12-16T20:49:08.900402+0000","last_undegraded":"2023-12-16T20:49:08.900402+0000","last_fullsized":"2023-12-16T20:49:08.900402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:17:12.261391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'7","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:02.737397+0000","last_change":"2023-12-16T20:21:35.420314+0000","last_active":"2023-12-16T20:49:02.737397+0000","last_peered":"2023-12-16T20:49:02.737397+0000","last_clean":"2023-12-16T20:49:02.737397+0000","last_became_active":"2023-12-16T20:21:35.420074+0000","last_became_peered":"2023-12-16T20:21:35.420074+0000","last_unstale":"2023-12-16T20:49:02.737397+0000","last_undegraded":"2023-12-16T20:49:02.737397+0000","last_fullsized":"2023-12-16T20:49:02.737397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'129","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.470922+0000","last_change":"2023-12-16T20:21:41.215282+0000","last_active":"2023-12-16T20:48:41.470922+0000","last_peered":"2023-12-16T20:48:41.470922+0000","last_clean":"2023-12-16T20:48:41.470922+0000","last_became_active":"2023-12-16T20:21:41.214939+0000","last_became_peered":"2023-12-16T20:21:41.214939+0000","last_unstale":"2023-12-16T20:48:41.470922+0000","last_undegraded":"2023-12-16T20:48:41.470922+0000","last_fullsized":"2023-12-16T20:48:41.470922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:06:12.245089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":12347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'21","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.902928+0000","last_change":"2023-12-16T20:21:36.534345+0000","last_active":"2023-12-16T20:49:08.902928+0000","last_peered":"2023-12-16T20:49:08.902928+0000","last_clean":"2023-12-16T20:49:08.902928+0000","last_became_active":"2023-12-16T20:21:36.534064+0000","last_became_peered":"2023-12-16T20:21:36.534064+0000","last_unstale":"2023-12-16T20:49:08.902928+0000","last_undegraded":"2023-12-16T20:49:08.902928+0000","last_fullsized":"2023-12-16T20:49:08.902928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:05.641757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:51.557836+0000","last_change":"2023-12-16T20:21:35.390941+0000","last_active":"2023-12-16T20:48:51.557836+0000","last_peered":"2023-12-16T20:48:51.557836+0000","last_clean":"2023-12-16T20:48:51.557836+0000","last_became_active":"2023-12-16T20:21:35.390740+0000","last_became_peered":"2023-12-16T20:21:35.390740+0000","last_unstale":"2023-12-16T20:48:51.557836+0000","last_undegraded":"2023-12-16T20:48:51.557836+0000","last_fullsized":"2023-12-16T20:48:51.557836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:00:44.009248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'180","reported_seq":207,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.239005+0000","last_change":"2023-12-16T20:21:40.754355+0000","last_active":"2023-12-16T20:48:39.239005+0000","last_peered":"2023-12-16T20:48:39.239005+0000","last_clean":"2023-12-16T20:48:39.239005+0000","last_became_active":"2023-12-16T20:21:40.753981+0000","last_became_peered":"2023-12-16T20:21:40.753981+0000","last_unstale":"2023-12-16T20:48:39.239005+0000","last_undegraded":"2023-12-16T20:48:39.239005+0000","last_fullsized":"2023-12-16T20:48:39.239005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:09.125671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":13396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'37","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.901207+0000","last_change":"2023-12-16T20:21:36.537080+0000","last_active":"2023-12-16T20:49:08.901207+0000","last_peered":"2023-12-16T20:49:08.901207+0000","last_clean":"2023-12-16T20:49:08.901207+0000","last_became_active":"2023-12-16T20:21:36.536822+0000","last_became_peered":"2023-12-16T20:21:36.536822+0000","last_unstale":"2023-12-16T20:49:08.901207+0000","last_undegraded":"2023-12-16T20:49:08.901207+0000","last_fullsized":"2023-12-16T20:49:08.901207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'9","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:02.737183+0000","last_change":"2023-12-16T20:21:35.417113+0000","last_active":"2023-12-16T20:49:02.737183+0000","last_peered":"2023-12-16T20:49:02.737183+0000","last_clean":"2023-12-16T20:49:02.737183+0000","last_became_active":"2023-12-16T20:21:35.416850+0000","last_became_peered":"2023-12-16T20:21:35.416850+0000","last_unstale":"2023-12-16T20:49:02.737183+0000","last_undegraded":"2023-12-16T20:49:02.737183+0000","last_fullsized":"2023-12-16T20:49:02.737183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'159","reported_seq":186,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.474976+0000","last_change":"2023-12-16T20:21:40.755436+0000","last_active":"2023-12-16T20:48:41.474976+0000","last_peered":"2023-12-16T20:48:41.474976+0000","last_clean":"2023-12-16T20:48:41.474976+0000","last_became_active":"2023-12-16T20:21:40.755041+0000","last_became_peered":"2023-12-16T20:21:40.755041+0000","last_unstale":"2023-12-16T20:48:41.474976+0000","last_undegraded":"2023-12-16T20:48:41.474976+0000","last_fullsized":"2023-12-16T20:48:41.474976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":9935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'32","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.886153+0000","last_change":"2023-12-16T20:21:36.541160+0000","last_active":"2023-12-16T20:49:08.886153+0000","last_peered":"2023-12-16T20:49:08.886153+0000","last_clean":"2023-12-16T20:49:08.886153+0000","last_became_active":"2023-12-16T20:21:36.540861+0000","last_became_peered":"2023-12-16T20:21:36.540861+0000","last_unstale":"2023-12-16T20:49:08.886153+0000","last_undegraded":"2023-12-16T20:49:08.886153+0000","last_fullsized":"2023-12-16T20:49:08.886153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:38.333571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.439148+0000","last_change":"2023-12-16T20:21:35.425071+0000","last_active":"2023-12-16T20:48:46.439148+0000","last_peered":"2023-12-16T20:48:46.439148+0000","last_clean":"2023-12-16T20:48:46.439148+0000","last_became_active":"2023-12-16T20:21:35.424822+0000","last_became_peered":"2023-12-16T20:21:35.424822+0000","last_unstale":"2023-12-16T20:48:46.439148+0000","last_undegraded":"2023-12-16T20:48:46.439148+0000","last_fullsized":"2023-12-16T20:48:46.439148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:11:00.396860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'130","reported_seq":157,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.361322+0000","last_change":"2023-12-16T20:21:41.215346+0000","last_active":"2023-12-16T20:48:39.361322+0000","last_peered":"2023-12-16T20:48:39.361322+0000","last_clean":"2023-12-16T20:48:39.361322+0000","last_became_active":"2023-12-16T20:21:41.215002+0000","last_became_peered":"2023-12-16T20:21:41.215002+0000","last_unstale":"2023-12-16T20:48:39.361322+0000","last_undegraded":"2023-12-16T20:48:39.361322+0000","last_fullsized":"2023-12-16T20:48:39.361322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":7078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'49","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.904907+0000","last_change":"2023-12-16T20:21:36.535791+0000","last_active":"2023-12-16T20:49:08.904907+0000","last_peered":"2023-12-16T20:49:08.904907+0000","last_clean":"2023-12-16T20:49:08.904907+0000","last_became_active":"2023-12-16T20:21:36.535447+0000","last_became_peered":"2023-12-16T20:21:36.535447+0000","last_unstale":"2023-12-16T20:49:08.904907+0000","last_undegraded":"2023-12-16T20:49:08.904907+0000","last_fullsized":"2023-12-16T20:49:08.904907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:28.307634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:55.659095+0000","last_change":"2023-12-16T20:21:35.423533+0000","last_active":"2023-12-16T20:48:55.659095+0000","last_peered":"2023-12-16T20:48:55.659095+0000","last_clean":"2023-12-16T20:48:55.659095+0000","last_became_active":"2023-12-16T20:21:35.423275+0000","last_became_peered":"2023-12-16T20:21:35.423275+0000","last_unstale":"2023-12-16T20:48:55.659095+0000","last_undegraded":"2023-12-16T20:48:55.659095+0000","last_fullsized":"2023-12-16T20:48:55.659095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:42:27.767422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'115","reported_seq":142,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.472049+0000","last_change":"2023-12-16T20:21:41.213083+0000","last_active":"2023-12-16T20:48:41.472049+0000","last_peered":"2023-12-16T20:48:41.472049+0000","last_clean":"2023-12-16T20:48:41.472049+0000","last_became_active":"2023-12-16T20:21:41.212699+0000","last_became_peered":"2023-12-16T20:21:41.212699+0000","last_unstale":"2023-12-16T20:48:41.472049+0000","last_undegraded":"2023-12-16T20:48:41.472049+0000","last_fullsized":"2023-12-16T20:48:41.472049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.972370+0000","last_change":"2023-12-16T20:21:36.523928+0000","last_active":"2023-12-16T20:49:08.972370+0000","last_peered":"2023-12-16T20:49:08.972370+0000","last_clean":"2023-12-16T20:49:08.972370+0000","last_became_active":"2023-12-16T20:21:36.523649+0000","last_became_peered":"2023-12-16T20:21:36.523649+0000","last_unstale":"2023-12-16T20:49:08.972370+0000","last_undegraded":"2023-12-16T20:49:08.972370+0000","last_fullsized":"2023-12-16T20:49:08.972370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'263","reported_seq":301,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:21.189614+0000","last_change":"2023-12-16T20:49:21.189639+0000","last_active":"2023-12-16T20:49:21.189614+0000","last_peered":"2023-12-16T20:49:21.189614+0000","last_clean":"2023-12-16T20:49:21.189614+0000","last_became_active":"2023-12-16T20:21:35.388392+0000","last_became_peered":"2023-12-16T20:21:35.388392+0000","last_unstale":"2023-12-16T20:49:21.189614+0000","last_undegraded":"2023-12-16T20:49:21.189614+0000","last_fullsized":"2023-12-16T20:49:21.189614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'263","last_scrub_stamp":"2023-12-16T20:49:21.189550+0000","last_deep_scrub":"27'263","last_deep_scrub_stamp":"2023-12-16T20:49:21.189550+0000","last_clean_scrub_stamp":"2023-12-16T20:49:21.189550+0000","objects_scrubbed":3,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:47:24.915095+0000","scrub_duration":0.0088499110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2496854,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":2582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'142","reported_seq":168,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.356577+0000","last_change":"2023-12-16T20:21:41.213106+0000","last_active":"2023-12-16T20:48:39.356577+0000","last_peered":"2023-12-16T20:48:39.356577+0000","last_clean":"2023-12-16T20:48:39.356577+0000","last_became_active":"2023-12-16T20:21:41.212721+0000","last_became_peered":"2023-12-16T20:21:41.212721+0000","last_unstale":"2023-12-16T20:48:39.356577+0000","last_undegraded":"2023-12-16T20:48:39.356577+0000","last_fullsized":"2023-12-16T20:48:39.356577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:47:15.750172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":13674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'36","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.902501+0000","last_change":"2023-12-16T20:21:36.519774+0000","last_active":"2023-12-16T20:49:08.902501+0000","last_peered":"2023-12-16T20:49:08.902501+0000","last_clean":"2023-12-16T20:49:08.902501+0000","last_became_active":"2023-12-16T20:21:36.519561+0000","last_became_peered":"2023-12-16T20:21:36.519561+0000","last_unstale":"2023-12-16T20:49:08.902501+0000","last_undegraded":"2023-12-16T20:49:08.902501+0000","last_fullsized":"2023-12-16T20:49:08.902501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:19:10.421516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'850","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:55.656917+0000","last_change":"2023-12-16T20:21:35.426168+0000","last_active":"2023-12-16T20:48:55.656917+0000","last_peered":"2023-12-16T20:48:55.656917+0000","last_clean":"2023-12-16T20:48:55.656917+0000","last_became_active":"2023-12-16T20:21:35.425929+0000","last_became_peered":"2023-12-16T20:21:35.425929+0000","last_unstale":"2023-12-16T20:48:55.656917+0000","last_undegraded":"2023-12-16T20:48:55.656917+0000","last_fullsized":"2023-12-16T20:48:55.656917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:59:30.829153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":4548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'165","reported_seq":192,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.513047+0000","last_change":"2023-12-16T20:21:40.754204+0000","last_active":"2023-12-16T20:48:41.513047+0000","last_peered":"2023-12-16T20:48:41.513047+0000","last_clean":"2023-12-16T20:48:41.513047+0000","last_became_active":"2023-12-16T20:21:40.753624+0000","last_became_peered":"2023-12-16T20:21:40.753624+0000","last_unstale":"2023-12-16T20:48:41.513047+0000","last_undegraded":"2023-12-16T20:48:41.513047+0000","last_fullsized":"2023-12-16T20:48:41.513047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":9759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'33","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.815896+0000","last_change":"2023-12-16T20:21:36.534827+0000","last_active":"2023-12-16T20:49:08.815896+0000","last_peered":"2023-12-16T20:49:08.815896+0000","last_clean":"2023-12-16T20:49:08.815896+0000","last_became_active":"2023-12-16T20:21:36.533790+0000","last_became_peered":"2023-12-16T20:21:36.533790+0000","last_unstale":"2023-12-16T20:49:08.815896+0000","last_undegraded":"2023-12-16T20:49:08.815896+0000","last_fullsized":"2023-12-16T20:49:08.815896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:33:19.545737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'706","reported_seq":736,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:02.746997+0000","last_change":"2023-12-16T20:21:35.416050+0000","last_active":"2023-12-16T20:49:02.746997+0000","last_peered":"2023-12-16T20:49:02.746997+0000","last_clean":"2023-12-16T20:49:02.746997+0000","last_became_active":"2023-12-16T20:21:35.415790+0000","last_became_peered":"2023-12-16T20:21:35.415790+0000","last_unstale":"2023-12-16T20:49:02.746997+0000","last_undegraded":"2023-12-16T20:49:02.746997+0000","last_fullsized":"2023-12-16T20:49:02.746997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":703,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'154","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.369610+0000","last_change":"2023-12-16T20:21:40.795197+0000","last_active":"2023-12-16T20:48:39.369610+0000","last_peered":"2023-12-16T20:48:39.369610+0000","last_clean":"2023-12-16T20:48:39.369610+0000","last_became_active":"2023-12-16T20:21:40.793667+0000","last_became_peered":"2023-12-16T20:21:40.793667+0000","last_unstale":"2023-12-16T20:48:39.369610+0000","last_undegraded":"2023-12-16T20:48:39.369610+0000","last_fullsized":"2023-12-16T20:48:39.369610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:32.304405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":20505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'40","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.969330+0000","last_change":"2023-12-16T20:21:36.552680+0000","last_active":"2023-12-16T20:49:08.969330+0000","last_peered":"2023-12-16T20:49:08.969330+0000","last_clean":"2023-12-16T20:49:08.969330+0000","last_became_active":"2023-12-16T20:21:36.552482+0000","last_became_peered":"2023-12-16T20:21:36.552482+0000","last_unstale":"2023-12-16T20:49:08.969330+0000","last_undegraded":"2023-12-16T20:49:08.969330+0000","last_fullsized":"2023-12-16T20:49:08.969330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:00.762391+0000","last_change":"2023-12-16T20:21:35.428379+0000","last_active":"2023-12-16T20:49:00.762391+0000","last_peered":"2023-12-16T20:49:00.762391+0000","last_clean":"2023-12-16T20:49:00.762391+0000","last_became_active":"2023-12-16T20:21:35.428100+0000","last_became_peered":"2023-12-16T20:21:35.428100+0000","last_unstale":"2023-12-16T20:49:00.762391+0000","last_undegraded":"2023-12-16T20:49:00.762391+0000","last_fullsized":"2023-12-16T20:49:00.762391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:44.330608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'126","reported_seq":153,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.472111+0000","last_change":"2023-12-16T20:21:40.753333+0000","last_active":"2023-12-16T20:48:41.472111+0000","last_peered":"2023-12-16T20:48:41.472111+0000","last_clean":"2023-12-16T20:48:41.472111+0000","last_became_active":"2023-12-16T20:21:40.752957+0000","last_became_peered":"2023-12-16T20:21:40.752957+0000","last_unstale":"2023-12-16T20:48:41.472111+0000","last_undegraded":"2023-12-16T20:48:41.472111+0000","last_fullsized":"2023-12-16T20:48:41.472111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":10032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'43","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.895445+0000","last_change":"2023-12-16T20:22:14.841007+0000","last_active":"2023-12-16T20:49:08.895445+0000","last_peered":"2023-12-16T20:49:08.895445+0000","last_clean":"2023-12-16T20:49:08.895445+0000","last_became_active":"2023-12-16T20:22:14.840679+0000","last_became_peered":"2023-12-16T20:22:14.840679+0000","last_unstale":"2023-12-16T20:49:08.895445+0000","last_undegraded":"2023-12-16T20:49:08.895445+0000","last_fullsized":"2023-12-16T20:49:08.895445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:48.476563+0000","last_change":"2023-12-16T20:21:35.430197+0000","last_active":"2023-12-16T20:48:48.476563+0000","last_peered":"2023-12-16T20:48:48.476563+0000","last_clean":"2023-12-16T20:48:48.476563+0000","last_became_active":"2023-12-16T20:21:35.429940+0000","last_became_peered":"2023-12-16T20:21:35.429940+0000","last_unstale":"2023-12-16T20:48:48.476563+0000","last_undegraded":"2023-12-16T20:48:48.476563+0000","last_fullsized":"2023-12-16T20:48:48.476563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:17:53.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'174","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.465920+0000","last_change":"2023-12-16T20:21:41.216238+0000","last_active":"2023-12-16T20:48:41.465920+0000","last_peered":"2023-12-16T20:48:41.465920+0000","last_clean":"2023-12-16T20:48:41.465920+0000","last_became_active":"2023-12-16T20:21:41.215893+0000","last_became_peered":"2023-12-16T20:21:41.215893+0000","last_unstale":"2023-12-16T20:48:41.465920+0000","last_undegraded":"2023-12-16T20:48:41.465920+0000","last_fullsized":"2023-12-16T20:48:41.465920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":9716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'144","reported_seq":173,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.475068+0000","last_change":"2023-12-16T20:21:41.215277+0000","last_active":"2023-12-16T20:48:41.475068+0000","last_peered":"2023-12-16T20:48:41.475068+0000","last_clean":"2023-12-16T20:48:41.475068+0000","last_became_active":"2023-12-16T20:21:41.214950+0000","last_became_peered":"2023-12-16T20:21:41.214950+0000","last_unstale":"2023-12-16T20:48:41.475068+0000","last_undegraded":"2023-12-16T20:48:41.475068+0000","last_fullsized":"2023-12-16T20:48:41.475068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":7732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'44","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.798901+0000","last_change":"2023-12-16T20:21:36.519789+0000","last_active":"2023-12-16T20:49:08.798901+0000","last_peered":"2023-12-16T20:49:08.798901+0000","last_clean":"2023-12-16T20:49:08.798901+0000","last_became_active":"2023-12-16T20:21:36.519476+0000","last_became_peered":"2023-12-16T20:21:36.519476+0000","last_unstale":"2023-12-16T20:49:08.798901+0000","last_undegraded":"2023-12-16T20:49:08.798901+0000","last_fullsized":"2023-12-16T20:49:08.798901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:51.515982+0000","last_change":"2023-12-16T20:21:35.415150+0000","last_active":"2023-12-16T20:48:51.515982+0000","last_peered":"2023-12-16T20:48:51.515982+0000","last_clean":"2023-12-16T20:48:51.515982+0000","last_became_active":"2023-12-16T20:21:35.414846+0000","last_became_peered":"2023-12-16T20:21:35.414846+0000","last_unstale":"2023-12-16T20:48:51.515982+0000","last_undegraded":"2023-12-16T20:48:51.515982+0000","last_fullsized":"2023-12-16T20:48:51.515982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:09:37.215505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'142","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.474966+0000","last_change":"2023-12-16T20:21:40.794438+0000","last_active":"2023-12-16T20:48:41.474966+0000","last_peered":"2023-12-16T20:48:41.474966+0000","last_clean":"2023-12-16T20:48:41.474966+0000","last_became_active":"2023-12-16T20:21:40.794073+0000","last_became_peered":"2023-12-16T20:21:40.794073+0000","last_unstale":"2023-12-16T20:48:41.474966+0000","last_undegraded":"2023-12-16T20:48:41.474966+0000","last_fullsized":"2023-12-16T20:48:41.474966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:32.702839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":21602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'45","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796594+0000","last_change":"2023-12-16T20:22:14.772045+0000","last_active":"2023-12-16T20:49:08.796594+0000","last_peered":"2023-12-16T20:49:08.796594+0000","last_clean":"2023-12-16T20:49:08.796594+0000","last_became_active":"2023-12-16T20:22:14.771747+0000","last_became_peered":"2023-12-16T20:22:14.771747+0000","last_unstale":"2023-12-16T20:49:08.796594+0000","last_undegraded":"2023-12-16T20:49:08.796594+0000","last_fullsized":"2023-12-16T20:49:08.796594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"27'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:56.602372+0000","last_change":"2023-12-16T20:21:35.422176+0000","last_active":"2023-12-16T20:48:56.602372+0000","last_peered":"2023-12-16T20:48:56.602372+0000","last_clean":"2023-12-16T20:48:56.602372+0000","last_became_active":"2023-12-16T20:21:35.421982+0000","last_became_peered":"2023-12-16T20:21:35.421982+0000","last_unstale":"2023-12-16T20:48:56.602372+0000","last_undegraded":"2023-12-16T20:48:56.602372+0000","last_fullsized":"2023-12-16T20:48:56.602372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'701","reported_seq":730,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:02.737447+0000","last_change":"2023-12-16T20:21:35.424509+0000","last_active":"2023-12-16T20:49:02.737447+0000","last_peered":"2023-12-16T20:49:02.737447+0000","last_clean":"2023-12-16T20:49:02.737447+0000","last_became_active":"2023-12-16T20:21:35.424254+0000","last_became_peered":"2023-12-16T20:21:35.424254+0000","last_unstale":"2023-12-16T20:49:02.737447+0000","last_undegraded":"2023-12-16T20:49:02.737447+0000","last_fullsized":"2023-12-16T20:49:02.737447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:38:59.376223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'39","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.973270+0000","last_change":"2023-12-16T20:21:36.533903+0000","last_active":"2023-12-16T20:49:08.973270+0000","last_peered":"2023-12-16T20:49:08.973270+0000","last_clean":"2023-12-16T20:49:08.973270+0000","last_became_active":"2023-12-16T20:21:36.533574+0000","last_became_peered":"2023-12-16T20:21:36.533574+0000","last_unstale":"2023-12-16T20:49:08.973270+0000","last_undegraded":"2023-12-16T20:49:08.973270+0000","last_fullsized":"2023-12-16T20:49:08.973270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'88","reported_seq":115,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:11.382290+0000","last_change":"2023-12-16T20:21:40.794426+0000","last_active":"2023-12-16T20:49:11.382290+0000","last_peered":"2023-12-16T20:49:11.382290+0000","last_clean":"2023-12-16T20:49:11.382290+0000","last_became_active":"2023-12-16T20:21:40.794082+0000","last_became_peered":"2023-12-16T20:21:40.794082+0000","last_unstale":"2023-12-16T20:49:11.382290+0000","last_undegraded":"2023-12-16T20:49:11.382290+0000","last_fullsized":"2023-12-16T20:49:11.382290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'686","reported_seq":716,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:06.538226+0000","last_change":"2023-12-16T20:21:35.419910+0000","last_active":"2023-12-16T20:49:06.538226+0000","last_peered":"2023-12-16T20:49:06.538226+0000","last_clean":"2023-12-16T20:49:06.538226+0000","last_became_active":"2023-12-16T20:21:35.419409+0000","last_became_peered":"2023-12-16T20:21:35.419409+0000","last_unstale":"2023-12-16T20:49:06.538226+0000","last_undegraded":"2023-12-16T20:49:06.538226+0000","last_fullsized":"2023-12-16T20:49:06.538226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":4443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'33","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.817786+0000","last_change":"2023-12-16T20:21:36.533684+0000","last_active":"2023-12-16T20:49:08.817786+0000","last_peered":"2023-12-16T20:49:08.817786+0000","last_clean":"2023-12-16T20:49:08.817786+0000","last_became_active":"2023-12-16T20:21:36.533325+0000","last_became_peered":"2023-12-16T20:21:36.533325+0000","last_unstale":"2023-12-16T20:49:08.817786+0000","last_undegraded":"2023-12-16T20:49:08.817786+0000","last_fullsized":"2023-12-16T20:49:08.817786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:10:30.795818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'165","reported_seq":192,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:11.539055+0000","last_change":"2023-12-16T20:21:40.745455+0000","last_active":"2023-12-16T20:49:11.539055+0000","last_peered":"2023-12-16T20:49:11.539055+0000","last_clean":"2023-12-16T20:49:11.539055+0000","last_became_active":"2023-12-16T20:21:40.744731+0000","last_became_peered":"2023-12-16T20:21:40.744731+0000","last_unstale":"2023-12-16T20:49:11.539055+0000","last_undegraded":"2023-12-16T20:49:11.539055+0000","last_fullsized":"2023-12-16T20:49:11.539055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":13136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'49","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.894941+0000","last_change":"2023-12-16T20:21:36.542529+0000","last_active":"2023-12-16T20:49:08.894941+0000","last_peered":"2023-12-16T20:49:08.894941+0000","last_clean":"2023-12-16T20:49:08.894941+0000","last_became_active":"2023-12-16T20:21:36.542287+0000","last_became_peered":"2023-12-16T20:21:36.542287+0000","last_unstale":"2023-12-16T20:49:08.894941+0000","last_undegraded":"2023-12-16T20:49:08.894941+0000","last_fullsized":"2023-12-16T20:49:08.894941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:07.990286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'51","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.887736+0000","last_change":"2023-12-16T20:21:36.551193+0000","last_active":"2023-12-16T20:49:08.887736+0000","last_peered":"2023-12-16T20:49:08.887736+0000","last_clean":"2023-12-16T20:49:08.887736+0000","last_became_active":"2023-12-16T20:21:36.550911+0000","last_became_peered":"2023-12-16T20:21:36.550911+0000","last_unstale":"2023-12-16T20:49:08.887736+0000","last_undegraded":"2023-12-16T20:49:08.887736+0000","last_fullsized":"2023-12-16T20:49:08.887736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'50","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820628+0000","last_change":"2023-12-16T20:21:36.556390+0000","last_active":"2023-12-16T20:49:08.820628+0000","last_peered":"2023-12-16T20:49:08.820628+0000","last_clean":"2023-12-16T20:49:08.820628+0000","last_became_active":"2023-12-16T20:21:36.555822+0000","last_became_peered":"2023-12-16T20:21:36.555822+0000","last_unstale":"2023-12-16T20:49:08.820628+0000","last_undegraded":"2023-12-16T20:49:08.820628+0000","last_fullsized":"2023-12-16T20:49:08.820628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:14:28.307634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'35","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.971772+0000","last_change":"2023-12-16T20:21:36.525171+0000","last_active":"2023-12-16T20:49:08.971772+0000","last_peered":"2023-12-16T20:49:08.971772+0000","last_clean":"2023-12-16T20:49:08.971772+0000","last_became_active":"2023-12-16T20:21:36.524747+0000","last_became_peered":"2023-12-16T20:21:36.524747+0000","last_unstale":"2023-12-16T20:49:08.971772+0000","last_undegraded":"2023-12-16T20:49:08.971772+0000","last_fullsized":"2023-12-16T20:49:08.971772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'29","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.800432+0000","last_change":"2023-12-16T20:21:36.533944+0000","last_active":"2023-12-16T20:49:08.800432+0000","last_peered":"2023-12-16T20:49:08.800432+0000","last_clean":"2023-12-16T20:49:08.800432+0000","last_became_active":"2023-12-16T20:21:36.533682+0000","last_became_peered":"2023-12-16T20:21:36.533682+0000","last_unstale":"2023-12-16T20:49:08.800432+0000","last_undegraded":"2023-12-16T20:49:08.800432+0000","last_fullsized":"2023-12-16T20:49:08.800432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'35","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796723+0000","last_change":"2023-12-16T20:21:36.519818+0000","last_active":"2023-12-16T20:49:08.796723+0000","last_peered":"2023-12-16T20:49:08.796723+0000","last_clean":"2023-12-16T20:49:08.796723+0000","last_became_active":"2023-12-16T20:21:36.519545+0000","last_became_peered":"2023-12-16T20:21:36.519545+0000","last_unstale":"2023-12-16T20:49:08.796723+0000","last_undegraded":"2023-12-16T20:49:08.796723+0000","last_fullsized":"2023-12-16T20:49:08.796723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.899167+0000","last_change":"2023-12-16T20:21:36.542706+0000","last_active":"2023-12-16T20:49:08.899167+0000","last_peered":"2023-12-16T20:49:08.899167+0000","last_clean":"2023-12-16T20:49:08.899167+0000","last_became_active":"2023-12-16T20:21:36.542184+0000","last_became_peered":"2023-12-16T20:21:36.542184+0000","last_unstale":"2023-12-16T20:49:08.899167+0000","last_undegraded":"2023-12-16T20:49:08.899167+0000","last_fullsized":"2023-12-16T20:49:08.899167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'32","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796325+0000","last_change":"2023-12-16T20:21:36.536726+0000","last_active":"2023-12-16T20:49:08.796325+0000","last_peered":"2023-12-16T20:49:08.796325+0000","last_clean":"2023-12-16T20:49:08.796325+0000","last_became_active":"2023-12-16T20:21:36.536439+0000","last_became_peered":"2023-12-16T20:21:36.536439+0000","last_unstale":"2023-12-16T20:49:08.796325+0000","last_undegraded":"2023-12-16T20:49:08.796325+0000","last_fullsized":"2023-12-16T20:49:08.796325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'33","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820643+0000","last_change":"2023-12-16T20:21:36.555521+0000","last_active":"2023-12-16T20:49:08.820643+0000","last_peered":"2023-12-16T20:49:08.820643+0000","last_clean":"2023-12-16T20:49:08.820643+0000","last_became_active":"2023-12-16T20:21:36.555100+0000","last_became_peered":"2023-12-16T20:21:36.555100+0000","last_unstale":"2023-12-16T20:49:08.820643+0000","last_undegraded":"2023-12-16T20:49:08.820643+0000","last_fullsized":"2023-12-16T20:49:08.820643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'45","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.797063+0000","last_change":"2023-12-16T20:21:36.535856+0000","last_active":"2023-12-16T20:49:08.797063+0000","last_peered":"2023-12-16T20:49:08.797063+0000","last_clean":"2023-12-16T20:49:08.797063+0000","last_became_active":"2023-12-16T20:21:36.535600+0000","last_became_peered":"2023-12-16T20:21:36.535600+0000","last_unstale":"2023-12-16T20:49:08.797063+0000","last_undegraded":"2023-12-16T20:49:08.797063+0000","last_fullsized":"2023-12-16T20:49:08.797063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'38","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820712+0000","last_change":"2023-12-16T20:21:36.553376+0000","last_active":"2023-12-16T20:49:08.820712+0000","last_peered":"2023-12-16T20:49:08.820712+0000","last_clean":"2023-12-16T20:49:08.820712+0000","last_became_active":"2023-12-16T20:21:36.553155+0000","last_became_peered":"2023-12-16T20:21:36.553155+0000","last_unstale":"2023-12-16T20:49:08.820712+0000","last_undegraded":"2023-12-16T20:49:08.820712+0000","last_fullsized":"2023-12-16T20:49:08.820712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:40:35.362214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'50","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.972438+0000","last_change":"2023-12-16T20:21:36.524517+0000","last_active":"2023-12-16T20:49:08.972438+0000","last_peered":"2023-12-16T20:49:08.972438+0000","last_clean":"2023-12-16T20:49:08.972438+0000","last_became_active":"2023-12-16T20:21:36.524166+0000","last_became_peered":"2023-12-16T20:21:36.524166+0000","last_unstale":"2023-12-16T20:49:08.972438+0000","last_undegraded":"2023-12-16T20:49:08.972438+0000","last_fullsized":"2023-12-16T20:49:08.972438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'45","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.890304+0000","last_change":"2023-12-16T20:21:36.542513+0000","last_active":"2023-12-16T20:49:08.890304+0000","last_peered":"2023-12-16T20:49:08.890304+0000","last_clean":"2023-12-16T20:49:08.890304+0000","last_became_active":"2023-12-16T20:21:36.542191+0000","last_became_peered":"2023-12-16T20:21:36.542191+0000","last_unstale":"2023-12-16T20:49:08.890304+0000","last_undegraded":"2023-12-16T20:49:08.890304+0000","last_fullsized":"2023-12-16T20:49:08.890304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:44:25.687447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'35","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:19.988486+0000","last_change":"2023-12-16T20:22:14.772163+0000","last_active":"2023-12-16T20:49:19.988486+0000","last_peered":"2023-12-16T20:49:19.988486+0000","last_clean":"2023-12-16T20:49:19.988486+0000","last_became_active":"2023-12-16T20:22:14.771830+0000","last_became_peered":"2023-12-16T20:22:14.771830+0000","last_unstale":"2023-12-16T20:49:19.988486+0000","last_undegraded":"2023-12-16T20:49:19.988486+0000","last_fullsized":"2023-12-16T20:49:19.988486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"27'47","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.896204+0000","last_change":"2023-12-16T20:21:36.544461+0000","last_active":"2023-12-16T20:49:08.896204+0000","last_peered":"2023-12-16T20:49:08.896204+0000","last_clean":"2023-12-16T20:49:08.896204+0000","last_became_active":"2023-12-16T20:21:36.544225+0000","last_became_peered":"2023-12-16T20:21:36.544225+0000","last_unstale":"2023-12-16T20:49:08.896204+0000","last_undegraded":"2023-12-16T20:49:08.896204+0000","last_fullsized":"2023-12-16T20:49:08.896204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'40","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820348+0000","last_change":"2023-12-16T20:21:36.554370+0000","last_active":"2023-12-16T20:49:08.820348+0000","last_peered":"2023-12-16T20:49:08.820348+0000","last_clean":"2023-12-16T20:49:08.820348+0000","last_became_active":"2023-12-16T20:21:36.554130+0000","last_became_peered":"2023-12-16T20:21:36.554130+0000","last_unstale":"2023-12-16T20:49:08.820348+0000","last_undegraded":"2023-12-16T20:49:08.820348+0000","last_fullsized":"2023-12-16T20:49:08.820348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:14:05.641757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'45","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.823702+0000","last_change":"2023-12-16T20:21:36.555346+0000","last_active":"2023-12-16T20:49:08.823702+0000","last_peered":"2023-12-16T20:49:08.823702+0000","last_clean":"2023-12-16T20:49:08.823702+0000","last_became_active":"2023-12-16T20:21:36.554772+0000","last_became_peered":"2023-12-16T20:21:36.554772+0000","last_unstale":"2023-12-16T20:49:08.823702+0000","last_undegraded":"2023-12-16T20:49:08.823702+0000","last_fullsized":"2023-12-16T20:49:08.823702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:45:17.392604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'44","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796711+0000","last_change":"2023-12-16T20:21:36.534502+0000","last_active":"2023-12-16T20:49:08.796711+0000","last_peered":"2023-12-16T20:49:08.796711+0000","last_clean":"2023-12-16T20:49:08.796711+0000","last_became_active":"2023-12-16T20:21:36.534307+0000","last_became_peered":"2023-12-16T20:21:36.534307+0000","last_unstale":"2023-12-16T20:49:08.796711+0000","last_undegraded":"2023-12-16T20:49:08.796711+0000","last_fullsized":"2023-12-16T20:49:08.796711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'40","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.972298+0000","last_change":"2023-12-16T20:21:36.525661+0000","last_active":"2023-12-16T20:49:08.972298+0000","last_peered":"2023-12-16T20:49:08.972298+0000","last_clean":"2023-12-16T20:49:08.972298+0000","last_became_active":"2023-12-16T20:21:36.525427+0000","last_became_peered":"2023-12-16T20:21:36.525427+0000","last_unstale":"2023-12-16T20:49:08.972298+0000","last_undegraded":"2023-12-16T20:49:08.972298+0000","last_fullsized":"2023-12-16T20:49:08.972298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'36","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.800316+0000","last_change":"2023-12-16T20:21:36.542756+0000","last_active":"2023-12-16T20:49:08.800316+0000","last_peered":"2023-12-16T20:49:08.800316+0000","last_clean":"2023-12-16T20:49:08.800316+0000","last_became_active":"2023-12-16T20:21:36.542513+0000","last_became_peered":"2023-12-16T20:21:36.542513+0000","last_unstale":"2023-12-16T20:49:08.800316+0000","last_undegraded":"2023-12-16T20:49:08.800316+0000","last_fullsized":"2023-12-16T20:49:08.800316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'30","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.814024+0000","last_change":"2023-12-16T20:21:36.544754+0000","last_active":"2023-12-16T20:49:08.814024+0000","last_peered":"2023-12-16T20:49:08.814024+0000","last_clean":"2023-12-16T20:49:08.814024+0000","last_became_active":"2023-12-16T20:21:36.544492+0000","last_became_peered":"2023-12-16T20:21:36.544492+0000","last_unstale":"2023-12-16T20:49:08.814024+0000","last_undegraded":"2023-12-16T20:49:08.814024+0000","last_fullsized":"2023-12-16T20:49:08.814024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:19.509623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'38","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.889041+0000","last_change":"2023-12-16T20:22:14.769644+0000","last_active":"2023-12-16T20:49:08.889041+0000","last_peered":"2023-12-16T20:49:08.889041+0000","last_clean":"2023-12-16T20:49:08.889041+0000","last_became_active":"2023-12-16T20:22:14.769348+0000","last_became_peered":"2023-12-16T20:22:14.769348+0000","last_unstale":"2023-12-16T20:49:08.889041+0000","last_undegraded":"2023-12-16T20:49:08.889041+0000","last_fullsized":"2023-12-16T20:49:08.889041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:17:52.188255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'50","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.894678+0000","last_change":"2023-12-16T20:21:36.551107+0000","last_active":"2023-12-16T20:49:08.894678+0000","last_peered":"2023-12-16T20:49:08.894678+0000","last_clean":"2023-12-16T20:49:08.894678+0000","last_became_active":"2023-12-16T20:21:36.550815+0000","last_became_peered":"2023-12-16T20:21:36.550815+0000","last_unstale":"2023-12-16T20:49:08.894678+0000","last_undegraded":"2023-12-16T20:49:08.894678+0000","last_fullsized":"2023-12-16T20:49:08.894678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:11:04.730466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'42","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.903770+0000","last_change":"2023-12-16T20:21:36.554041+0000","last_active":"2023-12-16T20:49:08.903770+0000","last_peered":"2023-12-16T20:49:08.903770+0000","last_clean":"2023-12-16T20:49:08.903770+0000","last_became_active":"2023-12-16T20:21:36.553708+0000","last_became_peered":"2023-12-16T20:21:36.553708+0000","last_unstale":"2023-12-16T20:49:08.903770+0000","last_undegraded":"2023-12-16T20:49:08.903770+0000","last_fullsized":"2023-12-16T20:49:08.903770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:58:36.868562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'29","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.800113+0000","last_change":"2023-12-16T20:21:36.551348+0000","last_active":"2023-12-16T20:49:08.800113+0000","last_peered":"2023-12-16T20:49:08.800113+0000","last_clean":"2023-12-16T20:49:08.800113+0000","last_became_active":"2023-12-16T20:21:36.551066+0000","last_became_peered":"2023-12-16T20:21:36.551066+0000","last_unstale":"2023-12-16T20:49:08.800113+0000","last_undegraded":"2023-12-16T20:49:08.800113+0000","last_fullsized":"2023-12-16T20:49:08.800113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'37","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.900820+0000","last_change":"2023-12-16T20:21:36.523828+0000","last_active":"2023-12-16T20:49:08.900820+0000","last_peered":"2023-12-16T20:49:08.900820+0000","last_clean":"2023-12-16T20:49:08.900820+0000","last_became_active":"2023-12-16T20:21:36.523604+0000","last_became_peered":"2023-12-16T20:21:36.523604+0000","last_unstale":"2023-12-16T20:49:08.900820+0000","last_undegraded":"2023-12-16T20:49:08.900820+0000","last_fullsized":"2023-12-16T20:49:08.900820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'39","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.823448+0000","last_change":"2023-12-16T20:21:36.556286+0000","last_active":"2023-12-16T20:49:08.823448+0000","last_peered":"2023-12-16T20:49:08.823448+0000","last_clean":"2023-12-16T20:49:08.823448+0000","last_became_active":"2023-12-16T20:21:36.556041+0000","last_became_peered":"2023-12-16T20:21:36.556041+0000","last_unstale":"2023-12-16T20:49:08.823448+0000","last_undegraded":"2023-12-16T20:49:08.823448+0000","last_fullsized":"2023-12-16T20:49:08.823448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:31:57.783339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'39","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.894521+0000","last_change":"2023-12-16T20:21:36.518408+0000","last_active":"2023-12-16T20:49:08.894521+0000","last_peered":"2023-12-16T20:49:08.894521+0000","last_clean":"2023-12-16T20:49:08.894521+0000","last_became_active":"2023-12-16T20:21:36.518138+0000","last_became_peered":"2023-12-16T20:21:36.518138+0000","last_unstale":"2023-12-16T20:49:08.894521+0000","last_undegraded":"2023-12-16T20:49:08.894521+0000","last_fullsized":"2023-12-16T20:49:08.894521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:42:27.909199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'24","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.823139+0000","last_change":"2023-12-16T20:21:36.555311+0000","last_active":"2023-12-16T20:49:08.823139+0000","last_peered":"2023-12-16T20:49:08.823139+0000","last_clean":"2023-12-16T20:49:08.823139+0000","last_became_active":"2023-12-16T20:21:36.555041+0000","last_became_peered":"2023-12-16T20:21:36.555041+0000","last_unstale":"2023-12-16T20:49:08.823139+0000","last_undegraded":"2023-12-16T20:49:08.823139+0000","last_fullsized":"2023-12-16T20:49:08.823139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:16:20.609645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'44","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.972509+0000","last_change":"2023-12-16T20:21:36.524036+0000","last_active":"2023-12-16T20:49:08.972509+0000","last_peered":"2023-12-16T20:49:08.972509+0000","last_clean":"2023-12-16T20:49:08.972509+0000","last_became_active":"2023-12-16T20:21:36.523784+0000","last_became_peered":"2023-12-16T20:21:36.523784+0000","last_unstale":"2023-12-16T20:49:08.972509+0000","last_undegraded":"2023-12-16T20:49:08.972509+0000","last_fullsized":"2023-12-16T20:49:08.972509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'36","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.798823+0000","last_change":"2023-12-16T20:21:36.526391+0000","last_active":"2023-12-16T20:49:08.798823+0000","last_peered":"2023-12-16T20:49:08.798823+0000","last_clean":"2023-12-16T20:49:08.798823+0000","last_became_active":"2023-12-16T20:21:36.526151+0000","last_became_peered":"2023-12-16T20:21:36.526151+0000","last_unstale":"2023-12-16T20:49:08.798823+0000","last_undegraded":"2023-12-16T20:49:08.798823+0000","last_fullsized":"2023-12-16T20:49:08.798823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'28","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.900106+0000","last_change":"2023-12-16T20:21:36.543566+0000","last_active":"2023-12-16T20:49:08.900106+0000","last_peered":"2023-12-16T20:49:08.900106+0000","last_clean":"2023-12-16T20:49:08.900106+0000","last_became_active":"2023-12-16T20:21:36.543306+0000","last_became_peered":"2023-12-16T20:21:36.543306+0000","last_unstale":"2023-12-16T20:49:08.900106+0000","last_undegraded":"2023-12-16T20:49:08.900106+0000","last_fullsized":"2023-12-16T20:49:08.900106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T20:31:03.543973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4117,"num_write_kb":324188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4666,"ondisk_log_size":4666,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2442,"ondisk_log_size":2442,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40469915,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1038,"num_read_kb":1098,"num_write":9075,"num_write_kb":44922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56229888,"data_stored":80939830,"data_compressed":7486620,"data_compressed_allocated":11714560,"data_compressed_original":36487168,"omap_allocated":0,"internal_metadata":0},"log_size":8617,"ondisk_log_size":8617,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65176,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575188,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84588,"kb_used_data":17316,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94287252,"statfs":{"total":96636764160,"available":96550146048,"internally_reserved":0,"allocated":17731584,"data_stored":25875293,"data_compressed":2385754,"data_compressed_allocated":3723264,"data_compressed_original":12046336,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40300000000000002,"15min":0.39800000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53300000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.434,"5min":0.41999999999999998,"15min":0.42299999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56000000000000005,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46300000000000002}]},{"osd":1,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.42499999999999999,"15min":0.41999999999999998},"min":{"1min":0.35099999999999998,"5min":0.24399999999999999,"15min":0.23799999999999999},"max":{"1min":0.59099999999999997,"5min":0.67200000000000004,"15min":0.70999999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.28599999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.54800000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.63400000000000001}]},{"osd":2,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40799999999999997,"15min":0.41099999999999998},"min":{"1min":0.26800000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.54600000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.44400000000000001,"15min":0.44500000000000001},"min":{"1min":0.36899999999999999,"5min":0.29399999999999998,"15min":0.29099999999999998},"max":{"1min":0.58199999999999996,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.60599999999999998}]},{"osd":3,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.438,"15min":0.432},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28000000000000003},"max":{"1min":0.57899999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45500000000000002,"15min":0.45800000000000002},"min":{"1min":0.30099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58099999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.498}]},{"osd":4,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.27100000000000002,"5min":0.23200000000000001,"15min":0.20499999999999999},"max":{"1min":0.48899999999999999,"5min":0.501,"15min":0.621},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.38100000000000001,"15min":0.374},"min":{"1min":0.27800000000000002,"5min":0.219,"15min":0.20899999999999999},"max":{"1min":0.52900000000000003,"5min":0.58199999999999996,"15min":0.624},"last":0.26400000000000001}]},{"osd":5,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38800000000000001,"15min":0.38700000000000001},"min":{"1min":0.27400000000000002,"5min":0.24199999999999999,"15min":0.24099999999999999},"max":{"1min":0.54600000000000004,"5min":0.63900000000000001,"15min":0.72099999999999997},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.40500000000000003,"15min":0.40600000000000003},"min":{"1min":0.316,"5min":0.25900000000000001,"15min":0.255},"max":{"1min":0.51400000000000001,"5min":0.57299999999999995,"15min":0.65700000000000003},"last":0.32500000000000001}]},{"osd":6,"last update":"Sat Dec 16 20:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41399999999999998},"min":{"1min":0.34599999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51000000000000001,"5min":0.53700000000000003,"15min":0.69499999999999995},"last":0.377},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.436,"15min":0.441},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.52400000000000002,"5min":0.623,"15min":0.65200000000000002},"last":0.36399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575188,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57068,"kb_used_data":12004,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94314772,"statfs":{"total":96636764160,"available":96578326528,"internally_reserved":0,"allocated":12292096,"data_stored":16896407,"data_compressed":1393950,"data_compressed_allocated":2220032,"data_compressed_original":7004160,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38200000000000001,"15min":0.39800000000000002},"min":{"1min":0.251,"5min":0.23200000000000001,"15min":0.217},"max":{"1min":0.505,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.433,"15min":0.432},"min":{"1min":0.26700000000000002,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":0.52600000000000002,"5min":0.60799999999999998,"15min":0.67100000000000004},"last":0.53200000000000003}]},{"osd":1,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.40100000000000002,"15min":0.40799999999999997},"min":{"1min":0.27100000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51400000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42599999999999999,"15min":0.42399999999999999},"min":{"1min":0.29799999999999999,"5min":0.26500000000000001,"15min":0.26400000000000001},"max":{"1min":0.54400000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.52000000000000002}]},{"osd":2,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40999999999999998,"15min":0.41699999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.52100000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.253},"max":{"1min":0.51200000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.504}]},{"osd":3,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44800000000000001,"15min":0.437},"min":{"1min":0.371,"5min":0.30599999999999999,"15min":0.26500000000000001},"max":{"1min":0.57999999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.433,"15min":0.44400000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.52400000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.47399999999999998}]},{"osd":4,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.379,"15min":0.37},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.217},"max":{"1min":0.48699999999999999,"5min":0.59199999999999997,"15min":0.64000000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.38900000000000001,"15min":0.38700000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55800000000000005,"5min":0.64300000000000002,"15min":0.68700000000000006},"last":0.375}]},{"osd":5,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.38600000000000001,"15min":0.377},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.22900000000000001},"max":{"1min":0.54600000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42199999999999999,"15min":0.42099999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.57799999999999996,"5min":0.60699999999999998,"15min":0.67200000000000004},"last":0.439}]},{"osd":7,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.27800000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.65700000000000003,"15min":0.69899999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42399999999999999,"15min":0.43099999999999999},"min":{"1min":0.29299999999999998,"5min":0.28299999999999997,"15min":0.27200000000000002},"max":{"1min":0.53600000000000003,"5min":0.60599999999999998,"15min":0.747},"last":0.45900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575188,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":118609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.42399999999999999,"15min":0.42699999999999999},"min":{"1min":0.33600000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64200000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.41799999999999998,"15min":0.41399999999999998},"min":{"1min":0.27600000000000002,"5min":0.252,"15min":0.24399999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.39700000000000002}]},{"osd":1,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.34399999999999997,"5min":0.27600000000000002,"15min":0.25600000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.42699999999999999},"min":{"1min":0.32000000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.371}]},{"osd":2,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.35199999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.441,"15min":0.434},"min":{"1min":0.33500000000000002,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51900000000000002}]},{"osd":3,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29499999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.35699999999999998,"5min":0.312,"15min":0.28199999999999997},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.60699999999999998}]},{"osd":4,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.371,"15min":0.36199999999999999},"min":{"1min":0.26200000000000001,"5min":0.24199999999999999,"15min":0.224},"max":{"1min":0.60099999999999998,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38600000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.22600000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.54200000000000004}]},{"osd":6,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39500000000000002,"15min":0.38500000000000001},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.24199999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.68999999999999995},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.433,"15min":0.41799999999999998},"min":{"1min":0.30199999999999999,"5min":0.28000000000000003,"15min":0.26700000000000002},"max":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.72099999999999997},"last":0.56200000000000006}]},{"osd":7,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.432,"15min":0.432},"min":{"1min":0.27700000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46200000000000002,"15min":0.44800000000000001},"min":{"1min":0.318,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.624}]}]},{"osd":4,"up_from":13,"seq":55834575188,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65112,"kb_used_data":7568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94306728,"statfs":{"total":96636764160,"available":96570089472,"internally_reserved":0,"allocated":7749632,"data_stored":11004073,"data_compressed":1082070,"data_compressed_allocated":1703936,"data_compressed_original":5144576,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.434,"15min":0.42199999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.441,"15min":0.432},"min":{"1min":0.34699999999999998,"5min":0.26600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57999999999999996,"5min":0.65300000000000002,"15min":0.68899999999999995},"last":0.67900000000000005}]},{"osd":1,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45300000000000001,"15min":0.439},"min":{"1min":0.32700000000000001,"5min":0.29799999999999999,"15min":0.27900000000000003},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42799999999999999,"15min":0.41999999999999998},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.26600000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.66700000000000004}]},{"osd":2,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.436,"15min":0.42799999999999999},"min":{"1min":0.29099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.379,"5min":0.311,"15min":0.309},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.70799999999999996}]},{"osd":3,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44500000000000001,"15min":0.43099999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.27900000000000003},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47299999999999998,"15min":0.46400000000000002},"min":{"1min":0.32500000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.79400000000000004},"last":0.752}]},{"osd":5,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.377,"15min":0.38200000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.39700000000000002,"15min":0.39000000000000001},"min":{"1min":0.26600000000000001,"5min":0.26300000000000001,"15min":0.22},"max":{"1min":0.50800000000000001,"5min":0.58999999999999997,"15min":0.63100000000000001},"last":0.47999999999999998}]},{"osd":6,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39600000000000002,"15min":0.39500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23799999999999999},"max":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.75},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.443,"15min":0.435},"min":{"1min":0.29799999999999999,"5min":0.26400000000000001,"15min":0.22600000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.53000000000000003}]},{"osd":7,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.432,"15min":0.42999999999999999},"min":{"1min":0.29999999999999999,"5min":0.28899999999999998,"15min":0.25600000000000001},"max":{"1min":0.60299999999999998,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46200000000000002,"15min":0.45900000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27000000000000002},"max":{"1min":0.59199999999999997,"5min":0.63400000000000001,"15min":0.77600000000000002},"last":0.63200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575188,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58848,"kb_used_data":9624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312992,"statfs":{"total":96636764160,"available":96576503808,"internally_reserved":0,"allocated":9854976,"data_stored":12924992,"data_compressed":1002682,"data_compressed_allocated":1646592,"data_compressed_original":4898816,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.28999999999999998,"15min":0.28499999999999998},"min":{"1min":0.222,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":0.38300000000000001,"5min":0.48699999999999999,"15min":0.52600000000000002},"last":0.218},{"interface":"front","average":{"1min":0.317,"5min":0.30299999999999999,"15min":0.29699999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.46600000000000003,"5min":0.48899999999999999,"15min":0.56999999999999995},"last":0.25800000000000001}]},{"osd":1,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29999999999999999},"min":{"1min":0.22700000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.434,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.317,"5min":0.32500000000000001,"15min":0.32300000000000001},"min":{"1min":0.245,"5min":0.21099999999999999,"15min":0.19900000000000001},"max":{"1min":0.40200000000000002,"5min":0.48299999999999998,"15min":0.56100000000000005},"last":0.249}]},{"osd":2,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.33300000000000002,"15min":0.33400000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.222},"max":{"1min":0.443,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35299999999999998,"15min":0.35199999999999998},"min":{"1min":0.29899999999999999,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":0.44900000000000001,"5min":0.51100000000000001,"15min":0.53600000000000003},"last":0.31900000000000001}]},{"osd":4,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40500000000000003,"15min":0.41299999999999998},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.27600000000000002},"max":{"1min":0.52900000000000003,"5min":0.53000000000000003,"15min":0.69999999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.443,"15min":0.439},"min":{"1min":0.35199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56699999999999995,"5min":0.70399999999999996,"15min":0.72399999999999998},"last":0.56899999999999995}]},{"osd":5,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.435,"15min":0.44},"min":{"1min":0.35399999999999998,"5min":0.31900000000000001,"15min":0.313},"max":{"1min":0.55200000000000005,"5min":0.68100000000000005,"15min":0.76900000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.442,"5min":0.45100000000000001,"15min":0.45400000000000001},"min":{"1min":0.38300000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.52400000000000002,"5min":0.61499999999999999,"15min":0.71599999999999997},"last":0.60199999999999998}]},{"osd":6,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44,"15min":0.44500000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.73599999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45600000000000002,"15min":0.46300000000000002},"min":{"1min":0.372,"5min":0.317,"15min":0.317},"max":{"1min":0.64100000000000001,"5min":0.66700000000000004,"15min":0.75},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Dec 16 20:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48299999999999998,"15min":0.48099999999999998},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.34000000000000002},"max":{"1min":0.57299999999999995,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44700000000000001,"15min":0.45700000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.56599999999999995,"5min":0.63400000000000001,"15min":0.68999999999999995},"last":0.66900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575188,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":341408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.309,"15min":0.30299999999999999},"min":{"1min":0.215,"5min":0.18099999999999999,"15min":0.17000000000000001},"max":{"1min":0.47299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.215},{"interface":"front","average":{"1min":0.317,"5min":0.30299999999999999,"15min":0.30199999999999999},"min":{"1min":0.224,"5min":0.189,"15min":0.189},"max":{"1min":0.53400000000000003,"5min":0.55800000000000005,"15min":0.623},"last":0.32300000000000001}]},{"osd":1,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.248,"5min":0.23300000000000001,"15min":0.193},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.32100000000000001,"15min":0.32800000000000001},"min":{"1min":0.23499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.54800000000000004},"last":0.255}]},{"osd":3,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.32800000000000001,"15min":0.32500000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36199999999999999,"15min":0.36299999999999999},"min":{"1min":0.26200000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.56699999999999995,"5min":0.57799999999999996,"15min":0.60599999999999998},"last":0.34000000000000002}]},{"osd":4,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.36199999999999999,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.432},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.432,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.29499999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52100000000000002}]},{"osd":5,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.34899999999999998,"5min":0.311,"15min":0.30299999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.443},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.67000000000000004},"last":0.48999999999999999}]},{"osd":6,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.48299999999999998,"15min":0.47599999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.32500000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.77400000000000002},"last":0.42299999999999999}]},{"osd":7,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.47299999999999998},"min":{"1min":0.35999999999999999,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.64000000000000001,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.46000000000000002,"15min":0.46200000000000002},"min":{"1min":0.35999999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.502}]}]},{"osd":1,"up_from":13,"seq":55834575188,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42460,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329380,"statfs":{"total":96636764160,"available":96593285120,"internally_reserved":0,"allocated":3035136,"data_stored":4312983,"data_compressed":488319,"data_compressed_allocated":745472,"data_compressed_original":2203648,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.27400000000000002,"15min":0.27600000000000002},"min":{"1min":0.20000000000000001,"5min":0.184,"15min":0.16800000000000001},"max":{"1min":0.42099999999999999,"5min":0.46100000000000002,"15min":0.61499999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.309,"5min":0.31,"15min":0.316},"min":{"1min":0.22600000000000001,"5min":0.218,"15min":0.21199999999999999},"max":{"1min":0.38300000000000001,"5min":0.55500000000000005,"15min":0.56499999999999995},"last":0.25}]},{"osd":2,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.29299999999999998,"5min":0.28499999999999998,"15min":0.29199999999999998},"min":{"1min":0.22600000000000001,"5min":0.20599999999999999,"15min":0.19},"max":{"1min":0.377,"5min":0.44,"15min":0.51200000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.32400000000000001,"15min":0.32000000000000001},"min":{"1min":0.245,"5min":0.221,"15min":0.20999999999999999},"max":{"1min":0.40200000000000002,"5min":0.56200000000000006,"15min":0.58499999999999996},"last":0.36399999999999999}]},{"osd":3,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.34599999999999997},"min":{"1min":0.28399999999999997,"5min":0.23200000000000001,"15min":0.223},"max":{"1min":0.40400000000000003,"5min":0.499,"15min":0.55800000000000005},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34200000000000003},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48099999999999998,"5min":0.52500000000000002,"15min":0.59699999999999998},"last":0.33300000000000002}]},{"osd":4,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40100000000000002,"15min":0.40600000000000003},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.64100000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.432,"15min":0.433},"min":{"1min":0.35499999999999998,"5min":0.32100000000000001,"15min":0.307},"max":{"1min":0.55800000000000005,"5min":0.57999999999999996,"15min":0.65400000000000003},"last":0.64300000000000002}]},{"osd":5,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42599999999999999,"15min":0.441},"min":{"1min":0.35599999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.64600000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.42799999999999999,"15min":0.436},"min":{"1min":0.34599999999999997,"5min":0.318,"15min":0.28100000000000003},"max":{"1min":0.57899999999999996,"5min":0.64500000000000002,"15min":0.69299999999999995},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.45700000000000002},"min":{"1min":0.39300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.58099999999999996,"5min":0.65800000000000003,"15min":0.754},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.36099999999999999,"5min":0.33300000000000002,"15min":0.29999999999999999},"max":{"1min":0.55500000000000005,"5min":0.628,"15min":0.73099999999999998},"last":0.626}]},{"osd":7,"last update":"Sat Dec 16 20:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.33700000000000002},"max":{"1min":0.60099999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.58299999999999996,"5min":0.64300000000000002,"15min":0.71799999999999997},"last":0.63400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575188,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60428,"kb_used_data":7044,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311412,"statfs":{"total":96636764160,"available":96574885888,"internally_reserved":0,"allocated":7213056,"data_stored":11594953,"data_compressed":1199021,"data_compressed_allocated":1765376,"data_compressed_original":6336512,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.27700000000000002,"5min":0.27900000000000003,"15min":0.28299999999999997},"min":{"1min":0.189,"5min":0.17299999999999999,"15min":0.17100000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.56799999999999995},"last":0.247},{"interface":"front","average":{"1min":0.317,"5min":0.316,"15min":0.307},"min":{"1min":0.22700000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.44,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.32700000000000001}]},{"osd":2,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.308,"15min":0.30499999999999999},"min":{"1min":0.20300000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.45100000000000001,"5min":0.52300000000000002,"15min":0.54900000000000004},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.31,"5min":0.32600000000000001,"15min":0.32200000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.20300000000000001},"max":{"1min":0.42899999999999999,"5min":0.57899999999999996,"15min":0.66400000000000003},"last":0.39000000000000001}]},{"osd":3,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.20399999999999999},"max":{"1min":0.46700000000000003,"5min":0.52400000000000002,"15min":0.54100000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34000000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.224},"max":{"1min":0.45000000000000001,"5min":0.59199999999999997,"15min":0.60999999999999999},"last":0.376}]},{"osd":4,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.433,"15min":0.434},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.54000000000000004,"5min":0.67900000000000005,"15min":0.69799999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.435},"min":{"1min":0.36299999999999999,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.56000000000000005,"5min":0.60399999999999998,"15min":0.64200000000000002},"last":0.49399999999999999}]},{"osd":5,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46100000000000002,"15min":0.443},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.29999999999999999},"max":{"1min":0.58499999999999996,"5min":0.67900000000000005,"15min":0.69899999999999995},"last":0.443},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46600000000000003,"15min":0.46300000000000002},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.59399999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.53700000000000003}]},{"osd":6,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.375,"5min":0.32600000000000001,"15min":0.31900000000000001},"max":{"1min":0.628,"5min":0.69199999999999995,"15min":0.71799999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.46000000000000002},"min":{"1min":0.38600000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.60899999999999999,"5min":0.70299999999999996,"15min":0.73499999999999999},"last":0.47199999999999998}]},{"osd":7,"last update":"Sat Dec 16 20:48:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.40799999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65200000000000002,"5min":0.69999999999999996,"15min":0.73599999999999999},"last":0.502},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.34000000000000002},"max":{"1min":0.66100000000000003,"5min":0.66800000000000004,"15min":0.69099999999999995},"last":0.45900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6856704,"data_stored":10886066,"data_compressed":1166433,"data_compressed_allocated":1720320,"data_compressed_original":5763072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2744320,"data_stored":4194464,"data_compressed":488319,"data_compressed_allocated":745472,"data_compressed_original":2203648,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":222889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9564160,"data_stored":12806473,"data_compressed":1002682,"data_compressed_allocated":1646592,"data_compressed_original":4898816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7458816,"data_stored":10885554,"data_compressed":1082070,"data_compressed_allocated":1703936,"data_compressed_original":5144576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12001280,"data_stored":16777888,"data_compressed":1393950,"data_compressed_allocated":2220032,"data_compressed_original":7004160,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17375232,"data_stored":25166406,"data_compressed":2353166,"data_compressed_allocated":3678208,"data_compressed_original":11472896,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T20:49:25.163 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.163 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.163 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.164 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.164 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.164 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.164 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.164 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.164 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.164 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.164 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.165 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.165 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.165 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.165 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.165 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.165 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.165 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.165 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.165 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.166 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.166 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.166 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.166 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.166 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.166 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.166 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.166 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.166 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.166 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.167 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.167 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.167 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.167 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.167 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.167 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.167 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.167 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.167 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.168 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.168 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.168 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.168 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.168 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.168 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.168 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.168 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-16T20:21:23.008820+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=23, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.168 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.168 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.169 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.169 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.169 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.169 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.169 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.169 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.169 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.169 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.169 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.170 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.170 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.170 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.170 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.170 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.170 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.170 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.171 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.171 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.171 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.171 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.171 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.171 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.171 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.171 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.171 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.171 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.172 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.172 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.172 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.172 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.172 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.172 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.172 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.172 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.172 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.172 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.173 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.173 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.173 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.173 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.173 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.173 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.173 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.173 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.173 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.174 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.174 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.174 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.174 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.174 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.174 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.174 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.174 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.174 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.175 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.175 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.175 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.175 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.175 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.175 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.175 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.175 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.175 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.175 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.176 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.176 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.176 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.176 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.176 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.176 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.176 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.176 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.176 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.176 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.177 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.177 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.177 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.177 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:25.177 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T20:49:28.470 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:49:28.473 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:49:45.179 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T20:49:45.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.284+0000 7fe0de961640 1 Processor -- start 2023-12-16T20:49:45.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.284+0000 7fe0de961640 1 -- start start 2023-12-16T20:49:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.285+0000 7fe0de961640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d8071450 0x7fe0d806f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.285+0000 7fe0de961640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d8161ea0 con 0x7fe0d8071830 2023-12-16T20:49:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.285+0000 7fe0de961640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d806f860 con 0x7fe0d81619d0 2023-12-16T20:49:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.285+0000 7fe0de961640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d80cb800 con 0x7fe0d8071450 2023-12-16T20:49:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.285+0000 7fe0dcefe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe0d8071830 0x7fe0d8157670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48286/0 (socket says 172.21.15.87:48286) 2023-12-16T20:49:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.285+0000 7fe0dcefe640 1 -- 172.21.15.87:0/2843428991 learned_addr learned my addr 172.21.15.87:0/2843428991 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:49:45.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.288+0000 7fe0d6ffd640 1 -- 172.21.15.87:0/2843428991 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006275757 0 0) 0x7fe0d8161ea0 con 0x7fe0d8071830 2023-12-16T20:49:45.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.288+0000 7fe0d6ffd640 1 -- 172.21.15.87:0/2843428991 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0c0003520 con 0x7fe0d8071830 2023-12-16T20:49:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.291+0000 7fe0d6ffd640 1 -- 172.21.15.87:0/2843428991 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3605744830 0 0) 0x7fe0c0003520 con 0x7fe0d8071830 2023-12-16T20:49:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.291+0000 7fe0d6ffd640 1 -- 172.21.15.87:0/2843428991 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d8071450 msgr2=0x7fe0d806f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.291+0000 7fe0d6ffd640 1 --2- 172.21.15.87:0/2843428991 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d8071450 0x7fe0d806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.291+0000 7fe0d6ffd640 1 -- 172.21.15.87:0/2843428991 >> v1:172.21.15.195:6789/0 conn(0x7fe0d81619d0 legacy=0x7fe0d815e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.291+0000 7fe0d6ffd640 1 -- 172.21.15.87:0/2843428991 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d80caf60 con 0x7fe0d8071830 2023-12-16T20:49:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.291+0000 7fe0d6ffd640 1 -- 172.21.15.87:0/2843428991 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1165302485 0 0) 0x7fe0d00019f0 con 0x7fe0d8071830 2023-12-16T20:49:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.291+0000 7fe0d6ffd640 1 -- 172.21.15.87:0/2843428991 >> v1:172.21.15.87:6789/0 conn(0x7fe0d8071830 legacy=0x7fe0d8157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.291+0000 7fe0d6ffd640 1 --2- 172.21.15.87:0/2843428991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0c00039a0 0x7fe0c0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.291+0000 7fe0d6ffd640 1 --2- 172.21.15.87:0/2843428991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0c00047c0 0x7fe0c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.291+0000 7fe0d6ffd640 1 --2- 172.21.15.87:0/2843428991 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d8071450 0x7fe0c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.291+0000 7fe0d6ffd640 1 -- 172.21.15.87:0/2843428991 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d80cb800 con 0x7fe0c00047c0 2023-12-16T20:49:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.291+0000 7fe0d6ffd640 1 -- 172.21.15.87:0/2843428991 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00054e0 con 0x7fe0c00039a0 2023-12-16T20:49:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.291+0000 7fe0d6ffd640 1 -- 172.21.15.87:0/2843428991 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c000bec0 con 0x7fe0d8071450 2023-12-16T20:49:45.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.294+0000 7fe0d77fe640 1 --2- 172.21.15.87:0/2843428991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0c00047c0 0x7fe0c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:45.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.297+0000 7fe0d77fe640 1 -- 172.21.15.87:0/2843428991 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d8071450 msgr2=0x7fe0c000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:45.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.297+0000 7fe0d77fe640 1 --2- 172.21.15.87:0/2843428991 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d8071450 0x7fe0c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:45.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.297+0000 7fe0d77fe640 1 -- 172.21.15.87:0/2843428991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0c00039a0 msgr2=0x7fe0c0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:49:45.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.297+0000 7fe0d77fe640 1 --2- 172.21.15.87:0/2843428991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0c00039a0 0x7fe0c0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:45.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.297+0000 7fe0d77fe640 1 -- 172.21.15.87:0/2843428991 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c0003520 con 0x7fe0c00047c0 2023-12-16T20:49:45.299 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.299+0000 7fe0d77fe640 1 --2- 172.21.15.87:0/2843428991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0c00047c0 0x7fe0c0004c40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc001640 tx=0x7fe0c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c788814d07a3246b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:45.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.302+0000 7fe0d6ffd640 1 -- 172.21.15.87:0/2843428991 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc005270 con 0x7fe0c00047c0 2023-12-16T20:49:45.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.302+0000 7fe0d6ffd640 1 -- 172.21.15.87:0/2843428991 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0cc02e070 con 0x7fe0c00047c0 2023-12-16T20:49:45.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.302+0000 7fe0d6ffd640 1 -- 172.21.15.87:0/2843428991 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc003610 con 0x7fe0c00047c0 2023-12-16T20:49:45.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.303+0000 7fe0de961640 1 -- 172.21.15.87:0/2843428991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0c00047c0 msgr2=0x7fe0c0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:45.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.303+0000 7fe0de961640 1 --2- 172.21.15.87:0/2843428991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0c00047c0 0x7fe0c0004c40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc001640 tx=0x7fe0c00057f0 comp rx=0 tx=0).stop 2023-12-16T20:49:45.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.303+0000 7fe0dcefe640 1 -- 172.21.15.87:0/2843428991 reap_dead start 2023-12-16T20:49:45.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.303+0000 7fe0de961640 1 -- 172.21.15.87:0/2843428991 shutdown_connections 2023-12-16T20:49:45.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.303+0000 7fe0de961640 1 -- 172.21.15.87:0/2843428991 >> 172.21.15.87:0/2843428991 conn(0x7fe0d806cd60 msgr2=0x7fe0d806d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:45.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.303+0000 7fe0de961640 1 -- 172.21.15.87:0/2843428991 shutdown_connections 2023-12-16T20:49:45.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.303+0000 7fe0de961640 1 -- 172.21.15.87:0/2843428991 wait complete. 2023-12-16T20:49:45.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.304+0000 7fe0de961640 1 Processor -- start 2023-12-16T20:49:45.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.304+0000 7fe0de961640 1 -- start start 2023-12-16T20:49:45.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.305+0000 7fe0de961640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0c00047c0 0x7fe0d815c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:45.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.305+0000 7fe0de961640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0d814c2d0 0x7fe0d814d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:45.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.305+0000 7fe0de961640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d814eae0 0x7fe0d814ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:45.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.305+0000 7fe0de961640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d815b660 con 0x7fe0d814c2d0 2023-12-16T20:49:45.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.305+0000 7fe0de961640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d815d6a0 con 0x7fe0c00047c0 2023-12-16T20:49:45.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.305+0000 7fe0de961640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d814d6c0 con 0x7fe0d814eae0 2023-12-16T20:49:45.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.306+0000 7fe0d77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0d814c2d0 0x7fe0d814d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:45.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.306+0000 7fe0d77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0d814c2d0 0x7fe0d814d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56550/0 (socket says 172.21.15.87:56550) 2023-12-16T20:49:45.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.306+0000 7fe0d77fe640 1 -- 172.21.15.87:0/3063514410 learned_addr learned my addr 172.21.15.87:0/3063514410 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:49:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.309+0000 7fe0d77fe640 1 -- 172.21.15.87:0/3063514410 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d814eae0 msgr2=0x7fe0d814ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.309+0000 7fe0d77fe640 1 --2- 172.21.15.87:0/3063514410 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d814eae0 0x7fe0d814ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.309+0000 7fe0d77fe640 1 -- 172.21.15.87:0/3063514410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0c00047c0 msgr2=0x7fe0d815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.309+0000 7fe0d77fe640 1 --2- 172.21.15.87:0/3063514410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0c00047c0 0x7fe0d815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.309+0000 7fe0d77fe640 1 -- 172.21.15.87:0/3063514410 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d81564f0 con 0x7fe0d814c2d0 2023-12-16T20:49:45.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.313+0000 7fe0d77fe640 1 --2- 172.21.15.87:0/3063514410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0d814c2d0 0x7fe0d814d180 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc001760 tx=0x7fe0cc000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:45.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.319+0000 7fe0d4ff9640 1 -- 172.21.15.87:0/3063514410 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc005470 con 0x7fe0d814c2d0 2023-12-16T20:49:45.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.319+0000 7fe0de961640 1 -- 172.21.15.87:0/3063514410 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d81567b0 con 0x7fe0d814c2d0 2023-12-16T20:49:45.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.319+0000 7fe0de961640 1 -- 172.21.15.87:0/3063514410 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d8156d70 con 0x7fe0d814c2d0 2023-12-16T20:49:45.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.320+0000 7fe0de961640 1 -- 172.21.15.87:0/3063514410 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d8156f00 con 0x7fe0d814c2d0 2023-12-16T20:49:45.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.322+0000 7fe0d4ff9640 1 -- 172.21.15.87:0/3063514410 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0cc003800 con 0x7fe0d814c2d0 2023-12-16T20:49:45.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.322+0000 7fe0d4ff9640 1 -- 172.21.15.87:0/3063514410 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc003b70 con 0x7fe0d814c2d0 2023-12-16T20:49:45.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.616+0000 7fe0d4ff9640 1 -- 172.21.15.87:0/3063514410 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fe0cc030030 con 0x7fe0d814c2d0 2023-12-16T20:49:45.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.616+0000 7fe0d4ff9640 1 --2- 172.21.15.87:0/3063514410 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe0c406ae70 0x7fe0c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:49:45.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.617+0000 7fe0d7fff640 1 --2- 172.21.15.87:0/3063514410 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe0c406ae70 0x7fe0c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:49:45.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.617+0000 7fe0d7fff640 1 --2- 172.21.15.87:0/3063514410 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe0c406ae70 0x7fe0c406d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009710 tx=0x7fe0c8006d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:49:45.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.632+0000 7fe0d4ff9640 1 -- 172.21.15.87:0/3063514410 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe0cc031e60 con 0x7fe0d814c2d0 2023-12-16T20:49:45.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.632+0000 7fe0d4ff9640 1 -- 172.21.15.87:0/3063514410 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fe0cc075cd0 con 0x7fe0d814c2d0 2023-12-16T20:49:45.797 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.796+0000 7fe0de961640 1 -- 172.21.15.87:0/3063514410 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0d8072030 con 0x7fe0c406ae70 2023-12-16T20:49:45.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.805+0000 7fe0d4ff9640 1 -- 172.21.15.87:0/3063514410 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369167 (secure 0 0 0) 0x7fe0d8072030 con 0x7fe0c406ae70 2023-12-16T20:49:45.810 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:49:45.812 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-12-16T20:49:45.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.809+0000 7fe0de961640 1 -- 172.21.15.87:0/3063514410 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe0c406ae70 msgr2=0x7fe0c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:45.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.809+0000 7fe0de961640 1 --2- 172.21.15.87:0/3063514410 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe0c406ae70 0x7fe0c406d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009710 tx=0x7fe0c8006d10 comp rx=0 tx=0).stop 2023-12-16T20:49:45.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.809+0000 7fe0de961640 1 -- 172.21.15.87:0/3063514410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0d814c2d0 msgr2=0x7fe0d814d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:49:45.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.809+0000 7fe0de961640 1 --2- 172.21.15.87:0/3063514410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0d814c2d0 0x7fe0d814d180 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc001760 tx=0x7fe0cc000fb0 comp rx=0 tx=0).stop 2023-12-16T20:49:45.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.809+0000 7fe0de961640 1 -- 172.21.15.87:0/3063514410 shutdown_connections 2023-12-16T20:49:45.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.809+0000 7fe0de961640 1 --2- 172.21.15.87:0/3063514410 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe0d814eae0 0x7fe0d814ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:45.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.809+0000 7fe0de961640 1 --2- 172.21.15.87:0/3063514410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0d814c2d0 0x7fe0d814d180 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:45.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.809+0000 7fe0de961640 1 --2- 172.21.15.87:0/3063514410 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fe0c406ae70 0x7fe0c406d330 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:45.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.809+0000 7fe0de961640 1 --2- 172.21.15.87:0/3063514410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0c00047c0 0x7fe0d815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:49:45.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.809+0000 7fe0de961640 1 -- 172.21.15.87:0/3063514410 >> 172.21.15.87:0/3063514410 conn(0x7fe0d806cd60 msgr2=0x7fe0d8157440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:49:45.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.809+0000 7fe0de961640 1 -- 172.21.15.87:0/3063514410 shutdown_connections 2023-12-16T20:49:45.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:49:45.809+0000 7fe0de961640 1 -- 172.21.15.87:0/3063514410 wait complete. 2023-12-16T20:49:45.821 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":872,"stamp":"2023-12-16T20:49:44.652986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41060283,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1154,"num_read_kb":1198,"num_write":13351,"num_write_kb":371526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15866,"ondisk_log_size":15866,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":431648,"kb_used_data":57312,"kb_used_omap":12,"kb_used_meta":374259,"kb_avail":754543072,"statfs":{"total":773094113280,"available":772652105728,"internally_reserved":0,"allocated":58687488,"data_stored":83068718,"data_compressed":7551796,"data_compressed_allocated":11804672,"data_compressed_original":37634048,"omap_allocated":12751,"internal_metadata":383241777},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003179"},"pg_stats":[{"pgid":"2.1f","version":"27'645","reported_seq":685,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:23.157430+0000","last_change":"2023-12-16T20:49:23.157455+0000","last_active":"2023-12-16T20:49:23.157430+0000","last_peered":"2023-12-16T20:49:23.157430+0000","last_clean":"2023-12-16T20:49:23.157430+0000","last_became_active":"2023-12-16T20:21:35.413075+0000","last_became_peered":"2023-12-16T20:21:35.413075+0000","last_unstale":"2023-12-16T20:49:23.157430+0000","last_undegraded":"2023-12-16T20:49:23.157430+0000","last_fullsized":"2023-12-16T20:49:23.157430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'645","last_scrub_stamp":"2023-12-16T20:49:23.157376+0000","last_deep_scrub":"27'645","last_deep_scrub_stamp":"2023-12-16T20:49:23.157376+0000","last_clean_scrub_stamp":"2023-12-16T20:49:23.157376+0000","objects_scrubbed":3,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:45.002915+0000","scrub_duration":0.012814567000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'31","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:25.961331+0000","last_change":"2023-12-16T20:49:25.961331+0000","last_active":"2023-12-16T20:49:25.961331+0000","last_peered":"2023-12-16T20:49:25.961331+0000","last_clean":"2023-12-16T20:49:25.961331+0000","last_became_active":"2023-12-16T20:21:36.542667+0000","last_became_peered":"2023-12-16T20:21:36.542667+0000","last_unstale":"2023-12-16T20:49:25.961331+0000","last_undegraded":"2023-12-16T20:49:25.961331+0000","last_fullsized":"2023-12-16T20:49:25.961331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2023-12-16T20:49:25.961221+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2023-12-16T20:49:25.961221+0000","last_clean_scrub_stamp":"2023-12-16T20:49:25.961221+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:37:18.758291+0000","scrub_duration":0.001405351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'182","reported_seq":209,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.469524+0000","last_change":"2023-12-16T20:21:41.216466+0000","last_active":"2023-12-16T20:48:41.469524+0000","last_peered":"2023-12-16T20:48:41.469524+0000","last_clean":"2023-12-16T20:48:41.469524+0000","last_became_active":"2023-12-16T20:21:41.216062+0000","last_became_peered":"2023-12-16T20:21:41.216062+0000","last_unstale":"2023-12-16T20:48:41.469524+0000","last_undegraded":"2023-12-16T20:48:41.469524+0000","last_fullsized":"2023-12-16T20:48:41.469524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":13331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'711","reported_seq":752,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.086965+0000","last_change":"2023-12-16T20:49:35.086965+0000","last_active":"2023-12-16T20:49:35.086965+0000","last_peered":"2023-12-16T20:49:35.086965+0000","last_clean":"2023-12-16T20:49:35.086965+0000","last_became_active":"2023-12-16T20:21:35.419745+0000","last_became_peered":"2023-12-16T20:21:35.419745+0000","last_unstale":"2023-12-16T20:49:35.086965+0000","last_undegraded":"2023-12-16T20:49:35.086965+0000","last_fullsized":"2023-12-16T20:49:35.086965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'711","last_scrub_stamp":"2023-12-16T20:49:35.086833+0000","last_deep_scrub":"27'711","last_deep_scrub_stamp":"2023-12-16T20:49:35.086833+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.086833+0000","objects_scrubbed":1,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:55:19.452990+0000","scrub_duration":0.013529074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'38","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:20.169422+0000","last_change":"2023-12-16T20:49:20.169443+0000","last_active":"2023-12-16T20:49:20.169422+0000","last_peered":"2023-12-16T20:49:20.169422+0000","last_clean":"2023-12-16T20:49:20.169422+0000","last_became_active":"2023-12-16T20:21:36.552621+0000","last_became_peered":"2023-12-16T20:21:36.552621+0000","last_unstale":"2023-12-16T20:49:20.169422+0000","last_undegraded":"2023-12-16T20:49:20.169422+0000","last_fullsized":"2023-12-16T20:49:20.169422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:20.169357+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:20.169357+0000","last_clean_scrub_stamp":"2023-12-16T20:49:20.169357+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:05:52.134660+0000","scrub_duration":0.001403729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'122","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.504782+0000","last_change":"2023-12-16T20:21:40.754959+0000","last_active":"2023-12-16T20:48:41.504782+0000","last_peered":"2023-12-16T20:48:41.504782+0000","last_clean":"2023-12-16T20:48:41.504782+0000","last_became_active":"2023-12-16T20:21:40.754509+0000","last_became_peered":"2023-12-16T20:21:40.754509+0000","last_unstale":"2023-12-16T20:48:41.504782+0000","last_undegraded":"2023-12-16T20:48:41.504782+0000","last_fullsized":"2023-12-16T20:48:41.504782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1395","reported_seq":1433,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.931101+0000","last_change":"2023-12-16T20:49:37.931129+0000","last_active":"2023-12-16T20:49:37.931101+0000","last_peered":"2023-12-16T20:49:37.931101+0000","last_clean":"2023-12-16T20:49:37.931101+0000","last_became_active":"2023-12-16T20:21:35.427317+0000","last_became_peered":"2023-12-16T20:21:35.427317+0000","last_unstale":"2023-12-16T20:49:37.931101+0000","last_undegraded":"2023-12-16T20:49:37.931101+0000","last_fullsized":"2023-12-16T20:49:37.931101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1395","last_scrub_stamp":"2023-12-16T20:49:37.931040+0000","last_deep_scrub":"27'1395","last_deep_scrub_stamp":"2023-12-16T20:49:37.931040+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.931040+0000","objects_scrubbed":3,"log_size":1395,"log_dups_size":0,"ondisk_log_size":1395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:22:53.562497+0000","scrub_duration":0.022717590999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":9004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'33","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.888700+0000","last_change":"2023-12-16T20:22:14.769257+0000","last_active":"2023-12-16T20:49:08.888700+0000","last_peered":"2023-12-16T20:49:08.888700+0000","last_clean":"2023-12-16T20:49:08.888700+0000","last_became_active":"2023-12-16T20:22:14.768968+0000","last_became_peered":"2023-12-16T20:22:14.768968+0000","last_unstale":"2023-12-16T20:49:08.888700+0000","last_undegraded":"2023-12-16T20:49:08.888700+0000","last_fullsized":"2023-12-16T20:49:08.888700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"27'156","reported_seq":192,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:11.645374+0000","last_change":"2023-12-16T20:22:14.820429+0000","last_active":"2023-12-16T20:49:11.645374+0000","last_peered":"2023-12-16T20:49:11.645374+0000","last_clean":"2023-12-16T20:49:11.645374+0000","last_became_active":"2023-12-16T20:22:14.819924+0000","last_became_peered":"2023-12-16T20:22:14.819924+0000","last_unstale":"2023-12-16T20:49:11.645374+0000","last_undegraded":"2023-12-16T20:49:11.645374+0000","last_fullsized":"2023-12-16T20:49:11.645374+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":12476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:40.919237+0000","last_change":"2023-12-16T20:49:40.919278+0000","last_active":"2023-12-16T20:49:40.919237+0000","last_peered":"2023-12-16T20:49:40.919237+0000","last_clean":"2023-12-16T20:49:40.919237+0000","last_became_active":"2023-12-16T20:21:35.413234+0000","last_became_peered":"2023-12-16T20:21:35.413234+0000","last_unstale":"2023-12-16T20:49:40.919237+0000","last_undegraded":"2023-12-16T20:49:40.919237+0000","last_fullsized":"2023-12-16T20:49:40.919237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-16T20:49:40.919143+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-16T20:49:40.919143+0000","last_clean_scrub_stamp":"2023-12-16T20:49:40.919143+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:18:08.836684+0000","scrub_duration":0.0023112950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'49","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.819982+0000","last_change":"2023-12-16T20:21:36.554419+0000","last_active":"2023-12-16T20:49:08.819982+0000","last_peered":"2023-12-16T20:49:08.819982+0000","last_clean":"2023-12-16T20:49:08.819982+0000","last_became_active":"2023-12-16T20:21:36.554014+0000","last_became_peered":"2023-12-16T20:21:36.554014+0000","last_unstale":"2023-12-16T20:49:08.819982+0000","last_undegraded":"2023-12-16T20:49:08.819982+0000","last_fullsized":"2023-12-16T20:49:08.819982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'146","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:40.448517+0000","last_change":"2023-12-16T20:49:40.448537+0000","last_active":"2023-12-16T20:49:40.448517+0000","last_peered":"2023-12-16T20:49:40.448517+0000","last_clean":"2023-12-16T20:49:40.448517+0000","last_became_active":"2023-12-16T20:21:40.794471+0000","last_became_peered":"2023-12-16T20:21:40.794471+0000","last_unstale":"2023-12-16T20:49:40.448517+0000","last_undegraded":"2023-12-16T20:49:40.448517+0000","last_fullsized":"2023-12-16T20:49:40.448517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'146","last_scrub_stamp":"2023-12-16T20:49:40.448446+0000","last_deep_scrub":"27'146","last_deep_scrub_stamp":"2023-12-16T20:49:40.448446+0000","last_clean_scrub_stamp":"2023-12-16T20:49:40.448446+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:54:56.914280+0000","scrub_duration":0.0016447670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'39","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.890314+0000","last_change":"2023-12-16T20:21:36.542450+0000","last_active":"2023-12-16T20:49:08.890314+0000","last_peered":"2023-12-16T20:49:08.890314+0000","last_clean":"2023-12-16T20:49:08.890314+0000","last_became_active":"2023-12-16T20:21:36.542157+0000","last_became_peered":"2023-12-16T20:21:36.542157+0000","last_unstale":"2023-12-16T20:49:08.890314+0000","last_undegraded":"2023-12-16T20:49:08.890314+0000","last_fullsized":"2023-12-16T20:49:08.890314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'682","reported_seq":721,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:39.928151+0000","last_change":"2023-12-16T20:49:39.928177+0000","last_active":"2023-12-16T20:49:39.928151+0000","last_peered":"2023-12-16T20:49:39.928151+0000","last_clean":"2023-12-16T20:49:39.928151+0000","last_became_active":"2023-12-16T20:21:35.413400+0000","last_became_peered":"2023-12-16T20:21:35.413400+0000","last_unstale":"2023-12-16T20:49:39.928151+0000","last_undegraded":"2023-12-16T20:49:39.928151+0000","last_fullsized":"2023-12-16T20:49:39.928151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'682","last_scrub_stamp":"2023-12-16T20:49:39.928085+0000","last_deep_scrub":"27'682","last_deep_scrub_stamp":"2023-12-16T20:49:39.928085+0000","last_clean_scrub_stamp":"2023-12-16T20:49:39.928085+0000","objects_scrubbed":2,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:26:52.170550+0000","scrub_duration":0.016337826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":4429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'121","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.641761+0000","last_change":"2023-12-16T20:21:40.745971+0000","last_active":"2023-12-16T20:48:41.641761+0000","last_peered":"2023-12-16T20:48:41.641761+0000","last_clean":"2023-12-16T20:48:41.641761+0000","last_became_active":"2023-12-16T20:21:40.745544+0000","last_became_peered":"2023-12-16T20:21:40.745544+0000","last_unstale":"2023-12-16T20:48:41.641761+0000","last_undegraded":"2023-12-16T20:48:41.641761+0000","last_fullsized":"2023-12-16T20:48:41.641761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":10860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'38","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:29.049902+0000","last_change":"2023-12-16T20:49:29.049927+0000","last_active":"2023-12-16T20:49:29.049902+0000","last_peered":"2023-12-16T20:49:29.049902+0000","last_clean":"2023-12-16T20:49:29.049902+0000","last_became_active":"2023-12-16T20:21:36.525983+0000","last_became_peered":"2023-12-16T20:21:36.525983+0000","last_unstale":"2023-12-16T20:49:29.049902+0000","last_undegraded":"2023-12-16T20:49:29.049902+0000","last_fullsized":"2023-12-16T20:49:29.049902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:29.049801+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:29.049801+0000","last_clean_scrub_stamp":"2023-12-16T20:49:29.049801+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:17:56.967342+0000","scrub_duration":0.001151219,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'2","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:00.763597+0000","last_change":"2023-12-16T20:21:35.420017+0000","last_active":"2023-12-16T20:49:00.763597+0000","last_peered":"2023-12-16T20:49:00.763597+0000","last_clean":"2023-12-16T20:49:00.763597+0000","last_became_active":"2023-12-16T20:21:35.419731+0000","last_became_peered":"2023-12-16T20:21:35.419731+0000","last_unstale":"2023-12-16T20:49:00.763597+0000","last_undegraded":"2023-12-16T20:49:00.763597+0000","last_fullsized":"2023-12-16T20:49:00.763597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'169","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.641749+0000","last_change":"2023-12-16T20:21:40.755335+0000","last_active":"2023-12-16T20:48:41.641749+0000","last_peered":"2023-12-16T20:48:41.641749+0000","last_clean":"2023-12-16T20:48:41.641749+0000","last_became_active":"2023-12-16T20:21:40.754829+0000","last_became_peered":"2023-12-16T20:21:40.754829+0000","last_unstale":"2023-12-16T20:48:41.641749+0000","last_undegraded":"2023-12-16T20:48:41.641749+0000","last_fullsized":"2023-12-16T20:48:41.641749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":10412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'38","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.059182+0000","last_change":"2023-12-16T20:49:37.059222+0000","last_active":"2023-12-16T20:49:37.059182+0000","last_peered":"2023-12-16T20:49:37.059182+0000","last_clean":"2023-12-16T20:49:37.059182+0000","last_became_active":"2023-12-16T20:21:36.518686+0000","last_became_peered":"2023-12-16T20:21:36.518686+0000","last_unstale":"2023-12-16T20:49:37.059182+0000","last_undegraded":"2023-12-16T20:49:37.059182+0000","last_fullsized":"2023-12-16T20:49:37.059182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:37.059110+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:37.059110+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.059110+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:02:40.257888+0000","scrub_duration":0.00095491900000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:38.167504+0000","last_change":"2023-12-16T20:49:38.167525+0000","last_active":"2023-12-16T20:49:38.167504+0000","last_peered":"2023-12-16T20:49:38.167504+0000","last_clean":"2023-12-16T20:49:38.167504+0000","last_became_active":"2023-12-16T20:21:35.416067+0000","last_became_peered":"2023-12-16T20:21:35.416067+0000","last_unstale":"2023-12-16T20:49:38.167504+0000","last_undegraded":"2023-12-16T20:49:38.167504+0000","last_fullsized":"2023-12-16T20:49:38.167504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-12-16T20:49:38.167435+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-12-16T20:49:38.167435+0000","last_clean_scrub_stamp":"2023-12-16T20:49:38.167435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:37:30.964505+0000","scrub_duration":0.0011178469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'126","reported_seq":154,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.483608+0000","last_change":"2023-12-16T20:21:41.215250+0000","last_active":"2023-12-16T20:48:46.483608+0000","last_peered":"2023-12-16T20:48:46.483608+0000","last_clean":"2023-12-16T20:48:46.483608+0000","last_became_active":"2023-12-16T20:21:41.214198+0000","last_became_peered":"2023-12-16T20:21:41.214198+0000","last_unstale":"2023-12-16T20:48:46.483608+0000","last_undegraded":"2023-12-16T20:48:46.483608+0000","last_fullsized":"2023-12-16T20:48:46.483608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":7034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'34","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:34.369451+0000","last_change":"2023-12-16T20:49:34.369486+0000","last_active":"2023-12-16T20:49:34.369451+0000","last_peered":"2023-12-16T20:49:34.369451+0000","last_clean":"2023-12-16T20:49:34.369451+0000","last_became_active":"2023-12-16T20:21:36.536321+0000","last_became_peered":"2023-12-16T20:21:36.536321+0000","last_unstale":"2023-12-16T20:49:34.369451+0000","last_undegraded":"2023-12-16T20:49:34.369451+0000","last_fullsized":"2023-12-16T20:49:34.369451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2023-12-16T20:49:34.369363+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2023-12-16T20:49:34.369363+0000","last_clean_scrub_stamp":"2023-12-16T20:49:34.369363+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:03:30.826563+0000","scrub_duration":0.0011209779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:36.954766+0000","last_change":"2023-12-16T20:49:36.954785+0000","last_active":"2023-12-16T20:49:36.954766+0000","last_peered":"2023-12-16T20:49:36.954766+0000","last_clean":"2023-12-16T20:49:36.954766+0000","last_became_active":"2023-12-16T20:21:35.420547+0000","last_became_peered":"2023-12-16T20:21:35.420547+0000","last_unstale":"2023-12-16T20:49:36.954766+0000","last_undegraded":"2023-12-16T20:49:36.954766+0000","last_fullsized":"2023-12-16T20:49:36.954766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2023-12-16T20:49:36.954706+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2023-12-16T20:49:36.954706+0000","last_clean_scrub_stamp":"2023-12-16T20:49:36.954706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:06:52.792558+0000","scrub_duration":0.001061644,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'120","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.641772+0000","last_change":"2023-12-16T20:21:40.757445+0000","last_active":"2023-12-16T20:48:41.641772+0000","last_peered":"2023-12-16T20:48:41.641772+0000","last_clean":"2023-12-16T20:48:41.641772+0000","last_became_active":"2023-12-16T20:21:40.756997+0000","last_became_peered":"2023-12-16T20:21:40.756997+0000","last_unstale":"2023-12-16T20:48:41.641772+0000","last_undegraded":"2023-12-16T20:48:41.641772+0000","last_fullsized":"2023-12-16T20:48:41.641772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":6714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'40","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:40.269251+0000","last_change":"2023-12-16T20:49:40.269289+0000","last_active":"2023-12-16T20:49:40.269251+0000","last_peered":"2023-12-16T20:49:40.269251+0000","last_clean":"2023-12-16T20:49:40.269251+0000","last_became_active":"2023-12-16T20:21:36.524703+0000","last_became_peered":"2023-12-16T20:21:36.524703+0000","last_unstale":"2023-12-16T20:49:40.269251+0000","last_undegraded":"2023-12-16T20:49:40.269251+0000","last_fullsized":"2023-12-16T20:49:40.269251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2023-12-16T20:49:40.269176+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2023-12-16T20:49:40.269176+0000","last_clean_scrub_stamp":"2023-12-16T20:49:40.269176+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:25:27.096610+0000","scrub_duration":0.001165059,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'11","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:24.985429+0000","last_change":"2023-12-16T20:49:24.985449+0000","last_active":"2023-12-16T20:49:24.985429+0000","last_peered":"2023-12-16T20:49:24.985429+0000","last_clean":"2023-12-16T20:49:24.985429+0000","last_became_active":"2023-12-16T20:21:35.428465+0000","last_became_peered":"2023-12-16T20:21:35.428465+0000","last_unstale":"2023-12-16T20:49:24.985429+0000","last_undegraded":"2023-12-16T20:49:24.985429+0000","last_fullsized":"2023-12-16T20:49:24.985429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2023-12-16T20:49:24.985368+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2023-12-16T20:49:24.985368+0000","last_clean_scrub_stamp":"2023-12-16T20:49:24.985368+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:46:57.920491+0000","scrub_duration":0.002106316,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'152","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.642270+0000","last_change":"2023-12-16T20:21:41.213330+0000","last_active":"2023-12-16T20:48:46.642270+0000","last_peered":"2023-12-16T20:48:46.642270+0000","last_clean":"2023-12-16T20:48:46.642270+0000","last_became_active":"2023-12-16T20:21:41.212976+0000","last_became_peered":"2023-12-16T20:21:41.212976+0000","last_unstale":"2023-12-16T20:48:46.642270+0000","last_undegraded":"2023-12-16T20:48:46.642270+0000","last_fullsized":"2023-12-16T20:48:46.642270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":10330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'37","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:40.941803+0000","last_change":"2023-12-16T20:49:40.941825+0000","last_active":"2023-12-16T20:49:40.941803+0000","last_peered":"2023-12-16T20:49:40.941803+0000","last_clean":"2023-12-16T20:49:40.941803+0000","last_became_active":"2023-12-16T20:21:36.518673+0000","last_became_peered":"2023-12-16T20:21:36.518673+0000","last_unstale":"2023-12-16T20:49:40.941803+0000","last_undegraded":"2023-12-16T20:49:40.941803+0000","last_fullsized":"2023-12-16T20:49:40.941803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2023-12-16T20:49:40.941728+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2023-12-16T20:49:40.941728+0000","last_clean_scrub_stamp":"2023-12-16T20:49:40.941728+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:05:27.080261+0000","scrub_duration":0.0014944279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'310","reported_seq":341,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:10.565043+0000","last_change":"2023-12-16T20:21:35.423292+0000","last_active":"2023-12-16T20:49:10.565043+0000","last_peered":"2023-12-16T20:49:10.565043+0000","last_clean":"2023-12-16T20:49:10.565043+0000","last_became_active":"2023-12-16T20:21:35.423045+0000","last_became_peered":"2023-12-16T20:21:35.423045+0000","last_unstale":"2023-12-16T20:49:10.565043+0000","last_undegraded":"2023-12-16T20:49:10.565043+0000","last_fullsized":"2023-12-16T20:49:10.565043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":886,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'156","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.465959+0000","last_change":"2023-12-16T20:21:41.216113+0000","last_active":"2023-12-16T20:48:41.465959+0000","last_peered":"2023-12-16T20:48:41.465959+0000","last_clean":"2023-12-16T20:48:41.465959+0000","last_became_active":"2023-12-16T20:21:41.215747+0000","last_became_peered":"2023-12-16T20:21:41.215747+0000","last_unstale":"2023-12-16T20:48:41.465959+0000","last_undegraded":"2023-12-16T20:48:41.465959+0000","last_fullsized":"2023-12-16T20:48:41.465959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'35","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796509+0000","last_change":"2023-12-16T20:21:36.451660+0000","last_active":"2023-12-16T20:49:08.796509+0000","last_peered":"2023-12-16T20:49:08.796509+0000","last_clean":"2023-12-16T20:49:08.796509+0000","last_became_active":"2023-12-16T20:21:36.451404+0000","last_became_peered":"2023-12-16T20:21:36.451404+0000","last_unstale":"2023-12-16T20:49:08.796509+0000","last_undegraded":"2023-12-16T20:49:08.796509+0000","last_fullsized":"2023-12-16T20:49:08.796509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:58.652022+0000","last_change":"2023-12-16T20:21:35.420184+0000","last_active":"2023-12-16T20:48:58.652022+0000","last_peered":"2023-12-16T20:48:58.652022+0000","last_clean":"2023-12-16T20:48:58.652022+0000","last_became_active":"2023-12-16T20:21:35.419917+0000","last_became_peered":"2023-12-16T20:21:35.419917+0000","last_unstale":"2023-12-16T20:48:58.652022+0000","last_undegraded":"2023-12-16T20:48:58.652022+0000","last_fullsized":"2023-12-16T20:48:58.652022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'136","reported_seq":165,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.501274+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:48:46.501274+0000","last_peered":"2023-12-16T20:48:46.501274+0000","last_clean":"2023-12-16T20:48:46.501274+0000","last_became_active":"2023-12-16T20:21:41.212704+0000","last_became_peered":"2023-12-16T20:21:41.212704+0000","last_unstale":"2023-12-16T20:48:46.501274+0000","last_undegraded":"2023-12-16T20:48:46.501274+0000","last_fullsized":"2023-12-16T20:48:46.501274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":9011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'38","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.823189+0000","last_change":"2023-12-16T20:21:36.555288+0000","last_active":"2023-12-16T20:49:08.823189+0000","last_peered":"2023-12-16T20:49:08.823189+0000","last_clean":"2023-12-16T20:49:08.823189+0000","last_became_active":"2023-12-16T20:21:36.555011+0000","last_became_peered":"2023-12-16T20:21:36.555011+0000","last_unstale":"2023-12-16T20:49:08.823189+0000","last_undegraded":"2023-12-16T20:49:08.823189+0000","last_fullsized":"2023-12-16T20:49:08.823189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'5","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.178105+0000","last_change":"2023-12-16T20:49:37.178126+0000","last_active":"2023-12-16T20:49:37.178105+0000","last_peered":"2023-12-16T20:49:37.178105+0000","last_clean":"2023-12-16T20:49:37.178105+0000","last_became_active":"2023-12-16T20:21:35.417683+0000","last_became_peered":"2023-12-16T20:21:35.417683+0000","last_unstale":"2023-12-16T20:49:37.178105+0000","last_undegraded":"2023-12-16T20:49:37.178105+0000","last_fullsized":"2023-12-16T20:49:37.178105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:37.178026+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:37.178026+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.178026+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:16:43.237442+0000","scrub_duration":0.00095622999999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'180","reported_seq":209,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.483523+0000","last_change":"2023-12-16T20:21:40.794299+0000","last_active":"2023-12-16T20:48:46.483523+0000","last_peered":"2023-12-16T20:48:46.483523+0000","last_clean":"2023-12-16T20:48:46.483523+0000","last_became_active":"2023-12-16T20:21:40.793754+0000","last_became_peered":"2023-12-16T20:21:40.793754+0000","last_unstale":"2023-12-16T20:48:46.483523+0000","last_undegraded":"2023-12-16T20:48:46.483523+0000","last_fullsized":"2023-12-16T20:48:46.483523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":10123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'33","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:31.412846+0000","last_change":"2023-12-16T20:49:31.412901+0000","last_active":"2023-12-16T20:49:31.412846+0000","last_peered":"2023-12-16T20:49:31.412846+0000","last_clean":"2023-12-16T20:49:31.412846+0000","last_became_active":"2023-12-16T20:21:36.533651+0000","last_became_peered":"2023-12-16T20:21:36.533651+0000","last_unstale":"2023-12-16T20:49:31.412846+0000","last_undegraded":"2023-12-16T20:49:31.412846+0000","last_fullsized":"2023-12-16T20:49:31.412846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:31.412729+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:31.412729+0000","last_clean_scrub_stamp":"2023-12-16T20:49:31.412729+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:47:35.138274+0000","scrub_duration":0.0013879739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'7","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.737712+0000","last_change":"2023-12-16T20:49:37.737756+0000","last_active":"2023-12-16T20:49:37.737712+0000","last_peered":"2023-12-16T20:49:37.737712+0000","last_clean":"2023-12-16T20:49:37.737712+0000","last_became_active":"2023-12-16T20:21:35.421875+0000","last_became_peered":"2023-12-16T20:21:35.421875+0000","last_unstale":"2023-12-16T20:49:37.737712+0000","last_undegraded":"2023-12-16T20:49:37.737712+0000","last_fullsized":"2023-12-16T20:49:37.737712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-16T20:49:37.737605+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-16T20:49:37.737605+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.737605+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:22:53.369062+0000","scrub_duration":0.001373296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'112","reported_seq":141,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.483549+0000","last_change":"2023-12-16T20:21:40.754363+0000","last_active":"2023-12-16T20:48:46.483549+0000","last_peered":"2023-12-16T20:48:46.483549+0000","last_clean":"2023-12-16T20:48:46.483549+0000","last_became_active":"2023-12-16T20:21:40.753994+0000","last_became_peered":"2023-12-16T20:21:40.753994+0000","last_unstale":"2023-12-16T20:48:46.483549+0000","last_undegraded":"2023-12-16T20:48:46.483549+0000","last_fullsized":"2023-12-16T20:48:46.483549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'33","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:19.988428+0000","last_change":"2023-12-16T20:21:36.451488+0000","last_active":"2023-12-16T20:49:19.988428+0000","last_peered":"2023-12-16T20:49:19.988428+0000","last_clean":"2023-12-16T20:49:19.988428+0000","last_became_active":"2023-12-16T20:21:36.451231+0000","last_became_peered":"2023-12-16T20:21:36.451231+0000","last_unstale":"2023-12-16T20:49:19.988428+0000","last_undegraded":"2023-12-16T20:49:19.988428+0000","last_fullsized":"2023-12-16T20:49:19.988428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'1042","reported_seq":2120,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:26.183376+0000","last_change":"2023-12-16T20:49:26.183411+0000","last_active":"2023-12-16T20:49:26.183376+0000","last_peered":"2023-12-16T20:49:26.183376+0000","last_clean":"2023-12-16T20:49:26.183376+0000","last_became_active":"2023-12-16T20:21:35.420236+0000","last_became_peered":"2023-12-16T20:21:35.420236+0000","last_unstale":"2023-12-16T20:49:26.183376+0000","last_undegraded":"2023-12-16T20:49:26.183376+0000","last_fullsized":"2023-12-16T20:49:26.183376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1042","last_scrub_stamp":"2023-12-16T20:49:26.183300+0000","last_deep_scrub":"27'1042","last_deep_scrub_stamp":"2023-12-16T20:49:26.183300+0000","last_clean_scrub_stamp":"2023-12-16T20:49:26.183300+0000","objects_scrubbed":1,"log_size":1042,"log_dups_size":0,"ondisk_log_size":1042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:27:50.281048+0000","scrub_duration":0.0018598899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222889,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1038,"num_read_kb":1098,"num_write":1039,"num_write_kb":1099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'134","reported_seq":159,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.484635+0000","last_change":"2023-12-16T20:22:14.842642+0000","last_active":"2023-12-16T20:48:41.484635+0000","last_peered":"2023-12-16T20:48:41.484635+0000","last_clean":"2023-12-16T20:48:41.484635+0000","last_became_active":"2023-12-16T20:22:14.842220+0000","last_became_peered":"2023-12-16T20:22:14.842220+0000","last_unstale":"2023-12-16T20:48:41.484635+0000","last_undegraded":"2023-12-16T20:48:41.484635+0000","last_fullsized":"2023-12-16T20:48:41.484635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":9129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"27'27","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.972439+0000","last_change":"2023-12-16T20:21:36.535835+0000","last_active":"2023-12-16T20:49:08.972439+0000","last_peered":"2023-12-16T20:49:08.972439+0000","last_clean":"2023-12-16T20:49:08.972439+0000","last_became_active":"2023-12-16T20:21:36.535571+0000","last_became_peered":"2023-12-16T20:21:36.535571+0000","last_unstale":"2023-12-16T20:49:08.972439+0000","last_undegraded":"2023-12-16T20:49:08.972439+0000","last_fullsized":"2023-12-16T20:49:08.972439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'544","reported_seq":577,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:24.563814+0000","last_change":"2023-12-16T20:21:35.418993+0000","last_active":"2023-12-16T20:49:24.563814+0000","last_peered":"2023-12-16T20:49:24.563814+0000","last_clean":"2023-12-16T20:49:24.563814+0000","last_became_active":"2023-12-16T20:21:35.418751+0000","last_became_peered":"2023-12-16T20:21:35.418751+0000","last_unstale":"2023-12-16T20:49:24.563814+0000","last_undegraded":"2023-12-16T20:49:24.563814+0000","last_fullsized":"2023-12-16T20:49:24.563814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'129","reported_seq":157,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:40.300141+0000","last_change":"2023-12-16T20:21:41.214405+0000","last_active":"2023-12-16T20:48:40.300141+0000","last_peered":"2023-12-16T20:48:40.300141+0000","last_clean":"2023-12-16T20:48:40.300141+0000","last_became_active":"2023-12-16T20:21:41.213977+0000","last_became_peered":"2023-12-16T20:21:41.213977+0000","last_unstale":"2023-12-16T20:48:40.300141+0000","last_undegraded":"2023-12-16T20:48:40.300141+0000","last_fullsized":"2023-12-16T20:48:40.300141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":8382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'30","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:25.008712+0000","last_change":"2023-12-16T20:49:25.008746+0000","last_active":"2023-12-16T20:49:25.008712+0000","last_peered":"2023-12-16T20:49:25.008712+0000","last_clean":"2023-12-16T20:49:25.008712+0000","last_became_active":"2023-12-16T20:21:36.550997+0000","last_became_peered":"2023-12-16T20:21:36.550997+0000","last_unstale":"2023-12-16T20:49:25.008712+0000","last_undegraded":"2023-12-16T20:49:25.008712+0000","last_fullsized":"2023-12-16T20:49:25.008712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-12-16T20:49:25.008610+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-12-16T20:49:25.008610+0000","last_clean_scrub_stamp":"2023-12-16T20:49:25.008610+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:16:31.068027+0000","scrub_duration":0.001488783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'4","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:02.736078+0000","last_change":"2023-12-16T20:21:35.416258+0000","last_active":"2023-12-16T20:49:02.736078+0000","last_peered":"2023-12-16T20:49:02.736078+0000","last_clean":"2023-12-16T20:49:02.736078+0000","last_became_active":"2023-12-16T20:21:35.415984+0000","last_became_peered":"2023-12-16T20:21:35.415984+0000","last_unstale":"2023-12-16T20:49:02.736078+0000","last_undegraded":"2023-12-16T20:49:02.736078+0000","last_fullsized":"2023-12-16T20:49:02.736078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.944057+0000","last_change":"2023-12-16T20:49:35.944081+0000","last_active":"2023-12-16T20:49:35.944057+0000","last_peered":"2023-12-16T20:49:35.944057+0000","last_clean":"2023-12-16T20:49:35.944057+0000","last_became_active":"2023-12-16T20:21:25.195675+0000","last_became_peered":"2023-12-16T20:21:25.195675+0000","last_unstale":"2023-12-16T20:49:35.944057+0000","last_undegraded":"2023-12-16T20:49:35.944057+0000","last_fullsized":"2023-12-16T20:49:35.944057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2023-12-16T20:49:35.944005+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2023-12-16T20:49:35.944005+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.944005+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:22:55.655410+0000","scrub_duration":0.0041226689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'192","reported_seq":221,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:51.606021+0000","last_change":"2023-12-16T20:21:41.214322+0000","last_active":"2023-12-16T20:48:51.606021+0000","last_peered":"2023-12-16T20:48:51.606021+0000","last_clean":"2023-12-16T20:48:51.606021+0000","last_became_active":"2023-12-16T20:21:41.214012+0000","last_became_peered":"2023-12-16T20:21:41.214012+0000","last_unstale":"2023-12-16T20:48:51.606021+0000","last_undegraded":"2023-12-16T20:48:51.606021+0000","last_fullsized":"2023-12-16T20:48:51.606021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":12745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'36","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:29.998284+0000","last_change":"2023-12-16T20:49:29.998311+0000","last_active":"2023-12-16T20:49:29.998284+0000","last_peered":"2023-12-16T20:49:29.998284+0000","last_clean":"2023-12-16T20:49:29.998284+0000","last_became_active":"2023-12-16T20:21:36.552619+0000","last_became_peered":"2023-12-16T20:21:36.552619+0000","last_unstale":"2023-12-16T20:49:29.998284+0000","last_undegraded":"2023-12-16T20:49:29.998284+0000","last_fullsized":"2023-12-16T20:49:29.998284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2023-12-16T20:49:29.998180+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2023-12-16T20:49:29.998180+0000","last_clean_scrub_stamp":"2023-12-16T20:49:29.998180+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:51.843719+0000","scrub_duration":0.001334638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:30.083872+0000","last_change":"2023-12-16T20:49:30.083904+0000","last_active":"2023-12-16T20:49:30.083872+0000","last_peered":"2023-12-16T20:49:30.083872+0000","last_clean":"2023-12-16T20:49:30.083872+0000","last_became_active":"2023-12-16T20:21:35.413308+0000","last_became_peered":"2023-12-16T20:21:35.413308+0000","last_unstale":"2023-12-16T20:49:30.083872+0000","last_undegraded":"2023-12-16T20:49:30.083872+0000","last_fullsized":"2023-12-16T20:49:30.083872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-16T20:49:30.083795+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-16T20:49:30.083795+0000","last_clean_scrub_stamp":"2023-12-16T20:49:30.083795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:57:33.423790+0000","scrub_duration":0.001344486,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'151","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:40.301227+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:48:40.301227+0000","last_peered":"2023-12-16T20:48:40.301227+0000","last_clean":"2023-12-16T20:48:40.301227+0000","last_became_active":"2023-12-16T20:21:41.212608+0000","last_became_peered":"2023-12-16T20:21:41.212608+0000","last_unstale":"2023-12-16T20:48:40.301227+0000","last_undegraded":"2023-12-16T20:48:40.301227+0000","last_fullsized":"2023-12-16T20:48:40.301227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":6553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'41","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.820818+0000","last_change":"2023-12-16T20:21:36.555870+0000","last_active":"2023-12-16T20:49:08.820818+0000","last_peered":"2023-12-16T20:49:08.820818+0000","last_clean":"2023-12-16T20:49:08.820818+0000","last_became_active":"2023-12-16T20:21:36.555631+0000","last_became_peered":"2023-12-16T20:21:36.555631+0000","last_unstale":"2023-12-16T20:49:08.820818+0000","last_undegraded":"2023-12-16T20:49:08.820818+0000","last_fullsized":"2023-12-16T20:49:08.820818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'4","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:59.707658+0000","last_change":"2023-12-16T20:21:35.416140+0000","last_active":"2023-12-16T20:48:59.707658+0000","last_peered":"2023-12-16T20:48:59.707658+0000","last_clean":"2023-12-16T20:48:59.707658+0000","last_became_active":"2023-12-16T20:21:35.415810+0000","last_became_peered":"2023-12-16T20:21:35.415810+0000","last_unstale":"2023-12-16T20:48:59.707658+0000","last_undegraded":"2023-12-16T20:48:59.707658+0000","last_fullsized":"2023-12-16T20:48:59.707658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'169","reported_seq":206,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.500821+0000","last_change":"2023-12-16T20:22:14.842693+0000","last_active":"2023-12-16T20:48:41.500821+0000","last_peered":"2023-12-16T20:48:41.500821+0000","last_clean":"2023-12-16T20:48:41.500821+0000","last_became_active":"2023-12-16T20:22:14.842282+0000","last_became_peered":"2023-12-16T20:22:14.842282+0000","last_unstale":"2023-12-16T20:48:41.500821+0000","last_undegraded":"2023-12-16T20:48:41.500821+0000","last_fullsized":"2023-12-16T20:48:41.500821+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":8236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'35","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.903042+0000","last_change":"2023-12-16T20:21:36.536346+0000","last_active":"2023-12-16T20:49:08.903042+0000","last_peered":"2023-12-16T20:49:08.903042+0000","last_clean":"2023-12-16T20:49:08.903042+0000","last_became_active":"2023-12-16T20:21:36.536093+0000","last_became_peered":"2023-12-16T20:21:36.536093+0000","last_unstale":"2023-12-16T20:49:08.903042+0000","last_undegraded":"2023-12-16T20:49:08.903042+0000","last_fullsized":"2023-12-16T20:49:08.903042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'8","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:33.942561+0000","last_change":"2023-12-16T20:49:33.942600+0000","last_active":"2023-12-16T20:49:33.942561+0000","last_peered":"2023-12-16T20:49:33.942561+0000","last_clean":"2023-12-16T20:49:33.942561+0000","last_became_active":"2023-12-16T20:21:35.420074+0000","last_became_peered":"2023-12-16T20:21:35.420074+0000","last_unstale":"2023-12-16T20:49:33.942561+0000","last_undegraded":"2023-12-16T20:49:33.942561+0000","last_fullsized":"2023-12-16T20:49:33.942561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2023-12-16T20:49:33.942494+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2023-12-16T20:49:33.942494+0000","last_clean_scrub_stamp":"2023-12-16T20:49:33.942494+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:52:08.699859+0000","scrub_duration":0.0020749739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'129","reported_seq":157,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.471552+0000","last_change":"2023-12-16T20:21:41.215282+0000","last_active":"2023-12-16T20:48:41.471552+0000","last_peered":"2023-12-16T20:48:41.471552+0000","last_clean":"2023-12-16T20:48:41.471552+0000","last_became_active":"2023-12-16T20:21:41.214939+0000","last_became_peered":"2023-12-16T20:21:41.214939+0000","last_unstale":"2023-12-16T20:48:41.471552+0000","last_undegraded":"2023-12-16T20:48:41.471552+0000","last_fullsized":"2023-12-16T20:48:41.471552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":12347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'21","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.902992+0000","last_change":"2023-12-16T20:21:36.534345+0000","last_active":"2023-12-16T20:49:08.902992+0000","last_peered":"2023-12-16T20:49:08.902992+0000","last_clean":"2023-12-16T20:49:08.902992+0000","last_became_active":"2023-12-16T20:21:36.534064+0000","last_became_peered":"2023-12-16T20:21:36.534064+0000","last_unstale":"2023-12-16T20:49:08.902992+0000","last_undegraded":"2023-12-16T20:49:08.902992+0000","last_fullsized":"2023-12-16T20:49:08.902992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:24.454926+0000","last_change":"2023-12-16T20:49:24.454950+0000","last_active":"2023-12-16T20:49:24.454926+0000","last_peered":"2023-12-16T20:49:24.454926+0000","last_clean":"2023-12-16T20:49:24.454926+0000","last_became_active":"2023-12-16T20:21:35.390740+0000","last_became_peered":"2023-12-16T20:21:35.390740+0000","last_unstale":"2023-12-16T20:49:24.454926+0000","last_undegraded":"2023-12-16T20:49:24.454926+0000","last_fullsized":"2023-12-16T20:49:24.454926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:24.454859+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:24.454859+0000","last_clean_scrub_stamp":"2023-12-16T20:49:24.454859+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:46:57.389983+0000","scrub_duration":0.0022306159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'180","reported_seq":216,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:38.446260+0000","last_change":"2023-12-16T20:49:38.446279+0000","last_active":"2023-12-16T20:49:38.446260+0000","last_peered":"2023-12-16T20:49:38.446260+0000","last_clean":"2023-12-16T20:49:38.446260+0000","last_became_active":"2023-12-16T20:21:40.753981+0000","last_became_peered":"2023-12-16T20:21:40.753981+0000","last_unstale":"2023-12-16T20:49:38.446260+0000","last_undegraded":"2023-12-16T20:49:38.446260+0000","last_fullsized":"2023-12-16T20:49:38.446260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'180","last_scrub_stamp":"2023-12-16T20:49:38.446193+0000","last_deep_scrub":"27'180","last_deep_scrub_stamp":"2023-12-16T20:49:38.446193+0000","last_clean_scrub_stamp":"2023-12-16T20:49:38.446193+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:22:54.077650+0000","scrub_duration":0.00173639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":13396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'37","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:24.563913+0000","last_change":"2023-12-16T20:21:36.537080+0000","last_active":"2023-12-16T20:49:24.563913+0000","last_peered":"2023-12-16T20:49:24.563913+0000","last_clean":"2023-12-16T20:49:24.563913+0000","last_became_active":"2023-12-16T20:21:36.536822+0000","last_became_peered":"2023-12-16T20:21:36.536822+0000","last_unstale":"2023-12-16T20:49:24.563913+0000","last_undegraded":"2023-12-16T20:49:24.563913+0000","last_fullsized":"2023-12-16T20:49:24.563913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'13","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:36.010890+0000","last_change":"2023-12-16T20:49:36.010890+0000","last_active":"2023-12-16T20:49:36.010890+0000","last_peered":"2023-12-16T20:49:36.010890+0000","last_clean":"2023-12-16T20:49:36.010890+0000","last_became_active":"2023-12-16T20:21:35.416850+0000","last_became_peered":"2023-12-16T20:21:35.416850+0000","last_unstale":"2023-12-16T20:49:36.010890+0000","last_undegraded":"2023-12-16T20:49:36.010890+0000","last_fullsized":"2023-12-16T20:49:36.010890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2023-12-16T20:49:36.010800+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2023-12-16T20:49:36.010800+0000","last_clean_scrub_stamp":"2023-12-16T20:49:36.010800+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:31:01.472769+0000","scrub_duration":0.0029238240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'159","reported_seq":186,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.474976+0000","last_change":"2023-12-16T20:21:40.755436+0000","last_active":"2023-12-16T20:48:41.474976+0000","last_peered":"2023-12-16T20:48:41.474976+0000","last_clean":"2023-12-16T20:48:41.474976+0000","last_became_active":"2023-12-16T20:21:40.755041+0000","last_became_peered":"2023-12-16T20:21:40.755041+0000","last_unstale":"2023-12-16T20:48:41.474976+0000","last_undegraded":"2023-12-16T20:48:41.474976+0000","last_fullsized":"2023-12-16T20:48:41.474976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":9935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'32","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:23.790036+0000","last_change":"2023-12-16T20:21:36.541160+0000","last_active":"2023-12-16T20:49:23.790036+0000","last_peered":"2023-12-16T20:49:23.790036+0000","last_clean":"2023-12-16T20:49:23.790036+0000","last_became_active":"2023-12-16T20:21:36.540861+0000","last_became_peered":"2023-12-16T20:21:36.540861+0000","last_unstale":"2023-12-16T20:49:23.790036+0000","last_undegraded":"2023-12-16T20:49:23.790036+0000","last_fullsized":"2023-12-16T20:49:23.790036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:38.003759+0000","last_change":"2023-12-16T20:49:38.003778+0000","last_active":"2023-12-16T20:49:38.003759+0000","last_peered":"2023-12-16T20:49:38.003759+0000","last_clean":"2023-12-16T20:49:38.003759+0000","last_became_active":"2023-12-16T20:21:35.424822+0000","last_became_peered":"2023-12-16T20:21:35.424822+0000","last_unstale":"2023-12-16T20:49:38.003759+0000","last_undegraded":"2023-12-16T20:49:38.003759+0000","last_fullsized":"2023-12-16T20:49:38.003759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-16T20:49:38.003697+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-16T20:49:38.003697+0000","last_clean_scrub_stamp":"2023-12-16T20:49:38.003697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:03:34.460897+0000","scrub_duration":0.00081691399999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'130","reported_seq":157,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.361322+0000","last_change":"2023-12-16T20:21:41.215346+0000","last_active":"2023-12-16T20:48:39.361322+0000","last_peered":"2023-12-16T20:48:39.361322+0000","last_clean":"2023-12-16T20:48:39.361322+0000","last_became_active":"2023-12-16T20:21:41.215002+0000","last_became_peered":"2023-12-16T20:21:41.215002+0000","last_unstale":"2023-12-16T20:48:39.361322+0000","last_undegraded":"2023-12-16T20:48:39.361322+0000","last_fullsized":"2023-12-16T20:48:39.361322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":7078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'49","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:24.563960+0000","last_change":"2023-12-16T20:21:36.535791+0000","last_active":"2023-12-16T20:49:24.563960+0000","last_peered":"2023-12-16T20:49:24.563960+0000","last_clean":"2023-12-16T20:49:24.563960+0000","last_became_active":"2023-12-16T20:21:36.535447+0000","last_became_peered":"2023-12-16T20:21:36.535447+0000","last_unstale":"2023-12-16T20:49:24.563960+0000","last_undegraded":"2023-12-16T20:49:24.563960+0000","last_fullsized":"2023-12-16T20:49:24.563960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:23.046802+0000","last_change":"2023-12-16T20:21:35.423533+0000","last_active":"2023-12-16T20:49:23.046802+0000","last_peered":"2023-12-16T20:49:23.046802+0000","last_clean":"2023-12-16T20:49:23.046802+0000","last_became_active":"2023-12-16T20:21:35.423275+0000","last_became_peered":"2023-12-16T20:21:35.423275+0000","last_unstale":"2023-12-16T20:49:23.046802+0000","last_undegraded":"2023-12-16T20:49:23.046802+0000","last_fullsized":"2023-12-16T20:49:23.046802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'115","reported_seq":142,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.472049+0000","last_change":"2023-12-16T20:21:41.213083+0000","last_active":"2023-12-16T20:48:41.472049+0000","last_peered":"2023-12-16T20:48:41.472049+0000","last_clean":"2023-12-16T20:48:41.472049+0000","last_became_active":"2023-12-16T20:21:41.212699+0000","last_became_peered":"2023-12-16T20:21:41.212699+0000","last_unstale":"2023-12-16T20:48:41.472049+0000","last_undegraded":"2023-12-16T20:48:41.472049+0000","last_fullsized":"2023-12-16T20:48:41.472049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'45","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:19.185167+0000","last_change":"2023-12-16T20:21:36.523928+0000","last_active":"2023-12-16T20:49:19.185167+0000","last_peered":"2023-12-16T20:49:19.185167+0000","last_clean":"2023-12-16T20:49:19.185167+0000","last_became_active":"2023-12-16T20:21:36.523649+0000","last_became_peered":"2023-12-16T20:21:36.523649+0000","last_unstale":"2023-12-16T20:49:19.185167+0000","last_undegraded":"2023-12-16T20:49:19.185167+0000","last_fullsized":"2023-12-16T20:49:19.185167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'263","reported_seq":302,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:21.189639+0000","last_change":"2023-12-16T20:49:21.189639+0000","last_active":"2023-12-16T20:49:21.189639+0000","last_peered":"2023-12-16T20:49:21.189639+0000","last_clean":"2023-12-16T20:49:21.189639+0000","last_became_active":"2023-12-16T20:21:35.388392+0000","last_became_peered":"2023-12-16T20:21:35.388392+0000","last_unstale":"2023-12-16T20:49:21.189639+0000","last_undegraded":"2023-12-16T20:49:21.189639+0000","last_fullsized":"2023-12-16T20:49:21.189639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'263","last_scrub_stamp":"2023-12-16T20:49:21.189550+0000","last_deep_scrub":"27'263","last_deep_scrub_stamp":"2023-12-16T20:49:21.189550+0000","last_clean_scrub_stamp":"2023-12-16T20:49:21.189550+0000","objects_scrubbed":3,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:47:24.915095+0000","scrub_duration":0.0088499110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2496854,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":2582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'142","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.499958+0000","last_change":"2023-12-16T20:21:41.213106+0000","last_active":"2023-12-16T20:48:41.499958+0000","last_peered":"2023-12-16T20:48:41.499958+0000","last_clean":"2023-12-16T20:48:41.499958+0000","last_became_active":"2023-12-16T20:21:41.212721+0000","last_became_peered":"2023-12-16T20:21:41.212721+0000","last_unstale":"2023-12-16T20:48:41.499958+0000","last_undegraded":"2023-12-16T20:48:41.499958+0000","last_fullsized":"2023-12-16T20:48:41.499958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":13674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'36","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.904041+0000","last_change":"2023-12-16T20:21:36.519774+0000","last_active":"2023-12-16T20:49:08.904041+0000","last_peered":"2023-12-16T20:49:08.904041+0000","last_clean":"2023-12-16T20:49:08.904041+0000","last_became_active":"2023-12-16T20:21:36.519561+0000","last_became_peered":"2023-12-16T20:21:36.519561+0000","last_unstale":"2023-12-16T20:49:08.904041+0000","last_undegraded":"2023-12-16T20:49:08.904041+0000","last_fullsized":"2023-12-16T20:49:08.904041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'853","reported_seq":892,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:27.001377+0000","last_change":"2023-12-16T20:49:27.001377+0000","last_active":"2023-12-16T20:49:27.001377+0000","last_peered":"2023-12-16T20:49:27.001377+0000","last_clean":"2023-12-16T20:49:27.001377+0000","last_became_active":"2023-12-16T20:21:35.425929+0000","last_became_peered":"2023-12-16T20:21:35.425929+0000","last_unstale":"2023-12-16T20:49:27.001377+0000","last_undegraded":"2023-12-16T20:49:27.001377+0000","last_fullsized":"2023-12-16T20:49:27.001377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'853","last_scrub_stamp":"2023-12-16T20:49:27.001283+0000","last_deep_scrub":"27'853","last_deep_scrub_stamp":"2023-12-16T20:49:27.001283+0000","last_clean_scrub_stamp":"2023-12-16T20:49:27.001283+0000","objects_scrubbed":4,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:45:17.910698+0000","scrub_duration":0.017121821999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":4548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'165","reported_seq":193,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:19.988451+0000","last_change":"2023-12-16T20:21:40.754204+0000","last_active":"2023-12-16T20:49:19.988451+0000","last_peered":"2023-12-16T20:49:19.988451+0000","last_clean":"2023-12-16T20:49:19.988451+0000","last_became_active":"2023-12-16T20:21:40.753624+0000","last_became_peered":"2023-12-16T20:21:40.753624+0000","last_unstale":"2023-12-16T20:49:19.988451+0000","last_undegraded":"2023-12-16T20:49:19.988451+0000","last_fullsized":"2023-12-16T20:49:19.988451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":9759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'33","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:32.382521+0000","last_change":"2023-12-16T20:49:32.382521+0000","last_active":"2023-12-16T20:49:32.382521+0000","last_peered":"2023-12-16T20:49:32.382521+0000","last_clean":"2023-12-16T20:49:32.382521+0000","last_became_active":"2023-12-16T20:21:36.533790+0000","last_became_peered":"2023-12-16T20:21:36.533790+0000","last_unstale":"2023-12-16T20:49:32.382521+0000","last_undegraded":"2023-12-16T20:49:32.382521+0000","last_fullsized":"2023-12-16T20:49:32.382521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:32.382392+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:32.382392+0000","last_clean_scrub_stamp":"2023-12-16T20:49:32.382392+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:54.227931+0000","scrub_duration":0.0013665769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'706","reported_seq":736,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:02.746997+0000","last_change":"2023-12-16T20:21:35.416050+0000","last_active":"2023-12-16T20:49:02.746997+0000","last_peered":"2023-12-16T20:49:02.746997+0000","last_clean":"2023-12-16T20:49:02.746997+0000","last_became_active":"2023-12-16T20:21:35.415790+0000","last_became_peered":"2023-12-16T20:21:35.415790+0000","last_unstale":"2023-12-16T20:49:02.746997+0000","last_undegraded":"2023-12-16T20:49:02.746997+0000","last_fullsized":"2023-12-16T20:49:02.746997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:34.089279+0000","last_clean_scrub_stamp":"2023-12-16T20:21:34.089279+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":703,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'154","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:22.260924+0000","last_change":"2023-12-16T20:21:40.795197+0000","last_active":"2023-12-16T20:49:22.260924+0000","last_peered":"2023-12-16T20:49:22.260924+0000","last_clean":"2023-12-16T20:49:22.260924+0000","last_became_active":"2023-12-16T20:21:40.793667+0000","last_became_peered":"2023-12-16T20:21:40.793667+0000","last_unstale":"2023-12-16T20:49:22.260924+0000","last_undegraded":"2023-12-16T20:49:22.260924+0000","last_fullsized":"2023-12-16T20:49:22.260924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":20505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'40","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:41.244903+0000","last_change":"2023-12-16T20:49:41.244938+0000","last_active":"2023-12-16T20:49:41.244903+0000","last_peered":"2023-12-16T20:49:41.244903+0000","last_clean":"2023-12-16T20:49:41.244903+0000","last_became_active":"2023-12-16T20:21:36.552482+0000","last_became_peered":"2023-12-16T20:21:36.552482+0000","last_unstale":"2023-12-16T20:49:41.244903+0000","last_undegraded":"2023-12-16T20:49:41.244903+0000","last_fullsized":"2023-12-16T20:49:41.244903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2023-12-16T20:49:41.244780+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2023-12-16T20:49:41.244780+0000","last_clean_scrub_stamp":"2023-12-16T20:49:41.244780+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:46:41.157923+0000","scrub_duration":0.00118479,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:32.853509+0000","last_change":"2023-12-16T20:49:32.853535+0000","last_active":"2023-12-16T20:49:32.853509+0000","last_peered":"2023-12-16T20:49:32.853509+0000","last_clean":"2023-12-16T20:49:32.853509+0000","last_became_active":"2023-12-16T20:21:35.428100+0000","last_became_peered":"2023-12-16T20:21:35.428100+0000","last_unstale":"2023-12-16T20:49:32.853509+0000","last_undegraded":"2023-12-16T20:49:32.853509+0000","last_fullsized":"2023-12-16T20:49:32.853509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-12-16T20:49:32.853418+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-12-16T20:49:32.853418+0000","last_clean_scrub_stamp":"2023-12-16T20:49:32.853418+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:16:38.912835+0000","scrub_duration":0.001267879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'126","reported_seq":154,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:21.495532+0000","last_change":"2023-12-16T20:21:40.753333+0000","last_active":"2023-12-16T20:49:21.495532+0000","last_peered":"2023-12-16T20:49:21.495532+0000","last_clean":"2023-12-16T20:49:21.495532+0000","last_became_active":"2023-12-16T20:21:40.752957+0000","last_became_peered":"2023-12-16T20:21:40.752957+0000","last_unstale":"2023-12-16T20:49:21.495532+0000","last_undegraded":"2023-12-16T20:49:21.495532+0000","last_fullsized":"2023-12-16T20:49:21.495532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":10032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'43","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.895445+0000","last_change":"2023-12-16T20:22:14.841007+0000","last_active":"2023-12-16T20:49:08.895445+0000","last_peered":"2023-12-16T20:49:08.895445+0000","last_clean":"2023-12-16T20:49:08.895445+0000","last_became_active":"2023-12-16T20:22:14.840679+0000","last_became_peered":"2023-12-16T20:22:14.840679+0000","last_unstale":"2023-12-16T20:49:08.895445+0000","last_undegraded":"2023-12-16T20:49:08.895445+0000","last_fullsized":"2023-12-16T20:49:08.895445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.961032+0000","last_change":"2023-12-16T20:49:35.961051+0000","last_active":"2023-12-16T20:49:35.961032+0000","last_peered":"2023-12-16T20:49:35.961032+0000","last_clean":"2023-12-16T20:49:35.961032+0000","last_became_active":"2023-12-16T20:21:35.429940+0000","last_became_peered":"2023-12-16T20:21:35.429940+0000","last_unstale":"2023-12-16T20:49:35.961032+0000","last_undegraded":"2023-12-16T20:49:35.961032+0000","last_fullsized":"2023-12-16T20:49:35.961032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:35.960970+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:35.960970+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.960970+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:07:46.264662+0000","scrub_duration":0.00082690499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'174","reported_seq":202,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:21.495545+0000","last_change":"2023-12-16T20:21:41.216238+0000","last_active":"2023-12-16T20:49:21.495545+0000","last_peered":"2023-12-16T20:49:21.495545+0000","last_clean":"2023-12-16T20:49:21.495545+0000","last_became_active":"2023-12-16T20:21:41.215893+0000","last_became_peered":"2023-12-16T20:21:41.215893+0000","last_unstale":"2023-12-16T20:49:21.495545+0000","last_undegraded":"2023-12-16T20:49:21.495545+0000","last_fullsized":"2023-12-16T20:49:21.495545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":9716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'144","reported_seq":173,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.475068+0000","last_change":"2023-12-16T20:21:41.215277+0000","last_active":"2023-12-16T20:48:41.475068+0000","last_peered":"2023-12-16T20:48:41.475068+0000","last_clean":"2023-12-16T20:48:41.475068+0000","last_became_active":"2023-12-16T20:21:41.214950+0000","last_became_peered":"2023-12-16T20:21:41.214950+0000","last_unstale":"2023-12-16T20:48:41.475068+0000","last_undegraded":"2023-12-16T20:48:41.475068+0000","last_fullsized":"2023-12-16T20:48:41.475068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":7732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'44","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.210606+0000","last_change":"2023-12-16T20:49:35.210624+0000","last_active":"2023-12-16T20:49:35.210606+0000","last_peered":"2023-12-16T20:49:35.210606+0000","last_clean":"2023-12-16T20:49:35.210606+0000","last_became_active":"2023-12-16T20:21:36.519476+0000","last_became_peered":"2023-12-16T20:21:36.519476+0000","last_unstale":"2023-12-16T20:49:35.210606+0000","last_undegraded":"2023-12-16T20:49:35.210606+0000","last_fullsized":"2023-12-16T20:49:35.210606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2023-12-16T20:49:35.210541+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2023-12-16T20:49:35.210541+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.210541+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:05:54.945127+0000","scrub_duration":0.00098724800000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:41.643915+0000","last_change":"2023-12-16T20:49:41.643946+0000","last_active":"2023-12-16T20:49:41.643915+0000","last_peered":"2023-12-16T20:49:41.643915+0000","last_clean":"2023-12-16T20:49:41.643915+0000","last_became_active":"2023-12-16T20:21:35.414846+0000","last_became_peered":"2023-12-16T20:21:35.414846+0000","last_unstale":"2023-12-16T20:49:41.643915+0000","last_undegraded":"2023-12-16T20:49:41.643915+0000","last_fullsized":"2023-12-16T20:49:41.643915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:41.643824+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:41.643824+0000","last_clean_scrub_stamp":"2023-12-16T20:49:41.643824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:54:58.109657+0000","scrub_duration":0.000945662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'142","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.605478+0000","last_change":"2023-12-16T20:21:40.794438+0000","last_active":"2023-12-16T20:48:46.605478+0000","last_peered":"2023-12-16T20:48:46.605478+0000","last_clean":"2023-12-16T20:48:46.605478+0000","last_became_active":"2023-12-16T20:21:40.794073+0000","last_became_peered":"2023-12-16T20:21:40.794073+0000","last_unstale":"2023-12-16T20:48:46.605478+0000","last_undegraded":"2023-12-16T20:48:46.605478+0000","last_fullsized":"2023-12-16T20:48:46.605478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":21602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'45","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796594+0000","last_change":"2023-12-16T20:22:14.772045+0000","last_active":"2023-12-16T20:49:08.796594+0000","last_peered":"2023-12-16T20:49:08.796594+0000","last_clean":"2023-12-16T20:49:08.796594+0000","last_became_active":"2023-12-16T20:22:14.771747+0000","last_became_peered":"2023-12-16T20:22:14.771747+0000","last_unstale":"2023-12-16T20:49:08.796594+0000","last_undegraded":"2023-12-16T20:49:08.796594+0000","last_fullsized":"2023-12-16T20:49:08.796594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:36.037153+0000","last_change":"2023-12-16T20:49:36.037185+0000","last_active":"2023-12-16T20:49:36.037153+0000","last_peered":"2023-12-16T20:49:36.037153+0000","last_clean":"2023-12-16T20:49:36.037153+0000","last_became_active":"2023-12-16T20:21:35.421982+0000","last_became_peered":"2023-12-16T20:21:35.421982+0000","last_unstale":"2023-12-16T20:49:36.037153+0000","last_undegraded":"2023-12-16T20:49:36.037153+0000","last_fullsized":"2023-12-16T20:49:36.037153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-16T20:49:36.037044+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-16T20:49:36.037044+0000","last_clean_scrub_stamp":"2023-12-16T20:49:36.037044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:06:48.326428+0000","scrub_duration":0.001104584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'702","reported_seq":740,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:36.983829+0000","last_change":"2023-12-16T20:49:36.983854+0000","last_active":"2023-12-16T20:49:36.983829+0000","last_peered":"2023-12-16T20:49:36.983829+0000","last_clean":"2023-12-16T20:49:36.983829+0000","last_became_active":"2023-12-16T20:21:35.424254+0000","last_became_peered":"2023-12-16T20:21:35.424254+0000","last_unstale":"2023-12-16T20:49:36.983829+0000","last_undegraded":"2023-12-16T20:49:36.983829+0000","last_fullsized":"2023-12-16T20:49:36.983829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'702","last_scrub_stamp":"2023-12-16T20:49:36.983769+0000","last_deep_scrub":"27'702","last_deep_scrub_stamp":"2023-12-16T20:49:36.983769+0000","last_clean_scrub_stamp":"2023-12-16T20:49:36.983769+0000","objects_scrubbed":1,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:05:56.718355+0000","scrub_duration":0.011541968999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'39","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.292672+0000","last_change":"2023-12-16T20:49:35.292691+0000","last_active":"2023-12-16T20:49:35.292672+0000","last_peered":"2023-12-16T20:49:35.292672+0000","last_clean":"2023-12-16T20:49:35.292672+0000","last_became_active":"2023-12-16T20:21:36.533574+0000","last_became_peered":"2023-12-16T20:21:36.533574+0000","last_unstale":"2023-12-16T20:49:35.292672+0000","last_undegraded":"2023-12-16T20:49:35.292672+0000","last_fullsized":"2023-12-16T20:49:35.292672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-12-16T20:49:35.292617+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-12-16T20:49:35.292617+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.292617+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:10:47.828054+0000","scrub_duration":0.0011431620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'88","reported_seq":115,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:11.382290+0000","last_change":"2023-12-16T20:21:40.794426+0000","last_active":"2023-12-16T20:49:11.382290+0000","last_peered":"2023-12-16T20:49:11.382290+0000","last_clean":"2023-12-16T20:49:11.382290+0000","last_became_active":"2023-12-16T20:21:40.794082+0000","last_became_peered":"2023-12-16T20:21:40.794082+0000","last_unstale":"2023-12-16T20:49:11.382290+0000","last_undegraded":"2023-12-16T20:49:11.382290+0000","last_fullsized":"2023-12-16T20:49:11.382290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'687","reported_seq":725,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:34.057180+0000","last_change":"2023-12-16T20:49:34.057203+0000","last_active":"2023-12-16T20:49:34.057180+0000","last_peered":"2023-12-16T20:49:34.057180+0000","last_clean":"2023-12-16T20:49:34.057180+0000","last_became_active":"2023-12-16T20:21:35.419409+0000","last_became_peered":"2023-12-16T20:21:35.419409+0000","last_unstale":"2023-12-16T20:49:34.057180+0000","last_undegraded":"2023-12-16T20:49:34.057180+0000","last_fullsized":"2023-12-16T20:49:34.057180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'687","last_scrub_stamp":"2023-12-16T20:49:34.057124+0000","last_deep_scrub":"27'687","last_deep_scrub_stamp":"2023-12-16T20:49:34.057124+0000","last_clean_scrub_stamp":"2023-12-16T20:49:34.057124+0000","objects_scrubbed":1,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:18:49.932557+0000","scrub_duration":0.013116096000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":4443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'33","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:27.400108+0000","last_change":"2023-12-16T20:49:27.400127+0000","last_active":"2023-12-16T20:49:27.400108+0000","last_peered":"2023-12-16T20:49:27.400108+0000","last_clean":"2023-12-16T20:49:27.400108+0000","last_became_active":"2023-12-16T20:21:36.533325+0000","last_became_peered":"2023-12-16T20:21:36.533325+0000","last_unstale":"2023-12-16T20:49:27.400108+0000","last_undegraded":"2023-12-16T20:49:27.400108+0000","last_fullsized":"2023-12-16T20:49:27.400108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:27.400042+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:27.400042+0000","last_clean_scrub_stamp":"2023-12-16T20:49:27.400042+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:05:59.365345+0000","scrub_duration":0.001383497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'165","reported_seq":192,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:11.539055+0000","last_change":"2023-12-16T20:21:40.745455+0000","last_active":"2023-12-16T20:49:11.539055+0000","last_peered":"2023-12-16T20:49:11.539055+0000","last_clean":"2023-12-16T20:49:11.539055+0000","last_became_active":"2023-12-16T20:21:40.744731+0000","last_became_peered":"2023-12-16T20:21:40.744731+0000","last_unstale":"2023-12-16T20:49:11.539055+0000","last_undegraded":"2023-12-16T20:49:11.539055+0000","last_fullsized":"2023-12-16T20:49:11.539055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":13136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'49","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.895078+0000","last_change":"2023-12-16T20:21:36.542529+0000","last_active":"2023-12-16T20:49:08.895078+0000","last_peered":"2023-12-16T20:49:08.895078+0000","last_clean":"2023-12-16T20:49:08.895078+0000","last_became_active":"2023-12-16T20:21:36.542287+0000","last_became_peered":"2023-12-16T20:21:36.542287+0000","last_unstale":"2023-12-16T20:49:08.895078+0000","last_undegraded":"2023-12-16T20:49:08.895078+0000","last_fullsized":"2023-12-16T20:49:08.895078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'51","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:38.084320+0000","last_change":"2023-12-16T20:49:38.084340+0000","last_active":"2023-12-16T20:49:38.084320+0000","last_peered":"2023-12-16T20:49:38.084320+0000","last_clean":"2023-12-16T20:49:38.084320+0000","last_became_active":"2023-12-16T20:21:36.550911+0000","last_became_peered":"2023-12-16T20:21:36.550911+0000","last_unstale":"2023-12-16T20:49:38.084320+0000","last_undegraded":"2023-12-16T20:49:38.084320+0000","last_fullsized":"2023-12-16T20:49:38.084320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2023-12-16T20:49:38.084254+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2023-12-16T20:49:38.084254+0000","last_clean_scrub_stamp":"2023-12-16T20:49:38.084254+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:53:36.801901+0000","scrub_duration":0.0010491820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'50","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.823507+0000","last_change":"2023-12-16T20:21:36.556390+0000","last_active":"2023-12-16T20:49:08.823507+0000","last_peered":"2023-12-16T20:49:08.823507+0000","last_clean":"2023-12-16T20:49:08.823507+0000","last_became_active":"2023-12-16T20:21:36.555822+0000","last_became_peered":"2023-12-16T20:21:36.555822+0000","last_unstale":"2023-12-16T20:49:08.823507+0000","last_undegraded":"2023-12-16T20:49:08.823507+0000","last_fullsized":"2023-12-16T20:49:08.823507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'35","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:33.218396+0000","last_change":"2023-12-16T20:49:33.218419+0000","last_active":"2023-12-16T20:49:33.218396+0000","last_peered":"2023-12-16T20:49:33.218396+0000","last_clean":"2023-12-16T20:49:33.218396+0000","last_became_active":"2023-12-16T20:21:36.524747+0000","last_became_peered":"2023-12-16T20:21:36.524747+0000","last_unstale":"2023-12-16T20:49:33.218396+0000","last_undegraded":"2023-12-16T20:49:33.218396+0000","last_fullsized":"2023-12-16T20:49:33.218396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-12-16T20:49:33.218309+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-12-16T20:49:33.218309+0000","last_clean_scrub_stamp":"2023-12-16T20:49:33.218309+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:06:49.056161+0000","scrub_duration":0.001493435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'29","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:39.987503+0000","last_change":"2023-12-16T20:49:39.987522+0000","last_active":"2023-12-16T20:49:39.987503+0000","last_peered":"2023-12-16T20:49:39.987503+0000","last_clean":"2023-12-16T20:49:39.987503+0000","last_became_active":"2023-12-16T20:21:36.533682+0000","last_became_peered":"2023-12-16T20:21:36.533682+0000","last_unstale":"2023-12-16T20:49:39.987503+0000","last_undegraded":"2023-12-16T20:49:39.987503+0000","last_fullsized":"2023-12-16T20:49:39.987503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2023-12-16T20:49:39.987436+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2023-12-16T20:49:39.987436+0000","last_clean_scrub_stamp":"2023-12-16T20:49:39.987436+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:23:23.211223+0000","scrub_duration":0.001185576,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'35","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:32.165257+0000","last_change":"2023-12-16T20:49:32.165280+0000","last_active":"2023-12-16T20:49:32.165257+0000","last_peered":"2023-12-16T20:49:32.165257+0000","last_clean":"2023-12-16T20:49:32.165257+0000","last_became_active":"2023-12-16T20:21:36.519545+0000","last_became_peered":"2023-12-16T20:21:36.519545+0000","last_unstale":"2023-12-16T20:49:32.165257+0000","last_undegraded":"2023-12-16T20:49:32.165257+0000","last_fullsized":"2023-12-16T20:49:32.165257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-12-16T20:49:32.165177+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-12-16T20:49:32.165177+0000","last_clean_scrub_stamp":"2023-12-16T20:49:32.165177+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:54.010717+0000","scrub_duration":0.001316684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'45","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.899266+0000","last_change":"2023-12-16T20:21:36.542706+0000","last_active":"2023-12-16T20:49:08.899266+0000","last_peered":"2023-12-16T20:49:08.899266+0000","last_clean":"2023-12-16T20:49:08.899266+0000","last_became_active":"2023-12-16T20:21:36.542184+0000","last_became_peered":"2023-12-16T20:21:36.542184+0000","last_unstale":"2023-12-16T20:49:08.899266+0000","last_undegraded":"2023-12-16T20:49:08.899266+0000","last_fullsized":"2023-12-16T20:49:08.899266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'32","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:28.026815+0000","last_change":"2023-12-16T20:49:28.026851+0000","last_active":"2023-12-16T20:49:28.026815+0000","last_peered":"2023-12-16T20:49:28.026815+0000","last_clean":"2023-12-16T20:49:28.026815+0000","last_became_active":"2023-12-16T20:21:36.536439+0000","last_became_peered":"2023-12-16T20:21:36.536439+0000","last_unstale":"2023-12-16T20:49:28.026815+0000","last_undegraded":"2023-12-16T20:49:28.026815+0000","last_fullsized":"2023-12-16T20:49:28.026815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2023-12-16T20:49:28.026722+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2023-12-16T20:49:28.026722+0000","last_clean_scrub_stamp":"2023-12-16T20:49:28.026722+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:39:31.846535+0000","scrub_duration":0.0019544250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'33","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.823147+0000","last_change":"2023-12-16T20:21:36.555521+0000","last_active":"2023-12-16T20:49:08.823147+0000","last_peered":"2023-12-16T20:49:08.823147+0000","last_clean":"2023-12-16T20:49:08.823147+0000","last_became_active":"2023-12-16T20:21:36.555100+0000","last_became_peered":"2023-12-16T20:21:36.555100+0000","last_unstale":"2023-12-16T20:49:08.823147+0000","last_undegraded":"2023-12-16T20:49:08.823147+0000","last_fullsized":"2023-12-16T20:49:08.823147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'45","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.797063+0000","last_change":"2023-12-16T20:21:36.535856+0000","last_active":"2023-12-16T20:49:08.797063+0000","last_peered":"2023-12-16T20:49:08.797063+0000","last_clean":"2023-12-16T20:49:08.797063+0000","last_became_active":"2023-12-16T20:21:36.535600+0000","last_became_peered":"2023-12-16T20:21:36.535600+0000","last_unstale":"2023-12-16T20:49:08.797063+0000","last_undegraded":"2023-12-16T20:49:08.797063+0000","last_fullsized":"2023-12-16T20:49:08.797063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'38","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:25.854415+0000","last_change":"2023-12-16T20:49:25.854454+0000","last_active":"2023-12-16T20:49:25.854415+0000","last_peered":"2023-12-16T20:49:25.854415+0000","last_clean":"2023-12-16T20:49:25.854415+0000","last_became_active":"2023-12-16T20:21:36.553155+0000","last_became_peered":"2023-12-16T20:21:36.553155+0000","last_unstale":"2023-12-16T20:49:25.854415+0000","last_undegraded":"2023-12-16T20:49:25.854415+0000","last_fullsized":"2023-12-16T20:49:25.854415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:25.854334+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:25.854334+0000","last_clean_scrub_stamp":"2023-12-16T20:49:25.854334+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:47.699873+0000","scrub_duration":0.001008225,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'50","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.280447+0000","last_change":"2023-12-16T20:49:37.280466+0000","last_active":"2023-12-16T20:49:37.280447+0000","last_peered":"2023-12-16T20:49:37.280447+0000","last_clean":"2023-12-16T20:49:37.280447+0000","last_became_active":"2023-12-16T20:21:36.524166+0000","last_became_peered":"2023-12-16T20:21:36.524166+0000","last_unstale":"2023-12-16T20:49:37.280447+0000","last_undegraded":"2023-12-16T20:49:37.280447+0000","last_fullsized":"2023-12-16T20:49:37.280447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2023-12-16T20:49:37.280377+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2023-12-16T20:49:37.280377+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.280377+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:22:49.350447+0000","scrub_duration":0.0010662930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'45","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.890374+0000","last_change":"2023-12-16T20:21:36.542513+0000","last_active":"2023-12-16T20:49:08.890374+0000","last_peered":"2023-12-16T20:49:08.890374+0000","last_clean":"2023-12-16T20:49:08.890374+0000","last_became_active":"2023-12-16T20:21:36.542191+0000","last_became_peered":"2023-12-16T20:21:36.542191+0000","last_unstale":"2023-12-16T20:49:08.890374+0000","last_undegraded":"2023-12-16T20:49:08.890374+0000","last_fullsized":"2023-12-16T20:49:08.890374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'35","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:19.988486+0000","last_change":"2023-12-16T20:22:14.772163+0000","last_active":"2023-12-16T20:49:19.988486+0000","last_peered":"2023-12-16T20:49:19.988486+0000","last_clean":"2023-12-16T20:49:19.988486+0000","last_became_active":"2023-12-16T20:22:14.771830+0000","last_became_peered":"2023-12-16T20:22:14.771830+0000","last_unstale":"2023-12-16T20:49:19.988486+0000","last_undegraded":"2023-12-16T20:49:19.988486+0000","last_fullsized":"2023-12-16T20:49:19.988486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"27'47","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:20.753130+0000","last_change":"2023-12-16T20:21:36.544461+0000","last_active":"2023-12-16T20:49:20.753130+0000","last_peered":"2023-12-16T20:49:20.753130+0000","last_clean":"2023-12-16T20:49:20.753130+0000","last_became_active":"2023-12-16T20:21:36.544225+0000","last_became_peered":"2023-12-16T20:21:36.544225+0000","last_unstale":"2023-12-16T20:49:20.753130+0000","last_undegraded":"2023-12-16T20:49:20.753130+0000","last_fullsized":"2023-12-16T20:49:20.753130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'40","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:23.046998+0000","last_change":"2023-12-16T20:21:36.554370+0000","last_active":"2023-12-16T20:49:23.046998+0000","last_peered":"2023-12-16T20:49:23.046998+0000","last_clean":"2023-12-16T20:49:23.046998+0000","last_became_active":"2023-12-16T20:21:36.554130+0000","last_became_peered":"2023-12-16T20:21:36.554130+0000","last_unstale":"2023-12-16T20:49:23.046998+0000","last_undegraded":"2023-12-16T20:49:23.046998+0000","last_fullsized":"2023-12-16T20:49:23.046998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'45","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:23.046987+0000","last_change":"2023-12-16T20:21:36.555346+0000","last_active":"2023-12-16T20:49:23.046987+0000","last_peered":"2023-12-16T20:49:23.046987+0000","last_clean":"2023-12-16T20:49:23.046987+0000","last_became_active":"2023-12-16T20:21:36.554772+0000","last_became_peered":"2023-12-16T20:21:36.554772+0000","last_unstale":"2023-12-16T20:49:23.046987+0000","last_undegraded":"2023-12-16T20:49:23.046987+0000","last_fullsized":"2023-12-16T20:49:23.046987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'44","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:19.988525+0000","last_change":"2023-12-16T20:21:36.534502+0000","last_active":"2023-12-16T20:49:19.988525+0000","last_peered":"2023-12-16T20:49:19.988525+0000","last_clean":"2023-12-16T20:49:19.988525+0000","last_became_active":"2023-12-16T20:21:36.534307+0000","last_became_peered":"2023-12-16T20:21:36.534307+0000","last_unstale":"2023-12-16T20:49:19.988525+0000","last_undegraded":"2023-12-16T20:49:19.988525+0000","last_fullsized":"2023-12-16T20:49:19.988525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'40","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:34.267761+0000","last_change":"2023-12-16T20:49:34.267761+0000","last_active":"2023-12-16T20:49:34.267761+0000","last_peered":"2023-12-16T20:49:34.267761+0000","last_clean":"2023-12-16T20:49:34.267761+0000","last_became_active":"2023-12-16T20:21:36.525427+0000","last_became_peered":"2023-12-16T20:21:36.525427+0000","last_unstale":"2023-12-16T20:49:34.267761+0000","last_undegraded":"2023-12-16T20:49:34.267761+0000","last_fullsized":"2023-12-16T20:49:34.267761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2023-12-16T20:49:34.267634+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2023-12-16T20:49:34.267634+0000","last_clean_scrub_stamp":"2023-12-16T20:49:34.267634+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:39:38.087447+0000","scrub_duration":0.00089495000000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'36","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.800316+0000","last_change":"2023-12-16T20:21:36.542756+0000","last_active":"2023-12-16T20:49:08.800316+0000","last_peered":"2023-12-16T20:49:08.800316+0000","last_clean":"2023-12-16T20:49:08.800316+0000","last_became_active":"2023-12-16T20:21:36.542513+0000","last_became_peered":"2023-12-16T20:21:36.542513+0000","last_unstale":"2023-12-16T20:49:08.800316+0000","last_undegraded":"2023-12-16T20:49:08.800316+0000","last_fullsized":"2023-12-16T20:49:08.800316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:33.399940+0000","last_change":"2023-12-16T20:49:33.399965+0000","last_active":"2023-12-16T20:49:33.399940+0000","last_peered":"2023-12-16T20:49:33.399940+0000","last_clean":"2023-12-16T20:49:33.399940+0000","last_became_active":"2023-12-16T20:21:36.544492+0000","last_became_peered":"2023-12-16T20:21:36.544492+0000","last_unstale":"2023-12-16T20:49:33.399940+0000","last_undegraded":"2023-12-16T20:49:33.399940+0000","last_fullsized":"2023-12-16T20:49:33.399940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-12-16T20:49:33.399843+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-12-16T20:49:33.399843+0000","last_clean_scrub_stamp":"2023-12-16T20:49:33.399843+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:25:07.939906+0000","scrub_duration":0.0012000960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'38","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.889657+0000","last_change":"2023-12-16T20:22:14.769644+0000","last_active":"2023-12-16T20:49:08.889657+0000","last_peered":"2023-12-16T20:49:08.889657+0000","last_clean":"2023-12-16T20:49:08.889657+0000","last_became_active":"2023-12-16T20:22:14.769348+0000","last_became_peered":"2023-12-16T20:22:14.769348+0000","last_unstale":"2023-12-16T20:49:08.889657+0000","last_undegraded":"2023-12-16T20:49:08.889657+0000","last_fullsized":"2023-12-16T20:49:08.889657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'50","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.894784+0000","last_change":"2023-12-16T20:21:36.551107+0000","last_active":"2023-12-16T20:49:08.894784+0000","last_peered":"2023-12-16T20:49:08.894784+0000","last_clean":"2023-12-16T20:49:08.894784+0000","last_became_active":"2023-12-16T20:21:36.550815+0000","last_became_peered":"2023-12-16T20:21:36.550815+0000","last_unstale":"2023-12-16T20:49:08.894784+0000","last_undegraded":"2023-12-16T20:49:08.894784+0000","last_fullsized":"2023-12-16T20:49:08.894784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'42","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.903872+0000","last_change":"2023-12-16T20:21:36.554041+0000","last_active":"2023-12-16T20:49:08.903872+0000","last_peered":"2023-12-16T20:49:08.903872+0000","last_clean":"2023-12-16T20:49:08.903872+0000","last_became_active":"2023-12-16T20:21:36.553708+0000","last_became_peered":"2023-12-16T20:21:36.553708+0000","last_unstale":"2023-12-16T20:49:08.903872+0000","last_undegraded":"2023-12-16T20:49:08.903872+0000","last_fullsized":"2023-12-16T20:49:08.903872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'29","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.800113+0000","last_change":"2023-12-16T20:21:36.551348+0000","last_active":"2023-12-16T20:49:08.800113+0000","last_peered":"2023-12-16T20:49:08.800113+0000","last_clean":"2023-12-16T20:49:08.800113+0000","last_became_active":"2023-12-16T20:21:36.551066+0000","last_became_peered":"2023-12-16T20:21:36.551066+0000","last_unstale":"2023-12-16T20:49:08.800113+0000","last_undegraded":"2023-12-16T20:49:08.800113+0000","last_fullsized":"2023-12-16T20:49:08.800113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'37","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.900919+0000","last_change":"2023-12-16T20:21:36.523828+0000","last_active":"2023-12-16T20:49:08.900919+0000","last_peered":"2023-12-16T20:49:08.900919+0000","last_clean":"2023-12-16T20:49:08.900919+0000","last_became_active":"2023-12-16T20:21:36.523604+0000","last_became_peered":"2023-12-16T20:21:36.523604+0000","last_unstale":"2023-12-16T20:49:08.900919+0000","last_undegraded":"2023-12-16T20:49:08.900919+0000","last_fullsized":"2023-12-16T20:49:08.900919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'39","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.823536+0000","last_change":"2023-12-16T20:21:36.556286+0000","last_active":"2023-12-16T20:49:08.823536+0000","last_peered":"2023-12-16T20:49:08.823536+0000","last_clean":"2023-12-16T20:49:08.823536+0000","last_became_active":"2023-12-16T20:21:36.556041+0000","last_became_peered":"2023-12-16T20:21:36.556041+0000","last_unstale":"2023-12-16T20:49:08.823536+0000","last_undegraded":"2023-12-16T20:49:08.823536+0000","last_fullsized":"2023-12-16T20:49:08.823536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'39","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.904361+0000","last_change":"2023-12-16T20:21:36.518408+0000","last_active":"2023-12-16T20:49:08.904361+0000","last_peered":"2023-12-16T20:49:08.904361+0000","last_clean":"2023-12-16T20:49:08.904361+0000","last_became_active":"2023-12-16T20:21:36.518138+0000","last_became_peered":"2023-12-16T20:21:36.518138+0000","last_unstale":"2023-12-16T20:49:08.904361+0000","last_undegraded":"2023-12-16T20:49:08.904361+0000","last_fullsized":"2023-12-16T20:49:08.904361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'24","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:23.047006+0000","last_change":"2023-12-16T20:21:36.555311+0000","last_active":"2023-12-16T20:49:23.047006+0000","last_peered":"2023-12-16T20:49:23.047006+0000","last_clean":"2023-12-16T20:49:23.047006+0000","last_became_active":"2023-12-16T20:21:36.555041+0000","last_became_peered":"2023-12-16T20:21:36.555041+0000","last_unstale":"2023-12-16T20:49:23.047006+0000","last_undegraded":"2023-12-16T20:49:23.047006+0000","last_fullsized":"2023-12-16T20:49:23.047006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'44","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:27.192471+0000","last_change":"2023-12-16T20:49:27.192490+0000","last_active":"2023-12-16T20:49:27.192471+0000","last_peered":"2023-12-16T20:49:27.192471+0000","last_clean":"2023-12-16T20:49:27.192471+0000","last_became_active":"2023-12-16T20:21:36.523784+0000","last_became_peered":"2023-12-16T20:21:36.523784+0000","last_unstale":"2023-12-16T20:49:27.192471+0000","last_undegraded":"2023-12-16T20:49:27.192471+0000","last_fullsized":"2023-12-16T20:49:27.192471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2023-12-16T20:49:27.192403+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2023-12-16T20:49:27.192403+0000","last_clean_scrub_stamp":"2023-12-16T20:49:27.192403+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:22:46.903808+0000","scrub_duration":0.001038298,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'36","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.798823+0000","last_change":"2023-12-16T20:21:36.526391+0000","last_active":"2023-12-16T20:49:08.798823+0000","last_peered":"2023-12-16T20:49:08.798823+0000","last_clean":"2023-12-16T20:49:08.798823+0000","last_became_active":"2023-12-16T20:21:36.526151+0000","last_became_peered":"2023-12-16T20:21:36.526151+0000","last_unstale":"2023-12-16T20:49:08.798823+0000","last_undegraded":"2023-12-16T20:49:08.798823+0000","last_fullsized":"2023-12-16T20:49:08.798823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'28","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.900881+0000","last_change":"2023-12-16T20:21:36.543566+0000","last_active":"2023-12-16T20:49:08.900881+0000","last_peered":"2023-12-16T20:49:08.900881+0000","last_clean":"2023-12-16T20:49:08.900881+0000","last_became_active":"2023-12-16T20:21:36.543306+0000","last_became_peered":"2023-12-16T20:21:36.543306+0000","last_unstale":"2023-12-16T20:49:08.900881+0000","last_undegraded":"2023-12-16T20:49:08.900881+0000","last_fullsized":"2023-12-16T20:49:08.900881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4117,"num_write_kb":324188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4666,"ondisk_log_size":4666,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2442,"ondisk_log_size":2442,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40469915,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1038,"num_read_kb":1098,"num_write":9075,"num_write_kb":44922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56229888,"data_stored":80939830,"data_compressed":7486620,"data_compressed_allocated":11714560,"data_compressed_original":36487168,"omap_allocated":0,"internal_metadata":0},"log_size":8639,"ondisk_log_size":8639,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65176,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575192,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84588,"kb_used_data":17316,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94287252,"statfs":{"total":96636764160,"available":96550146048,"internally_reserved":0,"allocated":17731584,"data_stored":25875293,"data_compressed":2385754,"data_compressed_allocated":3723264,"data_compressed_original":12046336,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.41599999999999998,"15min":0.40100000000000002},"min":{"1min":0.26900000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.70499999999999996,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.432,"15min":0.42599999999999999},"min":{"1min":0.313,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.53900000000000003}]},{"osd":1,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.438,"15min":0.42399999999999999},"min":{"1min":0.32000000000000001,"5min":0.24399999999999999,"15min":0.23799999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.41899999999999998},"min":{"1min":0.34799999999999998,"5min":0.27200000000000002,"15min":0.252},"max":{"1min":0.71699999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.67200000000000004}]},{"osd":2,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42199999999999999,"15min":0.41199999999999998},"min":{"1min":0.31,"5min":0.254,"15min":0.254},"max":{"1min":0.66600000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.44700000000000001},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.29099999999999998},"max":{"1min":0.60599999999999998,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.60899999999999999}]},{"osd":3,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.45100000000000001,"15min":0.434},"min":{"1min":0.34699999999999998,"5min":0.28799999999999998,"15min":0.28000000000000003},"max":{"1min":0.63100000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.379,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.77300000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.65700000000000003}]},{"osd":4,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.378,"15min":0.35999999999999999},"min":{"1min":0.27500000000000002,"5min":0.23200000000000001,"15min":0.20499999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.437},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38100000000000001,"15min":0.374},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.20899999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.39500000000000002}]},{"osd":5,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38900000000000001,"15min":0.38500000000000001},"min":{"1min":0.25800000000000001,"5min":0.24199999999999999,"15min":0.24099999999999999},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.72099999999999997},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.30399999999999999,"5min":0.25900000000000001,"15min":0.255},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.65700000000000003},"last":0.48299999999999998}]},{"osd":6,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.29399999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.443},"min":{"1min":0.27900000000000003,"5min":0.246,"15min":0.246},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575192,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57068,"kb_used_data":12004,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94314772,"statfs":{"total":96636764160,"available":96578326528,"internally_reserved":0,"allocated":12292096,"data_stored":16896407,"data_compressed":1393950,"data_compressed_allocated":2220032,"data_compressed_original":7004160,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38200000000000001,"15min":0.39800000000000002},"min":{"1min":0.251,"5min":0.23200000000000001,"15min":0.217},"max":{"1min":0.505,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.378},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.433,"15min":0.432},"min":{"1min":0.26700000000000002,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":0.52600000000000002,"5min":0.60799999999999998,"15min":0.67100000000000004},"last":0.40699999999999997}]},{"osd":1,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.40100000000000002,"15min":0.40799999999999997},"min":{"1min":0.27100000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51400000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.42599999999999999,"15min":0.42399999999999999},"min":{"1min":0.29799999999999999,"5min":0.26500000000000001,"15min":0.26400000000000001},"max":{"1min":0.54400000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.32600000000000001}]},{"osd":2,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40999999999999998,"15min":0.41699999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.52100000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.253},"max":{"1min":0.51200000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.314}]},{"osd":3,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44800000000000001,"15min":0.437},"min":{"1min":0.371,"5min":0.30599999999999999,"15min":0.26500000000000001},"max":{"1min":0.57999999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.433,"15min":0.44400000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.52400000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.437}]},{"osd":4,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.379,"15min":0.37},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.217},"max":{"1min":0.48699999999999999,"5min":0.59199999999999997,"15min":0.64000000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.38900000000000001,"15min":0.38700000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55800000000000005,"5min":0.64300000000000002,"15min":0.68700000000000006},"last":0.36199999999999999}]},{"osd":5,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.38600000000000001,"15min":0.377},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.22900000000000001},"max":{"1min":0.54600000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42199999999999999,"15min":0.42099999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.57799999999999996,"5min":0.60699999999999998,"15min":0.67200000000000004},"last":0.47399999999999998}]},{"osd":7,"last update":"Sat Dec 16 20:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.27800000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.65700000000000003,"15min":0.69899999999999995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42399999999999999,"15min":0.43099999999999999},"min":{"1min":0.29299999999999998,"5min":0.28299999999999997,"15min":0.27200000000000002},"max":{"1min":0.53600000000000003,"5min":0.60599999999999998,"15min":0.747},"last":0.42299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575192,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":118609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.42399999999999999,"15min":0.42699999999999999},"min":{"1min":0.33600000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64200000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.41799999999999998,"15min":0.41399999999999998},"min":{"1min":0.27600000000000002,"5min":0.252,"15min":0.24399999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.34399999999999997,"5min":0.27600000000000002,"15min":0.25600000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.42699999999999999},"min":{"1min":0.32000000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.48599999999999999}]},{"osd":2,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.35199999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.441,"15min":0.434},"min":{"1min":0.33500000000000002,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.505}]},{"osd":3,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29499999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.35699999999999998,"5min":0.312,"15min":0.28199999999999997},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.497}]},{"osd":4,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.371,"15min":0.36199999999999999},"min":{"1min":0.26200000000000001,"5min":0.24199999999999999,"15min":0.224},"max":{"1min":0.60099999999999998,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38600000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.22600000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.44500000000000001}]},{"osd":6,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39500000000000002,"15min":0.38500000000000001},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.24199999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.68999999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.433,"15min":0.41799999999999998},"min":{"1min":0.30199999999999999,"5min":0.28000000000000003,"15min":0.26700000000000002},"max":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.72099999999999997},"last":0.46400000000000002}]},{"osd":7,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.432,"15min":0.432},"min":{"1min":0.27700000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46200000000000002,"15min":0.44800000000000001},"min":{"1min":0.318,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.432}]}]},{"osd":4,"up_from":13,"seq":55834575192,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65112,"kb_used_data":7568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94306728,"statfs":{"total":96636764160,"available":96570089472,"internally_reserved":0,"allocated":7749632,"data_stored":11004073,"data_compressed":1082070,"data_compressed_allocated":1703936,"data_compressed_original":5144576,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.434,"15min":0.42199999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.438},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.441,"15min":0.432},"min":{"1min":0.34699999999999998,"5min":0.26600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57999999999999996,"5min":0.65300000000000002,"15min":0.68899999999999995},"last":0.48899999999999999}]},{"osd":1,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45300000000000001,"15min":0.439},"min":{"1min":0.32700000000000001,"5min":0.29799999999999999,"15min":0.27900000000000003},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42799999999999999,"15min":0.41999999999999998},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.26600000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.503}]},{"osd":2,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.436,"15min":0.42799999999999999},"min":{"1min":0.29099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.379,"5min":0.311,"15min":0.309},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.54000000000000004}]},{"osd":3,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44500000000000001,"15min":0.43099999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.27900000000000003},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47299999999999998,"15min":0.46400000000000002},"min":{"1min":0.32500000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.79400000000000004},"last":0.51900000000000002}]},{"osd":5,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.377,"15min":0.38200000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.39700000000000002,"15min":0.39000000000000001},"min":{"1min":0.26600000000000001,"5min":0.26300000000000001,"15min":0.22},"max":{"1min":0.50800000000000001,"5min":0.58999999999999997,"15min":0.63100000000000001},"last":0.38500000000000001}]},{"osd":6,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39600000000000002,"15min":0.39500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23799999999999999},"max":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.75},"last":0.372},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.443,"15min":0.435},"min":{"1min":0.29799999999999999,"5min":0.26400000000000001,"15min":0.22600000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.40100000000000002}]},{"osd":7,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.432,"15min":0.42999999999999999},"min":{"1min":0.29999999999999999,"5min":0.28899999999999998,"15min":0.25600000000000001},"max":{"1min":0.60299999999999998,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46200000000000002,"15min":0.45900000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27000000000000002},"max":{"1min":0.59199999999999997,"5min":0.63400000000000001,"15min":0.77600000000000002},"last":0.47299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575192,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58848,"kb_used_data":9624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312992,"statfs":{"total":96636764160,"available":96576503808,"internally_reserved":0,"allocated":9854976,"data_stored":12924992,"data_compressed":1002682,"data_compressed_allocated":1646592,"data_compressed_original":4898816,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.28999999999999998,"15min":0.28499999999999998},"min":{"1min":0.218,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":0.40699999999999997,"5min":0.48699999999999999,"15min":0.52600000000000002},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.30399999999999999,"15min":0.29699999999999999},"min":{"1min":0.20799999999999999,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.38300000000000001,"5min":0.48899999999999999,"15min":0.56999999999999995},"last":0.25800000000000001}]},{"osd":1,"last update":"Sat Dec 16 20:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.308,"15min":0.30099999999999999},"min":{"1min":0.246,"5min":0.186,"15min":0.186},"max":{"1min":0.42399999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.308},{"interface":"front","average":{"1min":0.312,"5min":0.32100000000000001,"15min":0.32300000000000001},"min":{"1min":0.22500000000000001,"5min":0.21099999999999999,"15min":0.19900000000000001},"max":{"1min":0.435,"5min":0.48299999999999998,"15min":0.56100000000000005},"last":0.29399999999999998}]},{"osd":2,"last update":"Sat Dec 16 20:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.32900000000000001,"15min":0.33200000000000002},"min":{"1min":0.253,"5min":0.23499999999999999,"15min":0.222},"max":{"1min":0.39200000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35599999999999998,"15min":0.35199999999999998},"min":{"1min":0.28100000000000003,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":0.441,"5min":0.51100000000000001,"15min":0.53600000000000003},"last":0.32900000000000001}]},{"osd":4,"last update":"Sat Dec 16 20:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.41299999999999998,"15min":0.41499999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.44600000000000001,"15min":0.44},"min":{"1min":0.34399999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66400000000000003,"5min":0.70399999999999996,"15min":0.72399999999999998},"last":0.47999999999999998}]},{"osd":5,"last update":"Sat Dec 16 20:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.443,"15min":0.441},"min":{"1min":0.36599999999999999,"5min":0.31900000000000001,"15min":0.313},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.76900000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45400000000000001,"15min":0.45600000000000002},"min":{"1min":0.36099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.71599999999999997},"last":0.52600000000000002}]},{"osd":6,"last update":"Sat Dec 16 20:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.44600000000000001},"min":{"1min":0.35099999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.73599999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46500000000000002,"15min":0.46300000000000002},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.317},"max":{"1min":0.63900000000000001,"5min":0.66700000000000004,"15min":0.75},"last":0.40500000000000003}]},{"osd":7,"last update":"Sat Dec 16 20:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48799999999999999,"15min":0.48199999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34000000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.504},{"interface":"front","average":{"1min":0.496,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.46100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575192,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":341408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.309,"15min":0.30299999999999999},"min":{"1min":0.215,"5min":0.18099999999999999,"15min":0.17000000000000001},"max":{"1min":0.47299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.317,"5min":0.30299999999999999,"15min":0.30199999999999999},"min":{"1min":0.224,"5min":0.189,"15min":0.189},"max":{"1min":0.53400000000000003,"5min":0.55800000000000005,"15min":0.623},"last":0.29699999999999999}]},{"osd":1,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.248,"5min":0.23300000000000001,"15min":0.193},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.32100000000000001,"15min":0.32800000000000001},"min":{"1min":0.23499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.54800000000000004},"last":0.33800000000000002}]},{"osd":3,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.32800000000000001,"15min":0.32500000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.371},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36199999999999999,"15min":0.36299999999999999},"min":{"1min":0.26200000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.56699999999999995,"5min":0.57799999999999996,"15min":0.60599999999999998},"last":0.39000000000000001}]},{"osd":4,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.36199999999999999,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.432,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.29499999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.66600000000000004}]},{"osd":5,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.34899999999999998,"5min":0.311,"15min":0.30299999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.67000000000000004},"last":0.623}]},{"osd":6,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.48299999999999998,"15min":0.47599999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.32500000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.77400000000000002},"last":0.67400000000000004}]},{"osd":7,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.47299999999999998},"min":{"1min":0.35999999999999999,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.64000000000000001,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.46000000000000002,"15min":0.46200000000000002},"min":{"1min":0.35999999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.64300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575192,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42460,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329380,"statfs":{"total":96636764160,"available":96593285120,"internally_reserved":0,"allocated":3035136,"data_stored":4312983,"data_compressed":488319,"data_compressed_allocated":745472,"data_compressed_original":2203648,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.28299999999999997,"15min":0.27900000000000003},"min":{"1min":0.22,"5min":0.184,"15min":0.16800000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.61499999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.309,"15min":0.315},"min":{"1min":0.22,"5min":0.218,"15min":0.21199999999999999},"max":{"1min":0.495,"5min":0.495,"15min":0.55500000000000005},"last":0.36299999999999999}]},{"osd":2,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.29199999999999998,"15min":0.29399999999999998},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32100000000000001},"min":{"1min":0.24099999999999999,"5min":0.221,"15min":0.20999999999999999},"max":{"1min":0.502,"5min":0.502,"15min":0.58499999999999996},"last":0.38600000000000001}]},{"osd":3,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34699999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.55800000000000005},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.34599999999999997,"15min":0.34200000000000003},"min":{"1min":0.24399999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.59699999999999998},"last":0.45500000000000002}]},{"osd":4,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.40999999999999998},"min":{"1min":0.34799999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.438},"min":{"1min":0.36199999999999999,"5min":0.32100000000000001,"15min":0.307},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.49399999999999999}]},{"osd":5,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.434,"15min":0.442},"min":{"1min":0.34499999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.443,"15min":0.44},"min":{"1min":0.39200000000000002,"5min":0.318,"15min":0.28100000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.47999999999999998}]},{"osd":6,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.504},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.45600000000000002,"15min":0.44900000000000001},"min":{"1min":0.39300000000000002,"5min":0.33300000000000002,"15min":0.29999999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.33700000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.47399999999999998,"15min":0.47899999999999998},"min":{"1min":0.372,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.71799999999999997},"last":0.56499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575192,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60428,"kb_used_data":7044,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311412,"statfs":{"total":96636764160,"available":96574885888,"internally_reserved":0,"allocated":7213056,"data_stored":11594953,"data_compressed":1199021,"data_compressed_allocated":1765376,"data_compressed_original":6336512,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.28100000000000003,"15min":0.28399999999999997},"min":{"1min":0.216,"5min":0.17299999999999999,"15min":0.17100000000000001},"max":{"1min":0.432,"5min":0.48299999999999998,"15min":0.56799999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.31900000000000001,"15min":0.307},"min":{"1min":0.28499999999999998,"5min":0.20699999999999999,"15min":0.19400000000000001},"max":{"1min":0.48099999999999998,"5min":0.504,"15min":0.57899999999999996},"last":0.32000000000000001}]},{"osd":2,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.315,"15min":0.307},"min":{"1min":0.25700000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.47999999999999998,"5min":0.52300000000000002,"15min":0.54900000000000004},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32200000000000001},"min":{"1min":0.25600000000000001,"5min":0.218,"15min":0.20300000000000001},"max":{"1min":0.42099999999999999,"5min":0.57899999999999996,"15min":0.66400000000000003},"last":0.33600000000000002}]},{"osd":3,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.32900000000000001,"15min":0.32600000000000001},"min":{"1min":0.23999999999999999,"5min":0.22600000000000001,"15min":0.20399999999999999},"max":{"1min":0.48099999999999998,"5min":0.52100000000000002,"15min":0.54100000000000004},"last":0.374},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.34100000000000003},"min":{"1min":0.309,"5min":0.23100000000000001,"15min":0.224},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.60999999999999999},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.441,"15min":0.436},"min":{"1min":0.35399999999999998,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.44800000000000001,"15min":0.439},"min":{"1min":0.375,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.41799999999999998}]},{"osd":5,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46800000000000003,"15min":0.44600000000000001},"min":{"1min":0.35899999999999999,"5min":0.32600000000000001,"15min":0.29999999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.376,"5min":0.307,"15min":0.30199999999999999},"max":{"1min":0.64200000000000002,"5min":0.64500000000000002,"15min":0.70399999999999996},"last":0.51500000000000001}]},{"osd":6,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47999999999999998,"15min":0.47399999999999998},"min":{"1min":0.38100000000000001,"5min":0.35599999999999998,"15min":0.31900000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.71799999999999997},"last":0.438},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.46200000000000002},"min":{"1min":0.376,"5min":0.32800000000000001,"15min":0.32700000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.498}]},{"osd":7,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.5,"15min":0.49199999999999999},"min":{"1min":0.372,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.40500000000000003,"5min":0.34599999999999997,"15min":0.34000000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.52900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6856704,"data_stored":10886066,"data_compressed":1166433,"data_compressed_allocated":1720320,"data_compressed_original":5763072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2744320,"data_stored":4194464,"data_compressed":488319,"data_compressed_allocated":745472,"data_compressed_original":2203648,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":222889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9564160,"data_stored":12806473,"data_compressed":1002682,"data_compressed_allocated":1646592,"data_compressed_original":4898816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7458816,"data_stored":10885554,"data_compressed":1082070,"data_compressed_allocated":1703936,"data_compressed_original":5144576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12001280,"data_stored":16777888,"data_compressed":1393950,"data_compressed_allocated":2220032,"data_compressed_original":7004160,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17375232,"data_stored":25166406,"data_compressed":2353166,"data_compressed_allocated":3678208,"data_compressed_original":11472896,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T20:49:45.828 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.829 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.829 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.829 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.829 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.829 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.829 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.830 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.830 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.830 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.830 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.830 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.830 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.830 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.830 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.830 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.831 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.831 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.831 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.831 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.831 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.831 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.831 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.831 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.831 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.832 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.832 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.832 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.832 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.832 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.832 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.832 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.832 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.832 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.833 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.833 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.833 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.833 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.833 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.833 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.833 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.833 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.833 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.834 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.834 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.834 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-12-16T20:21:34.089279+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=34, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.834 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.834 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.834 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.834 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.834 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.835 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.835 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.835 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.835 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.835 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.835 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.835 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.835 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.836 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.836 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.836 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.836 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.836 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.836 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.836 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.836 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.836 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.837 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.837 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.837 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.837 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.837 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.837 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.837 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.838 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.838 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:49:45.838 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T20:49:58.533 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:49:58.537 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:50:05.839 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T20:50:05.953 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.952+0000 7ff7a1a15640 1 Processor -- start 2023-12-16T20:50:05.953 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.952+0000 7ff7a1a15640 1 -- start start 2023-12-16T20:50:05.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.953+0000 7ff7a1a15640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff79c1501c0 0x7ff79c159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:05.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.953+0000 7ff7a1a15640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff79c072b60 con 0x7ff79c0bff00 2023-12-16T20:50:05.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.953+0000 7ff7a1a15640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff79c0c1a90 con 0x7ff79c156e60 2023-12-16T20:50:05.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.953+0000 7ff7a1a15640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c0c1d30 con 0x7ff79c1501c0 2023-12-16T20:50:05.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.953+0000 7ff7927fc640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff79c0bff00 0x7ff79c072450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40322/0 (socket says 172.21.15.87:40322) 2023-12-16T20:50:05.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.953+0000 7ff7927fc640 1 -- 172.21.15.87:0/2761893025 learned_addr learned my addr 172.21.15.87:0/2761893025 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:50:05.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.953+0000 7ff79affd640 1 --2- 172.21.15.87:0/2761893025 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff79c1501c0 0x7ff79c159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:05.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.956+0000 7ff79affd640 1 -- 172.21.15.87:0/2761893025 >> v1:172.21.15.195:6789/0 conn(0x7ff79c156e60 legacy=0x7ff79c071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:05.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.956+0000 7ff79affd640 1 -- 172.21.15.87:0/2761893025 >> v1:172.21.15.87:6789/0 conn(0x7ff79c0bff00 legacy=0x7ff79c072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:05.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.956+0000 7ff79a7fc640 1 -- 172.21.15.87:0/2761893025 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759117075 0 0) 0x7ff79c072b60 con 0x7ff79c0bff00 2023-12-16T20:50:05.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.956+0000 7ff79affd640 1 -- 172.21.15.87:0/2761893025 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79c0c2010 con 0x7ff79c1501c0 2023-12-16T20:50:05.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.958+0000 7ff79affd640 1 --2- 172.21.15.87:0/2761893025 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff79c1501c0 0x7ff79c159860 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0097d0 tx=0x7ff78c02b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c8b93140c9e5d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:05.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.962+0000 7ff79a7fc640 1 -- 172.21.15.87:0/2761893025 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c030880 con 0x7ff79c1501c0 2023-12-16T20:50:05.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.962+0000 7ff79a7fc640 1 -- 172.21.15.87:0/2761893025 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c0309e0 con 0x7ff79c1501c0 2023-12-16T20:50:05.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.962+0000 7ff79a7fc640 1 -- 172.21.15.87:0/2761893025 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c030d70 con 0x7ff79c1501c0 2023-12-16T20:50:05.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.962+0000 7ff7a1a15640 1 -- 172.21.15.87:0/2761893025 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff79c1501c0 msgr2=0x7ff79c159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:05.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.962+0000 7ff7a1a15640 1 --2- 172.21.15.87:0/2761893025 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff79c1501c0 0x7ff79c159860 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0097d0 tx=0x7ff78c02b9c0 comp rx=0 tx=0).stop 2023-12-16T20:50:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.962+0000 7ff7a1a15640 1 -- 172.21.15.87:0/2761893025 shutdown_connections 2023-12-16T20:50:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.962+0000 7ff7a1a15640 1 --2- 172.21.15.87:0/2761893025 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff79c1501c0 0x7ff79c159860 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.962+0000 7ff7a1a15640 1 -- 172.21.15.87:0/2761893025 >> 172.21.15.87:0/2761893025 conn(0x7ff79c06cd60 msgr2=0x7ff79c06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.962+0000 7ff7a1a15640 1 -- 172.21.15.87:0/2761893025 shutdown_connections 2023-12-16T20:50:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.963+0000 7ff7a1a15640 1 -- 172.21.15.87:0/2761893025 wait complete. 2023-12-16T20:50:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.964+0000 7ff7a1a15640 1 Processor -- start 2023-12-16T20:50:05.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.964+0000 7ff7a1a15640 1 -- start start 2023-12-16T20:50:05.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.965+0000 7ff7a1a15640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff79c0bff00 0x7ff79c1553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:05.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.965+0000 7ff7a1a15640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff79c1501c0 0x7ff79c157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:05.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.965+0000 7ff7a1a15640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff79c156e60 0x7ff79c157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:05.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.965+0000 7ff7a1a15640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c1540c0 con 0x7ff79c1501c0 2023-12-16T20:50:05.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.965+0000 7ff7a1a15640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c154f20 con 0x7ff79c0bff00 2023-12-16T20:50:05.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.965+0000 7ff7a1a15640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c155fd0 con 0x7ff79c156e60 2023-12-16T20:50:05.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.965+0000 7ff7927fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff79c1501c0 0x7ff79c157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.965+0000 7ff7927fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff79c1501c0 0x7ff79c157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37716/0 (socket says 172.21.15.87:37716) 2023-12-16T20:50:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.965+0000 7ff7927fc640 1 -- 172.21.15.87:0/2636720283 learned_addr learned my addr 172.21.15.87:0/2636720283 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:50:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.965+0000 7ff79affd640 1 --2- 172.21.15.87:0/2636720283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff79c0bff00 0x7ff79c1553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.965+0000 7ff79b7fe640 1 --2- 172.21.15.87:0/2636720283 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff79c156e60 0x7ff79c157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:05.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.969+0000 7ff79b7fe640 1 -- 172.21.15.87:0/2636720283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff79c0bff00 msgr2=0x7ff79c1553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:05.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.969+0000 7ff79b7fe640 1 --2- 172.21.15.87:0/2636720283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff79c0bff00 0x7ff79c1553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:05.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.969+0000 7ff79b7fe640 1 -- 172.21.15.87:0/2636720283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff79c1501c0 msgr2=0x7ff79c157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:05.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.969+0000 7ff79b7fe640 1 --2- 172.21.15.87:0/2636720283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff79c1501c0 0x7ff79c157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:05.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.969+0000 7ff79b7fe640 1 -- 172.21.15.87:0/2636720283 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c009400 con 0x7ff79c156e60 2023-12-16T20:50:05.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.972+0000 7ff79b7fe640 1 --2- 172.21.15.87:0/2636720283 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff79c156e60 0x7ff79c157f80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff79400c730 tx=0x7ff79400cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:05.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.975+0000 7ff798ff9640 1 -- 172.21.15.87:0/2636720283 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff794003b70 con 0x7ff79c156e60 2023-12-16T20:50:05.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.975+0000 7ff798ff9640 1 -- 172.21.15.87:0/2636720283 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff794003cd0 con 0x7ff79c156e60 2023-12-16T20:50:05.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.975+0000 7ff798ff9640 1 -- 172.21.15.87:0/2636720283 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff794005310 con 0x7ff79c156e60 2023-12-16T20:50:05.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.975+0000 7ff7a1a15640 1 -- 172.21.15.87:0/2636720283 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff79c154310 con 0x7ff79c156e60 2023-12-16T20:50:05.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.975+0000 7ff7a1a15640 1 -- 172.21.15.87:0/2636720283 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79c1548d0 con 0x7ff79c156e60 2023-12-16T20:50:05.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:05.976+0000 7ff7a1a15640 1 -- 172.21.15.87:0/2636720283 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff79c0c7fa0 con 0x7ff79c156e60 2023-12-16T20:50:06.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.219+0000 7ff798ff9640 1 -- 172.21.15.87:0/2636720283 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ff794005680 con 0x7ff79c156e60 2023-12-16T20:50:06.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.219+0000 7ff798ff9640 1 --2- 172.21.15.87:0/2636720283 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff77c06aec0 0x7ff77c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:06.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.220+0000 7ff79affd640 1 --2- 172.21.15.87:0/2636720283 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff77c06aec0 0x7ff77c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:06.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.220+0000 7ff79affd640 1 --2- 172.21.15.87:0/2636720283 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff77c06aec0 0x7ff77c06d380 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff78c036000 tx=0x7ff78c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:06.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.223+0000 7ff798ff9640 1 -- 172.21.15.87:0/2636720283 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff794058c90 con 0x7ff79c156e60 2023-12-16T20:50:06.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.235+0000 7ff798ff9640 1 -- 172.21.15.87:0/2636720283 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ff794054fd0 con 0x7ff79c156e60 2023-12-16T20:50:06.420 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.419+0000 7ff7a1a15640 1 -- 172.21.15.87:0/2636720283 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff79c159c00 con 0x7ff77c06aec0 2023-12-16T20:50:06.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.428+0000 7ff798ff9640 1 -- 172.21.15.87:0/2636720283 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372113 (secure 0 0 0) 0x7ff79c159c00 con 0x7ff77c06aec0 2023-12-16T20:50:06.433 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:50:06.435 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-12-16T20:50:06.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.431+0000 7ff7a1a15640 1 -- 172.21.15.87:0/2636720283 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff77c06aec0 msgr2=0x7ff77c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:06.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.431+0000 7ff7a1a15640 1 --2- 172.21.15.87:0/2636720283 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff77c06aec0 0x7ff77c06d380 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff78c036000 tx=0x7ff78c008030 comp rx=0 tx=0).stop 2023-12-16T20:50:06.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.431+0000 7ff7a1a15640 1 -- 172.21.15.87:0/2636720283 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff79c156e60 msgr2=0x7ff79c157f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:06.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.431+0000 7ff7a1a15640 1 --2- 172.21.15.87:0/2636720283 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff79c156e60 0x7ff79c157f80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff79400c730 tx=0x7ff79400cbf0 comp rx=0 tx=0).stop 2023-12-16T20:50:06.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.432+0000 7ff7a1a15640 1 -- 172.21.15.87:0/2636720283 shutdown_connections 2023-12-16T20:50:06.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.432+0000 7ff7a1a15640 1 --2- 172.21.15.87:0/2636720283 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff79c156e60 0x7ff79c157f80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:06.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.432+0000 7ff7a1a15640 1 --2- 172.21.15.87:0/2636720283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff79c1501c0 0x7ff79c157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:06.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.432+0000 7ff7a1a15640 1 --2- 172.21.15.87:0/2636720283 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff77c06aec0 0x7ff77c06d380 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:06.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.432+0000 7ff7a1a15640 1 --2- 172.21.15.87:0/2636720283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff79c0bff00 0x7ff79c1553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:06.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.432+0000 7ff7a1a15640 1 -- 172.21.15.87:0/2636720283 >> 172.21.15.87:0/2636720283 conn(0x7ff79c06cd60 msgr2=0x7ff79c14a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:06.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.432+0000 7ff7a1a15640 1 -- 172.21.15.87:0/2636720283 shutdown_connections 2023-12-16T20:50:06.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:06.432+0000 7ff7a1a15640 1 -- 172.21.15.87:0/2636720283 wait complete. 2023-12-16T20:50:06.443 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":882,"stamp":"2023-12-16T20:50:04.658250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41060283,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1154,"num_read_kb":1198,"num_write":13351,"num_write_kb":371526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15871,"ondisk_log_size":15871,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":431648,"kb_used_data":57312,"kb_used_omap":12,"kb_used_meta":374259,"kb_avail":754543072,"statfs":{"total":773094113280,"available":772652105728,"internally_reserved":0,"allocated":58687488,"data_stored":83068718,"data_compressed":7551796,"data_compressed_allocated":11804672,"data_compressed_original":37634048,"omap_allocated":12751,"internal_metadata":383241777},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003310"},"pg_stats":[{"pgid":"2.1f","version":"27'645","reported_seq":685,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:23.157430+0000","last_change":"2023-12-16T20:49:23.157455+0000","last_active":"2023-12-16T20:49:23.157430+0000","last_peered":"2023-12-16T20:49:23.157430+0000","last_clean":"2023-12-16T20:49:23.157430+0000","last_became_active":"2023-12-16T20:21:35.413075+0000","last_became_peered":"2023-12-16T20:21:35.413075+0000","last_unstale":"2023-12-16T20:49:23.157430+0000","last_undegraded":"2023-12-16T20:49:23.157430+0000","last_fullsized":"2023-12-16T20:49:23.157430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'645","last_scrub_stamp":"2023-12-16T20:49:23.157376+0000","last_deep_scrub":"27'645","last_deep_scrub_stamp":"2023-12-16T20:49:23.157376+0000","last_clean_scrub_stamp":"2023-12-16T20:49:23.157376+0000","objects_scrubbed":3,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:45.002915+0000","scrub_duration":0.012814567000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'31","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:25.961331+0000","last_change":"2023-12-16T20:49:25.961331+0000","last_active":"2023-12-16T20:49:25.961331+0000","last_peered":"2023-12-16T20:49:25.961331+0000","last_clean":"2023-12-16T20:49:25.961331+0000","last_became_active":"2023-12-16T20:21:36.542667+0000","last_became_peered":"2023-12-16T20:21:36.542667+0000","last_unstale":"2023-12-16T20:49:25.961331+0000","last_undegraded":"2023-12-16T20:49:25.961331+0000","last_fullsized":"2023-12-16T20:49:25.961331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2023-12-16T20:49:25.961221+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2023-12-16T20:49:25.961221+0000","last_clean_scrub_stamp":"2023-12-16T20:49:25.961221+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:37:18.758291+0000","scrub_duration":0.001405351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'182","reported_seq":217,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:52.865833+0000","last_change":"2023-12-16T20:49:52.865854+0000","last_active":"2023-12-16T20:49:52.865833+0000","last_peered":"2023-12-16T20:49:52.865833+0000","last_clean":"2023-12-16T20:49:52.865833+0000","last_became_active":"2023-12-16T20:21:41.216062+0000","last_became_peered":"2023-12-16T20:21:41.216062+0000","last_unstale":"2023-12-16T20:49:52.865833+0000","last_undegraded":"2023-12-16T20:49:52.865833+0000","last_fullsized":"2023-12-16T20:49:52.865833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'182","last_scrub_stamp":"2023-12-16T20:49:52.865754+0000","last_deep_scrub":"27'182","last_deep_scrub_stamp":"2023-12-16T20:49:52.865754+0000","last_clean_scrub_stamp":"2023-12-16T20:49:52.865754+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:55.826353+0000","scrub_duration":0.001882774,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":13331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'711","reported_seq":752,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.086965+0000","last_change":"2023-12-16T20:49:35.086965+0000","last_active":"2023-12-16T20:49:35.086965+0000","last_peered":"2023-12-16T20:49:35.086965+0000","last_clean":"2023-12-16T20:49:35.086965+0000","last_became_active":"2023-12-16T20:21:35.419745+0000","last_became_peered":"2023-12-16T20:21:35.419745+0000","last_unstale":"2023-12-16T20:49:35.086965+0000","last_undegraded":"2023-12-16T20:49:35.086965+0000","last_fullsized":"2023-12-16T20:49:35.086965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'711","last_scrub_stamp":"2023-12-16T20:49:35.086833+0000","last_deep_scrub":"27'711","last_deep_scrub_stamp":"2023-12-16T20:49:35.086833+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.086833+0000","objects_scrubbed":1,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:55:19.452990+0000","scrub_duration":0.013529074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'38","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:20.169422+0000","last_change":"2023-12-16T20:49:20.169443+0000","last_active":"2023-12-16T20:49:20.169422+0000","last_peered":"2023-12-16T20:49:20.169422+0000","last_clean":"2023-12-16T20:49:20.169422+0000","last_became_active":"2023-12-16T20:21:36.552621+0000","last_became_peered":"2023-12-16T20:21:36.552621+0000","last_unstale":"2023-12-16T20:49:20.169422+0000","last_undegraded":"2023-12-16T20:49:20.169422+0000","last_fullsized":"2023-12-16T20:49:20.169422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:20.169357+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:20.169357+0000","last_clean_scrub_stamp":"2023-12-16T20:49:20.169357+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:05:52.134660+0000","scrub_duration":0.001403729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'122","reported_seq":157,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:44.472423+0000","last_change":"2023-12-16T20:49:44.472443+0000","last_active":"2023-12-16T20:49:44.472423+0000","last_peered":"2023-12-16T20:49:44.472423+0000","last_clean":"2023-12-16T20:49:44.472423+0000","last_became_active":"2023-12-16T20:21:40.754509+0000","last_became_peered":"2023-12-16T20:21:40.754509+0000","last_unstale":"2023-12-16T20:49:44.472423+0000","last_undegraded":"2023-12-16T20:49:44.472423+0000","last_fullsized":"2023-12-16T20:49:44.472423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'122","last_scrub_stamp":"2023-12-16T20:49:44.472356+0000","last_deep_scrub":"27'122","last_deep_scrub_stamp":"2023-12-16T20:49:44.472356+0000","last_clean_scrub_stamp":"2023-12-16T20:49:44.472356+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:22:56.542426+0000","scrub_duration":0.001614327,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1395","reported_seq":1433,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.931101+0000","last_change":"2023-12-16T20:49:37.931129+0000","last_active":"2023-12-16T20:49:37.931101+0000","last_peered":"2023-12-16T20:49:37.931101+0000","last_clean":"2023-12-16T20:49:37.931101+0000","last_became_active":"2023-12-16T20:21:35.427317+0000","last_became_peered":"2023-12-16T20:21:35.427317+0000","last_unstale":"2023-12-16T20:49:37.931101+0000","last_undegraded":"2023-12-16T20:49:37.931101+0000","last_fullsized":"2023-12-16T20:49:37.931101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1395","last_scrub_stamp":"2023-12-16T20:49:37.931040+0000","last_deep_scrub":"27'1395","last_deep_scrub_stamp":"2023-12-16T20:49:37.931040+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.931040+0000","objects_scrubbed":3,"log_size":1395,"log_dups_size":0,"ondisk_log_size":1395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:22:53.562497+0000","scrub_duration":0.022717590999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":9004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'33","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:46.898286+0000","last_change":"2023-12-16T20:49:46.898318+0000","last_active":"2023-12-16T20:49:46.898286+0000","last_peered":"2023-12-16T20:49:46.898286+0000","last_clean":"2023-12-16T20:49:46.898286+0000","last_became_active":"2023-12-16T20:22:14.768968+0000","last_became_peered":"2023-12-16T20:22:14.768968+0000","last_unstale":"2023-12-16T20:49:46.898286+0000","last_undegraded":"2023-12-16T20:49:46.898286+0000","last_fullsized":"2023-12-16T20:49:46.898286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:46.898186+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:46.898186+0000","last_clean_scrub_stamp":"2023-12-16T20:49:46.898186+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:25:21.438249+0000","scrub_duration":0.00121396,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"27'156","reported_seq":200,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:51.448513+0000","last_change":"2023-12-16T20:49:51.448535+0000","last_active":"2023-12-16T20:49:51.448513+0000","last_peered":"2023-12-16T20:49:51.448513+0000","last_clean":"2023-12-16T20:49:51.448513+0000","last_became_active":"2023-12-16T20:22:14.819924+0000","last_became_peered":"2023-12-16T20:22:14.819924+0000","last_unstale":"2023-12-16T20:49:51.448513+0000","last_undegraded":"2023-12-16T20:49:51.448513+0000","last_fullsized":"2023-12-16T20:49:51.448513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'156","last_scrub_stamp":"2023-12-16T20:49:51.448383+0000","last_deep_scrub":"27'156","last_deep_scrub_stamp":"2023-12-16T20:49:51.448383+0000","last_clean_scrub_stamp":"2023-12-16T20:49:51.448383+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:53:08.749663+0000","scrub_duration":0.001709286,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":12476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:40.919237+0000","last_change":"2023-12-16T20:49:40.919278+0000","last_active":"2023-12-16T20:49:40.919237+0000","last_peered":"2023-12-16T20:49:40.919237+0000","last_clean":"2023-12-16T20:49:40.919237+0000","last_became_active":"2023-12-16T20:21:35.413234+0000","last_became_peered":"2023-12-16T20:21:35.413234+0000","last_unstale":"2023-12-16T20:49:40.919237+0000","last_undegraded":"2023-12-16T20:49:40.919237+0000","last_fullsized":"2023-12-16T20:49:40.919237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-16T20:49:40.919143+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-16T20:49:40.919143+0000","last_clean_scrub_stamp":"2023-12-16T20:49:40.919143+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:18:08.836684+0000","scrub_duration":0.0023112950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'49","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:01.618340+0000","last_change":"2023-12-16T20:50:01.618358+0000","last_active":"2023-12-16T20:50:01.618340+0000","last_peered":"2023-12-16T20:50:01.618340+0000","last_clean":"2023-12-16T20:50:01.618340+0000","last_became_active":"2023-12-16T20:21:36.554014+0000","last_became_peered":"2023-12-16T20:21:36.554014+0000","last_unstale":"2023-12-16T20:50:01.618340+0000","last_undegraded":"2023-12-16T20:50:01.618340+0000","last_fullsized":"2023-12-16T20:50:01.618340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2023-12-16T20:50:01.618277+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2023-12-16T20:50:01.618277+0000","last_clean_scrub_stamp":"2023-12-16T20:50:01.618277+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:41:22.296873+0000","scrub_duration":0.00098290700000000009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'146","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:40.448517+0000","last_change":"2023-12-16T20:49:40.448537+0000","last_active":"2023-12-16T20:49:40.448517+0000","last_peered":"2023-12-16T20:49:40.448517+0000","last_clean":"2023-12-16T20:49:40.448517+0000","last_became_active":"2023-12-16T20:21:40.794471+0000","last_became_peered":"2023-12-16T20:21:40.794471+0000","last_unstale":"2023-12-16T20:49:40.448517+0000","last_undegraded":"2023-12-16T20:49:40.448517+0000","last_fullsized":"2023-12-16T20:49:40.448517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'146","last_scrub_stamp":"2023-12-16T20:49:40.448446+0000","last_deep_scrub":"27'146","last_deep_scrub_stamp":"2023-12-16T20:49:40.448446+0000","last_clean_scrub_stamp":"2023-12-16T20:49:40.448446+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:54:56.914280+0000","scrub_duration":0.0016447670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'39","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:46.102034+0000","last_change":"2023-12-16T20:49:46.102034+0000","last_active":"2023-12-16T20:49:46.102034+0000","last_peered":"2023-12-16T20:49:46.102034+0000","last_clean":"2023-12-16T20:49:46.102034+0000","last_became_active":"2023-12-16T20:21:36.542157+0000","last_became_peered":"2023-12-16T20:21:36.542157+0000","last_unstale":"2023-12-16T20:49:46.102034+0000","last_undegraded":"2023-12-16T20:49:46.102034+0000","last_fullsized":"2023-12-16T20:49:46.102034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-12-16T20:49:46.101940+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-12-16T20:49:46.101940+0000","last_clean_scrub_stamp":"2023-12-16T20:49:46.101940+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:26:58.344405+0000","scrub_duration":0.000980491,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'682","reported_seq":721,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:39.928151+0000","last_change":"2023-12-16T20:49:39.928177+0000","last_active":"2023-12-16T20:49:39.928151+0000","last_peered":"2023-12-16T20:49:39.928151+0000","last_clean":"2023-12-16T20:49:39.928151+0000","last_became_active":"2023-12-16T20:21:35.413400+0000","last_became_peered":"2023-12-16T20:21:35.413400+0000","last_unstale":"2023-12-16T20:49:39.928151+0000","last_undegraded":"2023-12-16T20:49:39.928151+0000","last_fullsized":"2023-12-16T20:49:39.928151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'682","last_scrub_stamp":"2023-12-16T20:49:39.928085+0000","last_deep_scrub":"27'682","last_deep_scrub_stamp":"2023-12-16T20:49:39.928085+0000","last_clean_scrub_stamp":"2023-12-16T20:49:39.928085+0000","objects_scrubbed":2,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:26:52.170550+0000","scrub_duration":0.016337826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":4429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'121","reported_seq":157,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:49.446137+0000","last_change":"2023-12-16T20:49:49.446160+0000","last_active":"2023-12-16T20:49:49.446137+0000","last_peered":"2023-12-16T20:49:49.446137+0000","last_clean":"2023-12-16T20:49:49.446137+0000","last_became_active":"2023-12-16T20:21:40.745544+0000","last_became_peered":"2023-12-16T20:21:40.745544+0000","last_unstale":"2023-12-16T20:49:49.446137+0000","last_undegraded":"2023-12-16T20:49:49.446137+0000","last_fullsized":"2023-12-16T20:49:49.446137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'121","last_scrub_stamp":"2023-12-16T20:49:49.446051+0000","last_deep_scrub":"27'121","last_deep_scrub_stamp":"2023-12-16T20:49:49.446051+0000","last_clean_scrub_stamp":"2023-12-16T20:49:49.446051+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:55:33.812208+0000","scrub_duration":0.0017083669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":10860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'38","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:29.049902+0000","last_change":"2023-12-16T20:49:29.049927+0000","last_active":"2023-12-16T20:49:29.049902+0000","last_peered":"2023-12-16T20:49:29.049902+0000","last_clean":"2023-12-16T20:49:29.049902+0000","last_became_active":"2023-12-16T20:21:36.525983+0000","last_became_peered":"2023-12-16T20:21:36.525983+0000","last_unstale":"2023-12-16T20:49:29.049902+0000","last_undegraded":"2023-12-16T20:49:29.049902+0000","last_fullsized":"2023-12-16T20:49:29.049902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:29.049801+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:29.049801+0000","last_clean_scrub_stamp":"2023-12-16T20:49:29.049801+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:17:56.967342+0000","scrub_duration":0.001151219,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:54.210144+0000","last_change":"2023-12-16T20:49:54.210164+0000","last_active":"2023-12-16T20:49:54.210144+0000","last_peered":"2023-12-16T20:49:54.210144+0000","last_clean":"2023-12-16T20:49:54.210144+0000","last_became_active":"2023-12-16T20:21:35.419731+0000","last_became_peered":"2023-12-16T20:21:35.419731+0000","last_unstale":"2023-12-16T20:49:54.210144+0000","last_undegraded":"2023-12-16T20:49:54.210144+0000","last_fullsized":"2023-12-16T20:49:54.210144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-16T20:49:54.210064+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-16T20:49:54.210064+0000","last_clean_scrub_stamp":"2023-12-16T20:49:54.210064+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:25:41.037499+0000","scrub_duration":0.00090329199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'169","reported_seq":205,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:55.456625+0000","last_change":"2023-12-16T20:49:55.456647+0000","last_active":"2023-12-16T20:49:55.456625+0000","last_peered":"2023-12-16T20:49:55.456625+0000","last_clean":"2023-12-16T20:49:55.456625+0000","last_became_active":"2023-12-16T20:21:40.754829+0000","last_became_peered":"2023-12-16T20:21:40.754829+0000","last_unstale":"2023-12-16T20:49:55.456625+0000","last_undegraded":"2023-12-16T20:49:55.456625+0000","last_fullsized":"2023-12-16T20:49:55.456625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'169","last_scrub_stamp":"2023-12-16T20:49:55.456544+0000","last_deep_scrub":"27'169","last_deep_scrub_stamp":"2023-12-16T20:49:55.456544+0000","last_clean_scrub_stamp":"2023-12-16T20:49:55.456544+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:07:48.448673+0000","scrub_duration":0.0016987910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":10412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'38","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.059222+0000","last_change":"2023-12-16T20:49:37.059222+0000","last_active":"2023-12-16T20:49:37.059222+0000","last_peered":"2023-12-16T20:49:37.059222+0000","last_clean":"2023-12-16T20:49:37.059222+0000","last_became_active":"2023-12-16T20:21:36.518686+0000","last_became_peered":"2023-12-16T20:21:36.518686+0000","last_unstale":"2023-12-16T20:49:37.059222+0000","last_undegraded":"2023-12-16T20:49:37.059222+0000","last_fullsized":"2023-12-16T20:49:37.059222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:37.059110+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:37.059110+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.059110+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:02:40.257888+0000","scrub_duration":0.00095491900000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:38.167525+0000","last_change":"2023-12-16T20:49:38.167525+0000","last_active":"2023-12-16T20:49:38.167525+0000","last_peered":"2023-12-16T20:49:38.167525+0000","last_clean":"2023-12-16T20:49:38.167525+0000","last_became_active":"2023-12-16T20:21:35.416067+0000","last_became_peered":"2023-12-16T20:21:35.416067+0000","last_unstale":"2023-12-16T20:49:38.167525+0000","last_undegraded":"2023-12-16T20:49:38.167525+0000","last_fullsized":"2023-12-16T20:49:38.167525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-12-16T20:49:38.167435+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-12-16T20:49:38.167435+0000","last_clean_scrub_stamp":"2023-12-16T20:49:38.167435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:37:30.964505+0000","scrub_duration":0.0011178469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'126","reported_seq":154,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.483608+0000","last_change":"2023-12-16T20:21:41.215250+0000","last_active":"2023-12-16T20:48:46.483608+0000","last_peered":"2023-12-16T20:48:46.483608+0000","last_clean":"2023-12-16T20:48:46.483608+0000","last_became_active":"2023-12-16T20:21:41.214198+0000","last_became_peered":"2023-12-16T20:21:41.214198+0000","last_unstale":"2023-12-16T20:48:46.483608+0000","last_undegraded":"2023-12-16T20:48:46.483608+0000","last_fullsized":"2023-12-16T20:48:46.483608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":7034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'34","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:34.369486+0000","last_change":"2023-12-16T20:49:34.369486+0000","last_active":"2023-12-16T20:49:34.369486+0000","last_peered":"2023-12-16T20:49:34.369486+0000","last_clean":"2023-12-16T20:49:34.369486+0000","last_became_active":"2023-12-16T20:21:36.536321+0000","last_became_peered":"2023-12-16T20:21:36.536321+0000","last_unstale":"2023-12-16T20:49:34.369486+0000","last_undegraded":"2023-12-16T20:49:34.369486+0000","last_fullsized":"2023-12-16T20:49:34.369486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2023-12-16T20:49:34.369363+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2023-12-16T20:49:34.369363+0000","last_clean_scrub_stamp":"2023-12-16T20:49:34.369363+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:03:30.826563+0000","scrub_duration":0.0011209779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'6","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:36.954785+0000","last_change":"2023-12-16T20:49:36.954785+0000","last_active":"2023-12-16T20:49:36.954785+0000","last_peered":"2023-12-16T20:49:36.954785+0000","last_clean":"2023-12-16T20:49:36.954785+0000","last_became_active":"2023-12-16T20:21:35.420547+0000","last_became_peered":"2023-12-16T20:21:35.420547+0000","last_unstale":"2023-12-16T20:49:36.954785+0000","last_undegraded":"2023-12-16T20:49:36.954785+0000","last_fullsized":"2023-12-16T20:49:36.954785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2023-12-16T20:49:36.954706+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2023-12-16T20:49:36.954706+0000","last_clean_scrub_stamp":"2023-12-16T20:49:36.954706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:06:52.792558+0000","scrub_duration":0.001061644,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'120","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:43.423699+0000","last_change":"2023-12-16T20:49:43.423737+0000","last_active":"2023-12-16T20:49:43.423699+0000","last_peered":"2023-12-16T20:49:43.423699+0000","last_clean":"2023-12-16T20:49:43.423699+0000","last_became_active":"2023-12-16T20:21:40.756997+0000","last_became_peered":"2023-12-16T20:21:40.756997+0000","last_unstale":"2023-12-16T20:49:43.423699+0000","last_undegraded":"2023-12-16T20:49:43.423699+0000","last_fullsized":"2023-12-16T20:49:43.423699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'120","last_scrub_stamp":"2023-12-16T20:49:43.423601+0000","last_deep_scrub":"27'120","last_deep_scrub_stamp":"2023-12-16T20:49:43.423601+0000","last_clean_scrub_stamp":"2023-12-16T20:49:43.423601+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:10:55.959038+0000","scrub_duration":0.0018042889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":6714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'40","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:40.269289+0000","last_change":"2023-12-16T20:49:40.269289+0000","last_active":"2023-12-16T20:49:40.269289+0000","last_peered":"2023-12-16T20:49:40.269289+0000","last_clean":"2023-12-16T20:49:40.269289+0000","last_became_active":"2023-12-16T20:21:36.524703+0000","last_became_peered":"2023-12-16T20:21:36.524703+0000","last_unstale":"2023-12-16T20:49:40.269289+0000","last_undegraded":"2023-12-16T20:49:40.269289+0000","last_fullsized":"2023-12-16T20:49:40.269289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2023-12-16T20:49:40.269176+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2023-12-16T20:49:40.269176+0000","last_clean_scrub_stamp":"2023-12-16T20:49:40.269176+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:25:27.096610+0000","scrub_duration":0.001165059,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'11","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:24.985449+0000","last_change":"2023-12-16T20:49:24.985449+0000","last_active":"2023-12-16T20:49:24.985449+0000","last_peered":"2023-12-16T20:49:24.985449+0000","last_clean":"2023-12-16T20:49:24.985449+0000","last_became_active":"2023-12-16T20:21:35.428465+0000","last_became_peered":"2023-12-16T20:21:35.428465+0000","last_unstale":"2023-12-16T20:49:24.985449+0000","last_undegraded":"2023-12-16T20:49:24.985449+0000","last_fullsized":"2023-12-16T20:49:24.985449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2023-12-16T20:49:24.985368+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2023-12-16T20:49:24.985368+0000","last_clean_scrub_stamp":"2023-12-16T20:49:24.985368+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:46:57.920491+0000","scrub_duration":0.002106316,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'152","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:52.444847+0000","last_change":"2023-12-16T20:49:52.444872+0000","last_active":"2023-12-16T20:49:52.444847+0000","last_peered":"2023-12-16T20:49:52.444847+0000","last_clean":"2023-12-16T20:49:52.444847+0000","last_became_active":"2023-12-16T20:21:41.212976+0000","last_became_peered":"2023-12-16T20:21:41.212976+0000","last_unstale":"2023-12-16T20:49:52.444847+0000","last_undegraded":"2023-12-16T20:49:52.444847+0000","last_fullsized":"2023-12-16T20:49:52.444847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'152","last_scrub_stamp":"2023-12-16T20:49:52.444755+0000","last_deep_scrub":"27'152","last_deep_scrub_stamp":"2023-12-16T20:49:52.444755+0000","last_clean_scrub_stamp":"2023-12-16T20:49:52.444755+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:02:55.643533+0000","scrub_duration":0.001694704,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":10330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'37","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:40.941825+0000","last_change":"2023-12-16T20:49:40.941825+0000","last_active":"2023-12-16T20:49:40.941825+0000","last_peered":"2023-12-16T20:49:40.941825+0000","last_clean":"2023-12-16T20:49:40.941825+0000","last_became_active":"2023-12-16T20:21:36.518673+0000","last_became_peered":"2023-12-16T20:21:36.518673+0000","last_unstale":"2023-12-16T20:49:40.941825+0000","last_undegraded":"2023-12-16T20:49:40.941825+0000","last_fullsized":"2023-12-16T20:49:40.941825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2023-12-16T20:49:40.941728+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2023-12-16T20:49:40.941728+0000","last_clean_scrub_stamp":"2023-12-16T20:49:40.941728+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:05:27.080261+0000","scrub_duration":0.0014944279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'311","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:50.263800+0000","last_change":"2023-12-16T20:49:50.263820+0000","last_active":"2023-12-16T20:49:50.263800+0000","last_peered":"2023-12-16T20:49:50.263800+0000","last_clean":"2023-12-16T20:49:50.263800+0000","last_became_active":"2023-12-16T20:21:35.423045+0000","last_became_peered":"2023-12-16T20:21:35.423045+0000","last_unstale":"2023-12-16T20:49:50.263800+0000","last_undegraded":"2023-12-16T20:49:50.263800+0000","last_fullsized":"2023-12-16T20:49:50.263800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'311","last_scrub_stamp":"2023-12-16T20:49:50.263741+0000","last_deep_scrub":"27'311","last_deep_scrub_stamp":"2023-12-16T20:49:50.263741+0000","last_clean_scrub_stamp":"2023-12-16T20:49:50.263741+0000","objects_scrubbed":1,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:11:02.799178+0000","scrub_duration":0.0034881420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":886,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'156","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:00.890654+0000","last_change":"2023-12-16T20:50:00.890690+0000","last_active":"2023-12-16T20:50:00.890654+0000","last_peered":"2023-12-16T20:50:00.890654+0000","last_clean":"2023-12-16T20:50:00.890654+0000","last_became_active":"2023-12-16T20:21:41.215747+0000","last_became_peered":"2023-12-16T20:21:41.215747+0000","last_unstale":"2023-12-16T20:50:00.890654+0000","last_undegraded":"2023-12-16T20:50:00.890654+0000","last_fullsized":"2023-12-16T20:50:00.890654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'156","last_scrub_stamp":"2023-12-16T20:50:00.890558+0000","last_deep_scrub":"27'156","last_deep_scrub_stamp":"2023-12-16T20:50:00.890558+0000","last_clean_scrub_stamp":"2023-12-16T20:50:00.890558+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:12.602561+0000","scrub_duration":0.001533455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'35","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796509+0000","last_change":"2023-12-16T20:21:36.451660+0000","last_active":"2023-12-16T20:49:08.796509+0000","last_peered":"2023-12-16T20:49:08.796509+0000","last_clean":"2023-12-16T20:49:08.796509+0000","last_became_active":"2023-12-16T20:21:36.451404+0000","last_became_peered":"2023-12-16T20:21:36.451404+0000","last_unstale":"2023-12-16T20:49:08.796509+0000","last_undegraded":"2023-12-16T20:49:08.796509+0000","last_fullsized":"2023-12-16T20:49:08.796509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:42.928992+0000","last_change":"2023-12-16T20:49:42.929016+0000","last_active":"2023-12-16T20:49:42.928992+0000","last_peered":"2023-12-16T20:49:42.928992+0000","last_clean":"2023-12-16T20:49:42.928992+0000","last_became_active":"2023-12-16T20:21:35.419917+0000","last_became_peered":"2023-12-16T20:21:35.419917+0000","last_unstale":"2023-12-16T20:49:42.928992+0000","last_undegraded":"2023-12-16T20:49:42.928992+0000","last_fullsized":"2023-12-16T20:49:42.928992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-16T20:49:42.928908+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-16T20:49:42.928908+0000","last_clean_scrub_stamp":"2023-12-16T20:49:42.928908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:18:58.804341+0000","scrub_duration":0.001569261,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'136","reported_seq":165,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.501274+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:48:46.501274+0000","last_peered":"2023-12-16T20:48:46.501274+0000","last_clean":"2023-12-16T20:48:46.501274+0000","last_became_active":"2023-12-16T20:21:41.212704+0000","last_became_peered":"2023-12-16T20:21:41.212704+0000","last_unstale":"2023-12-16T20:48:46.501274+0000","last_undegraded":"2023-12-16T20:48:46.501274+0000","last_fullsized":"2023-12-16T20:48:46.501274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":9011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'38","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:51.641831+0000","last_change":"2023-12-16T20:49:51.641869+0000","last_active":"2023-12-16T20:49:51.641831+0000","last_peered":"2023-12-16T20:49:51.641831+0000","last_clean":"2023-12-16T20:49:51.641831+0000","last_became_active":"2023-12-16T20:21:36.555011+0000","last_became_peered":"2023-12-16T20:21:36.555011+0000","last_unstale":"2023-12-16T20:49:51.641831+0000","last_undegraded":"2023-12-16T20:49:51.641831+0000","last_fullsized":"2023-12-16T20:49:51.641831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:51.641701+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:51.641701+0000","last_clean_scrub_stamp":"2023-12-16T20:49:51.641701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:07:03.931085+0000","scrub_duration":0.001332794,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'5","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.178105+0000","last_change":"2023-12-16T20:49:37.178126+0000","last_active":"2023-12-16T20:49:37.178105+0000","last_peered":"2023-12-16T20:49:37.178105+0000","last_clean":"2023-12-16T20:49:37.178105+0000","last_became_active":"2023-12-16T20:21:35.417683+0000","last_became_peered":"2023-12-16T20:21:35.417683+0000","last_unstale":"2023-12-16T20:49:37.178105+0000","last_undegraded":"2023-12-16T20:49:37.178105+0000","last_fullsized":"2023-12-16T20:49:37.178105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:37.178026+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:37.178026+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.178026+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:16:43.237442+0000","scrub_duration":0.00095622999999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'180","reported_seq":209,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.483523+0000","last_change":"2023-12-16T20:21:40.794299+0000","last_active":"2023-12-16T20:48:46.483523+0000","last_peered":"2023-12-16T20:48:46.483523+0000","last_clean":"2023-12-16T20:48:46.483523+0000","last_became_active":"2023-12-16T20:21:40.793754+0000","last_became_peered":"2023-12-16T20:21:40.793754+0000","last_unstale":"2023-12-16T20:48:46.483523+0000","last_undegraded":"2023-12-16T20:48:46.483523+0000","last_fullsized":"2023-12-16T20:48:46.483523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":10123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'33","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:31.412846+0000","last_change":"2023-12-16T20:49:31.412901+0000","last_active":"2023-12-16T20:49:31.412846+0000","last_peered":"2023-12-16T20:49:31.412846+0000","last_clean":"2023-12-16T20:49:31.412846+0000","last_became_active":"2023-12-16T20:21:36.533651+0000","last_became_peered":"2023-12-16T20:21:36.533651+0000","last_unstale":"2023-12-16T20:49:31.412846+0000","last_undegraded":"2023-12-16T20:49:31.412846+0000","last_fullsized":"2023-12-16T20:49:31.412846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:31.412729+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:31.412729+0000","last_clean_scrub_stamp":"2023-12-16T20:49:31.412729+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:47:35.138274+0000","scrub_duration":0.0013879739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'7","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.737712+0000","last_change":"2023-12-16T20:49:37.737756+0000","last_active":"2023-12-16T20:49:37.737712+0000","last_peered":"2023-12-16T20:49:37.737712+0000","last_clean":"2023-12-16T20:49:37.737712+0000","last_became_active":"2023-12-16T20:21:35.421875+0000","last_became_peered":"2023-12-16T20:21:35.421875+0000","last_unstale":"2023-12-16T20:49:37.737712+0000","last_undegraded":"2023-12-16T20:49:37.737712+0000","last_fullsized":"2023-12-16T20:49:37.737712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-16T20:49:37.737605+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-16T20:49:37.737605+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.737605+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:22:53.369062+0000","scrub_duration":0.001373296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'112","reported_seq":141,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.483549+0000","last_change":"2023-12-16T20:21:40.754363+0000","last_active":"2023-12-16T20:48:46.483549+0000","last_peered":"2023-12-16T20:48:46.483549+0000","last_clean":"2023-12-16T20:48:46.483549+0000","last_became_active":"2023-12-16T20:21:40.753994+0000","last_became_peered":"2023-12-16T20:21:40.753994+0000","last_unstale":"2023-12-16T20:48:46.483549+0000","last_undegraded":"2023-12-16T20:48:46.483549+0000","last_fullsized":"2023-12-16T20:48:46.483549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'33","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:58.278771+0000","last_change":"2023-12-16T20:49:58.278792+0000","last_active":"2023-12-16T20:49:58.278771+0000","last_peered":"2023-12-16T20:49:58.278771+0000","last_clean":"2023-12-16T20:49:58.278771+0000","last_became_active":"2023-12-16T20:21:36.451231+0000","last_became_peered":"2023-12-16T20:21:36.451231+0000","last_unstale":"2023-12-16T20:49:58.278771+0000","last_undegraded":"2023-12-16T20:49:58.278771+0000","last_fullsized":"2023-12-16T20:49:58.278771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:58.278691+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:58.278691+0000","last_clean_scrub_stamp":"2023-12-16T20:49:58.278691+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:50:56.909460+0000","scrub_duration":0.0011625979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'1042","reported_seq":2120,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:26.183376+0000","last_change":"2023-12-16T20:49:26.183411+0000","last_active":"2023-12-16T20:49:26.183376+0000","last_peered":"2023-12-16T20:49:26.183376+0000","last_clean":"2023-12-16T20:49:26.183376+0000","last_became_active":"2023-12-16T20:21:35.420236+0000","last_became_peered":"2023-12-16T20:21:35.420236+0000","last_unstale":"2023-12-16T20:49:26.183376+0000","last_undegraded":"2023-12-16T20:49:26.183376+0000","last_fullsized":"2023-12-16T20:49:26.183376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1042","last_scrub_stamp":"2023-12-16T20:49:26.183300+0000","last_deep_scrub":"27'1042","last_deep_scrub_stamp":"2023-12-16T20:49:26.183300+0000","last_clean_scrub_stamp":"2023-12-16T20:49:26.183300+0000","objects_scrubbed":1,"log_size":1042,"log_dups_size":0,"ondisk_log_size":1042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:27:50.281048+0000","scrub_duration":0.0018598899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222889,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1038,"num_read_kb":1098,"num_write":1039,"num_write_kb":1099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'134","reported_seq":167,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:56.870809+0000","last_change":"2023-12-16T20:49:56.870849+0000","last_active":"2023-12-16T20:49:56.870809+0000","last_peered":"2023-12-16T20:49:56.870809+0000","last_clean":"2023-12-16T20:49:56.870809+0000","last_became_active":"2023-12-16T20:22:14.842220+0000","last_became_peered":"2023-12-16T20:22:14.842220+0000","last_unstale":"2023-12-16T20:49:56.870809+0000","last_undegraded":"2023-12-16T20:49:56.870809+0000","last_fullsized":"2023-12-16T20:49:56.870809+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'134","last_scrub_stamp":"2023-12-16T20:49:56.870733+0000","last_deep_scrub":"27'134","last_deep_scrub_stamp":"2023-12-16T20:49:56.870733+0000","last_clean_scrub_stamp":"2023-12-16T20:49:56.870733+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:23:12.502189+0000","scrub_duration":0.0016554510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":9129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"27'27","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:43.234920+0000","last_change":"2023-12-16T20:49:43.234962+0000","last_active":"2023-12-16T20:49:43.234920+0000","last_peered":"2023-12-16T20:49:43.234920+0000","last_clean":"2023-12-16T20:49:43.234920+0000","last_became_active":"2023-12-16T20:21:36.535571+0000","last_became_peered":"2023-12-16T20:21:36.535571+0000","last_unstale":"2023-12-16T20:49:43.234920+0000","last_undegraded":"2023-12-16T20:49:43.234920+0000","last_fullsized":"2023-12-16T20:49:43.234920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2023-12-16T20:49:43.234817+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2023-12-16T20:49:43.234817+0000","last_clean_scrub_stamp":"2023-12-16T20:49:43.234817+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:02:46.433595+0000","scrub_duration":0.001196548,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'545","reported_seq":586,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:48.856264+0000","last_change":"2023-12-16T20:49:48.856285+0000","last_active":"2023-12-16T20:49:48.856264+0000","last_peered":"2023-12-16T20:49:48.856264+0000","last_clean":"2023-12-16T20:49:48.856264+0000","last_became_active":"2023-12-16T20:21:35.418751+0000","last_became_peered":"2023-12-16T20:21:35.418751+0000","last_unstale":"2023-12-16T20:49:48.856264+0000","last_undegraded":"2023-12-16T20:49:48.856264+0000","last_fullsized":"2023-12-16T20:49:48.856264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'545","last_scrub_stamp":"2023-12-16T20:49:48.856178+0000","last_deep_scrub":"27'545","last_deep_scrub_stamp":"2023-12-16T20:49:48.856178+0000","last_clean_scrub_stamp":"2023-12-16T20:49:48.856178+0000","objects_scrubbed":1,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:46:48.769321+0000","scrub_duration":0.013032899000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'129","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:55.975864+0000","last_change":"2023-12-16T20:49:55.975910+0000","last_active":"2023-12-16T20:49:55.975864+0000","last_peered":"2023-12-16T20:49:55.975864+0000","last_clean":"2023-12-16T20:49:55.975864+0000","last_became_active":"2023-12-16T20:21:41.213977+0000","last_became_peered":"2023-12-16T20:21:41.213977+0000","last_unstale":"2023-12-16T20:49:55.975864+0000","last_undegraded":"2023-12-16T20:49:55.975864+0000","last_fullsized":"2023-12-16T20:49:55.975864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'129","last_scrub_stamp":"2023-12-16T20:49:55.975789+0000","last_deep_scrub":"27'129","last_deep_scrub_stamp":"2023-12-16T20:49:55.975789+0000","last_clean_scrub_stamp":"2023-12-16T20:49:55.975789+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:55:13.111565+0000","scrub_duration":0.0016379389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":8382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'30","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:25.008712+0000","last_change":"2023-12-16T20:49:25.008746+0000","last_active":"2023-12-16T20:49:25.008712+0000","last_peered":"2023-12-16T20:49:25.008712+0000","last_clean":"2023-12-16T20:49:25.008712+0000","last_became_active":"2023-12-16T20:21:36.550997+0000","last_became_peered":"2023-12-16T20:21:36.550997+0000","last_unstale":"2023-12-16T20:49:25.008712+0000","last_undegraded":"2023-12-16T20:49:25.008712+0000","last_fullsized":"2023-12-16T20:49:25.008712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-12-16T20:49:25.008610+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-12-16T20:49:25.008610+0000","last_clean_scrub_stamp":"2023-12-16T20:49:25.008610+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:16:31.068027+0000","scrub_duration":0.001488783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:44.635331+0000","last_change":"2023-12-16T20:49:44.635351+0000","last_active":"2023-12-16T20:49:44.635331+0000","last_peered":"2023-12-16T20:49:44.635331+0000","last_clean":"2023-12-16T20:49:44.635331+0000","last_became_active":"2023-12-16T20:21:35.415984+0000","last_became_peered":"2023-12-16T20:21:35.415984+0000","last_unstale":"2023-12-16T20:49:44.635331+0000","last_undegraded":"2023-12-16T20:49:44.635331+0000","last_fullsized":"2023-12-16T20:49:44.635331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2023-12-16T20:49:44.635268+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2023-12-16T20:49:44.635268+0000","last_clean_scrub_stamp":"2023-12-16T20:49:44.635268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:19:00.510701+0000","scrub_duration":0.001090756,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.944057+0000","last_change":"2023-12-16T20:49:35.944081+0000","last_active":"2023-12-16T20:49:35.944057+0000","last_peered":"2023-12-16T20:49:35.944057+0000","last_clean":"2023-12-16T20:49:35.944057+0000","last_became_active":"2023-12-16T20:21:25.195675+0000","last_became_peered":"2023-12-16T20:21:25.195675+0000","last_unstale":"2023-12-16T20:49:35.944057+0000","last_undegraded":"2023-12-16T20:49:35.944057+0000","last_fullsized":"2023-12-16T20:49:35.944057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2023-12-16T20:49:35.944005+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2023-12-16T20:49:35.944005+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.944005+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:22:55.655410+0000","scrub_duration":0.0041226689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'192","reported_seq":221,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:51.606021+0000","last_change":"2023-12-16T20:21:41.214322+0000","last_active":"2023-12-16T20:48:51.606021+0000","last_peered":"2023-12-16T20:48:51.606021+0000","last_clean":"2023-12-16T20:48:51.606021+0000","last_became_active":"2023-12-16T20:21:41.214012+0000","last_became_peered":"2023-12-16T20:21:41.214012+0000","last_unstale":"2023-12-16T20:48:51.606021+0000","last_undegraded":"2023-12-16T20:48:51.606021+0000","last_fullsized":"2023-12-16T20:48:51.606021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":12745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'36","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:29.998284+0000","last_change":"2023-12-16T20:49:29.998311+0000","last_active":"2023-12-16T20:49:29.998284+0000","last_peered":"2023-12-16T20:49:29.998284+0000","last_clean":"2023-12-16T20:49:29.998284+0000","last_became_active":"2023-12-16T20:21:36.552619+0000","last_became_peered":"2023-12-16T20:21:36.552619+0000","last_unstale":"2023-12-16T20:49:29.998284+0000","last_undegraded":"2023-12-16T20:49:29.998284+0000","last_fullsized":"2023-12-16T20:49:29.998284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2023-12-16T20:49:29.998180+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2023-12-16T20:49:29.998180+0000","last_clean_scrub_stamp":"2023-12-16T20:49:29.998180+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:51.843719+0000","scrub_duration":0.001334638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:30.083872+0000","last_change":"2023-12-16T20:49:30.083904+0000","last_active":"2023-12-16T20:49:30.083872+0000","last_peered":"2023-12-16T20:49:30.083872+0000","last_clean":"2023-12-16T20:49:30.083872+0000","last_became_active":"2023-12-16T20:21:35.413308+0000","last_became_peered":"2023-12-16T20:21:35.413308+0000","last_unstale":"2023-12-16T20:49:30.083872+0000","last_undegraded":"2023-12-16T20:49:30.083872+0000","last_fullsized":"2023-12-16T20:49:30.083872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-16T20:49:30.083795+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-16T20:49:30.083795+0000","last_clean_scrub_stamp":"2023-12-16T20:49:30.083795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:57:33.423790+0000","scrub_duration":0.001344486,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'151","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:23.790121+0000","last_change":"2023-12-16T20:21:41.213096+0000","last_active":"2023-12-16T20:49:23.790121+0000","last_peered":"2023-12-16T20:49:23.790121+0000","last_clean":"2023-12-16T20:49:23.790121+0000","last_became_active":"2023-12-16T20:21:41.212608+0000","last_became_peered":"2023-12-16T20:21:41.212608+0000","last_unstale":"2023-12-16T20:49:23.790121+0000","last_undegraded":"2023-12-16T20:49:23.790121+0000","last_fullsized":"2023-12-16T20:49:23.790121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":6553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'41","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:46.661846+0000","last_change":"2023-12-16T20:49:46.661867+0000","last_active":"2023-12-16T20:49:46.661846+0000","last_peered":"2023-12-16T20:49:46.661846+0000","last_clean":"2023-12-16T20:49:46.661846+0000","last_became_active":"2023-12-16T20:21:36.555631+0000","last_became_peered":"2023-12-16T20:21:36.555631+0000","last_unstale":"2023-12-16T20:49:46.661846+0000","last_undegraded":"2023-12-16T20:49:46.661846+0000","last_fullsized":"2023-12-16T20:49:46.661846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2023-12-16T20:49:46.661779+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2023-12-16T20:49:46.661779+0000","last_clean_scrub_stamp":"2023-12-16T20:49:46.661779+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:25:33.489213+0000","scrub_duration":0.0010676520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:57.264374+0000","last_change":"2023-12-16T20:49:57.264395+0000","last_active":"2023-12-16T20:49:57.264374+0000","last_peered":"2023-12-16T20:49:57.264374+0000","last_clean":"2023-12-16T20:49:57.264374+0000","last_became_active":"2023-12-16T20:21:35.415810+0000","last_became_peered":"2023-12-16T20:21:35.415810+0000","last_unstale":"2023-12-16T20:49:57.264374+0000","last_undegraded":"2023-12-16T20:49:57.264374+0000","last_fullsized":"2023-12-16T20:49:57.264374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:57.264322+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:57.264322+0000","last_clean_scrub_stamp":"2023-12-16T20:49:57.264322+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:07:09.553705+0000","scrub_duration":0.0024946949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'169","reported_seq":214,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:44.222648+0000","last_change":"2023-12-16T20:49:44.222668+0000","last_active":"2023-12-16T20:49:44.222648+0000","last_peered":"2023-12-16T20:49:44.222648+0000","last_clean":"2023-12-16T20:49:44.222648+0000","last_became_active":"2023-12-16T20:22:14.842282+0000","last_became_peered":"2023-12-16T20:22:14.842282+0000","last_unstale":"2023-12-16T20:49:44.222648+0000","last_undegraded":"2023-12-16T20:49:44.222648+0000","last_fullsized":"2023-12-16T20:49:44.222648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'169","last_scrub_stamp":"2023-12-16T20:49:44.222590+0000","last_deep_scrub":"27'169","last_deep_scrub_stamp":"2023-12-16T20:49:44.222590+0000","last_clean_scrub_stamp":"2023-12-16T20:49:44.222590+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:23:27.446377+0000","scrub_duration":0.001449423,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":8236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'35","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.903042+0000","last_change":"2023-12-16T20:21:36.536346+0000","last_active":"2023-12-16T20:49:08.903042+0000","last_peered":"2023-12-16T20:49:08.903042+0000","last_clean":"2023-12-16T20:49:08.903042+0000","last_became_active":"2023-12-16T20:21:36.536093+0000","last_became_peered":"2023-12-16T20:21:36.536093+0000","last_unstale":"2023-12-16T20:49:08.903042+0000","last_undegraded":"2023-12-16T20:49:08.903042+0000","last_fullsized":"2023-12-16T20:49:08.903042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'8","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:33.942561+0000","last_change":"2023-12-16T20:49:33.942600+0000","last_active":"2023-12-16T20:49:33.942561+0000","last_peered":"2023-12-16T20:49:33.942561+0000","last_clean":"2023-12-16T20:49:33.942561+0000","last_became_active":"2023-12-16T20:21:35.420074+0000","last_became_peered":"2023-12-16T20:21:35.420074+0000","last_unstale":"2023-12-16T20:49:33.942561+0000","last_undegraded":"2023-12-16T20:49:33.942561+0000","last_fullsized":"2023-12-16T20:49:33.942561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2023-12-16T20:49:33.942494+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2023-12-16T20:49:33.942494+0000","last_clean_scrub_stamp":"2023-12-16T20:49:33.942494+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:52:08.699859+0000","scrub_duration":0.0020749739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'129","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:23.047067+0000","last_change":"2023-12-16T20:21:41.215282+0000","last_active":"2023-12-16T20:49:23.047067+0000","last_peered":"2023-12-16T20:49:23.047067+0000","last_clean":"2023-12-16T20:49:23.047067+0000","last_became_active":"2023-12-16T20:21:41.214939+0000","last_became_peered":"2023-12-16T20:21:41.214939+0000","last_unstale":"2023-12-16T20:49:23.047067+0000","last_undegraded":"2023-12-16T20:49:23.047067+0000","last_fullsized":"2023-12-16T20:49:23.047067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":12347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'21","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:52.751235+0000","last_change":"2023-12-16T20:49:52.751264+0000","last_active":"2023-12-16T20:49:52.751235+0000","last_peered":"2023-12-16T20:49:52.751235+0000","last_clean":"2023-12-16T20:49:52.751235+0000","last_became_active":"2023-12-16T20:21:36.534064+0000","last_became_peered":"2023-12-16T20:21:36.534064+0000","last_unstale":"2023-12-16T20:49:52.751235+0000","last_undegraded":"2023-12-16T20:49:52.751235+0000","last_fullsized":"2023-12-16T20:49:52.751235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2023-12-16T20:49:52.751136+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2023-12-16T20:49:52.751136+0000","last_clean_scrub_stamp":"2023-12-16T20:49:52.751136+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:50:51.381905+0000","scrub_duration":0.0013552460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:24.454926+0000","last_change":"2023-12-16T20:49:24.454950+0000","last_active":"2023-12-16T20:49:24.454926+0000","last_peered":"2023-12-16T20:49:24.454926+0000","last_clean":"2023-12-16T20:49:24.454926+0000","last_became_active":"2023-12-16T20:21:35.390740+0000","last_became_peered":"2023-12-16T20:21:35.390740+0000","last_unstale":"2023-12-16T20:49:24.454926+0000","last_undegraded":"2023-12-16T20:49:24.454926+0000","last_fullsized":"2023-12-16T20:49:24.454926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:24.454859+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:24.454859+0000","last_clean_scrub_stamp":"2023-12-16T20:49:24.454859+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:46:57.389983+0000","scrub_duration":0.0022306159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'180","reported_seq":217,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:38.446279+0000","last_change":"2023-12-16T20:49:38.446279+0000","last_active":"2023-12-16T20:49:38.446279+0000","last_peered":"2023-12-16T20:49:38.446279+0000","last_clean":"2023-12-16T20:49:38.446279+0000","last_became_active":"2023-12-16T20:21:40.753981+0000","last_became_peered":"2023-12-16T20:21:40.753981+0000","last_unstale":"2023-12-16T20:49:38.446279+0000","last_undegraded":"2023-12-16T20:49:38.446279+0000","last_fullsized":"2023-12-16T20:49:38.446279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'180","last_scrub_stamp":"2023-12-16T20:49:38.446193+0000","last_deep_scrub":"27'180","last_deep_scrub_stamp":"2023-12-16T20:49:38.446193+0000","last_clean_scrub_stamp":"2023-12-16T20:49:38.446193+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:22:54.077650+0000","scrub_duration":0.00173639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":13396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'37","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:55.745796+0000","last_change":"2023-12-16T20:49:55.745832+0000","last_active":"2023-12-16T20:49:55.745796+0000","last_peered":"2023-12-16T20:49:55.745796+0000","last_clean":"2023-12-16T20:49:55.745796+0000","last_became_active":"2023-12-16T20:21:36.536822+0000","last_became_peered":"2023-12-16T20:21:36.536822+0000","last_unstale":"2023-12-16T20:49:55.745796+0000","last_undegraded":"2023-12-16T20:49:55.745796+0000","last_fullsized":"2023-12-16T20:49:55.745796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2023-12-16T20:49:55.745723+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2023-12-16T20:49:55.745723+0000","last_clean_scrub_stamp":"2023-12-16T20:49:55.745723+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:23:38.969510+0000","scrub_duration":0.00092544100000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'13","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:36.010890+0000","last_change":"2023-12-16T20:49:36.010890+0000","last_active":"2023-12-16T20:49:36.010890+0000","last_peered":"2023-12-16T20:49:36.010890+0000","last_clean":"2023-12-16T20:49:36.010890+0000","last_became_active":"2023-12-16T20:21:35.416850+0000","last_became_peered":"2023-12-16T20:21:35.416850+0000","last_unstale":"2023-12-16T20:49:36.010890+0000","last_undegraded":"2023-12-16T20:49:36.010890+0000","last_fullsized":"2023-12-16T20:49:36.010890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2023-12-16T20:49:36.010800+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2023-12-16T20:49:36.010800+0000","last_clean_scrub_stamp":"2023-12-16T20:49:36.010800+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:31:01.472769+0000","scrub_duration":0.0029238240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'159","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:46.189372+0000","last_change":"2023-12-16T20:49:46.189393+0000","last_active":"2023-12-16T20:49:46.189372+0000","last_peered":"2023-12-16T20:49:46.189372+0000","last_clean":"2023-12-16T20:49:46.189372+0000","last_became_active":"2023-12-16T20:21:40.755041+0000","last_became_peered":"2023-12-16T20:21:40.755041+0000","last_unstale":"2023-12-16T20:49:46.189372+0000","last_undegraded":"2023-12-16T20:49:46.189372+0000","last_fullsized":"2023-12-16T20:49:46.189372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'159","last_scrub_stamp":"2023-12-16T20:49:46.189303+0000","last_deep_scrub":"27'159","last_deep_scrub_stamp":"2023-12-16T20:49:46.189303+0000","last_clean_scrub_stamp":"2023-12-16T20:49:46.189303+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:05:32.327836+0000","scrub_duration":0.001539393,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":9935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'32","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:47.065132+0000","last_change":"2023-12-16T20:49:47.065175+0000","last_active":"2023-12-16T20:49:47.065132+0000","last_peered":"2023-12-16T20:49:47.065132+0000","last_clean":"2023-12-16T20:49:47.065132+0000","last_became_active":"2023-12-16T20:21:36.540861+0000","last_became_peered":"2023-12-16T20:21:36.540861+0000","last_unstale":"2023-12-16T20:49:47.065132+0000","last_undegraded":"2023-12-16T20:49:47.065132+0000","last_fullsized":"2023-12-16T20:49:47.065132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2023-12-16T20:49:47.065045+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2023-12-16T20:49:47.065045+0000","last_clean_scrub_stamp":"2023-12-16T20:49:47.065045+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:10:59.600482+0000","scrub_duration":0.00123215,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:38.003759+0000","last_change":"2023-12-16T20:49:38.003778+0000","last_active":"2023-12-16T20:49:38.003759+0000","last_peered":"2023-12-16T20:49:38.003759+0000","last_clean":"2023-12-16T20:49:38.003759+0000","last_became_active":"2023-12-16T20:21:35.424822+0000","last_became_peered":"2023-12-16T20:21:35.424822+0000","last_unstale":"2023-12-16T20:49:38.003759+0000","last_undegraded":"2023-12-16T20:49:38.003759+0000","last_fullsized":"2023-12-16T20:49:38.003759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-16T20:49:38.003697+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-16T20:49:38.003697+0000","last_clean_scrub_stamp":"2023-12-16T20:49:38.003697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:03:34.460897+0000","scrub_duration":0.00081691399999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'130","reported_seq":157,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:39.361322+0000","last_change":"2023-12-16T20:21:41.215346+0000","last_active":"2023-12-16T20:48:39.361322+0000","last_peered":"2023-12-16T20:48:39.361322+0000","last_clean":"2023-12-16T20:48:39.361322+0000","last_became_active":"2023-12-16T20:21:41.215002+0000","last_became_peered":"2023-12-16T20:21:41.215002+0000","last_unstale":"2023-12-16T20:48:39.361322+0000","last_undegraded":"2023-12-16T20:48:39.361322+0000","last_fullsized":"2023-12-16T20:48:39.361322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":7078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'49","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:24.563960+0000","last_change":"2023-12-16T20:21:36.535791+0000","last_active":"2023-12-16T20:49:24.563960+0000","last_peered":"2023-12-16T20:49:24.563960+0000","last_clean":"2023-12-16T20:49:24.563960+0000","last_became_active":"2023-12-16T20:21:36.535447+0000","last_became_peered":"2023-12-16T20:21:36.535447+0000","last_unstale":"2023-12-16T20:49:24.563960+0000","last_undegraded":"2023-12-16T20:49:24.563960+0000","last_fullsized":"2023-12-16T20:49:24.563960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:42.639497+0000","last_change":"2023-12-16T20:49:42.639525+0000","last_active":"2023-12-16T20:49:42.639497+0000","last_peered":"2023-12-16T20:49:42.639497+0000","last_clean":"2023-12-16T20:49:42.639497+0000","last_became_active":"2023-12-16T20:21:35.423275+0000","last_became_peered":"2023-12-16T20:21:35.423275+0000","last_unstale":"2023-12-16T20:49:42.639497+0000","last_undegraded":"2023-12-16T20:49:42.639497+0000","last_fullsized":"2023-12-16T20:49:42.639497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-12-16T20:49:42.639417+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-12-16T20:49:42.639417+0000","last_clean_scrub_stamp":"2023-12-16T20:49:42.639417+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:10:55.174854+0000","scrub_duration":0.0012433469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'115","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:54.883561+0000","last_change":"2023-12-16T20:49:54.883598+0000","last_active":"2023-12-16T20:49:54.883561+0000","last_peered":"2023-12-16T20:49:54.883561+0000","last_clean":"2023-12-16T20:49:54.883561+0000","last_became_active":"2023-12-16T20:21:41.212699+0000","last_became_peered":"2023-12-16T20:21:41.212699+0000","last_unstale":"2023-12-16T20:49:54.883561+0000","last_undegraded":"2023-12-16T20:49:54.883561+0000","last_fullsized":"2023-12-16T20:49:54.883561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'115","last_scrub_stamp":"2023-12-16T20:49:54.883463+0000","last_deep_scrub":"27'115","last_deep_scrub_stamp":"2023-12-16T20:49:54.883463+0000","last_clean_scrub_stamp":"2023-12-16T20:49:54.883463+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:54.123130+0000","scrub_duration":0.0019162179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'45","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:42.256750+0000","last_change":"2023-12-16T20:49:42.256769+0000","last_active":"2023-12-16T20:49:42.256750+0000","last_peered":"2023-12-16T20:49:42.256750+0000","last_clean":"2023-12-16T20:49:42.256750+0000","last_became_active":"2023-12-16T20:21:36.523649+0000","last_became_peered":"2023-12-16T20:21:36.523649+0000","last_unstale":"2023-12-16T20:49:42.256750+0000","last_undegraded":"2023-12-16T20:49:42.256750+0000","last_fullsized":"2023-12-16T20:49:42.256750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-16T20:49:42.256681+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-16T20:49:42.256681+0000","last_clean_scrub_stamp":"2023-12-16T20:49:42.256681+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:52:59.557961+0000","scrub_duration":0.0011776029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'263","reported_seq":302,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:21.189639+0000","last_change":"2023-12-16T20:49:21.189639+0000","last_active":"2023-12-16T20:49:21.189639+0000","last_peered":"2023-12-16T20:49:21.189639+0000","last_clean":"2023-12-16T20:49:21.189639+0000","last_became_active":"2023-12-16T20:21:35.388392+0000","last_became_peered":"2023-12-16T20:21:35.388392+0000","last_unstale":"2023-12-16T20:49:21.189639+0000","last_undegraded":"2023-12-16T20:49:21.189639+0000","last_fullsized":"2023-12-16T20:49:21.189639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'263","last_scrub_stamp":"2023-12-16T20:49:21.189550+0000","last_deep_scrub":"27'263","last_deep_scrub_stamp":"2023-12-16T20:49:21.189550+0000","last_clean_scrub_stamp":"2023-12-16T20:49:21.189550+0000","objects_scrubbed":3,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:47:24.915095+0000","scrub_duration":0.0088499110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2496854,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":2582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'142","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:41.499958+0000","last_change":"2023-12-16T20:21:41.213106+0000","last_active":"2023-12-16T20:48:41.499958+0000","last_peered":"2023-12-16T20:48:41.499958+0000","last_clean":"2023-12-16T20:48:41.499958+0000","last_became_active":"2023-12-16T20:21:41.212721+0000","last_became_peered":"2023-12-16T20:21:41.212721+0000","last_unstale":"2023-12-16T20:48:41.499958+0000","last_undegraded":"2023-12-16T20:48:41.499958+0000","last_fullsized":"2023-12-16T20:48:41.499958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":13674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'36","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.904041+0000","last_change":"2023-12-16T20:21:36.519774+0000","last_active":"2023-12-16T20:49:08.904041+0000","last_peered":"2023-12-16T20:49:08.904041+0000","last_clean":"2023-12-16T20:49:08.904041+0000","last_became_active":"2023-12-16T20:21:36.519561+0000","last_became_peered":"2023-12-16T20:21:36.519561+0000","last_unstale":"2023-12-16T20:49:08.904041+0000","last_undegraded":"2023-12-16T20:49:08.904041+0000","last_fullsized":"2023-12-16T20:49:08.904041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'853","reported_seq":892,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:27.001377+0000","last_change":"2023-12-16T20:49:27.001377+0000","last_active":"2023-12-16T20:49:27.001377+0000","last_peered":"2023-12-16T20:49:27.001377+0000","last_clean":"2023-12-16T20:49:27.001377+0000","last_became_active":"2023-12-16T20:21:35.425929+0000","last_became_peered":"2023-12-16T20:21:35.425929+0000","last_unstale":"2023-12-16T20:49:27.001377+0000","last_undegraded":"2023-12-16T20:49:27.001377+0000","last_fullsized":"2023-12-16T20:49:27.001377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'853","last_scrub_stamp":"2023-12-16T20:49:27.001283+0000","last_deep_scrub":"27'853","last_deep_scrub_stamp":"2023-12-16T20:49:27.001283+0000","last_clean_scrub_stamp":"2023-12-16T20:49:27.001283+0000","objects_scrubbed":4,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:45:17.910698+0000","scrub_duration":0.017121821999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":4548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'165","reported_seq":193,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:19.988451+0000","last_change":"2023-12-16T20:21:40.754204+0000","last_active":"2023-12-16T20:49:19.988451+0000","last_peered":"2023-12-16T20:49:19.988451+0000","last_clean":"2023-12-16T20:49:19.988451+0000","last_became_active":"2023-12-16T20:21:40.753624+0000","last_became_peered":"2023-12-16T20:21:40.753624+0000","last_unstale":"2023-12-16T20:49:19.988451+0000","last_undegraded":"2023-12-16T20:49:19.988451+0000","last_fullsized":"2023-12-16T20:49:19.988451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":9759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'33","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:32.382521+0000","last_change":"2023-12-16T20:49:32.382521+0000","last_active":"2023-12-16T20:49:32.382521+0000","last_peered":"2023-12-16T20:49:32.382521+0000","last_clean":"2023-12-16T20:49:32.382521+0000","last_became_active":"2023-12-16T20:21:36.533790+0000","last_became_peered":"2023-12-16T20:21:36.533790+0000","last_unstale":"2023-12-16T20:49:32.382521+0000","last_undegraded":"2023-12-16T20:49:32.382521+0000","last_fullsized":"2023-12-16T20:49:32.382521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:32.382392+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:32.382392+0000","last_clean_scrub_stamp":"2023-12-16T20:49:32.382392+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:54.227931+0000","scrub_duration":0.0013665769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'708","reported_seq":746,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:52.273670+0000","last_change":"2023-12-16T20:49:52.273727+0000","last_active":"2023-12-16T20:49:52.273670+0000","last_peered":"2023-12-16T20:49:52.273670+0000","last_clean":"2023-12-16T20:49:52.273670+0000","last_became_active":"2023-12-16T20:21:35.415790+0000","last_became_peered":"2023-12-16T20:21:35.415790+0000","last_unstale":"2023-12-16T20:49:52.273670+0000","last_undegraded":"2023-12-16T20:49:52.273670+0000","last_fullsized":"2023-12-16T20:49:52.273670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'708","last_scrub_stamp":"2023-12-16T20:49:52.273600+0000","last_deep_scrub":"27'708","last_deep_scrub_stamp":"2023-12-16T20:49:52.273600+0000","last_clean_scrub_stamp":"2023-12-16T20:49:52.273600+0000","objects_scrubbed":2,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:19:08.149033+0000","scrub_duration":0.0033982190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":703,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'154","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:54.490333+0000","last_change":"2023-12-16T20:49:54.490356+0000","last_active":"2023-12-16T20:49:54.490333+0000","last_peered":"2023-12-16T20:49:54.490333+0000","last_clean":"2023-12-16T20:49:54.490333+0000","last_became_active":"2023-12-16T20:21:40.793667+0000","last_became_peered":"2023-12-16T20:21:40.793667+0000","last_unstale":"2023-12-16T20:49:54.490333+0000","last_undegraded":"2023-12-16T20:49:54.490333+0000","last_fullsized":"2023-12-16T20:49:54.490333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'154","last_scrub_stamp":"2023-12-16T20:49:54.490252+0000","last_deep_scrub":"27'154","last_deep_scrub_stamp":"2023-12-16T20:49:54.490252+0000","last_clean_scrub_stamp":"2023-12-16T20:49:54.490252+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:47:30.325073+0000","scrub_duration":0.0017958200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":20505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'40","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:41.244903+0000","last_change":"2023-12-16T20:49:41.244938+0000","last_active":"2023-12-16T20:49:41.244903+0000","last_peered":"2023-12-16T20:49:41.244903+0000","last_clean":"2023-12-16T20:49:41.244903+0000","last_became_active":"2023-12-16T20:21:36.552482+0000","last_became_peered":"2023-12-16T20:21:36.552482+0000","last_unstale":"2023-12-16T20:49:41.244903+0000","last_undegraded":"2023-12-16T20:49:41.244903+0000","last_fullsized":"2023-12-16T20:49:41.244903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2023-12-16T20:49:41.244780+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2023-12-16T20:49:41.244780+0000","last_clean_scrub_stamp":"2023-12-16T20:49:41.244780+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:46:41.157923+0000","scrub_duration":0.00118479,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:32.853509+0000","last_change":"2023-12-16T20:49:32.853535+0000","last_active":"2023-12-16T20:49:32.853509+0000","last_peered":"2023-12-16T20:49:32.853509+0000","last_clean":"2023-12-16T20:49:32.853509+0000","last_became_active":"2023-12-16T20:21:35.428100+0000","last_became_peered":"2023-12-16T20:21:35.428100+0000","last_unstale":"2023-12-16T20:49:32.853509+0000","last_undegraded":"2023-12-16T20:49:32.853509+0000","last_fullsized":"2023-12-16T20:49:32.853509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-12-16T20:49:32.853418+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-12-16T20:49:32.853418+0000","last_clean_scrub_stamp":"2023-12-16T20:49:32.853418+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:16:38.912835+0000","scrub_duration":0.001267879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'126","reported_seq":154,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:21.495532+0000","last_change":"2023-12-16T20:21:40.753333+0000","last_active":"2023-12-16T20:49:21.495532+0000","last_peered":"2023-12-16T20:49:21.495532+0000","last_clean":"2023-12-16T20:49:21.495532+0000","last_became_active":"2023-12-16T20:21:40.752957+0000","last_became_peered":"2023-12-16T20:21:40.752957+0000","last_unstale":"2023-12-16T20:49:21.495532+0000","last_undegraded":"2023-12-16T20:49:21.495532+0000","last_fullsized":"2023-12-16T20:49:21.495532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":10032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'43","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:55.902407+0000","last_change":"2023-12-16T20:49:55.902427+0000","last_active":"2023-12-16T20:49:55.902407+0000","last_peered":"2023-12-16T20:49:55.902407+0000","last_clean":"2023-12-16T20:49:55.902407+0000","last_became_active":"2023-12-16T20:22:14.840679+0000","last_became_peered":"2023-12-16T20:22:14.840679+0000","last_unstale":"2023-12-16T20:49:55.902407+0000","last_undegraded":"2023-12-16T20:49:55.902407+0000","last_fullsized":"2023-12-16T20:49:55.902407+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2023-12-16T20:49:55.902337+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2023-12-16T20:49:55.902337+0000","last_clean_scrub_stamp":"2023-12-16T20:49:55.902337+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:17:01.961753+0000","scrub_duration":0.0011720260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.961032+0000","last_change":"2023-12-16T20:49:35.961051+0000","last_active":"2023-12-16T20:49:35.961032+0000","last_peered":"2023-12-16T20:49:35.961032+0000","last_clean":"2023-12-16T20:49:35.961032+0000","last_became_active":"2023-12-16T20:21:35.429940+0000","last_became_peered":"2023-12-16T20:21:35.429940+0000","last_unstale":"2023-12-16T20:49:35.961032+0000","last_undegraded":"2023-12-16T20:49:35.961032+0000","last_fullsized":"2023-12-16T20:49:35.961032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:35.960970+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:35.960970+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.960970+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:07:46.264662+0000","scrub_duration":0.00082690499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'174","reported_seq":210,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:51.902166+0000","last_change":"2023-12-16T20:49:51.902204+0000","last_active":"2023-12-16T20:49:51.902166+0000","last_peered":"2023-12-16T20:49:51.902166+0000","last_clean":"2023-12-16T20:49:51.902166+0000","last_became_active":"2023-12-16T20:21:41.215893+0000","last_became_peered":"2023-12-16T20:21:41.215893+0000","last_unstale":"2023-12-16T20:49:51.902166+0000","last_undegraded":"2023-12-16T20:49:51.902166+0000","last_fullsized":"2023-12-16T20:49:51.902166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'174","last_scrub_stamp":"2023-12-16T20:49:51.902070+0000","last_deep_scrub":"27'174","last_deep_scrub_stamp":"2023-12-16T20:49:51.902070+0000","last_clean_scrub_stamp":"2023-12-16T20:49:51.902070+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:14:53.769594+0000","scrub_duration":0.001858784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":9716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'144","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:59.069009+0000","last_change":"2023-12-16T20:49:59.069045+0000","last_active":"2023-12-16T20:49:59.069009+0000","last_peered":"2023-12-16T20:49:59.069009+0000","last_clean":"2023-12-16T20:49:59.069009+0000","last_became_active":"2023-12-16T20:21:41.214950+0000","last_became_peered":"2023-12-16T20:21:41.214950+0000","last_unstale":"2023-12-16T20:49:59.069009+0000","last_undegraded":"2023-12-16T20:49:59.069009+0000","last_fullsized":"2023-12-16T20:49:59.069009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'144","last_scrub_stamp":"2023-12-16T20:49:59.068933+0000","last_deep_scrub":"27'144","last_deep_scrub_stamp":"2023-12-16T20:49:59.068933+0000","last_clean_scrub_stamp":"2023-12-16T20:49:59.068933+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:43:09.001759+0000","scrub_duration":0.0016057809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":7732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'44","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.210606+0000","last_change":"2023-12-16T20:49:35.210624+0000","last_active":"2023-12-16T20:49:35.210606+0000","last_peered":"2023-12-16T20:49:35.210606+0000","last_clean":"2023-12-16T20:49:35.210606+0000","last_became_active":"2023-12-16T20:21:36.519476+0000","last_became_peered":"2023-12-16T20:21:36.519476+0000","last_unstale":"2023-12-16T20:49:35.210606+0000","last_undegraded":"2023-12-16T20:49:35.210606+0000","last_fullsized":"2023-12-16T20:49:35.210606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2023-12-16T20:49:35.210541+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2023-12-16T20:49:35.210541+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.210541+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:05:54.945127+0000","scrub_duration":0.00098724800000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:41.643915+0000","last_change":"2023-12-16T20:49:41.643946+0000","last_active":"2023-12-16T20:49:41.643915+0000","last_peered":"2023-12-16T20:49:41.643915+0000","last_clean":"2023-12-16T20:49:41.643915+0000","last_became_active":"2023-12-16T20:21:35.414846+0000","last_became_peered":"2023-12-16T20:21:35.414846+0000","last_unstale":"2023-12-16T20:49:41.643915+0000","last_undegraded":"2023-12-16T20:49:41.643915+0000","last_fullsized":"2023-12-16T20:49:41.643915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:41.643824+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:41.643824+0000","last_clean_scrub_stamp":"2023-12-16T20:49:41.643824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:54:58.109657+0000","scrub_duration":0.000945662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'142","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:48:46.605478+0000","last_change":"2023-12-16T20:21:40.794438+0000","last_active":"2023-12-16T20:48:46.605478+0000","last_peered":"2023-12-16T20:48:46.605478+0000","last_clean":"2023-12-16T20:48:46.605478+0000","last_became_active":"2023-12-16T20:21:40.794073+0000","last_became_peered":"2023-12-16T20:21:40.794073+0000","last_unstale":"2023-12-16T20:48:46.605478+0000","last_undegraded":"2023-12-16T20:48:46.605478+0000","last_fullsized":"2023-12-16T20:48:46.605478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":21602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'45","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796594+0000","last_change":"2023-12-16T20:22:14.772045+0000","last_active":"2023-12-16T20:49:08.796594+0000","last_peered":"2023-12-16T20:49:08.796594+0000","last_clean":"2023-12-16T20:49:08.796594+0000","last_became_active":"2023-12-16T20:22:14.771747+0000","last_became_peered":"2023-12-16T20:22:14.771747+0000","last_unstale":"2023-12-16T20:49:08.796594+0000","last_undegraded":"2023-12-16T20:49:08.796594+0000","last_fullsized":"2023-12-16T20:49:08.796594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:36.037153+0000","last_change":"2023-12-16T20:49:36.037185+0000","last_active":"2023-12-16T20:49:36.037153+0000","last_peered":"2023-12-16T20:49:36.037153+0000","last_clean":"2023-12-16T20:49:36.037153+0000","last_became_active":"2023-12-16T20:21:35.421982+0000","last_became_peered":"2023-12-16T20:21:35.421982+0000","last_unstale":"2023-12-16T20:49:36.037153+0000","last_undegraded":"2023-12-16T20:49:36.037153+0000","last_fullsized":"2023-12-16T20:49:36.037153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-16T20:49:36.037044+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-16T20:49:36.037044+0000","last_clean_scrub_stamp":"2023-12-16T20:49:36.037044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:06:48.326428+0000","scrub_duration":0.001104584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'702","reported_seq":740,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:36.983829+0000","last_change":"2023-12-16T20:49:36.983854+0000","last_active":"2023-12-16T20:49:36.983829+0000","last_peered":"2023-12-16T20:49:36.983829+0000","last_clean":"2023-12-16T20:49:36.983829+0000","last_became_active":"2023-12-16T20:21:35.424254+0000","last_became_peered":"2023-12-16T20:21:35.424254+0000","last_unstale":"2023-12-16T20:49:36.983829+0000","last_undegraded":"2023-12-16T20:49:36.983829+0000","last_fullsized":"2023-12-16T20:49:36.983829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'702","last_scrub_stamp":"2023-12-16T20:49:36.983769+0000","last_deep_scrub":"27'702","last_deep_scrub_stamp":"2023-12-16T20:49:36.983769+0000","last_clean_scrub_stamp":"2023-12-16T20:49:36.983769+0000","objects_scrubbed":1,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:05:56.718355+0000","scrub_duration":0.011541968999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'39","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.292672+0000","last_change":"2023-12-16T20:49:35.292691+0000","last_active":"2023-12-16T20:49:35.292672+0000","last_peered":"2023-12-16T20:49:35.292672+0000","last_clean":"2023-12-16T20:49:35.292672+0000","last_became_active":"2023-12-16T20:21:36.533574+0000","last_became_peered":"2023-12-16T20:21:36.533574+0000","last_unstale":"2023-12-16T20:49:35.292672+0000","last_undegraded":"2023-12-16T20:49:35.292672+0000","last_fullsized":"2023-12-16T20:49:35.292672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-12-16T20:49:35.292617+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-12-16T20:49:35.292617+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.292617+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:10:47.828054+0000","scrub_duration":0.0011431620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'88","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:45.947854+0000","last_change":"2023-12-16T20:49:45.947897+0000","last_active":"2023-12-16T20:49:45.947854+0000","last_peered":"2023-12-16T20:49:45.947854+0000","last_clean":"2023-12-16T20:49:45.947854+0000","last_became_active":"2023-12-16T20:21:40.794082+0000","last_became_peered":"2023-12-16T20:21:40.794082+0000","last_unstale":"2023-12-16T20:49:45.947854+0000","last_undegraded":"2023-12-16T20:49:45.947854+0000","last_fullsized":"2023-12-16T20:49:45.947854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'88","last_scrub_stamp":"2023-12-16T20:49:45.947775+0000","last_deep_scrub":"27'88","last_deep_scrub_stamp":"2023-12-16T20:49:45.947775+0000","last_clean_scrub_stamp":"2023-12-16T20:49:45.947775+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:34:07.793315+0000","scrub_duration":0.001508957,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'687","reported_seq":725,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:34.057180+0000","last_change":"2023-12-16T20:49:34.057203+0000","last_active":"2023-12-16T20:49:34.057180+0000","last_peered":"2023-12-16T20:49:34.057180+0000","last_clean":"2023-12-16T20:49:34.057180+0000","last_became_active":"2023-12-16T20:21:35.419409+0000","last_became_peered":"2023-12-16T20:21:35.419409+0000","last_unstale":"2023-12-16T20:49:34.057180+0000","last_undegraded":"2023-12-16T20:49:34.057180+0000","last_fullsized":"2023-12-16T20:49:34.057180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'687","last_scrub_stamp":"2023-12-16T20:49:34.057124+0000","last_deep_scrub":"27'687","last_deep_scrub_stamp":"2023-12-16T20:49:34.057124+0000","last_clean_scrub_stamp":"2023-12-16T20:49:34.057124+0000","objects_scrubbed":1,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:18:49.932557+0000","scrub_duration":0.013116096000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":4443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'33","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:27.400108+0000","last_change":"2023-12-16T20:49:27.400127+0000","last_active":"2023-12-16T20:49:27.400108+0000","last_peered":"2023-12-16T20:49:27.400108+0000","last_clean":"2023-12-16T20:49:27.400108+0000","last_became_active":"2023-12-16T20:21:36.533325+0000","last_became_peered":"2023-12-16T20:21:36.533325+0000","last_unstale":"2023-12-16T20:49:27.400108+0000","last_undegraded":"2023-12-16T20:49:27.400108+0000","last_fullsized":"2023-12-16T20:49:27.400108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:27.400042+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:27.400042+0000","last_clean_scrub_stamp":"2023-12-16T20:49:27.400042+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:05:59.365345+0000","scrub_duration":0.001383497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'165","reported_seq":192,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:11.539055+0000","last_change":"2023-12-16T20:21:40.745455+0000","last_active":"2023-12-16T20:49:11.539055+0000","last_peered":"2023-12-16T20:49:11.539055+0000","last_clean":"2023-12-16T20:49:11.539055+0000","last_became_active":"2023-12-16T20:21:40.744731+0000","last_became_peered":"2023-12-16T20:21:40.744731+0000","last_unstale":"2023-12-16T20:49:11.539055+0000","last_undegraded":"2023-12-16T20:49:11.539055+0000","last_fullsized":"2023-12-16T20:49:11.539055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:39.602550+0000","last_clean_scrub_stamp":"2023-12-16T20:21:39.602550+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":13136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'49","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:00.954202+0000","last_change":"2023-12-16T20:50:00.954235+0000","last_active":"2023-12-16T20:50:00.954202+0000","last_peered":"2023-12-16T20:50:00.954202+0000","last_clean":"2023-12-16T20:50:00.954202+0000","last_became_active":"2023-12-16T20:21:36.542287+0000","last_became_peered":"2023-12-16T20:21:36.542287+0000","last_unstale":"2023-12-16T20:50:00.954202+0000","last_undegraded":"2023-12-16T20:50:00.954202+0000","last_fullsized":"2023-12-16T20:50:00.954202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2023-12-16T20:50:00.954129+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2023-12-16T20:50:00.954129+0000","last_clean_scrub_stamp":"2023-12-16T20:50:00.954129+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:04.152907+0000","scrub_duration":0.0011496799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'51","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:38.084320+0000","last_change":"2023-12-16T20:49:38.084340+0000","last_active":"2023-12-16T20:49:38.084320+0000","last_peered":"2023-12-16T20:49:38.084320+0000","last_clean":"2023-12-16T20:49:38.084320+0000","last_became_active":"2023-12-16T20:21:36.550911+0000","last_became_peered":"2023-12-16T20:21:36.550911+0000","last_unstale":"2023-12-16T20:49:38.084320+0000","last_undegraded":"2023-12-16T20:49:38.084320+0000","last_fullsized":"2023-12-16T20:49:38.084320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2023-12-16T20:49:38.084254+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2023-12-16T20:49:38.084254+0000","last_clean_scrub_stamp":"2023-12-16T20:49:38.084254+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:53:36.801901+0000","scrub_duration":0.0010491820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'50","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:56.639838+0000","last_change":"2023-12-16T20:49:56.639875+0000","last_active":"2023-12-16T20:49:56.639838+0000","last_peered":"2023-12-16T20:49:56.639838+0000","last_clean":"2023-12-16T20:49:56.639838+0000","last_became_active":"2023-12-16T20:21:36.555822+0000","last_became_peered":"2023-12-16T20:21:36.555822+0000","last_unstale":"2023-12-16T20:49:56.639838+0000","last_undegraded":"2023-12-16T20:49:56.639838+0000","last_fullsized":"2023-12-16T20:49:56.639838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2023-12-16T20:49:56.639706+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2023-12-16T20:49:56.639706+0000","last_clean_scrub_stamp":"2023-12-16T20:49:56.639706+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:23:39.863493+0000","scrub_duration":0.0012747139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'35","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:33.218396+0000","last_change":"2023-12-16T20:49:33.218419+0000","last_active":"2023-12-16T20:49:33.218396+0000","last_peered":"2023-12-16T20:49:33.218396+0000","last_clean":"2023-12-16T20:49:33.218396+0000","last_became_active":"2023-12-16T20:21:36.524747+0000","last_became_peered":"2023-12-16T20:21:36.524747+0000","last_unstale":"2023-12-16T20:49:33.218396+0000","last_undegraded":"2023-12-16T20:49:33.218396+0000","last_fullsized":"2023-12-16T20:49:33.218396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-12-16T20:49:33.218309+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-12-16T20:49:33.218309+0000","last_clean_scrub_stamp":"2023-12-16T20:49:33.218309+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:06:49.056161+0000","scrub_duration":0.001493435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'29","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:39.987522+0000","last_change":"2023-12-16T20:49:39.987522+0000","last_active":"2023-12-16T20:49:39.987522+0000","last_peered":"2023-12-16T20:49:39.987522+0000","last_clean":"2023-12-16T20:49:39.987522+0000","last_became_active":"2023-12-16T20:21:36.533682+0000","last_became_peered":"2023-12-16T20:21:36.533682+0000","last_unstale":"2023-12-16T20:49:39.987522+0000","last_undegraded":"2023-12-16T20:49:39.987522+0000","last_fullsized":"2023-12-16T20:49:39.987522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2023-12-16T20:49:39.987436+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2023-12-16T20:49:39.987436+0000","last_clean_scrub_stamp":"2023-12-16T20:49:39.987436+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:23:23.211223+0000","scrub_duration":0.001185576,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'35","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:32.165280+0000","last_change":"2023-12-16T20:49:32.165280+0000","last_active":"2023-12-16T20:49:32.165280+0000","last_peered":"2023-12-16T20:49:32.165280+0000","last_clean":"2023-12-16T20:49:32.165280+0000","last_became_active":"2023-12-16T20:21:36.519545+0000","last_became_peered":"2023-12-16T20:21:36.519545+0000","last_unstale":"2023-12-16T20:49:32.165280+0000","last_undegraded":"2023-12-16T20:49:32.165280+0000","last_fullsized":"2023-12-16T20:49:32.165280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-12-16T20:49:32.165177+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-12-16T20:49:32.165177+0000","last_clean_scrub_stamp":"2023-12-16T20:49:32.165177+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:54.010717+0000","scrub_duration":0.001316684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'45","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:50.062054+0000","last_change":"2023-12-16T20:49:50.062089+0000","last_active":"2023-12-16T20:49:50.062054+0000","last_peered":"2023-12-16T20:49:50.062054+0000","last_clean":"2023-12-16T20:49:50.062054+0000","last_became_active":"2023-12-16T20:21:36.542184+0000","last_became_peered":"2023-12-16T20:21:36.542184+0000","last_unstale":"2023-12-16T20:49:50.062054+0000","last_undegraded":"2023-12-16T20:49:50.062054+0000","last_fullsized":"2023-12-16T20:49:50.062054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-16T20:49:50.061973+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-16T20:49:50.061973+0000","last_clean_scrub_stamp":"2023-12-16T20:49:50.061973+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:23:02.132043+0000","scrub_duration":0.0011178239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'32","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:28.026851+0000","last_change":"2023-12-16T20:49:28.026851+0000","last_active":"2023-12-16T20:49:28.026851+0000","last_peered":"2023-12-16T20:49:28.026851+0000","last_clean":"2023-12-16T20:49:28.026851+0000","last_became_active":"2023-12-16T20:21:36.536439+0000","last_became_peered":"2023-12-16T20:21:36.536439+0000","last_unstale":"2023-12-16T20:49:28.026851+0000","last_undegraded":"2023-12-16T20:49:28.026851+0000","last_fullsized":"2023-12-16T20:49:28.026851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2023-12-16T20:49:28.026722+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2023-12-16T20:49:28.026722+0000","last_clean_scrub_stamp":"2023-12-16T20:49:28.026722+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:39:31.846535+0000","scrub_duration":0.0019544250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'33","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:58.621856+0000","last_change":"2023-12-16T20:49:58.621878+0000","last_active":"2023-12-16T20:49:58.621856+0000","last_peered":"2023-12-16T20:49:58.621856+0000","last_clean":"2023-12-16T20:49:58.621856+0000","last_became_active":"2023-12-16T20:21:36.555100+0000","last_became_peered":"2023-12-16T20:21:36.555100+0000","last_unstale":"2023-12-16T20:49:58.621856+0000","last_undegraded":"2023-12-16T20:49:58.621856+0000","last_fullsized":"2023-12-16T20:49:58.621856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:58.621786+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:58.621786+0000","last_clean_scrub_stamp":"2023-12-16T20:49:58.621786+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:08:03.691113+0000","scrub_duration":0.001138752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'45","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:48.927941+0000","last_change":"2023-12-16T20:49:48.927959+0000","last_active":"2023-12-16T20:49:48.927941+0000","last_peered":"2023-12-16T20:49:48.927941+0000","last_clean":"2023-12-16T20:49:48.927941+0000","last_became_active":"2023-12-16T20:21:36.535600+0000","last_became_peered":"2023-12-16T20:21:36.535600+0000","last_unstale":"2023-12-16T20:49:48.927941+0000","last_undegraded":"2023-12-16T20:49:48.927941+0000","last_fullsized":"2023-12-16T20:49:48.927941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-16T20:49:48.927877+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-16T20:49:48.927877+0000","last_clean_scrub_stamp":"2023-12-16T20:49:48.927877+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:42:58.860704+0000","scrub_duration":0.001139078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'38","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:25.854415+0000","last_change":"2023-12-16T20:49:25.854454+0000","last_active":"2023-12-16T20:49:25.854415+0000","last_peered":"2023-12-16T20:49:25.854415+0000","last_clean":"2023-12-16T20:49:25.854415+0000","last_became_active":"2023-12-16T20:21:36.553155+0000","last_became_peered":"2023-12-16T20:21:36.553155+0000","last_unstale":"2023-12-16T20:49:25.854415+0000","last_undegraded":"2023-12-16T20:49:25.854415+0000","last_fullsized":"2023-12-16T20:49:25.854415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:25.854334+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:25.854334+0000","last_clean_scrub_stamp":"2023-12-16T20:49:25.854334+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:47.699873+0000","scrub_duration":0.001008225,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'50","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.280447+0000","last_change":"2023-12-16T20:49:37.280466+0000","last_active":"2023-12-16T20:49:37.280447+0000","last_peered":"2023-12-16T20:49:37.280447+0000","last_clean":"2023-12-16T20:49:37.280447+0000","last_became_active":"2023-12-16T20:21:36.524166+0000","last_became_peered":"2023-12-16T20:21:36.524166+0000","last_unstale":"2023-12-16T20:49:37.280447+0000","last_undegraded":"2023-12-16T20:49:37.280447+0000","last_fullsized":"2023-12-16T20:49:37.280447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2023-12-16T20:49:37.280377+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2023-12-16T20:49:37.280377+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.280377+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:22:49.350447+0000","scrub_duration":0.0010662930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'45","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:58.006262+0000","last_change":"2023-12-16T20:49:58.006282+0000","last_active":"2023-12-16T20:49:58.006262+0000","last_peered":"2023-12-16T20:49:58.006262+0000","last_clean":"2023-12-16T20:49:58.006262+0000","last_became_active":"2023-12-16T20:21:36.542191+0000","last_became_peered":"2023-12-16T20:21:36.542191+0000","last_unstale":"2023-12-16T20:49:58.006262+0000","last_undegraded":"2023-12-16T20:49:58.006262+0000","last_fullsized":"2023-12-16T20:49:58.006262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-16T20:49:58.006139+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-16T20:49:58.006139+0000","last_clean_scrub_stamp":"2023-12-16T20:49:58.006139+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:07:10.295523+0000","scrub_duration":0.0011112299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'35","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:19.988486+0000","last_change":"2023-12-16T20:22:14.772163+0000","last_active":"2023-12-16T20:49:19.988486+0000","last_peered":"2023-12-16T20:49:19.988486+0000","last_clean":"2023-12-16T20:49:19.988486+0000","last_became_active":"2023-12-16T20:22:14.771830+0000","last_became_peered":"2023-12-16T20:22:14.771830+0000","last_unstale":"2023-12-16T20:49:19.988486+0000","last_undegraded":"2023-12-16T20:49:19.988486+0000","last_fullsized":"2023-12-16T20:49:19.988486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"27'47","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:43.949523+0000","last_change":"2023-12-16T20:49:43.949543+0000","last_active":"2023-12-16T20:49:43.949523+0000","last_peered":"2023-12-16T20:49:43.949523+0000","last_clean":"2023-12-16T20:49:43.949523+0000","last_became_active":"2023-12-16T20:21:36.544225+0000","last_became_peered":"2023-12-16T20:21:36.544225+0000","last_unstale":"2023-12-16T20:49:43.949523+0000","last_undegraded":"2023-12-16T20:49:43.949523+0000","last_fullsized":"2023-12-16T20:49:43.949523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2023-12-16T20:49:43.949450+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2023-12-16T20:49:43.949450+0000","last_clean_scrub_stamp":"2023-12-16T20:49:43.949450+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:10:23.974459+0000","scrub_duration":0.0010557469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'40","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:23.046998+0000","last_change":"2023-12-16T20:21:36.554370+0000","last_active":"2023-12-16T20:49:23.046998+0000","last_peered":"2023-12-16T20:49:23.046998+0000","last_clean":"2023-12-16T20:49:23.046998+0000","last_became_active":"2023-12-16T20:21:36.554130+0000","last_became_peered":"2023-12-16T20:21:36.554130+0000","last_unstale":"2023-12-16T20:49:23.046998+0000","last_undegraded":"2023-12-16T20:49:23.046998+0000","last_fullsized":"2023-12-16T20:49:23.046998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'45","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:23.046987+0000","last_change":"2023-12-16T20:21:36.555346+0000","last_active":"2023-12-16T20:49:23.046987+0000","last_peered":"2023-12-16T20:49:23.046987+0000","last_clean":"2023-12-16T20:49:23.046987+0000","last_became_active":"2023-12-16T20:21:36.554772+0000","last_became_peered":"2023-12-16T20:21:36.554772+0000","last_unstale":"2023-12-16T20:49:23.046987+0000","last_undegraded":"2023-12-16T20:49:23.046987+0000","last_fullsized":"2023-12-16T20:49:23.046987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'44","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:01.198151+0000","last_change":"2023-12-16T20:50:01.198172+0000","last_active":"2023-12-16T20:50:01.198151+0000","last_peered":"2023-12-16T20:50:01.198151+0000","last_clean":"2023-12-16T20:50:01.198151+0000","last_became_active":"2023-12-16T20:21:36.534307+0000","last_became_peered":"2023-12-16T20:21:36.534307+0000","last_unstale":"2023-12-16T20:50:01.198151+0000","last_undegraded":"2023-12-16T20:50:01.198151+0000","last_fullsized":"2023-12-16T20:50:01.198151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2023-12-16T20:50:01.198074+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2023-12-16T20:50:01.198074+0000","last_clean_scrub_stamp":"2023-12-16T20:50:01.198074+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:47:37.032895+0000","scrub_duration":0.001109161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'40","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:34.267761+0000","last_change":"2023-12-16T20:49:34.267761+0000","last_active":"2023-12-16T20:49:34.267761+0000","last_peered":"2023-12-16T20:49:34.267761+0000","last_clean":"2023-12-16T20:49:34.267761+0000","last_became_active":"2023-12-16T20:21:36.525427+0000","last_became_peered":"2023-12-16T20:21:36.525427+0000","last_unstale":"2023-12-16T20:49:34.267761+0000","last_undegraded":"2023-12-16T20:49:34.267761+0000","last_fullsized":"2023-12-16T20:49:34.267761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2023-12-16T20:49:34.267634+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2023-12-16T20:49:34.267634+0000","last_clean_scrub_stamp":"2023-12-16T20:49:34.267634+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:39:38.087447+0000","scrub_duration":0.00089495000000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'36","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:42.936238+0000","last_change":"2023-12-16T20:49:42.936276+0000","last_active":"2023-12-16T20:49:42.936238+0000","last_peered":"2023-12-16T20:49:42.936238+0000","last_clean":"2023-12-16T20:49:42.936238+0000","last_became_active":"2023-12-16T20:21:36.542513+0000","last_became_peered":"2023-12-16T20:21:36.542513+0000","last_unstale":"2023-12-16T20:49:42.936238+0000","last_undegraded":"2023-12-16T20:49:42.936238+0000","last_fullsized":"2023-12-16T20:49:42.936238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2023-12-16T20:49:42.936104+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2023-12-16T20:49:42.936104+0000","last_clean_scrub_stamp":"2023-12-16T20:49:42.936104+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:41:03.614700+0000","scrub_duration":0.0018757719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:33.399940+0000","last_change":"2023-12-16T20:49:33.399965+0000","last_active":"2023-12-16T20:49:33.399940+0000","last_peered":"2023-12-16T20:49:33.399940+0000","last_clean":"2023-12-16T20:49:33.399940+0000","last_became_active":"2023-12-16T20:21:36.544492+0000","last_became_peered":"2023-12-16T20:21:36.544492+0000","last_unstale":"2023-12-16T20:49:33.399940+0000","last_undegraded":"2023-12-16T20:49:33.399940+0000","last_fullsized":"2023-12-16T20:49:33.399940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-12-16T20:49:33.399843+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-12-16T20:49:33.399843+0000","last_clean_scrub_stamp":"2023-12-16T20:49:33.399843+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:25:07.939906+0000","scrub_duration":0.0012000960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'38","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.889657+0000","last_change":"2023-12-16T20:22:14.769644+0000","last_active":"2023-12-16T20:49:08.889657+0000","last_peered":"2023-12-16T20:49:08.889657+0000","last_clean":"2023-12-16T20:49:08.889657+0000","last_became_active":"2023-12-16T20:22:14.769348+0000","last_became_peered":"2023-12-16T20:22:14.769348+0000","last_unstale":"2023-12-16T20:49:08.889657+0000","last_undegraded":"2023-12-16T20:49:08.889657+0000","last_fullsized":"2023-12-16T20:49:08.889657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'50","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:52.064542+0000","last_change":"2023-12-16T20:49:52.064563+0000","last_active":"2023-12-16T20:49:52.064542+0000","last_peered":"2023-12-16T20:49:52.064542+0000","last_clean":"2023-12-16T20:49:52.064542+0000","last_became_active":"2023-12-16T20:21:36.550815+0000","last_became_peered":"2023-12-16T20:21:36.550815+0000","last_unstale":"2023-12-16T20:49:52.064542+0000","last_undegraded":"2023-12-16T20:49:52.064542+0000","last_fullsized":"2023-12-16T20:49:52.064542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2023-12-16T20:49:52.064464+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2023-12-16T20:49:52.064464+0000","last_clean_scrub_stamp":"2023-12-16T20:49:52.064464+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:25:38.891898+0000","scrub_duration":0.0011038790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'42","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.903872+0000","last_change":"2023-12-16T20:21:36.554041+0000","last_active":"2023-12-16T20:49:08.903872+0000","last_peered":"2023-12-16T20:49:08.903872+0000","last_clean":"2023-12-16T20:49:08.903872+0000","last_became_active":"2023-12-16T20:21:36.553708+0000","last_became_peered":"2023-12-16T20:21:36.553708+0000","last_unstale":"2023-12-16T20:49:08.903872+0000","last_undegraded":"2023-12-16T20:49:08.903872+0000","last_fullsized":"2023-12-16T20:49:08.903872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'29","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:44.959365+0000","last_change":"2023-12-16T20:49:44.959383+0000","last_active":"2023-12-16T20:49:44.959365+0000","last_peered":"2023-12-16T20:49:44.959365+0000","last_clean":"2023-12-16T20:49:44.959365+0000","last_became_active":"2023-12-16T20:21:36.551066+0000","last_became_peered":"2023-12-16T20:21:36.551066+0000","last_unstale":"2023-12-16T20:49:44.959365+0000","last_undegraded":"2023-12-16T20:49:44.959365+0000","last_fullsized":"2023-12-16T20:49:44.959365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2023-12-16T20:49:44.959299+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2023-12-16T20:49:44.959299+0000","last_clean_scrub_stamp":"2023-12-16T20:49:44.959299+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:55:02.095074+0000","scrub_duration":0.001193115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'37","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:56.736482+0000","last_change":"2023-12-16T20:49:56.736503+0000","last_active":"2023-12-16T20:49:56.736482+0000","last_peered":"2023-12-16T20:49:56.736482+0000","last_clean":"2023-12-16T20:49:56.736482+0000","last_became_active":"2023-12-16T20:21:36.523604+0000","last_became_peered":"2023-12-16T20:21:36.523604+0000","last_unstale":"2023-12-16T20:49:56.736482+0000","last_undegraded":"2023-12-16T20:49:56.736482+0000","last_fullsized":"2023-12-16T20:49:56.736482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2023-12-16T20:49:56.736375+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2023-12-16T20:49:56.736375+0000","last_clean_scrub_stamp":"2023-12-16T20:49:56.736375+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:05:42.874908+0000","scrub_duration":0.0011361520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'39","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.823536+0000","last_change":"2023-12-16T20:21:36.556286+0000","last_active":"2023-12-16T20:49:08.823536+0000","last_peered":"2023-12-16T20:49:08.823536+0000","last_clean":"2023-12-16T20:49:08.823536+0000","last_became_active":"2023-12-16T20:21:36.556041+0000","last_became_peered":"2023-12-16T20:21:36.556041+0000","last_unstale":"2023-12-16T20:49:08.823536+0000","last_undegraded":"2023-12-16T20:49:08.823536+0000","last_fullsized":"2023-12-16T20:49:08.823536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'39","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.904361+0000","last_change":"2023-12-16T20:21:36.518408+0000","last_active":"2023-12-16T20:49:08.904361+0000","last_peered":"2023-12-16T20:49:08.904361+0000","last_clean":"2023-12-16T20:49:08.904361+0000","last_became_active":"2023-12-16T20:21:36.518138+0000","last_became_peered":"2023-12-16T20:21:36.518138+0000","last_unstale":"2023-12-16T20:49:08.904361+0000","last_undegraded":"2023-12-16T20:49:08.904361+0000","last_fullsized":"2023-12-16T20:49:08.904361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'24","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:54.686358+0000","last_change":"2023-12-16T20:49:54.686383+0000","last_active":"2023-12-16T20:49:54.686358+0000","last_peered":"2023-12-16T20:49:54.686358+0000","last_clean":"2023-12-16T20:49:54.686358+0000","last_became_active":"2023-12-16T20:21:36.555041+0000","last_became_peered":"2023-12-16T20:21:36.555041+0000","last_unstale":"2023-12-16T20:49:54.686358+0000","last_undegraded":"2023-12-16T20:49:54.686358+0000","last_fullsized":"2023-12-16T20:49:54.686358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2023-12-16T20:49:54.686275+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2023-12-16T20:49:54.686275+0000","last_clean_scrub_stamp":"2023-12-16T20:49:54.686275+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:09:43.952858+0000","scrub_duration":0.0012757529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'44","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:27.192471+0000","last_change":"2023-12-16T20:49:27.192490+0000","last_active":"2023-12-16T20:49:27.192471+0000","last_peered":"2023-12-16T20:49:27.192471+0000","last_clean":"2023-12-16T20:49:27.192471+0000","last_became_active":"2023-12-16T20:21:36.523784+0000","last_became_peered":"2023-12-16T20:21:36.523784+0000","last_unstale":"2023-12-16T20:49:27.192471+0000","last_undegraded":"2023-12-16T20:49:27.192471+0000","last_fullsized":"2023-12-16T20:49:27.192471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2023-12-16T20:49:27.192403+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2023-12-16T20:49:27.192403+0000","last_clean_scrub_stamp":"2023-12-16T20:49:27.192403+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:22:46.903808+0000","scrub_duration":0.001038298,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'36","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.798823+0000","last_change":"2023-12-16T20:21:36.526391+0000","last_active":"2023-12-16T20:49:08.798823+0000","last_peered":"2023-12-16T20:49:08.798823+0000","last_clean":"2023-12-16T20:49:08.798823+0000","last_became_active":"2023-12-16T20:21:36.526151+0000","last_became_peered":"2023-12-16T20:21:36.526151+0000","last_unstale":"2023-12-16T20:49:08.798823+0000","last_undegraded":"2023-12-16T20:49:08.798823+0000","last_fullsized":"2023-12-16T20:49:08.798823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'28","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.900881+0000","last_change":"2023-12-16T20:21:36.543566+0000","last_active":"2023-12-16T20:49:08.900881+0000","last_peered":"2023-12-16T20:49:08.900881+0000","last_clean":"2023-12-16T20:49:08.900881+0000","last_became_active":"2023-12-16T20:21:36.543306+0000","last_became_peered":"2023-12-16T20:21:36.543306+0000","last_unstale":"2023-12-16T20:49:08.900881+0000","last_undegraded":"2023-12-16T20:49:08.900881+0000","last_fullsized":"2023-12-16T20:49:08.900881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4117,"num_write_kb":324188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4666,"ondisk_log_size":4666,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2442,"ondisk_log_size":2442,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40469915,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1038,"num_read_kb":1098,"num_write":9075,"num_write_kb":44922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56229888,"data_stored":80939830,"data_compressed":7486620,"data_compressed_allocated":11714560,"data_compressed_original":36487168,"omap_allocated":0,"internal_metadata":0},"log_size":8644,"ondisk_log_size":8644,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65176,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575196,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84588,"kb_used_data":17316,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94287252,"statfs":{"total":96636764160,"available":96550146048,"internally_reserved":0,"allocated":17731584,"data_stored":25875293,"data_compressed":2385754,"data_compressed_allocated":3723264,"data_compressed_original":12046336,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.41599999999999998,"15min":0.40100000000000002},"min":{"1min":0.26900000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.70499999999999996,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.432,"15min":0.42599999999999999},"min":{"1min":0.313,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.51900000000000002}]},{"osd":1,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.438,"15min":0.42399999999999999},"min":{"1min":0.32000000000000001,"5min":0.24399999999999999,"15min":0.23799999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.41899999999999998},"min":{"1min":0.34799999999999998,"5min":0.27200000000000002,"15min":0.252},"max":{"1min":0.71699999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.498}]},{"osd":2,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42199999999999999,"15min":0.41199999999999998},"min":{"1min":0.31,"5min":0.254,"15min":0.254},"max":{"1min":0.66600000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.44700000000000001},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.29099999999999998},"max":{"1min":0.60599999999999998,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.56200000000000006}]},{"osd":3,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.45100000000000001,"15min":0.434},"min":{"1min":0.34699999999999998,"5min":0.28799999999999998,"15min":0.28000000000000003},"max":{"1min":0.63100000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.379,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.77300000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54300000000000004}]},{"osd":4,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.378,"15min":0.35999999999999999},"min":{"1min":0.27500000000000002,"5min":0.23200000000000001,"15min":0.20499999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38100000000000001,"15min":0.374},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.20899999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.34499999999999997}]},{"osd":5,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38900000000000001,"15min":0.38500000000000001},"min":{"1min":0.25800000000000001,"5min":0.24199999999999999,"15min":0.24099999999999999},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.72099999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.30399999999999999,"5min":0.25900000000000001,"15min":0.255},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.65700000000000003},"last":0.438}]},{"osd":6,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.29399999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.443},"min":{"1min":0.27900000000000003,"5min":0.246,"15min":0.246},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.39300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575196,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57068,"kb_used_data":12004,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94314772,"statfs":{"total":96636764160,"available":96578326528,"internally_reserved":0,"allocated":12292096,"data_stored":16896407,"data_compressed":1393950,"data_compressed_allocated":2220032,"data_compressed_original":7004160,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.39200000000000002,"15min":0.39900000000000002},"min":{"1min":0.31,"5min":0.23200000000000001,"15min":0.217},"max":{"1min":0.57999999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.432,"15min":0.432},"min":{"1min":0.313,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.67100000000000004},"last":0.63700000000000001}]},{"osd":1,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.33800000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.68200000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42999999999999999,"15min":0.42699999999999999},"min":{"1min":0.32600000000000001,"5min":0.26500000000000001,"15min":0.26400000000000001},"max":{"1min":0.65500000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.70499999999999996}]},{"osd":2,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.35899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.65900000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.314,"5min":0.29799999999999999,"15min":0.253},"max":{"1min":0.60799999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.53500000000000003}]},{"osd":3,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45500000000000002,"15min":0.44},"min":{"1min":0.35199999999999998,"5min":0.30599999999999999,"15min":0.26500000000000001},"max":{"1min":0.64600000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.442,"15min":0.44600000000000001},"min":{"1min":0.36299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.55500000000000005}]},{"osd":4,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38400000000000001,"15min":0.373},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.217},"max":{"1min":0.625,"5min":0.625,"15min":0.64000000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.25900000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.42599999999999999}]},{"osd":5,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.38300000000000001,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.26600000000000001,"15min":0.23300000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.442},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.42399999999999999},"min":{"1min":0.27900000000000003,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.45100000000000001}]},{"osd":7,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.42999999999999999},"min":{"1min":0.30299999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.373},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.42399999999999999,"15min":0.434},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.747},"last":0.40899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575196,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":118609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.42399999999999999,"15min":0.42699999999999999},"min":{"1min":0.33600000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64200000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.41799999999999998,"15min":0.41399999999999998},"min":{"1min":0.27600000000000002,"5min":0.252,"15min":0.24399999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.40000000000000002}]},{"osd":1,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.34399999999999997,"5min":0.27600000000000002,"15min":0.25600000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.42699999999999999},"min":{"1min":0.32000000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.35199999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.441,"15min":0.434},"min":{"1min":0.33500000000000002,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.36899999999999999}]},{"osd":3,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29499999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.35699999999999998,"5min":0.312,"15min":0.28199999999999997},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.57099999999999995}]},{"osd":4,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.371,"15min":0.36199999999999999},"min":{"1min":0.26200000000000001,"5min":0.24199999999999999,"15min":0.224},"max":{"1min":0.60099999999999998,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38600000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.22600000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.58399999999999996}]},{"osd":6,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39500000000000002,"15min":0.38500000000000001},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.24199999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.68999999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.433,"15min":0.41799999999999998},"min":{"1min":0.30199999999999999,"5min":0.28000000000000003,"15min":0.26700000000000002},"max":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.72099999999999997},"last":0.54800000000000004}]},{"osd":7,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.432,"15min":0.432},"min":{"1min":0.27700000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46200000000000002,"15min":0.44800000000000001},"min":{"1min":0.318,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.60499999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575196,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65112,"kb_used_data":7568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94306728,"statfs":{"total":96636764160,"available":96570089472,"internally_reserved":0,"allocated":7749632,"data_stored":11004073,"data_compressed":1082070,"data_compressed_allocated":1703936,"data_compressed_original":5144576,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.434,"15min":0.42199999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.441,"15min":0.432},"min":{"1min":0.34699999999999998,"5min":0.26600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57999999999999996,"5min":0.65300000000000002,"15min":0.68899999999999995},"last":0.61399999999999999}]},{"osd":1,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45300000000000001,"15min":0.439},"min":{"1min":0.32700000000000001,"5min":0.29799999999999999,"15min":0.27900000000000003},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42799999999999999,"15min":0.41999999999999998},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.26600000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.627}]},{"osd":2,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.436,"15min":0.42799999999999999},"min":{"1min":0.29099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.379,"5min":0.311,"15min":0.309},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.66300000000000003}]},{"osd":3,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44500000000000001,"15min":0.43099999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.27900000000000003},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47299999999999998,"15min":0.46400000000000002},"min":{"1min":0.32500000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.79400000000000004},"last":0.59699999999999998}]},{"osd":5,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.377,"15min":0.38200000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.39700000000000002,"15min":0.39000000000000001},"min":{"1min":0.26600000000000001,"5min":0.26300000000000001,"15min":0.22},"max":{"1min":0.50800000000000001,"5min":0.58999999999999997,"15min":0.63100000000000001},"last":0.52500000000000002}]},{"osd":6,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39600000000000002,"15min":0.39500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23799999999999999},"max":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.75},"last":0.437},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.443,"15min":0.435},"min":{"1min":0.29799999999999999,"5min":0.26400000000000001,"15min":0.22600000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.54000000000000004}]},{"osd":7,"last update":"Sat Dec 16 20:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.432,"15min":0.42999999999999999},"min":{"1min":0.29999999999999999,"5min":0.28899999999999998,"15min":0.25600000000000001},"max":{"1min":0.60299999999999998,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46200000000000002,"15min":0.45900000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27000000000000002},"max":{"1min":0.59199999999999997,"5min":0.63400000000000001,"15min":0.77600000000000002},"last":0.504}]}]},{"osd":3,"up_from":13,"seq":55834575196,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58848,"kb_used_data":9624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312992,"statfs":{"total":96636764160,"available":96576503808,"internally_reserved":0,"allocated":9854976,"data_stored":12924992,"data_compressed":1002682,"data_compressed_allocated":1646592,"data_compressed_original":4898816,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.28999999999999998,"15min":0.28499999999999998},"min":{"1min":0.218,"5min":0.191,"15min":0.17699999999999999},"max":{"1min":0.40699999999999997,"5min":0.48699999999999999,"15min":0.52600000000000002},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.30399999999999999,"15min":0.29699999999999999},"min":{"1min":0.20799999999999999,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.38300000000000001,"5min":0.48899999999999999,"15min":0.56999999999999995},"last":0.28899999999999998}]},{"osd":1,"last update":"Sat Dec 16 20:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.308,"15min":0.30099999999999999},"min":{"1min":0.246,"5min":0.186,"15min":0.186},"max":{"1min":0.42399999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.312,"5min":0.32100000000000001,"15min":0.32300000000000001},"min":{"1min":0.22500000000000001,"5min":0.21099999999999999,"15min":0.19900000000000001},"max":{"1min":0.435,"5min":0.48299999999999998,"15min":0.56100000000000005},"last":0.34399999999999997}]},{"osd":2,"last update":"Sat Dec 16 20:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.32900000000000001,"15min":0.33200000000000002},"min":{"1min":0.253,"5min":0.23499999999999999,"15min":0.222},"max":{"1min":0.39200000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35599999999999998,"15min":0.35199999999999998},"min":{"1min":0.28100000000000003,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":0.441,"5min":0.51100000000000001,"15min":0.53600000000000003},"last":0.316}]},{"osd":4,"last update":"Sat Dec 16 20:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.41299999999999998,"15min":0.41499999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.44600000000000001,"15min":0.44},"min":{"1min":0.34399999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66400000000000003,"5min":0.70399999999999996,"15min":0.72399999999999998},"last":0.55000000000000004}]},{"osd":5,"last update":"Sat Dec 16 20:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.443,"15min":0.441},"min":{"1min":0.36599999999999999,"5min":0.31900000000000001,"15min":0.313},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.76900000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45400000000000001,"15min":0.45600000000000002},"min":{"1min":0.36099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.71599999999999997},"last":0.54000000000000004}]},{"osd":6,"last update":"Sat Dec 16 20:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.44600000000000001},"min":{"1min":0.35099999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.73599999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46500000000000002,"15min":0.46300000000000002},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.317},"max":{"1min":0.63900000000000001,"5min":0.66700000000000004,"15min":0.75},"last":0.47399999999999998}]},{"osd":7,"last update":"Sat Dec 16 20:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48799999999999999,"15min":0.48199999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34000000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.46600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575196,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":341408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.309,"15min":0.30299999999999999},"min":{"1min":0.215,"5min":0.18099999999999999,"15min":0.17000000000000001},"max":{"1min":0.47299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.317,"5min":0.30299999999999999,"15min":0.30199999999999999},"min":{"1min":0.224,"5min":0.189,"15min":0.189},"max":{"1min":0.53400000000000003,"5min":0.55800000000000005,"15min":0.623},"last":0.376}]},{"osd":1,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.248,"5min":0.23300000000000001,"15min":0.193},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.32100000000000001,"15min":0.32800000000000001},"min":{"1min":0.23499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.54800000000000004},"last":0.50700000000000001}]},{"osd":3,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.32800000000000001,"15min":0.32500000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36199999999999999,"15min":0.36299999999999999},"min":{"1min":0.26200000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.56699999999999995,"5min":0.57799999999999996,"15min":0.60599999999999998},"last":0.47799999999999998}]},{"osd":4,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.36199999999999999,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.432,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.29499999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.49399999999999999}]},{"osd":5,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.34899999999999998,"5min":0.311,"15min":0.30299999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.67000000000000004},"last":0.52200000000000002}]},{"osd":6,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.441},{"interface":"front","average":{"1min":0.499,"5min":0.48299999999999998,"15min":0.47599999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.32500000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.77400000000000002},"last":0.58699999999999997}]},{"osd":7,"last update":"Sat Dec 16 20:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.47299999999999998},"min":{"1min":0.35999999999999999,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.64000000000000001,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.46000000000000002,"15min":0.46200000000000002},"min":{"1min":0.35999999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.55100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575196,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42460,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329380,"statfs":{"total":96636764160,"available":96593285120,"internally_reserved":0,"allocated":3035136,"data_stored":4312983,"data_compressed":488319,"data_compressed_allocated":745472,"data_compressed_original":2203648,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.28299999999999997,"15min":0.27900000000000003},"min":{"1min":0.22,"5min":0.184,"15min":0.16800000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.61499999999999999},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.309,"15min":0.315},"min":{"1min":0.22,"5min":0.218,"15min":0.21199999999999999},"max":{"1min":0.495,"5min":0.495,"15min":0.55500000000000005},"last":0.29599999999999999}]},{"osd":2,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.29199999999999998,"15min":0.29399999999999998},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32100000000000001},"min":{"1min":0.24099999999999999,"5min":0.221,"15min":0.20999999999999999},"max":{"1min":0.502,"5min":0.502,"15min":0.58499999999999996},"last":0.34100000000000003}]},{"osd":3,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34699999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.55800000000000005},"last":0.316},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.34599999999999997,"15min":0.34200000000000003},"min":{"1min":0.24399999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.59699999999999998},"last":0.33000000000000002}]},{"osd":4,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.40999999999999998},"min":{"1min":0.34799999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.438},"min":{"1min":0.36199999999999999,"5min":0.32100000000000001,"15min":0.307},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.55900000000000005}]},{"osd":5,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.434,"15min":0.442},"min":{"1min":0.34499999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.443,"15min":0.44},"min":{"1min":0.39200000000000002,"5min":0.318,"15min":0.28100000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.47999999999999998}]},{"osd":6,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.433},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.45600000000000002,"15min":0.44900000000000001},"min":{"1min":0.39300000000000002,"5min":0.33300000000000002,"15min":0.29999999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.33700000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.47399999999999998,"15min":0.47899999999999998},"min":{"1min":0.372,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.71799999999999997},"last":0.47199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575196,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60428,"kb_used_data":7044,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311412,"statfs":{"total":96636764160,"available":96574885888,"internally_reserved":0,"allocated":7213056,"data_stored":11594953,"data_compressed":1199021,"data_compressed_allocated":1765376,"data_compressed_original":6336512,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.28100000000000003,"15min":0.28399999999999997},"min":{"1min":0.216,"5min":0.17299999999999999,"15min":0.17100000000000001},"max":{"1min":0.432,"5min":0.48299999999999998,"15min":0.56799999999999995},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.31900000000000001,"15min":0.307},"min":{"1min":0.28499999999999998,"5min":0.20699999999999999,"15min":0.19400000000000001},"max":{"1min":0.48099999999999998,"5min":0.504,"15min":0.57899999999999996},"last":0.23799999999999999}]},{"osd":2,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.315,"15min":0.307},"min":{"1min":0.25700000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.47999999999999998,"5min":0.52300000000000002,"15min":0.54900000000000004},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32200000000000001},"min":{"1min":0.25600000000000001,"5min":0.218,"15min":0.20300000000000001},"max":{"1min":0.42099999999999999,"5min":0.57899999999999996,"15min":0.66400000000000003},"last":0.33500000000000002}]},{"osd":3,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.32900000000000001,"15min":0.32600000000000001},"min":{"1min":0.23999999999999999,"5min":0.22600000000000001,"15min":0.20399999999999999},"max":{"1min":0.48099999999999998,"5min":0.52100000000000002,"15min":0.54100000000000004},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.34100000000000003},"min":{"1min":0.309,"5min":0.23100000000000001,"15min":0.224},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.60999999999999999},"last":0.35099999999999998}]},{"osd":4,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.441,"15min":0.436},"min":{"1min":0.35399999999999998,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.44800000000000001,"15min":0.439},"min":{"1min":0.375,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.42799999999999999}]},{"osd":5,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46800000000000003,"15min":0.44600000000000001},"min":{"1min":0.35899999999999999,"5min":0.32600000000000001,"15min":0.29999999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.376,"5min":0.307,"15min":0.30199999999999999},"max":{"1min":0.64200000000000002,"5min":0.64500000000000002,"15min":0.70399999999999996},"last":0.438}]},{"osd":6,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47999999999999998,"15min":0.47399999999999998},"min":{"1min":0.38100000000000001,"5min":0.35599999999999998,"15min":0.31900000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.71799999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.46200000000000002},"min":{"1min":0.376,"5min":0.32800000000000001,"15min":0.32700000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.45600000000000002}]},{"osd":7,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.5,"15min":0.49199999999999999},"min":{"1min":0.372,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.40500000000000003,"5min":0.34599999999999997,"15min":0.34000000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.44900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6856704,"data_stored":10886066,"data_compressed":1166433,"data_compressed_allocated":1720320,"data_compressed_original":5763072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2744320,"data_stored":4194464,"data_compressed":488319,"data_compressed_allocated":745472,"data_compressed_original":2203648,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":222889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9564160,"data_stored":12806473,"data_compressed":1002682,"data_compressed_allocated":1646592,"data_compressed_original":4898816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7458816,"data_stored":10885554,"data_compressed":1082070,"data_compressed_allocated":1703936,"data_compressed_original":5144576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12001280,"data_stored":16777888,"data_compressed":1393950,"data_compressed_allocated":2220032,"data_compressed_original":7004160,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17375232,"data_stored":25166406,"data_compressed":2353166,"data_compressed_allocated":3678208,"data_compressed_original":11472896,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T20:50:06.454 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.455 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.455 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.455 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.455 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.455 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.456 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.456 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.456 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.456 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.456 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.456 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.456 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.457 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.457 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.457 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.457 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.457 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-16T20:21:39.602550+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=39, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.458 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.458 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.458 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.458 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.458 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.458 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.459 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.459 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.459 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:06.459 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T20:50:26.460 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T20:50:26.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.572+0000 7f30fb083640 1 Processor -- start 2023-12-16T20:50:26.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.572+0000 7f30fb083640 1 -- start start 2023-12-16T20:50:26.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.573+0000 7f30fb083640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f30f40bff00 0x7f30f4159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:26.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.573+0000 7f30fb083640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f30f4156e60 0x7f30f4071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:26.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.573+0000 7f30fb083640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f4072b60 con 0x7f30f41501c0 2023-12-16T20:50:26.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.573+0000 7f30fb083640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f41572d0 con 0x7f30f4156e60 2023-12-16T20:50:26.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.573+0000 7f30fb083640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f40c1a90 con 0x7f30f40bff00 2023-12-16T20:50:26.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.574+0000 7f30f8e1f640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f30f41501c0 0x7f30f4072450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40432/0 (socket says 172.21.15.87:40432) 2023-12-16T20:50:26.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.574+0000 7f30f8e1f640 1 -- 172.21.15.87:0/431412164 learned_addr learned my addr 172.21.15.87:0/431412164 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:50:26.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.574+0000 7f30f3fff640 1 --2- 172.21.15.87:0/431412164 >> v2:172.21.15.195:3300/0 conn(0x7f30f40bff00 0x7f30f4159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:26.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.574+0000 7f30f9620640 1 --2- 172.21.15.87:0/431412164 >> v2:172.21.15.87:3300/0 conn(0x7f30f4156e60 0x7f30f4071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:26.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.576+0000 7f30f3fff640 1 -- 172.21.15.87:0/431412164 >> v2:172.21.15.87:3300/0 conn(0x7f30f4156e60 msgr2=0x7f30f4071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:50:26.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.576+0000 7f30f3fff640 1 --2- 172.21.15.87:0/431412164 >> v2:172.21.15.87:3300/0 conn(0x7f30f4156e60 0x7f30f4071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:26.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.576+0000 7f30f3fff640 1 -- 172.21.15.87:0/431412164 >> v1:172.21.15.87:6789/0 conn(0x7f30f41501c0 legacy=0x7f30f4072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:26.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.576+0000 7f30f3fff640 1 -- 172.21.15.87:0/431412164 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f40c1d30 con 0x7f30f40bff00 2023-12-16T20:50:26.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.579+0000 7f30f3fff640 1 --2- 172.21.15.87:0/431412164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30f40bff00 0x7f30f4159860 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f30f406f9e0 tx=0x7f30e002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e31c375e968117e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:26.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.583+0000 7f30f37fe640 1 -- 172.21.15.87:0/431412164 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0030610 con 0x7f30f40bff00 2023-12-16T20:50:26.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.583+0000 7f30f37fe640 1 -- 172.21.15.87:0/431412164 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e0030770 con 0x7f30f40bff00 2023-12-16T20:50:26.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.583+0000 7f30f37fe640 1 -- 172.21.15.87:0/431412164 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0030b00 con 0x7f30f40bff00 2023-12-16T20:50:26.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.584+0000 7f30fb083640 1 -- 172.21.15.87:0/431412164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30f40bff00 msgr2=0x7f30f4159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:26.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.584+0000 7f30fb083640 1 --2- 172.21.15.87:0/431412164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30f40bff00 0x7f30f4159860 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f30f406f9e0 tx=0x7f30e002b960 comp rx=0 tx=0).stop 2023-12-16T20:50:26.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.584+0000 7f30fb083640 1 -- 172.21.15.87:0/431412164 shutdown_connections 2023-12-16T20:50:26.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.584+0000 7f30fb083640 1 --2- 172.21.15.87:0/431412164 >> v2:172.21.15.87:3300/0 conn(0x7f30f4156e60 0x7f30f4071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:26.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.584+0000 7f30fb083640 1 --2- 172.21.15.87:0/431412164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30f40bff00 0x7f30f4159860 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:26.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.584+0000 7f30fb083640 1 -- 172.21.15.87:0/431412164 >> 172.21.15.87:0/431412164 conn(0x7f30f406cd60 msgr2=0x7f30f406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:26.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.584+0000 7f30fb083640 1 -- 172.21.15.87:0/431412164 shutdown_connections 2023-12-16T20:50:26.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.584+0000 7f30fb083640 1 -- 172.21.15.87:0/431412164 wait complete. 2023-12-16T20:50:26.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.585+0000 7f30fb083640 1 Processor -- start 2023-12-16T20:50:26.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.585+0000 7f30fb083640 1 -- start start 2023-12-16T20:50:26.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.586+0000 7f30fb083640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30f40bff00 0x7f30f4150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:26.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.586+0000 7f30fb083640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30f41501c0 0x7f30f41e3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:26.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.586+0000 7f30fb083640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30f4156e60 0x7f30f41f0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:26.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.586+0000 7f30fb083640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f41499b0 con 0x7f30f40bff00 2023-12-16T20:50:26.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.586+0000 7f30fb083640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f4153c30 con 0x7f30f4156e60 2023-12-16T20:50:26.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.586+0000 7f30fb083640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f41efd00 con 0x7f30f41501c0 2023-12-16T20:50:26.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.586+0000 7f30f8e1f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30f40bff00 0x7f30f4150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:26.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.587+0000 7f30f8e1f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30f40bff00 0x7f30f4150b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45462/0 (socket says 172.21.15.87:45462) 2023-12-16T20:50:26.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.587+0000 7f30f8e1f640 1 -- 172.21.15.87:0/733460937 learned_addr learned my addr 172.21.15.87:0/733460937 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:50:26.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.587+0000 7f30f9620640 1 --2- 172.21.15.87:0/733460937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30f4156e60 0x7f30f41f0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:26.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.587+0000 7f30f3fff640 1 --2- 172.21.15.87:0/733460937 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30f41501c0 0x7f30f41e3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:26.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.590+0000 7f30f8e1f640 1 -- 172.21.15.87:0/733460937 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30f41501c0 msgr2=0x7f30f41e3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:26.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.590+0000 7f30f8e1f640 1 --2- 172.21.15.87:0/733460937 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30f41501c0 0x7f30f41e3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:26.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.590+0000 7f30f8e1f640 1 -- 172.21.15.87:0/733460937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30f4156e60 msgr2=0x7f30f41f0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:26.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.590+0000 7f30f8e1f640 1 --2- 172.21.15.87:0/733460937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30f4156e60 0x7f30f41f0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:26.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.590+0000 7f30f8e1f640 1 -- 172.21.15.87:0/733460937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e0009400 con 0x7f30f40bff00 2023-12-16T20:50:26.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.592+0000 7f30f8e1f640 1 --2- 172.21.15.87:0/733460937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30f40bff00 0x7f30f4150b60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f30e800c4a0 tx=0x7f30e800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:26.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.596+0000 7f30f17fa640 1 -- 172.21.15.87:0/733460937 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8005ce0 con 0x7f30f40bff00 2023-12-16T20:50:26.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.596+0000 7f30f17fa640 1 -- 172.21.15.87:0/733460937 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e8005e40 con 0x7f30f40bff00 2023-12-16T20:50:26.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.596+0000 7f30f17fa640 1 -- 172.21.15.87:0/733460937 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8007270 con 0x7f30f40bff00 2023-12-16T20:50:26.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.596+0000 7f30fb083640 1 -- 172.21.15.87:0/733460937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f4151270 con 0x7f30f40bff00 2023-12-16T20:50:26.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.596+0000 7f30fb083640 1 -- 172.21.15.87:0/733460937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f4152c20 con 0x7f30f40bff00 2023-12-16T20:50:26.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.597+0000 7f30fb083640 1 -- 172.21.15.87:0/733460937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f40c77e0 con 0x7f30f40bff00 2023-12-16T20:50:26.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.837+0000 7f30f17fa640 1 -- 172.21.15.87:0/733460937 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f30e8007490 con 0x7f30f40bff00 2023-12-16T20:50:26.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.837+0000 7f30f17fa640 1 --2- 172.21.15.87:0/733460937 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f30d806ae90 0x7f30d806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:26.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.837+0000 7f30f3fff640 1 --2- 172.21.15.87:0/733460937 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f30d806ae90 0x7f30d806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:26.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.838+0000 7f30f3fff640 1 --2- 172.21.15.87:0/733460937 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f30d806ae90 0x7f30d806d350 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f30e0036000 tx=0x7f30e0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:26.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.852+0000 7f30f17fa640 1 -- 172.21.15.87:0/733460937 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f30e8057dd0 con 0x7f30f40bff00 2023-12-16T20:50:26.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:26.852+0000 7f30f17fa640 1 -- 172.21.15.87:0/733460937 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f30e8054110 con 0x7f30f40bff00 2023-12-16T20:50:27.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:27.045+0000 7f30fb083640 1 -- 172.21.15.87:0/733460937 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f30f4156660 con 0x7f30d806ae90 2023-12-16T20:50:27.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:27.054+0000 7f30f17fa640 1 -- 172.21.15.87:0/733460937 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+373782 (secure 0 0 0) 0x7f30e0030410 con 0x7f30d806ae90 2023-12-16T20:50:27.059 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:50:27.061 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-12-16T20:50:27.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:27.058+0000 7f30fb083640 1 -- 172.21.15.87:0/733460937 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f30d806ae90 msgr2=0x7f30d806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:27.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:27.058+0000 7f30fb083640 1 --2- 172.21.15.87:0/733460937 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f30d806ae90 0x7f30d806d350 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f30e0036000 tx=0x7f30e0008030 comp rx=0 tx=0).stop 2023-12-16T20:50:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:27.058+0000 7f30fb083640 1 -- 172.21.15.87:0/733460937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30f40bff00 msgr2=0x7f30f4150b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:27.058+0000 7f30fb083640 1 --2- 172.21.15.87:0/733460937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30f40bff00 0x7f30f4150b60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f30e800c4a0 tx=0x7f30e800c960 comp rx=0 tx=0).stop 2023-12-16T20:50:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:27.058+0000 7f30fb083640 1 -- 172.21.15.87:0/733460937 shutdown_connections 2023-12-16T20:50:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:27.058+0000 7f30fb083640 1 --2- 172.21.15.87:0/733460937 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f30d806ae90 0x7f30d806d350 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:27.058+0000 7f30fb083640 1 --2- 172.21.15.87:0/733460937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30f4156e60 0x7f30f41f0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:27.058+0000 7f30fb083640 1 --2- 172.21.15.87:0/733460937 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30f41501c0 0x7f30f41e3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:27.058+0000 7f30fb083640 1 --2- 172.21.15.87:0/733460937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30f40bff00 0x7f30f4150b60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:27.058+0000 7f30fb083640 1 -- 172.21.15.87:0/733460937 >> 172.21.15.87:0/733460937 conn(0x7f30f406cd60 msgr2=0x7f30f40c64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:27.058+0000 7f30fb083640 1 -- 172.21.15.87:0/733460937 shutdown_connections 2023-12-16T20:50:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:27.058+0000 7f30fb083640 1 -- 172.21.15.87:0/733460937 wait complete. 2023-12-16T20:50:27.071 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":893,"stamp":"2023-12-16T20:50:26.664752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41060283,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1154,"num_read_kb":1198,"num_write":13351,"num_write_kb":371526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15871,"ondisk_log_size":15871,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":435808,"kb_used_data":57312,"kb_used_omap":12,"kb_used_meta":378419,"kb_avail":754538912,"statfs":{"total":773094113280,"available":772647845888,"internally_reserved":0,"allocated":58687488,"data_stored":83068718,"data_compressed":7551796,"data_compressed_allocated":11804672,"data_compressed_original":37634048,"omap_allocated":12751,"internal_metadata":387501617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003566"},"pg_stats":[{"pgid":"2.1f","version":"27'645","reported_seq":685,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:23.157430+0000","last_change":"2023-12-16T20:49:23.157455+0000","last_active":"2023-12-16T20:49:23.157430+0000","last_peered":"2023-12-16T20:49:23.157430+0000","last_clean":"2023-12-16T20:49:23.157430+0000","last_became_active":"2023-12-16T20:21:35.413075+0000","last_became_peered":"2023-12-16T20:21:35.413075+0000","last_unstale":"2023-12-16T20:49:23.157430+0000","last_undegraded":"2023-12-16T20:49:23.157430+0000","last_fullsized":"2023-12-16T20:49:23.157430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'645","last_scrub_stamp":"2023-12-16T20:49:23.157376+0000","last_deep_scrub":"27'645","last_deep_scrub_stamp":"2023-12-16T20:49:23.157376+0000","last_clean_scrub_stamp":"2023-12-16T20:49:23.157376+0000","objects_scrubbed":3,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:45.002915+0000","scrub_duration":0.012814567000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'31","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:25.961331+0000","last_change":"2023-12-16T20:49:25.961331+0000","last_active":"2023-12-16T20:49:25.961331+0000","last_peered":"2023-12-16T20:49:25.961331+0000","last_clean":"2023-12-16T20:49:25.961331+0000","last_became_active":"2023-12-16T20:21:36.542667+0000","last_became_peered":"2023-12-16T20:21:36.542667+0000","last_unstale":"2023-12-16T20:49:25.961331+0000","last_undegraded":"2023-12-16T20:49:25.961331+0000","last_fullsized":"2023-12-16T20:49:25.961331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2023-12-16T20:49:25.961221+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2023-12-16T20:49:25.961221+0000","last_clean_scrub_stamp":"2023-12-16T20:49:25.961221+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:37:18.758291+0000","scrub_duration":0.001405351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'182","reported_seq":217,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:52.865833+0000","last_change":"2023-12-16T20:49:52.865854+0000","last_active":"2023-12-16T20:49:52.865833+0000","last_peered":"2023-12-16T20:49:52.865833+0000","last_clean":"2023-12-16T20:49:52.865833+0000","last_became_active":"2023-12-16T20:21:41.216062+0000","last_became_peered":"2023-12-16T20:21:41.216062+0000","last_unstale":"2023-12-16T20:49:52.865833+0000","last_undegraded":"2023-12-16T20:49:52.865833+0000","last_fullsized":"2023-12-16T20:49:52.865833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'182","last_scrub_stamp":"2023-12-16T20:49:52.865754+0000","last_deep_scrub":"27'182","last_deep_scrub_stamp":"2023-12-16T20:49:52.865754+0000","last_clean_scrub_stamp":"2023-12-16T20:49:52.865754+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:55.826353+0000","scrub_duration":0.001882774,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":13331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'711","reported_seq":752,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.086965+0000","last_change":"2023-12-16T20:49:35.086965+0000","last_active":"2023-12-16T20:49:35.086965+0000","last_peered":"2023-12-16T20:49:35.086965+0000","last_clean":"2023-12-16T20:49:35.086965+0000","last_became_active":"2023-12-16T20:21:35.419745+0000","last_became_peered":"2023-12-16T20:21:35.419745+0000","last_unstale":"2023-12-16T20:49:35.086965+0000","last_undegraded":"2023-12-16T20:49:35.086965+0000","last_fullsized":"2023-12-16T20:49:35.086965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'711","last_scrub_stamp":"2023-12-16T20:49:35.086833+0000","last_deep_scrub":"27'711","last_deep_scrub_stamp":"2023-12-16T20:49:35.086833+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.086833+0000","objects_scrubbed":1,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:55:19.452990+0000","scrub_duration":0.013529074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'38","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:20.169422+0000","last_change":"2023-12-16T20:49:20.169443+0000","last_active":"2023-12-16T20:49:20.169422+0000","last_peered":"2023-12-16T20:49:20.169422+0000","last_clean":"2023-12-16T20:49:20.169422+0000","last_became_active":"2023-12-16T20:21:36.552621+0000","last_became_peered":"2023-12-16T20:21:36.552621+0000","last_unstale":"2023-12-16T20:49:20.169422+0000","last_undegraded":"2023-12-16T20:49:20.169422+0000","last_fullsized":"2023-12-16T20:49:20.169422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:20.169357+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:20.169357+0000","last_clean_scrub_stamp":"2023-12-16T20:49:20.169357+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:05:52.134660+0000","scrub_duration":0.001403729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'122","reported_seq":157,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:44.472423+0000","last_change":"2023-12-16T20:49:44.472443+0000","last_active":"2023-12-16T20:49:44.472423+0000","last_peered":"2023-12-16T20:49:44.472423+0000","last_clean":"2023-12-16T20:49:44.472423+0000","last_became_active":"2023-12-16T20:21:40.754509+0000","last_became_peered":"2023-12-16T20:21:40.754509+0000","last_unstale":"2023-12-16T20:49:44.472423+0000","last_undegraded":"2023-12-16T20:49:44.472423+0000","last_fullsized":"2023-12-16T20:49:44.472423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'122","last_scrub_stamp":"2023-12-16T20:49:44.472356+0000","last_deep_scrub":"27'122","last_deep_scrub_stamp":"2023-12-16T20:49:44.472356+0000","last_clean_scrub_stamp":"2023-12-16T20:49:44.472356+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:22:56.542426+0000","scrub_duration":0.001614327,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1395","reported_seq":1433,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.931101+0000","last_change":"2023-12-16T20:49:37.931129+0000","last_active":"2023-12-16T20:49:37.931101+0000","last_peered":"2023-12-16T20:49:37.931101+0000","last_clean":"2023-12-16T20:49:37.931101+0000","last_became_active":"2023-12-16T20:21:35.427317+0000","last_became_peered":"2023-12-16T20:21:35.427317+0000","last_unstale":"2023-12-16T20:49:37.931101+0000","last_undegraded":"2023-12-16T20:49:37.931101+0000","last_fullsized":"2023-12-16T20:49:37.931101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1395","last_scrub_stamp":"2023-12-16T20:49:37.931040+0000","last_deep_scrub":"27'1395","last_deep_scrub_stamp":"2023-12-16T20:49:37.931040+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.931040+0000","objects_scrubbed":3,"log_size":1395,"log_dups_size":0,"ondisk_log_size":1395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:22:53.562497+0000","scrub_duration":0.022717590999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":9004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'33","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:46.898286+0000","last_change":"2023-12-16T20:49:46.898318+0000","last_active":"2023-12-16T20:49:46.898286+0000","last_peered":"2023-12-16T20:49:46.898286+0000","last_clean":"2023-12-16T20:49:46.898286+0000","last_became_active":"2023-12-16T20:22:14.768968+0000","last_became_peered":"2023-12-16T20:22:14.768968+0000","last_unstale":"2023-12-16T20:49:46.898286+0000","last_undegraded":"2023-12-16T20:49:46.898286+0000","last_fullsized":"2023-12-16T20:49:46.898286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:46.898186+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:46.898186+0000","last_clean_scrub_stamp":"2023-12-16T20:49:46.898186+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:25:21.438249+0000","scrub_duration":0.00121396,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"27'156","reported_seq":200,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:51.448513+0000","last_change":"2023-12-16T20:49:51.448535+0000","last_active":"2023-12-16T20:49:51.448513+0000","last_peered":"2023-12-16T20:49:51.448513+0000","last_clean":"2023-12-16T20:49:51.448513+0000","last_became_active":"2023-12-16T20:22:14.819924+0000","last_became_peered":"2023-12-16T20:22:14.819924+0000","last_unstale":"2023-12-16T20:49:51.448513+0000","last_undegraded":"2023-12-16T20:49:51.448513+0000","last_fullsized":"2023-12-16T20:49:51.448513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'156","last_scrub_stamp":"2023-12-16T20:49:51.448383+0000","last_deep_scrub":"27'156","last_deep_scrub_stamp":"2023-12-16T20:49:51.448383+0000","last_clean_scrub_stamp":"2023-12-16T20:49:51.448383+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:53:08.749663+0000","scrub_duration":0.001709286,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":12476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:40.919237+0000","last_change":"2023-12-16T20:49:40.919278+0000","last_active":"2023-12-16T20:49:40.919237+0000","last_peered":"2023-12-16T20:49:40.919237+0000","last_clean":"2023-12-16T20:49:40.919237+0000","last_became_active":"2023-12-16T20:21:35.413234+0000","last_became_peered":"2023-12-16T20:21:35.413234+0000","last_unstale":"2023-12-16T20:49:40.919237+0000","last_undegraded":"2023-12-16T20:49:40.919237+0000","last_fullsized":"2023-12-16T20:49:40.919237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-16T20:49:40.919143+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-16T20:49:40.919143+0000","last_clean_scrub_stamp":"2023-12-16T20:49:40.919143+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:18:08.836684+0000","scrub_duration":0.0023112950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'49","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:01.618340+0000","last_change":"2023-12-16T20:50:01.618358+0000","last_active":"2023-12-16T20:50:01.618340+0000","last_peered":"2023-12-16T20:50:01.618340+0000","last_clean":"2023-12-16T20:50:01.618340+0000","last_became_active":"2023-12-16T20:21:36.554014+0000","last_became_peered":"2023-12-16T20:21:36.554014+0000","last_unstale":"2023-12-16T20:50:01.618340+0000","last_undegraded":"2023-12-16T20:50:01.618340+0000","last_fullsized":"2023-12-16T20:50:01.618340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2023-12-16T20:50:01.618277+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2023-12-16T20:50:01.618277+0000","last_clean_scrub_stamp":"2023-12-16T20:50:01.618277+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:41:22.296873+0000","scrub_duration":0.00098290700000000009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'146","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:40.448517+0000","last_change":"2023-12-16T20:49:40.448537+0000","last_active":"2023-12-16T20:49:40.448517+0000","last_peered":"2023-12-16T20:49:40.448517+0000","last_clean":"2023-12-16T20:49:40.448517+0000","last_became_active":"2023-12-16T20:21:40.794471+0000","last_became_peered":"2023-12-16T20:21:40.794471+0000","last_unstale":"2023-12-16T20:49:40.448517+0000","last_undegraded":"2023-12-16T20:49:40.448517+0000","last_fullsized":"2023-12-16T20:49:40.448517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'146","last_scrub_stamp":"2023-12-16T20:49:40.448446+0000","last_deep_scrub":"27'146","last_deep_scrub_stamp":"2023-12-16T20:49:40.448446+0000","last_clean_scrub_stamp":"2023-12-16T20:49:40.448446+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:54:56.914280+0000","scrub_duration":0.0016447670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'39","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:46.102034+0000","last_change":"2023-12-16T20:49:46.102034+0000","last_active":"2023-12-16T20:49:46.102034+0000","last_peered":"2023-12-16T20:49:46.102034+0000","last_clean":"2023-12-16T20:49:46.102034+0000","last_became_active":"2023-12-16T20:21:36.542157+0000","last_became_peered":"2023-12-16T20:21:36.542157+0000","last_unstale":"2023-12-16T20:49:46.102034+0000","last_undegraded":"2023-12-16T20:49:46.102034+0000","last_fullsized":"2023-12-16T20:49:46.102034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-12-16T20:49:46.101940+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-12-16T20:49:46.101940+0000","last_clean_scrub_stamp":"2023-12-16T20:49:46.101940+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:26:58.344405+0000","scrub_duration":0.000980491,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'682","reported_seq":721,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:39.928151+0000","last_change":"2023-12-16T20:49:39.928177+0000","last_active":"2023-12-16T20:49:39.928151+0000","last_peered":"2023-12-16T20:49:39.928151+0000","last_clean":"2023-12-16T20:49:39.928151+0000","last_became_active":"2023-12-16T20:21:35.413400+0000","last_became_peered":"2023-12-16T20:21:35.413400+0000","last_unstale":"2023-12-16T20:49:39.928151+0000","last_undegraded":"2023-12-16T20:49:39.928151+0000","last_fullsized":"2023-12-16T20:49:39.928151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'682","last_scrub_stamp":"2023-12-16T20:49:39.928085+0000","last_deep_scrub":"27'682","last_deep_scrub_stamp":"2023-12-16T20:49:39.928085+0000","last_clean_scrub_stamp":"2023-12-16T20:49:39.928085+0000","objects_scrubbed":2,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:26:52.170550+0000","scrub_duration":0.016337826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":4429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'121","reported_seq":157,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:49.446137+0000","last_change":"2023-12-16T20:49:49.446160+0000","last_active":"2023-12-16T20:49:49.446137+0000","last_peered":"2023-12-16T20:49:49.446137+0000","last_clean":"2023-12-16T20:49:49.446137+0000","last_became_active":"2023-12-16T20:21:40.745544+0000","last_became_peered":"2023-12-16T20:21:40.745544+0000","last_unstale":"2023-12-16T20:49:49.446137+0000","last_undegraded":"2023-12-16T20:49:49.446137+0000","last_fullsized":"2023-12-16T20:49:49.446137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'121","last_scrub_stamp":"2023-12-16T20:49:49.446051+0000","last_deep_scrub":"27'121","last_deep_scrub_stamp":"2023-12-16T20:49:49.446051+0000","last_clean_scrub_stamp":"2023-12-16T20:49:49.446051+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:55:33.812208+0000","scrub_duration":0.0017083669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":10860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'38","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:29.049902+0000","last_change":"2023-12-16T20:49:29.049927+0000","last_active":"2023-12-16T20:49:29.049902+0000","last_peered":"2023-12-16T20:49:29.049902+0000","last_clean":"2023-12-16T20:49:29.049902+0000","last_became_active":"2023-12-16T20:21:36.525983+0000","last_became_peered":"2023-12-16T20:21:36.525983+0000","last_unstale":"2023-12-16T20:49:29.049902+0000","last_undegraded":"2023-12-16T20:49:29.049902+0000","last_fullsized":"2023-12-16T20:49:29.049902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:29.049801+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:29.049801+0000","last_clean_scrub_stamp":"2023-12-16T20:49:29.049801+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:17:56.967342+0000","scrub_duration":0.001151219,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:54.210144+0000","last_change":"2023-12-16T20:49:54.210164+0000","last_active":"2023-12-16T20:49:54.210144+0000","last_peered":"2023-12-16T20:49:54.210144+0000","last_clean":"2023-12-16T20:49:54.210144+0000","last_became_active":"2023-12-16T20:21:35.419731+0000","last_became_peered":"2023-12-16T20:21:35.419731+0000","last_unstale":"2023-12-16T20:49:54.210144+0000","last_undegraded":"2023-12-16T20:49:54.210144+0000","last_fullsized":"2023-12-16T20:49:54.210144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-16T20:49:54.210064+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-16T20:49:54.210064+0000","last_clean_scrub_stamp":"2023-12-16T20:49:54.210064+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:25:41.037499+0000","scrub_duration":0.00090329199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'169","reported_seq":205,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:55.456625+0000","last_change":"2023-12-16T20:49:55.456647+0000","last_active":"2023-12-16T20:49:55.456625+0000","last_peered":"2023-12-16T20:49:55.456625+0000","last_clean":"2023-12-16T20:49:55.456625+0000","last_became_active":"2023-12-16T20:21:40.754829+0000","last_became_peered":"2023-12-16T20:21:40.754829+0000","last_unstale":"2023-12-16T20:49:55.456625+0000","last_undegraded":"2023-12-16T20:49:55.456625+0000","last_fullsized":"2023-12-16T20:49:55.456625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'169","last_scrub_stamp":"2023-12-16T20:49:55.456544+0000","last_deep_scrub":"27'169","last_deep_scrub_stamp":"2023-12-16T20:49:55.456544+0000","last_clean_scrub_stamp":"2023-12-16T20:49:55.456544+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:07:48.448673+0000","scrub_duration":0.0016987910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":10412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'38","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.059222+0000","last_change":"2023-12-16T20:49:37.059222+0000","last_active":"2023-12-16T20:49:37.059222+0000","last_peered":"2023-12-16T20:49:37.059222+0000","last_clean":"2023-12-16T20:49:37.059222+0000","last_became_active":"2023-12-16T20:21:36.518686+0000","last_became_peered":"2023-12-16T20:21:36.518686+0000","last_unstale":"2023-12-16T20:49:37.059222+0000","last_undegraded":"2023-12-16T20:49:37.059222+0000","last_fullsized":"2023-12-16T20:49:37.059222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:37.059110+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:37.059110+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.059110+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:02:40.257888+0000","scrub_duration":0.00095491900000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:38.167525+0000","last_change":"2023-12-16T20:49:38.167525+0000","last_active":"2023-12-16T20:49:38.167525+0000","last_peered":"2023-12-16T20:49:38.167525+0000","last_clean":"2023-12-16T20:49:38.167525+0000","last_became_active":"2023-12-16T20:21:35.416067+0000","last_became_peered":"2023-12-16T20:21:35.416067+0000","last_unstale":"2023-12-16T20:49:38.167525+0000","last_undegraded":"2023-12-16T20:49:38.167525+0000","last_fullsized":"2023-12-16T20:49:38.167525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-12-16T20:49:38.167435+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-12-16T20:49:38.167435+0000","last_clean_scrub_stamp":"2023-12-16T20:49:38.167435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:37:30.964505+0000","scrub_duration":0.0011178469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'126","reported_seq":162,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:20.158849+0000","last_change":"2023-12-16T20:50:20.158895+0000","last_active":"2023-12-16T20:50:20.158849+0000","last_peered":"2023-12-16T20:50:20.158849+0000","last_clean":"2023-12-16T20:50:20.158849+0000","last_became_active":"2023-12-16T20:21:41.214198+0000","last_became_peered":"2023-12-16T20:21:41.214198+0000","last_unstale":"2023-12-16T20:50:20.158849+0000","last_undegraded":"2023-12-16T20:50:20.158849+0000","last_fullsized":"2023-12-16T20:50:20.158849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'126","last_scrub_stamp":"2023-12-16T20:50:20.158751+0000","last_deep_scrub":"27'126","last_deep_scrub_stamp":"2023-12-16T20:50:20.158751+0000","last_clean_scrub_stamp":"2023-12-16T20:50:20.158751+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:20:42.334022+0000","scrub_duration":0.0019180569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":7034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'34","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:34.369486+0000","last_change":"2023-12-16T20:49:34.369486+0000","last_active":"2023-12-16T20:49:34.369486+0000","last_peered":"2023-12-16T20:49:34.369486+0000","last_clean":"2023-12-16T20:49:34.369486+0000","last_became_active":"2023-12-16T20:21:36.536321+0000","last_became_peered":"2023-12-16T20:21:36.536321+0000","last_unstale":"2023-12-16T20:49:34.369486+0000","last_undegraded":"2023-12-16T20:49:34.369486+0000","last_fullsized":"2023-12-16T20:49:34.369486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2023-12-16T20:49:34.369363+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2023-12-16T20:49:34.369363+0000","last_clean_scrub_stamp":"2023-12-16T20:49:34.369363+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:03:30.826563+0000","scrub_duration":0.0011209779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'6","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:36.954785+0000","last_change":"2023-12-16T20:49:36.954785+0000","last_active":"2023-12-16T20:49:36.954785+0000","last_peered":"2023-12-16T20:49:36.954785+0000","last_clean":"2023-12-16T20:49:36.954785+0000","last_became_active":"2023-12-16T20:21:35.420547+0000","last_became_peered":"2023-12-16T20:21:35.420547+0000","last_unstale":"2023-12-16T20:49:36.954785+0000","last_undegraded":"2023-12-16T20:49:36.954785+0000","last_fullsized":"2023-12-16T20:49:36.954785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2023-12-16T20:49:36.954706+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2023-12-16T20:49:36.954706+0000","last_clean_scrub_stamp":"2023-12-16T20:49:36.954706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:06:52.792558+0000","scrub_duration":0.001061644,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'120","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:43.423699+0000","last_change":"2023-12-16T20:49:43.423737+0000","last_active":"2023-12-16T20:49:43.423699+0000","last_peered":"2023-12-16T20:49:43.423699+0000","last_clean":"2023-12-16T20:49:43.423699+0000","last_became_active":"2023-12-16T20:21:40.756997+0000","last_became_peered":"2023-12-16T20:21:40.756997+0000","last_unstale":"2023-12-16T20:49:43.423699+0000","last_undegraded":"2023-12-16T20:49:43.423699+0000","last_fullsized":"2023-12-16T20:49:43.423699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'120","last_scrub_stamp":"2023-12-16T20:49:43.423601+0000","last_deep_scrub":"27'120","last_deep_scrub_stamp":"2023-12-16T20:49:43.423601+0000","last_clean_scrub_stamp":"2023-12-16T20:49:43.423601+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:10:55.959038+0000","scrub_duration":0.0018042889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":6714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'40","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:40.269289+0000","last_change":"2023-12-16T20:49:40.269289+0000","last_active":"2023-12-16T20:49:40.269289+0000","last_peered":"2023-12-16T20:49:40.269289+0000","last_clean":"2023-12-16T20:49:40.269289+0000","last_became_active":"2023-12-16T20:21:36.524703+0000","last_became_peered":"2023-12-16T20:21:36.524703+0000","last_unstale":"2023-12-16T20:49:40.269289+0000","last_undegraded":"2023-12-16T20:49:40.269289+0000","last_fullsized":"2023-12-16T20:49:40.269289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2023-12-16T20:49:40.269176+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2023-12-16T20:49:40.269176+0000","last_clean_scrub_stamp":"2023-12-16T20:49:40.269176+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:25:27.096610+0000","scrub_duration":0.001165059,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'11","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:24.985449+0000","last_change":"2023-12-16T20:49:24.985449+0000","last_active":"2023-12-16T20:49:24.985449+0000","last_peered":"2023-12-16T20:49:24.985449+0000","last_clean":"2023-12-16T20:49:24.985449+0000","last_became_active":"2023-12-16T20:21:35.428465+0000","last_became_peered":"2023-12-16T20:21:35.428465+0000","last_unstale":"2023-12-16T20:49:24.985449+0000","last_undegraded":"2023-12-16T20:49:24.985449+0000","last_fullsized":"2023-12-16T20:49:24.985449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2023-12-16T20:49:24.985368+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2023-12-16T20:49:24.985368+0000","last_clean_scrub_stamp":"2023-12-16T20:49:24.985368+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:46:57.920491+0000","scrub_duration":0.002106316,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'152","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:52.444847+0000","last_change":"2023-12-16T20:49:52.444872+0000","last_active":"2023-12-16T20:49:52.444847+0000","last_peered":"2023-12-16T20:49:52.444847+0000","last_clean":"2023-12-16T20:49:52.444847+0000","last_became_active":"2023-12-16T20:21:41.212976+0000","last_became_peered":"2023-12-16T20:21:41.212976+0000","last_unstale":"2023-12-16T20:49:52.444847+0000","last_undegraded":"2023-12-16T20:49:52.444847+0000","last_fullsized":"2023-12-16T20:49:52.444847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'152","last_scrub_stamp":"2023-12-16T20:49:52.444755+0000","last_deep_scrub":"27'152","last_deep_scrub_stamp":"2023-12-16T20:49:52.444755+0000","last_clean_scrub_stamp":"2023-12-16T20:49:52.444755+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:02:55.643533+0000","scrub_duration":0.001694704,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":10330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'37","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:40.941825+0000","last_change":"2023-12-16T20:49:40.941825+0000","last_active":"2023-12-16T20:49:40.941825+0000","last_peered":"2023-12-16T20:49:40.941825+0000","last_clean":"2023-12-16T20:49:40.941825+0000","last_became_active":"2023-12-16T20:21:36.518673+0000","last_became_peered":"2023-12-16T20:21:36.518673+0000","last_unstale":"2023-12-16T20:49:40.941825+0000","last_undegraded":"2023-12-16T20:49:40.941825+0000","last_fullsized":"2023-12-16T20:49:40.941825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2023-12-16T20:49:40.941728+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2023-12-16T20:49:40.941728+0000","last_clean_scrub_stamp":"2023-12-16T20:49:40.941728+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:05:27.080261+0000","scrub_duration":0.0014944279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'311","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:50.263800+0000","last_change":"2023-12-16T20:49:50.263820+0000","last_active":"2023-12-16T20:49:50.263800+0000","last_peered":"2023-12-16T20:49:50.263800+0000","last_clean":"2023-12-16T20:49:50.263800+0000","last_became_active":"2023-12-16T20:21:35.423045+0000","last_became_peered":"2023-12-16T20:21:35.423045+0000","last_unstale":"2023-12-16T20:49:50.263800+0000","last_undegraded":"2023-12-16T20:49:50.263800+0000","last_fullsized":"2023-12-16T20:49:50.263800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'311","last_scrub_stamp":"2023-12-16T20:49:50.263741+0000","last_deep_scrub":"27'311","last_deep_scrub_stamp":"2023-12-16T20:49:50.263741+0000","last_clean_scrub_stamp":"2023-12-16T20:49:50.263741+0000","objects_scrubbed":1,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:11:02.799178+0000","scrub_duration":0.0034881420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":886,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'156","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:00.890654+0000","last_change":"2023-12-16T20:50:00.890690+0000","last_active":"2023-12-16T20:50:00.890654+0000","last_peered":"2023-12-16T20:50:00.890654+0000","last_clean":"2023-12-16T20:50:00.890654+0000","last_became_active":"2023-12-16T20:21:41.215747+0000","last_became_peered":"2023-12-16T20:21:41.215747+0000","last_unstale":"2023-12-16T20:50:00.890654+0000","last_undegraded":"2023-12-16T20:50:00.890654+0000","last_fullsized":"2023-12-16T20:50:00.890654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'156","last_scrub_stamp":"2023-12-16T20:50:00.890558+0000","last_deep_scrub":"27'156","last_deep_scrub_stamp":"2023-12-16T20:50:00.890558+0000","last_clean_scrub_stamp":"2023-12-16T20:50:00.890558+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:12.602561+0000","scrub_duration":0.001533455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'35","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:05.274200+0000","last_change":"2023-12-16T20:50:05.274219+0000","last_active":"2023-12-16T20:50:05.274200+0000","last_peered":"2023-12-16T20:50:05.274200+0000","last_clean":"2023-12-16T20:50:05.274200+0000","last_became_active":"2023-12-16T20:21:36.451404+0000","last_became_peered":"2023-12-16T20:21:36.451404+0000","last_unstale":"2023-12-16T20:50:05.274200+0000","last_undegraded":"2023-12-16T20:50:05.274200+0000","last_fullsized":"2023-12-16T20:50:05.274200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-12-16T20:50:05.274132+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-12-16T20:50:05.274132+0000","last_clean_scrub_stamp":"2023-12-16T20:50:05.274132+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:34:27.772625+0000","scrub_duration":0.0009829420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:42.928992+0000","last_change":"2023-12-16T20:49:42.929016+0000","last_active":"2023-12-16T20:49:42.928992+0000","last_peered":"2023-12-16T20:49:42.928992+0000","last_clean":"2023-12-16T20:49:42.928992+0000","last_became_active":"2023-12-16T20:21:35.419917+0000","last_became_peered":"2023-12-16T20:21:35.419917+0000","last_unstale":"2023-12-16T20:49:42.928992+0000","last_undegraded":"2023-12-16T20:49:42.928992+0000","last_fullsized":"2023-12-16T20:49:42.928992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-16T20:49:42.928908+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-16T20:49:42.928908+0000","last_clean_scrub_stamp":"2023-12-16T20:49:42.928908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:18:58.804341+0000","scrub_duration":0.001569261,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'136","reported_seq":173,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:02.138808+0000","last_change":"2023-12-16T20:50:02.138830+0000","last_active":"2023-12-16T20:50:02.138808+0000","last_peered":"2023-12-16T20:50:02.138808+0000","last_clean":"2023-12-16T20:50:02.138808+0000","last_became_active":"2023-12-16T20:21:41.212704+0000","last_became_peered":"2023-12-16T20:21:41.212704+0000","last_unstale":"2023-12-16T20:50:02.138808+0000","last_undegraded":"2023-12-16T20:50:02.138808+0000","last_fullsized":"2023-12-16T20:50:02.138808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'136","last_scrub_stamp":"2023-12-16T20:50:02.138728+0000","last_deep_scrub":"27'136","last_deep_scrub_stamp":"2023-12-16T20:50:02.138728+0000","last_clean_scrub_stamp":"2023-12-16T20:50:02.138728+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:15:04.006251+0000","scrub_duration":0.001707783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":9011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'38","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:51.641831+0000","last_change":"2023-12-16T20:49:51.641869+0000","last_active":"2023-12-16T20:49:51.641831+0000","last_peered":"2023-12-16T20:49:51.641831+0000","last_clean":"2023-12-16T20:49:51.641831+0000","last_became_active":"2023-12-16T20:21:36.555011+0000","last_became_peered":"2023-12-16T20:21:36.555011+0000","last_unstale":"2023-12-16T20:49:51.641831+0000","last_undegraded":"2023-12-16T20:49:51.641831+0000","last_fullsized":"2023-12-16T20:49:51.641831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:51.641701+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:51.641701+0000","last_clean_scrub_stamp":"2023-12-16T20:49:51.641701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:07:03.931085+0000","scrub_duration":0.001332794,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'5","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.178105+0000","last_change":"2023-12-16T20:49:37.178126+0000","last_active":"2023-12-16T20:49:37.178105+0000","last_peered":"2023-12-16T20:49:37.178105+0000","last_clean":"2023-12-16T20:49:37.178105+0000","last_became_active":"2023-12-16T20:21:35.417683+0000","last_became_peered":"2023-12-16T20:21:35.417683+0000","last_unstale":"2023-12-16T20:49:37.178105+0000","last_undegraded":"2023-12-16T20:49:37.178105+0000","last_fullsized":"2023-12-16T20:49:37.178105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:37.178026+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:37.178026+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.178026+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:16:43.237442+0000","scrub_duration":0.00095622999999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'180","reported_seq":217,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:07.282336+0000","last_change":"2023-12-16T20:50:07.282372+0000","last_active":"2023-12-16T20:50:07.282336+0000","last_peered":"2023-12-16T20:50:07.282336+0000","last_clean":"2023-12-16T20:50:07.282336+0000","last_became_active":"2023-12-16T20:21:40.793754+0000","last_became_peered":"2023-12-16T20:21:40.793754+0000","last_unstale":"2023-12-16T20:50:07.282336+0000","last_undegraded":"2023-12-16T20:50:07.282336+0000","last_fullsized":"2023-12-16T20:50:07.282336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'180","last_scrub_stamp":"2023-12-16T20:50:07.282242+0000","last_deep_scrub":"27'180","last_deep_scrub_stamp":"2023-12-16T20:50:07.282242+0000","last_clean_scrub_stamp":"2023-12-16T20:50:07.282242+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:24:32.086175+0000","scrub_duration":0.0017886429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":10123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'33","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:31.412846+0000","last_change":"2023-12-16T20:49:31.412901+0000","last_active":"2023-12-16T20:49:31.412846+0000","last_peered":"2023-12-16T20:49:31.412846+0000","last_clean":"2023-12-16T20:49:31.412846+0000","last_became_active":"2023-12-16T20:21:36.533651+0000","last_became_peered":"2023-12-16T20:21:36.533651+0000","last_unstale":"2023-12-16T20:49:31.412846+0000","last_undegraded":"2023-12-16T20:49:31.412846+0000","last_fullsized":"2023-12-16T20:49:31.412846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:31.412729+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:31.412729+0000","last_clean_scrub_stamp":"2023-12-16T20:49:31.412729+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:47:35.138274+0000","scrub_duration":0.0013879739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'7","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.737712+0000","last_change":"2023-12-16T20:49:37.737756+0000","last_active":"2023-12-16T20:49:37.737712+0000","last_peered":"2023-12-16T20:49:37.737712+0000","last_clean":"2023-12-16T20:49:37.737712+0000","last_became_active":"2023-12-16T20:21:35.421875+0000","last_became_peered":"2023-12-16T20:21:35.421875+0000","last_unstale":"2023-12-16T20:49:37.737712+0000","last_undegraded":"2023-12-16T20:49:37.737712+0000","last_fullsized":"2023-12-16T20:49:37.737712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-16T20:49:37.737605+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-16T20:49:37.737605+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.737605+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:22:53.369062+0000","scrub_duration":0.001373296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'112","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:23.126310+0000","last_change":"2023-12-16T20:50:23.126333+0000","last_active":"2023-12-16T20:50:23.126310+0000","last_peered":"2023-12-16T20:50:23.126310+0000","last_clean":"2023-12-16T20:50:23.126310+0000","last_became_active":"2023-12-16T20:21:40.753994+0000","last_became_peered":"2023-12-16T20:21:40.753994+0000","last_unstale":"2023-12-16T20:50:23.126310+0000","last_undegraded":"2023-12-16T20:50:23.126310+0000","last_fullsized":"2023-12-16T20:50:23.126310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'112","last_scrub_stamp":"2023-12-16T20:50:23.126240+0000","last_deep_scrub":"27'112","last_deep_scrub_stamp":"2023-12-16T20:50:23.126240+0000","last_clean_scrub_stamp":"2023-12-16T20:50:23.126240+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:41:57.836948+0000","scrub_duration":0.0016879600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'33","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:58.278771+0000","last_change":"2023-12-16T20:49:58.278792+0000","last_active":"2023-12-16T20:49:58.278771+0000","last_peered":"2023-12-16T20:49:58.278771+0000","last_clean":"2023-12-16T20:49:58.278771+0000","last_became_active":"2023-12-16T20:21:36.451231+0000","last_became_peered":"2023-12-16T20:21:36.451231+0000","last_unstale":"2023-12-16T20:49:58.278771+0000","last_undegraded":"2023-12-16T20:49:58.278771+0000","last_fullsized":"2023-12-16T20:49:58.278771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:58.278691+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:58.278691+0000","last_clean_scrub_stamp":"2023-12-16T20:49:58.278691+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:50:56.909460+0000","scrub_duration":0.0011625979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'1042","reported_seq":2120,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:26.183376+0000","last_change":"2023-12-16T20:49:26.183411+0000","last_active":"2023-12-16T20:49:26.183376+0000","last_peered":"2023-12-16T20:49:26.183376+0000","last_clean":"2023-12-16T20:49:26.183376+0000","last_became_active":"2023-12-16T20:21:35.420236+0000","last_became_peered":"2023-12-16T20:21:35.420236+0000","last_unstale":"2023-12-16T20:49:26.183376+0000","last_undegraded":"2023-12-16T20:49:26.183376+0000","last_fullsized":"2023-12-16T20:49:26.183376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1042","last_scrub_stamp":"2023-12-16T20:49:26.183300+0000","last_deep_scrub":"27'1042","last_deep_scrub_stamp":"2023-12-16T20:49:26.183300+0000","last_clean_scrub_stamp":"2023-12-16T20:49:26.183300+0000","objects_scrubbed":1,"log_size":1042,"log_dups_size":0,"ondisk_log_size":1042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:27:50.281048+0000","scrub_duration":0.0018598899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222889,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1038,"num_read_kb":1098,"num_write":1039,"num_write_kb":1099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'134","reported_seq":168,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:56.870849+0000","last_change":"2023-12-16T20:49:56.870849+0000","last_active":"2023-12-16T20:49:56.870849+0000","last_peered":"2023-12-16T20:49:56.870849+0000","last_clean":"2023-12-16T20:49:56.870849+0000","last_became_active":"2023-12-16T20:22:14.842220+0000","last_became_peered":"2023-12-16T20:22:14.842220+0000","last_unstale":"2023-12-16T20:49:56.870849+0000","last_undegraded":"2023-12-16T20:49:56.870849+0000","last_fullsized":"2023-12-16T20:49:56.870849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'134","last_scrub_stamp":"2023-12-16T20:49:56.870733+0000","last_deep_scrub":"27'134","last_deep_scrub_stamp":"2023-12-16T20:49:56.870733+0000","last_clean_scrub_stamp":"2023-12-16T20:49:56.870733+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:23:12.502189+0000","scrub_duration":0.0016554510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":9129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"27'27","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:43.234920+0000","last_change":"2023-12-16T20:49:43.234962+0000","last_active":"2023-12-16T20:49:43.234920+0000","last_peered":"2023-12-16T20:49:43.234920+0000","last_clean":"2023-12-16T20:49:43.234920+0000","last_became_active":"2023-12-16T20:21:36.535571+0000","last_became_peered":"2023-12-16T20:21:36.535571+0000","last_unstale":"2023-12-16T20:49:43.234920+0000","last_undegraded":"2023-12-16T20:49:43.234920+0000","last_fullsized":"2023-12-16T20:49:43.234920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2023-12-16T20:49:43.234817+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2023-12-16T20:49:43.234817+0000","last_clean_scrub_stamp":"2023-12-16T20:49:43.234817+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:02:46.433595+0000","scrub_duration":0.001196548,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'545","reported_seq":586,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:48.856264+0000","last_change":"2023-12-16T20:49:48.856285+0000","last_active":"2023-12-16T20:49:48.856264+0000","last_peered":"2023-12-16T20:49:48.856264+0000","last_clean":"2023-12-16T20:49:48.856264+0000","last_became_active":"2023-12-16T20:21:35.418751+0000","last_became_peered":"2023-12-16T20:21:35.418751+0000","last_unstale":"2023-12-16T20:49:48.856264+0000","last_undegraded":"2023-12-16T20:49:48.856264+0000","last_fullsized":"2023-12-16T20:49:48.856264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'545","last_scrub_stamp":"2023-12-16T20:49:48.856178+0000","last_deep_scrub":"27'545","last_deep_scrub_stamp":"2023-12-16T20:49:48.856178+0000","last_clean_scrub_stamp":"2023-12-16T20:49:48.856178+0000","objects_scrubbed":1,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:46:48.769321+0000","scrub_duration":0.013032899000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'129","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:55.975864+0000","last_change":"2023-12-16T20:49:55.975910+0000","last_active":"2023-12-16T20:49:55.975864+0000","last_peered":"2023-12-16T20:49:55.975864+0000","last_clean":"2023-12-16T20:49:55.975864+0000","last_became_active":"2023-12-16T20:21:41.213977+0000","last_became_peered":"2023-12-16T20:21:41.213977+0000","last_unstale":"2023-12-16T20:49:55.975864+0000","last_undegraded":"2023-12-16T20:49:55.975864+0000","last_fullsized":"2023-12-16T20:49:55.975864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'129","last_scrub_stamp":"2023-12-16T20:49:55.975789+0000","last_deep_scrub":"27'129","last_deep_scrub_stamp":"2023-12-16T20:49:55.975789+0000","last_clean_scrub_stamp":"2023-12-16T20:49:55.975789+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:55:13.111565+0000","scrub_duration":0.0016379389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":8382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'30","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:25.008712+0000","last_change":"2023-12-16T20:49:25.008746+0000","last_active":"2023-12-16T20:49:25.008712+0000","last_peered":"2023-12-16T20:49:25.008712+0000","last_clean":"2023-12-16T20:49:25.008712+0000","last_became_active":"2023-12-16T20:21:36.550997+0000","last_became_peered":"2023-12-16T20:21:36.550997+0000","last_unstale":"2023-12-16T20:49:25.008712+0000","last_undegraded":"2023-12-16T20:49:25.008712+0000","last_fullsized":"2023-12-16T20:49:25.008712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-12-16T20:49:25.008610+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-12-16T20:49:25.008610+0000","last_clean_scrub_stamp":"2023-12-16T20:49:25.008610+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:16:31.068027+0000","scrub_duration":0.001488783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:44.635331+0000","last_change":"2023-12-16T20:49:44.635351+0000","last_active":"2023-12-16T20:49:44.635331+0000","last_peered":"2023-12-16T20:49:44.635331+0000","last_clean":"2023-12-16T20:49:44.635331+0000","last_became_active":"2023-12-16T20:21:35.415984+0000","last_became_peered":"2023-12-16T20:21:35.415984+0000","last_unstale":"2023-12-16T20:49:44.635331+0000","last_undegraded":"2023-12-16T20:49:44.635331+0000","last_fullsized":"2023-12-16T20:49:44.635331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2023-12-16T20:49:44.635268+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2023-12-16T20:49:44.635268+0000","last_clean_scrub_stamp":"2023-12-16T20:49:44.635268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:19:00.510701+0000","scrub_duration":0.001090756,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.944057+0000","last_change":"2023-12-16T20:49:35.944081+0000","last_active":"2023-12-16T20:49:35.944057+0000","last_peered":"2023-12-16T20:49:35.944057+0000","last_clean":"2023-12-16T20:49:35.944057+0000","last_became_active":"2023-12-16T20:21:25.195675+0000","last_became_peered":"2023-12-16T20:21:25.195675+0000","last_unstale":"2023-12-16T20:49:35.944057+0000","last_undegraded":"2023-12-16T20:49:35.944057+0000","last_fullsized":"2023-12-16T20:49:35.944057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2023-12-16T20:49:35.944005+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2023-12-16T20:49:35.944005+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.944005+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:22:55.655410+0000","scrub_duration":0.0041226689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'192","reported_seq":229,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:02.942506+0000","last_change":"2023-12-16T20:50:02.942529+0000","last_active":"2023-12-16T20:50:02.942506+0000","last_peered":"2023-12-16T20:50:02.942506+0000","last_clean":"2023-12-16T20:50:02.942506+0000","last_became_active":"2023-12-16T20:21:41.214012+0000","last_became_peered":"2023-12-16T20:21:41.214012+0000","last_unstale":"2023-12-16T20:50:02.942506+0000","last_undegraded":"2023-12-16T20:50:02.942506+0000","last_fullsized":"2023-12-16T20:50:02.942506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'192","last_scrub_stamp":"2023-12-16T20:50:02.942431+0000","last_deep_scrub":"27'192","last_deep_scrub_stamp":"2023-12-16T20:50:02.942431+0000","last_clean_scrub_stamp":"2023-12-16T20:50:02.942431+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:23:46.166218+0000","scrub_duration":0.0017960420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":12745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'36","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:29.998284+0000","last_change":"2023-12-16T20:49:29.998311+0000","last_active":"2023-12-16T20:49:29.998284+0000","last_peered":"2023-12-16T20:49:29.998284+0000","last_clean":"2023-12-16T20:49:29.998284+0000","last_became_active":"2023-12-16T20:21:36.552619+0000","last_became_peered":"2023-12-16T20:21:36.552619+0000","last_unstale":"2023-12-16T20:49:29.998284+0000","last_undegraded":"2023-12-16T20:49:29.998284+0000","last_fullsized":"2023-12-16T20:49:29.998284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2023-12-16T20:49:29.998180+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2023-12-16T20:49:29.998180+0000","last_clean_scrub_stamp":"2023-12-16T20:49:29.998180+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:51.843719+0000","scrub_duration":0.001334638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:30.083872+0000","last_change":"2023-12-16T20:49:30.083904+0000","last_active":"2023-12-16T20:49:30.083872+0000","last_peered":"2023-12-16T20:49:30.083872+0000","last_clean":"2023-12-16T20:49:30.083872+0000","last_became_active":"2023-12-16T20:21:35.413308+0000","last_became_peered":"2023-12-16T20:21:35.413308+0000","last_unstale":"2023-12-16T20:49:30.083872+0000","last_undegraded":"2023-12-16T20:49:30.083872+0000","last_fullsized":"2023-12-16T20:49:30.083872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-16T20:49:30.083795+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-16T20:49:30.083795+0000","last_clean_scrub_stamp":"2023-12-16T20:49:30.083795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:57:33.423790+0000","scrub_duration":0.001344486,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'151","reported_seq":188,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:04.951573+0000","last_change":"2023-12-16T20:50:04.951608+0000","last_active":"2023-12-16T20:50:04.951573+0000","last_peered":"2023-12-16T20:50:04.951573+0000","last_clean":"2023-12-16T20:50:04.951573+0000","last_became_active":"2023-12-16T20:21:41.212608+0000","last_became_peered":"2023-12-16T20:21:41.212608+0000","last_unstale":"2023-12-16T20:50:04.951573+0000","last_undegraded":"2023-12-16T20:50:04.951573+0000","last_fullsized":"2023-12-16T20:50:04.951573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'151","last_scrub_stamp":"2023-12-16T20:50:04.951489+0000","last_deep_scrub":"27'151","last_deep_scrub_stamp":"2023-12-16T20:50:04.951489+0000","last_clean_scrub_stamp":"2023-12-16T20:50:04.951489+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:05:51.090022+0000","scrub_duration":0.0015182559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":6553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'41","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:46.661846+0000","last_change":"2023-12-16T20:49:46.661867+0000","last_active":"2023-12-16T20:49:46.661846+0000","last_peered":"2023-12-16T20:49:46.661846+0000","last_clean":"2023-12-16T20:49:46.661846+0000","last_became_active":"2023-12-16T20:21:36.555631+0000","last_became_peered":"2023-12-16T20:21:36.555631+0000","last_unstale":"2023-12-16T20:49:46.661846+0000","last_undegraded":"2023-12-16T20:49:46.661846+0000","last_fullsized":"2023-12-16T20:49:46.661846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2023-12-16T20:49:46.661779+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2023-12-16T20:49:46.661779+0000","last_clean_scrub_stamp":"2023-12-16T20:49:46.661779+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:25:33.489213+0000","scrub_duration":0.0010676520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:57.264374+0000","last_change":"2023-12-16T20:49:57.264395+0000","last_active":"2023-12-16T20:49:57.264374+0000","last_peered":"2023-12-16T20:49:57.264374+0000","last_clean":"2023-12-16T20:49:57.264374+0000","last_became_active":"2023-12-16T20:21:35.415810+0000","last_became_peered":"2023-12-16T20:21:35.415810+0000","last_unstale":"2023-12-16T20:49:57.264374+0000","last_undegraded":"2023-12-16T20:49:57.264374+0000","last_fullsized":"2023-12-16T20:49:57.264374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:57.264322+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:57.264322+0000","last_clean_scrub_stamp":"2023-12-16T20:49:57.264322+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:07:09.553705+0000","scrub_duration":0.0024946949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'169","reported_seq":214,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:44.222648+0000","last_change":"2023-12-16T20:49:44.222668+0000","last_active":"2023-12-16T20:49:44.222648+0000","last_peered":"2023-12-16T20:49:44.222648+0000","last_clean":"2023-12-16T20:49:44.222648+0000","last_became_active":"2023-12-16T20:22:14.842282+0000","last_became_peered":"2023-12-16T20:22:14.842282+0000","last_unstale":"2023-12-16T20:49:44.222648+0000","last_undegraded":"2023-12-16T20:49:44.222648+0000","last_fullsized":"2023-12-16T20:49:44.222648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'169","last_scrub_stamp":"2023-12-16T20:49:44.222590+0000","last_deep_scrub":"27'169","last_deep_scrub_stamp":"2023-12-16T20:49:44.222590+0000","last_clean_scrub_stamp":"2023-12-16T20:49:44.222590+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:23:27.446377+0000","scrub_duration":0.001449423,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":8236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'35","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:11.713255+0000","last_change":"2023-12-16T20:50:11.713294+0000","last_active":"2023-12-16T20:50:11.713255+0000","last_peered":"2023-12-16T20:50:11.713255+0000","last_clean":"2023-12-16T20:50:11.713255+0000","last_became_active":"2023-12-16T20:21:36.536093+0000","last_became_peered":"2023-12-16T20:21:36.536093+0000","last_unstale":"2023-12-16T20:50:11.713255+0000","last_undegraded":"2023-12-16T20:50:11.713255+0000","last_fullsized":"2023-12-16T20:50:11.713255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-12-16T20:50:11.713146+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-12-16T20:50:11.713146+0000","last_clean_scrub_stamp":"2023-12-16T20:50:11.713146+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:15:13.580669+0000","scrub_duration":0.001350073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'8","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:33.942561+0000","last_change":"2023-12-16T20:49:33.942600+0000","last_active":"2023-12-16T20:49:33.942561+0000","last_peered":"2023-12-16T20:49:33.942561+0000","last_clean":"2023-12-16T20:49:33.942561+0000","last_became_active":"2023-12-16T20:21:35.420074+0000","last_became_peered":"2023-12-16T20:21:35.420074+0000","last_unstale":"2023-12-16T20:49:33.942561+0000","last_undegraded":"2023-12-16T20:49:33.942561+0000","last_fullsized":"2023-12-16T20:49:33.942561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2023-12-16T20:49:33.942494+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2023-12-16T20:49:33.942494+0000","last_clean_scrub_stamp":"2023-12-16T20:49:33.942494+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:52:08.699859+0000","scrub_duration":0.0020749739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'129","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:15.712313+0000","last_change":"2023-12-16T20:50:15.712336+0000","last_active":"2023-12-16T20:50:15.712313+0000","last_peered":"2023-12-16T20:50:15.712313+0000","last_clean":"2023-12-16T20:50:15.712313+0000","last_became_active":"2023-12-16T20:21:41.214939+0000","last_became_peered":"2023-12-16T20:21:41.214939+0000","last_unstale":"2023-12-16T20:50:15.712313+0000","last_undegraded":"2023-12-16T20:50:15.712313+0000","last_fullsized":"2023-12-16T20:50:15.712313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'129","last_scrub_stamp":"2023-12-16T20:50:15.712229+0000","last_deep_scrub":"27'129","last_deep_scrub_stamp":"2023-12-16T20:50:15.712229+0000","last_clean_scrub_stamp":"2023-12-16T20:50:15.712229+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:41:50.422937+0000","scrub_duration":0.001772055,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":12347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'21","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:52.751235+0000","last_change":"2023-12-16T20:49:52.751264+0000","last_active":"2023-12-16T20:49:52.751235+0000","last_peered":"2023-12-16T20:49:52.751235+0000","last_clean":"2023-12-16T20:49:52.751235+0000","last_became_active":"2023-12-16T20:21:36.534064+0000","last_became_peered":"2023-12-16T20:21:36.534064+0000","last_unstale":"2023-12-16T20:49:52.751235+0000","last_undegraded":"2023-12-16T20:49:52.751235+0000","last_fullsized":"2023-12-16T20:49:52.751235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2023-12-16T20:49:52.751136+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2023-12-16T20:49:52.751136+0000","last_clean_scrub_stamp":"2023-12-16T20:49:52.751136+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:50:51.381905+0000","scrub_duration":0.0013552460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:24.454926+0000","last_change":"2023-12-16T20:49:24.454950+0000","last_active":"2023-12-16T20:49:24.454926+0000","last_peered":"2023-12-16T20:49:24.454926+0000","last_clean":"2023-12-16T20:49:24.454926+0000","last_became_active":"2023-12-16T20:21:35.390740+0000","last_became_peered":"2023-12-16T20:21:35.390740+0000","last_unstale":"2023-12-16T20:49:24.454926+0000","last_undegraded":"2023-12-16T20:49:24.454926+0000","last_fullsized":"2023-12-16T20:49:24.454926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:24.454859+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:24.454859+0000","last_clean_scrub_stamp":"2023-12-16T20:49:24.454859+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:46:57.389983+0000","scrub_duration":0.0022306159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'180","reported_seq":217,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:38.446279+0000","last_change":"2023-12-16T20:49:38.446279+0000","last_active":"2023-12-16T20:49:38.446279+0000","last_peered":"2023-12-16T20:49:38.446279+0000","last_clean":"2023-12-16T20:49:38.446279+0000","last_became_active":"2023-12-16T20:21:40.753981+0000","last_became_peered":"2023-12-16T20:21:40.753981+0000","last_unstale":"2023-12-16T20:49:38.446279+0000","last_undegraded":"2023-12-16T20:49:38.446279+0000","last_fullsized":"2023-12-16T20:49:38.446279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'180","last_scrub_stamp":"2023-12-16T20:49:38.446193+0000","last_deep_scrub":"27'180","last_deep_scrub_stamp":"2023-12-16T20:49:38.446193+0000","last_clean_scrub_stamp":"2023-12-16T20:49:38.446193+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:22:54.077650+0000","scrub_duration":0.00173639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":13396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'37","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:55.745796+0000","last_change":"2023-12-16T20:49:55.745832+0000","last_active":"2023-12-16T20:49:55.745796+0000","last_peered":"2023-12-16T20:49:55.745796+0000","last_clean":"2023-12-16T20:49:55.745796+0000","last_became_active":"2023-12-16T20:21:36.536822+0000","last_became_peered":"2023-12-16T20:21:36.536822+0000","last_unstale":"2023-12-16T20:49:55.745796+0000","last_undegraded":"2023-12-16T20:49:55.745796+0000","last_fullsized":"2023-12-16T20:49:55.745796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2023-12-16T20:49:55.745723+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2023-12-16T20:49:55.745723+0000","last_clean_scrub_stamp":"2023-12-16T20:49:55.745723+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:23:38.969510+0000","scrub_duration":0.00092544100000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'13","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:36.010890+0000","last_change":"2023-12-16T20:49:36.010890+0000","last_active":"2023-12-16T20:49:36.010890+0000","last_peered":"2023-12-16T20:49:36.010890+0000","last_clean":"2023-12-16T20:49:36.010890+0000","last_became_active":"2023-12-16T20:21:35.416850+0000","last_became_peered":"2023-12-16T20:21:35.416850+0000","last_unstale":"2023-12-16T20:49:36.010890+0000","last_undegraded":"2023-12-16T20:49:36.010890+0000","last_fullsized":"2023-12-16T20:49:36.010890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2023-12-16T20:49:36.010800+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2023-12-16T20:49:36.010800+0000","last_clean_scrub_stamp":"2023-12-16T20:49:36.010800+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:31:01.472769+0000","scrub_duration":0.0029238240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'159","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:46.189372+0000","last_change":"2023-12-16T20:49:46.189393+0000","last_active":"2023-12-16T20:49:46.189372+0000","last_peered":"2023-12-16T20:49:46.189372+0000","last_clean":"2023-12-16T20:49:46.189372+0000","last_became_active":"2023-12-16T20:21:40.755041+0000","last_became_peered":"2023-12-16T20:21:40.755041+0000","last_unstale":"2023-12-16T20:49:46.189372+0000","last_undegraded":"2023-12-16T20:49:46.189372+0000","last_fullsized":"2023-12-16T20:49:46.189372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'159","last_scrub_stamp":"2023-12-16T20:49:46.189303+0000","last_deep_scrub":"27'159","last_deep_scrub_stamp":"2023-12-16T20:49:46.189303+0000","last_clean_scrub_stamp":"2023-12-16T20:49:46.189303+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:05:32.327836+0000","scrub_duration":0.001539393,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":9935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'32","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:47.065132+0000","last_change":"2023-12-16T20:49:47.065175+0000","last_active":"2023-12-16T20:49:47.065132+0000","last_peered":"2023-12-16T20:49:47.065132+0000","last_clean":"2023-12-16T20:49:47.065132+0000","last_became_active":"2023-12-16T20:21:36.540861+0000","last_became_peered":"2023-12-16T20:21:36.540861+0000","last_unstale":"2023-12-16T20:49:47.065132+0000","last_undegraded":"2023-12-16T20:49:47.065132+0000","last_fullsized":"2023-12-16T20:49:47.065132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2023-12-16T20:49:47.065045+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2023-12-16T20:49:47.065045+0000","last_clean_scrub_stamp":"2023-12-16T20:49:47.065045+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:10:59.600482+0000","scrub_duration":0.00123215,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:38.003759+0000","last_change":"2023-12-16T20:49:38.003778+0000","last_active":"2023-12-16T20:49:38.003759+0000","last_peered":"2023-12-16T20:49:38.003759+0000","last_clean":"2023-12-16T20:49:38.003759+0000","last_became_active":"2023-12-16T20:21:35.424822+0000","last_became_peered":"2023-12-16T20:21:35.424822+0000","last_unstale":"2023-12-16T20:49:38.003759+0000","last_undegraded":"2023-12-16T20:49:38.003759+0000","last_fullsized":"2023-12-16T20:49:38.003759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-16T20:49:38.003697+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-16T20:49:38.003697+0000","last_clean_scrub_stamp":"2023-12-16T20:49:38.003697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:03:34.460897+0000","scrub_duration":0.00081691399999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'130","reported_seq":165,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:03.922638+0000","last_change":"2023-12-16T20:50:03.922658+0000","last_active":"2023-12-16T20:50:03.922638+0000","last_peered":"2023-12-16T20:50:03.922638+0000","last_clean":"2023-12-16T20:50:03.922638+0000","last_became_active":"2023-12-16T20:21:41.215002+0000","last_became_peered":"2023-12-16T20:21:41.215002+0000","last_unstale":"2023-12-16T20:50:03.922638+0000","last_undegraded":"2023-12-16T20:50:03.922638+0000","last_fullsized":"2023-12-16T20:50:03.922638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'130","last_scrub_stamp":"2023-12-16T20:50:03.922571+0000","last_deep_scrub":"27'130","last_deep_scrub_stamp":"2023-12-16T20:50:03.922571+0000","last_clean_scrub_stamp":"2023-12-16T20:50:03.922571+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:30:15.547717+0000","scrub_duration":0.0015362489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":7078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'49","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:10.704079+0000","last_change":"2023-12-16T20:50:10.704102+0000","last_active":"2023-12-16T20:50:10.704079+0000","last_peered":"2023-12-16T20:50:10.704079+0000","last_clean":"2023-12-16T20:50:10.704079+0000","last_became_active":"2023-12-16T20:21:36.535447+0000","last_became_peered":"2023-12-16T20:21:36.535447+0000","last_unstale":"2023-12-16T20:50:10.704079+0000","last_undegraded":"2023-12-16T20:50:10.704079+0000","last_fullsized":"2023-12-16T20:50:10.704079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2023-12-16T20:50:10.704002+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2023-12-16T20:50:10.704002+0000","last_clean_scrub_stamp":"2023-12-16T20:50:10.704002+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:43:20.636829+0000","scrub_duration":0.001344736,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:42.639497+0000","last_change":"2023-12-16T20:49:42.639525+0000","last_active":"2023-12-16T20:49:42.639497+0000","last_peered":"2023-12-16T20:49:42.639497+0000","last_clean":"2023-12-16T20:49:42.639497+0000","last_became_active":"2023-12-16T20:21:35.423275+0000","last_became_peered":"2023-12-16T20:21:35.423275+0000","last_unstale":"2023-12-16T20:49:42.639497+0000","last_undegraded":"2023-12-16T20:49:42.639497+0000","last_fullsized":"2023-12-16T20:49:42.639497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-12-16T20:49:42.639417+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-12-16T20:49:42.639417+0000","last_clean_scrub_stamp":"2023-12-16T20:49:42.639417+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:10:55.174854+0000","scrub_duration":0.0012433469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'115","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:54.883561+0000","last_change":"2023-12-16T20:49:54.883598+0000","last_active":"2023-12-16T20:49:54.883561+0000","last_peered":"2023-12-16T20:49:54.883561+0000","last_clean":"2023-12-16T20:49:54.883561+0000","last_became_active":"2023-12-16T20:21:41.212699+0000","last_became_peered":"2023-12-16T20:21:41.212699+0000","last_unstale":"2023-12-16T20:49:54.883561+0000","last_undegraded":"2023-12-16T20:49:54.883561+0000","last_fullsized":"2023-12-16T20:49:54.883561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'115","last_scrub_stamp":"2023-12-16T20:49:54.883463+0000","last_deep_scrub":"27'115","last_deep_scrub_stamp":"2023-12-16T20:49:54.883463+0000","last_clean_scrub_stamp":"2023-12-16T20:49:54.883463+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:54.123130+0000","scrub_duration":0.0019162179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'45","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:42.256750+0000","last_change":"2023-12-16T20:49:42.256769+0000","last_active":"2023-12-16T20:49:42.256750+0000","last_peered":"2023-12-16T20:49:42.256750+0000","last_clean":"2023-12-16T20:49:42.256750+0000","last_became_active":"2023-12-16T20:21:36.523649+0000","last_became_peered":"2023-12-16T20:21:36.523649+0000","last_unstale":"2023-12-16T20:49:42.256750+0000","last_undegraded":"2023-12-16T20:49:42.256750+0000","last_fullsized":"2023-12-16T20:49:42.256750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-16T20:49:42.256681+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-16T20:49:42.256681+0000","last_clean_scrub_stamp":"2023-12-16T20:49:42.256681+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:52:59.557961+0000","scrub_duration":0.0011776029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'263","reported_seq":302,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:21.189639+0000","last_change":"2023-12-16T20:49:21.189639+0000","last_active":"2023-12-16T20:49:21.189639+0000","last_peered":"2023-12-16T20:49:21.189639+0000","last_clean":"2023-12-16T20:49:21.189639+0000","last_became_active":"2023-12-16T20:21:35.388392+0000","last_became_peered":"2023-12-16T20:21:35.388392+0000","last_unstale":"2023-12-16T20:49:21.189639+0000","last_undegraded":"2023-12-16T20:49:21.189639+0000","last_fullsized":"2023-12-16T20:49:21.189639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'263","last_scrub_stamp":"2023-12-16T20:49:21.189550+0000","last_deep_scrub":"27'263","last_deep_scrub_stamp":"2023-12-16T20:49:21.189550+0000","last_clean_scrub_stamp":"2023-12-16T20:49:21.189550+0000","objects_scrubbed":3,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:47:24.915095+0000","scrub_duration":0.0088499110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2496854,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":2582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'142","reported_seq":177,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:16.673814+0000","last_change":"2023-12-16T20:50:16.673837+0000","last_active":"2023-12-16T20:50:16.673814+0000","last_peered":"2023-12-16T20:50:16.673814+0000","last_clean":"2023-12-16T20:50:16.673814+0000","last_became_active":"2023-12-16T20:21:41.212721+0000","last_became_peered":"2023-12-16T20:21:41.212721+0000","last_unstale":"2023-12-16T20:50:16.673814+0000","last_undegraded":"2023-12-16T20:50:16.673814+0000","last_fullsized":"2023-12-16T20:50:16.673814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'142","last_scrub_stamp":"2023-12-16T20:50:16.673740+0000","last_deep_scrub":"27'142","last_deep_scrub_stamp":"2023-12-16T20:50:16.673740+0000","last_clean_scrub_stamp":"2023-12-16T20:50:16.673740+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:11:07.259861+0000","scrub_duration":0.0018609950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":13674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'36","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:19.718255+0000","last_change":"2023-12-16T20:50:19.718278+0000","last_active":"2023-12-16T20:50:19.718255+0000","last_peered":"2023-12-16T20:50:19.718255+0000","last_clean":"2023-12-16T20:50:19.718255+0000","last_became_active":"2023-12-16T20:21:36.519561+0000","last_became_peered":"2023-12-16T20:21:36.519561+0000","last_unstale":"2023-12-16T20:50:19.718255+0000","last_undegraded":"2023-12-16T20:50:19.718255+0000","last_fullsized":"2023-12-16T20:50:19.718255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2023-12-16T20:50:19.718136+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2023-12-16T20:50:19.718136+0000","last_clean_scrub_stamp":"2023-12-16T20:50:19.718136+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:31.430139+0000","scrub_duration":0.0017545589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'853","reported_seq":892,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:27.001377+0000","last_change":"2023-12-16T20:49:27.001377+0000","last_active":"2023-12-16T20:49:27.001377+0000","last_peered":"2023-12-16T20:49:27.001377+0000","last_clean":"2023-12-16T20:49:27.001377+0000","last_became_active":"2023-12-16T20:21:35.425929+0000","last_became_peered":"2023-12-16T20:21:35.425929+0000","last_unstale":"2023-12-16T20:49:27.001377+0000","last_undegraded":"2023-12-16T20:49:27.001377+0000","last_fullsized":"2023-12-16T20:49:27.001377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'853","last_scrub_stamp":"2023-12-16T20:49:27.001283+0000","last_deep_scrub":"27'853","last_deep_scrub_stamp":"2023-12-16T20:49:27.001283+0000","last_clean_scrub_stamp":"2023-12-16T20:49:27.001283+0000","objects_scrubbed":4,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:45:17.910698+0000","scrub_duration":0.017121821999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":4548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'165","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:17.088382+0000","last_change":"2023-12-16T20:50:17.088403+0000","last_active":"2023-12-16T20:50:17.088382+0000","last_peered":"2023-12-16T20:50:17.088382+0000","last_clean":"2023-12-16T20:50:17.088382+0000","last_became_active":"2023-12-16T20:21:40.753624+0000","last_became_peered":"2023-12-16T20:21:40.753624+0000","last_unstale":"2023-12-16T20:50:17.088382+0000","last_undegraded":"2023-12-16T20:50:17.088382+0000","last_fullsized":"2023-12-16T20:50:17.088382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'165","last_scrub_stamp":"2023-12-16T20:50:17.088309+0000","last_deep_scrub":"27'165","last_deep_scrub_stamp":"2023-12-16T20:50:17.088309+0000","last_clean_scrub_stamp":"2023-12-16T20:50:17.088309+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:43:27.021136+0000","scrub_duration":0.0017766119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":9759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'33","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:32.382521+0000","last_change":"2023-12-16T20:49:32.382521+0000","last_active":"2023-12-16T20:49:32.382521+0000","last_peered":"2023-12-16T20:49:32.382521+0000","last_clean":"2023-12-16T20:49:32.382521+0000","last_became_active":"2023-12-16T20:21:36.533790+0000","last_became_peered":"2023-12-16T20:21:36.533790+0000","last_unstale":"2023-12-16T20:49:32.382521+0000","last_undegraded":"2023-12-16T20:49:32.382521+0000","last_fullsized":"2023-12-16T20:49:32.382521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:32.382392+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:32.382392+0000","last_clean_scrub_stamp":"2023-12-16T20:49:32.382392+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:54.227931+0000","scrub_duration":0.0013665769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'708","reported_seq":746,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:52.273670+0000","last_change":"2023-12-16T20:49:52.273727+0000","last_active":"2023-12-16T20:49:52.273670+0000","last_peered":"2023-12-16T20:49:52.273670+0000","last_clean":"2023-12-16T20:49:52.273670+0000","last_became_active":"2023-12-16T20:21:35.415790+0000","last_became_peered":"2023-12-16T20:21:35.415790+0000","last_unstale":"2023-12-16T20:49:52.273670+0000","last_undegraded":"2023-12-16T20:49:52.273670+0000","last_fullsized":"2023-12-16T20:49:52.273670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'708","last_scrub_stamp":"2023-12-16T20:49:52.273600+0000","last_deep_scrub":"27'708","last_deep_scrub_stamp":"2023-12-16T20:49:52.273600+0000","last_clean_scrub_stamp":"2023-12-16T20:49:52.273600+0000","objects_scrubbed":2,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:19:08.149033+0000","scrub_duration":0.0033982190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":703,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'154","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:54.490333+0000","last_change":"2023-12-16T20:49:54.490356+0000","last_active":"2023-12-16T20:49:54.490333+0000","last_peered":"2023-12-16T20:49:54.490333+0000","last_clean":"2023-12-16T20:49:54.490333+0000","last_became_active":"2023-12-16T20:21:40.793667+0000","last_became_peered":"2023-12-16T20:21:40.793667+0000","last_unstale":"2023-12-16T20:49:54.490333+0000","last_undegraded":"2023-12-16T20:49:54.490333+0000","last_fullsized":"2023-12-16T20:49:54.490333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'154","last_scrub_stamp":"2023-12-16T20:49:54.490252+0000","last_deep_scrub":"27'154","last_deep_scrub_stamp":"2023-12-16T20:49:54.490252+0000","last_clean_scrub_stamp":"2023-12-16T20:49:54.490252+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:47:30.325073+0000","scrub_duration":0.0017958200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":20505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'40","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:41.244903+0000","last_change":"2023-12-16T20:49:41.244938+0000","last_active":"2023-12-16T20:49:41.244903+0000","last_peered":"2023-12-16T20:49:41.244903+0000","last_clean":"2023-12-16T20:49:41.244903+0000","last_became_active":"2023-12-16T20:21:36.552482+0000","last_became_peered":"2023-12-16T20:21:36.552482+0000","last_unstale":"2023-12-16T20:49:41.244903+0000","last_undegraded":"2023-12-16T20:49:41.244903+0000","last_fullsized":"2023-12-16T20:49:41.244903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2023-12-16T20:49:41.244780+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2023-12-16T20:49:41.244780+0000","last_clean_scrub_stamp":"2023-12-16T20:49:41.244780+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:46:41.157923+0000","scrub_duration":0.00118479,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:32.853509+0000","last_change":"2023-12-16T20:49:32.853535+0000","last_active":"2023-12-16T20:49:32.853509+0000","last_peered":"2023-12-16T20:49:32.853509+0000","last_clean":"2023-12-16T20:49:32.853509+0000","last_became_active":"2023-12-16T20:21:35.428100+0000","last_became_peered":"2023-12-16T20:21:35.428100+0000","last_unstale":"2023-12-16T20:49:32.853509+0000","last_undegraded":"2023-12-16T20:49:32.853509+0000","last_fullsized":"2023-12-16T20:49:32.853509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-12-16T20:49:32.853418+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-12-16T20:49:32.853418+0000","last_clean_scrub_stamp":"2023-12-16T20:49:32.853418+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:16:38.912835+0000","scrub_duration":0.001267879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'126","reported_seq":162,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:06.853446+0000","last_change":"2023-12-16T20:50:06.853475+0000","last_active":"2023-12-16T20:50:06.853446+0000","last_peered":"2023-12-16T20:50:06.853446+0000","last_clean":"2023-12-16T20:50:06.853446+0000","last_became_active":"2023-12-16T20:21:40.752957+0000","last_became_peered":"2023-12-16T20:21:40.752957+0000","last_unstale":"2023-12-16T20:50:06.853446+0000","last_undegraded":"2023-12-16T20:50:06.853446+0000","last_fullsized":"2023-12-16T20:50:06.853446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'126","last_scrub_stamp":"2023-12-16T20:50:06.853371+0000","last_deep_scrub":"27'126","last_deep_scrub_stamp":"2023-12-16T20:50:06.853371+0000","last_clean_scrub_stamp":"2023-12-16T20:50:06.853371+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:22:51.024082+0000","scrub_duration":0.0017641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":10032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'43","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:55.902407+0000","last_change":"2023-12-16T20:49:55.902427+0000","last_active":"2023-12-16T20:49:55.902407+0000","last_peered":"2023-12-16T20:49:55.902407+0000","last_clean":"2023-12-16T20:49:55.902407+0000","last_became_active":"2023-12-16T20:22:14.840679+0000","last_became_peered":"2023-12-16T20:22:14.840679+0000","last_unstale":"2023-12-16T20:49:55.902407+0000","last_undegraded":"2023-12-16T20:49:55.902407+0000","last_fullsized":"2023-12-16T20:49:55.902407+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2023-12-16T20:49:55.902337+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2023-12-16T20:49:55.902337+0000","last_clean_scrub_stamp":"2023-12-16T20:49:55.902337+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:17:01.961753+0000","scrub_duration":0.0011720260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.961032+0000","last_change":"2023-12-16T20:49:35.961051+0000","last_active":"2023-12-16T20:49:35.961032+0000","last_peered":"2023-12-16T20:49:35.961032+0000","last_clean":"2023-12-16T20:49:35.961032+0000","last_became_active":"2023-12-16T20:21:35.429940+0000","last_became_peered":"2023-12-16T20:21:35.429940+0000","last_unstale":"2023-12-16T20:49:35.961032+0000","last_undegraded":"2023-12-16T20:49:35.961032+0000","last_fullsized":"2023-12-16T20:49:35.961032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:35.960970+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:35.960970+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.960970+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:07:46.264662+0000","scrub_duration":0.00082690499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'174","reported_seq":210,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:51.902166+0000","last_change":"2023-12-16T20:49:51.902204+0000","last_active":"2023-12-16T20:49:51.902166+0000","last_peered":"2023-12-16T20:49:51.902166+0000","last_clean":"2023-12-16T20:49:51.902166+0000","last_became_active":"2023-12-16T20:21:41.215893+0000","last_became_peered":"2023-12-16T20:21:41.215893+0000","last_unstale":"2023-12-16T20:49:51.902166+0000","last_undegraded":"2023-12-16T20:49:51.902166+0000","last_fullsized":"2023-12-16T20:49:51.902166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'174","last_scrub_stamp":"2023-12-16T20:49:51.902070+0000","last_deep_scrub":"27'174","last_deep_scrub_stamp":"2023-12-16T20:49:51.902070+0000","last_clean_scrub_stamp":"2023-12-16T20:49:51.902070+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:14:53.769594+0000","scrub_duration":0.001858784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":9716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'144","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:59.069009+0000","last_change":"2023-12-16T20:49:59.069045+0000","last_active":"2023-12-16T20:49:59.069009+0000","last_peered":"2023-12-16T20:49:59.069009+0000","last_clean":"2023-12-16T20:49:59.069009+0000","last_became_active":"2023-12-16T20:21:41.214950+0000","last_became_peered":"2023-12-16T20:21:41.214950+0000","last_unstale":"2023-12-16T20:49:59.069009+0000","last_undegraded":"2023-12-16T20:49:59.069009+0000","last_fullsized":"2023-12-16T20:49:59.069009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'144","last_scrub_stamp":"2023-12-16T20:49:59.068933+0000","last_deep_scrub":"27'144","last_deep_scrub_stamp":"2023-12-16T20:49:59.068933+0000","last_clean_scrub_stamp":"2023-12-16T20:49:59.068933+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:43:09.001759+0000","scrub_duration":0.0016057809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":7732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'44","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.210606+0000","last_change":"2023-12-16T20:49:35.210624+0000","last_active":"2023-12-16T20:49:35.210606+0000","last_peered":"2023-12-16T20:49:35.210606+0000","last_clean":"2023-12-16T20:49:35.210606+0000","last_became_active":"2023-12-16T20:21:36.519476+0000","last_became_peered":"2023-12-16T20:21:36.519476+0000","last_unstale":"2023-12-16T20:49:35.210606+0000","last_undegraded":"2023-12-16T20:49:35.210606+0000","last_fullsized":"2023-12-16T20:49:35.210606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2023-12-16T20:49:35.210541+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2023-12-16T20:49:35.210541+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.210541+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:05:54.945127+0000","scrub_duration":0.00098724800000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:41.643915+0000","last_change":"2023-12-16T20:49:41.643946+0000","last_active":"2023-12-16T20:49:41.643915+0000","last_peered":"2023-12-16T20:49:41.643915+0000","last_clean":"2023-12-16T20:49:41.643915+0000","last_became_active":"2023-12-16T20:21:35.414846+0000","last_became_peered":"2023-12-16T20:21:35.414846+0000","last_unstale":"2023-12-16T20:49:41.643915+0000","last_undegraded":"2023-12-16T20:49:41.643915+0000","last_fullsized":"2023-12-16T20:49:41.643915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:41.643824+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:41.643824+0000","last_clean_scrub_stamp":"2023-12-16T20:49:41.643824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:54:58.109657+0000","scrub_duration":0.000945662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'142","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:10.074482+0000","last_change":"2023-12-16T20:50:10.074521+0000","last_active":"2023-12-16T20:50:10.074482+0000","last_peered":"2023-12-16T20:50:10.074482+0000","last_clean":"2023-12-16T20:50:10.074482+0000","last_became_active":"2023-12-16T20:21:40.794073+0000","last_became_peered":"2023-12-16T20:21:40.794073+0000","last_unstale":"2023-12-16T20:50:10.074482+0000","last_undegraded":"2023-12-16T20:50:10.074482+0000","last_fullsized":"2023-12-16T20:50:10.074482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'142","last_scrub_stamp":"2023-12-16T20:50:10.074366+0000","last_deep_scrub":"27'142","last_deep_scrub_stamp":"2023-12-16T20:50:10.074366+0000","last_clean_scrub_stamp":"2023-12-16T20:50:10.074366+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:24:34.878298+0000","scrub_duration":0.0019660390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":21602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'45","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:08.796594+0000","last_change":"2023-12-16T20:22:14.772045+0000","last_active":"2023-12-16T20:49:08.796594+0000","last_peered":"2023-12-16T20:49:08.796594+0000","last_clean":"2023-12-16T20:49:08.796594+0000","last_became_active":"2023-12-16T20:22:14.771747+0000","last_became_peered":"2023-12-16T20:22:14.771747+0000","last_unstale":"2023-12-16T20:49:08.796594+0000","last_undegraded":"2023-12-16T20:49:08.796594+0000","last_fullsized":"2023-12-16T20:49:08.796594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:36.037153+0000","last_change":"2023-12-16T20:49:36.037185+0000","last_active":"2023-12-16T20:49:36.037153+0000","last_peered":"2023-12-16T20:49:36.037153+0000","last_clean":"2023-12-16T20:49:36.037153+0000","last_became_active":"2023-12-16T20:21:35.421982+0000","last_became_peered":"2023-12-16T20:21:35.421982+0000","last_unstale":"2023-12-16T20:49:36.037153+0000","last_undegraded":"2023-12-16T20:49:36.037153+0000","last_fullsized":"2023-12-16T20:49:36.037153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-16T20:49:36.037044+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-16T20:49:36.037044+0000","last_clean_scrub_stamp":"2023-12-16T20:49:36.037044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:06:48.326428+0000","scrub_duration":0.001104584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'702","reported_seq":740,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:36.983829+0000","last_change":"2023-12-16T20:49:36.983854+0000","last_active":"2023-12-16T20:49:36.983829+0000","last_peered":"2023-12-16T20:49:36.983829+0000","last_clean":"2023-12-16T20:49:36.983829+0000","last_became_active":"2023-12-16T20:21:35.424254+0000","last_became_peered":"2023-12-16T20:21:35.424254+0000","last_unstale":"2023-12-16T20:49:36.983829+0000","last_undegraded":"2023-12-16T20:49:36.983829+0000","last_fullsized":"2023-12-16T20:49:36.983829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'702","last_scrub_stamp":"2023-12-16T20:49:36.983769+0000","last_deep_scrub":"27'702","last_deep_scrub_stamp":"2023-12-16T20:49:36.983769+0000","last_clean_scrub_stamp":"2023-12-16T20:49:36.983769+0000","objects_scrubbed":1,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:05:56.718355+0000","scrub_duration":0.011541968999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'39","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.292672+0000","last_change":"2023-12-16T20:49:35.292691+0000","last_active":"2023-12-16T20:49:35.292672+0000","last_peered":"2023-12-16T20:49:35.292672+0000","last_clean":"2023-12-16T20:49:35.292672+0000","last_became_active":"2023-12-16T20:21:36.533574+0000","last_became_peered":"2023-12-16T20:21:36.533574+0000","last_unstale":"2023-12-16T20:49:35.292672+0000","last_undegraded":"2023-12-16T20:49:35.292672+0000","last_fullsized":"2023-12-16T20:49:35.292672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-12-16T20:49:35.292617+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-12-16T20:49:35.292617+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.292617+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:10:47.828054+0000","scrub_duration":0.0011431620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'88","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:45.947854+0000","last_change":"2023-12-16T20:49:45.947897+0000","last_active":"2023-12-16T20:49:45.947854+0000","last_peered":"2023-12-16T20:49:45.947854+0000","last_clean":"2023-12-16T20:49:45.947854+0000","last_became_active":"2023-12-16T20:21:40.794082+0000","last_became_peered":"2023-12-16T20:21:40.794082+0000","last_unstale":"2023-12-16T20:49:45.947854+0000","last_undegraded":"2023-12-16T20:49:45.947854+0000","last_fullsized":"2023-12-16T20:49:45.947854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'88","last_scrub_stamp":"2023-12-16T20:49:45.947775+0000","last_deep_scrub":"27'88","last_deep_scrub_stamp":"2023-12-16T20:49:45.947775+0000","last_clean_scrub_stamp":"2023-12-16T20:49:45.947775+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:34:07.793315+0000","scrub_duration":0.001508957,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'687","reported_seq":725,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:34.057180+0000","last_change":"2023-12-16T20:49:34.057203+0000","last_active":"2023-12-16T20:49:34.057180+0000","last_peered":"2023-12-16T20:49:34.057180+0000","last_clean":"2023-12-16T20:49:34.057180+0000","last_became_active":"2023-12-16T20:21:35.419409+0000","last_became_peered":"2023-12-16T20:21:35.419409+0000","last_unstale":"2023-12-16T20:49:34.057180+0000","last_undegraded":"2023-12-16T20:49:34.057180+0000","last_fullsized":"2023-12-16T20:49:34.057180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'687","last_scrub_stamp":"2023-12-16T20:49:34.057124+0000","last_deep_scrub":"27'687","last_deep_scrub_stamp":"2023-12-16T20:49:34.057124+0000","last_clean_scrub_stamp":"2023-12-16T20:49:34.057124+0000","objects_scrubbed":1,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:18:49.932557+0000","scrub_duration":0.013116096000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":4443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'33","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:27.400108+0000","last_change":"2023-12-16T20:49:27.400127+0000","last_active":"2023-12-16T20:49:27.400108+0000","last_peered":"2023-12-16T20:49:27.400108+0000","last_clean":"2023-12-16T20:49:27.400108+0000","last_became_active":"2023-12-16T20:21:36.533325+0000","last_became_peered":"2023-12-16T20:21:36.533325+0000","last_unstale":"2023-12-16T20:49:27.400108+0000","last_undegraded":"2023-12-16T20:49:27.400108+0000","last_fullsized":"2023-12-16T20:49:27.400108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:27.400042+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:27.400042+0000","last_clean_scrub_stamp":"2023-12-16T20:49:27.400042+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:05:59.365345+0000","scrub_duration":0.001383497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'165","reported_seq":200,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:04.926738+0000","last_change":"2023-12-16T20:50:04.926772+0000","last_active":"2023-12-16T20:50:04.926738+0000","last_peered":"2023-12-16T20:50:04.926738+0000","last_clean":"2023-12-16T20:50:04.926738+0000","last_became_active":"2023-12-16T20:21:40.744731+0000","last_became_peered":"2023-12-16T20:21:40.744731+0000","last_unstale":"2023-12-16T20:50:04.926738+0000","last_undegraded":"2023-12-16T20:50:04.926738+0000","last_fullsized":"2023-12-16T20:50:04.926738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'165","last_scrub_stamp":"2023-12-16T20:50:04.926655+0000","last_deep_scrub":"27'165","last_deep_scrub_stamp":"2023-12-16T20:50:04.926655+0000","last_clean_scrub_stamp":"2023-12-16T20:50:04.926655+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:19:57.180214+0000","scrub_duration":0.001595499,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":13136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'49","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:00.954202+0000","last_change":"2023-12-16T20:50:00.954235+0000","last_active":"2023-12-16T20:50:00.954202+0000","last_peered":"2023-12-16T20:50:00.954202+0000","last_clean":"2023-12-16T20:50:00.954202+0000","last_became_active":"2023-12-16T20:21:36.542287+0000","last_became_peered":"2023-12-16T20:21:36.542287+0000","last_unstale":"2023-12-16T20:50:00.954202+0000","last_undegraded":"2023-12-16T20:50:00.954202+0000","last_fullsized":"2023-12-16T20:50:00.954202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2023-12-16T20:50:00.954129+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2023-12-16T20:50:00.954129+0000","last_clean_scrub_stamp":"2023-12-16T20:50:00.954129+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:04.152907+0000","scrub_duration":0.0011496799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'51","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:38.084320+0000","last_change":"2023-12-16T20:49:38.084340+0000","last_active":"2023-12-16T20:49:38.084320+0000","last_peered":"2023-12-16T20:49:38.084320+0000","last_clean":"2023-12-16T20:49:38.084320+0000","last_became_active":"2023-12-16T20:21:36.550911+0000","last_became_peered":"2023-12-16T20:21:36.550911+0000","last_unstale":"2023-12-16T20:49:38.084320+0000","last_undegraded":"2023-12-16T20:49:38.084320+0000","last_fullsized":"2023-12-16T20:49:38.084320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2023-12-16T20:49:38.084254+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2023-12-16T20:49:38.084254+0000","last_clean_scrub_stamp":"2023-12-16T20:49:38.084254+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:53:36.801901+0000","scrub_duration":0.0010491820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'50","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:56.639838+0000","last_change":"2023-12-16T20:49:56.639875+0000","last_active":"2023-12-16T20:49:56.639838+0000","last_peered":"2023-12-16T20:49:56.639838+0000","last_clean":"2023-12-16T20:49:56.639838+0000","last_became_active":"2023-12-16T20:21:36.555822+0000","last_became_peered":"2023-12-16T20:21:36.555822+0000","last_unstale":"2023-12-16T20:49:56.639838+0000","last_undegraded":"2023-12-16T20:49:56.639838+0000","last_fullsized":"2023-12-16T20:49:56.639838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2023-12-16T20:49:56.639706+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2023-12-16T20:49:56.639706+0000","last_clean_scrub_stamp":"2023-12-16T20:49:56.639706+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:23:39.863493+0000","scrub_duration":0.0012747139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'35","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:33.218396+0000","last_change":"2023-12-16T20:49:33.218419+0000","last_active":"2023-12-16T20:49:33.218396+0000","last_peered":"2023-12-16T20:49:33.218396+0000","last_clean":"2023-12-16T20:49:33.218396+0000","last_became_active":"2023-12-16T20:21:36.524747+0000","last_became_peered":"2023-12-16T20:21:36.524747+0000","last_unstale":"2023-12-16T20:49:33.218396+0000","last_undegraded":"2023-12-16T20:49:33.218396+0000","last_fullsized":"2023-12-16T20:49:33.218396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-12-16T20:49:33.218309+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-12-16T20:49:33.218309+0000","last_clean_scrub_stamp":"2023-12-16T20:49:33.218309+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:06:49.056161+0000","scrub_duration":0.001493435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'29","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:39.987522+0000","last_change":"2023-12-16T20:49:39.987522+0000","last_active":"2023-12-16T20:49:39.987522+0000","last_peered":"2023-12-16T20:49:39.987522+0000","last_clean":"2023-12-16T20:49:39.987522+0000","last_became_active":"2023-12-16T20:21:36.533682+0000","last_became_peered":"2023-12-16T20:21:36.533682+0000","last_unstale":"2023-12-16T20:49:39.987522+0000","last_undegraded":"2023-12-16T20:49:39.987522+0000","last_fullsized":"2023-12-16T20:49:39.987522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2023-12-16T20:49:39.987436+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2023-12-16T20:49:39.987436+0000","last_clean_scrub_stamp":"2023-12-16T20:49:39.987436+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:23:23.211223+0000","scrub_duration":0.001185576,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'35","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:32.165280+0000","last_change":"2023-12-16T20:49:32.165280+0000","last_active":"2023-12-16T20:49:32.165280+0000","last_peered":"2023-12-16T20:49:32.165280+0000","last_clean":"2023-12-16T20:49:32.165280+0000","last_became_active":"2023-12-16T20:21:36.519545+0000","last_became_peered":"2023-12-16T20:21:36.519545+0000","last_unstale":"2023-12-16T20:49:32.165280+0000","last_undegraded":"2023-12-16T20:49:32.165280+0000","last_fullsized":"2023-12-16T20:49:32.165280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-12-16T20:49:32.165177+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-12-16T20:49:32.165177+0000","last_clean_scrub_stamp":"2023-12-16T20:49:32.165177+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:54.010717+0000","scrub_duration":0.001316684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'45","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:50.062054+0000","last_change":"2023-12-16T20:49:50.062089+0000","last_active":"2023-12-16T20:49:50.062054+0000","last_peered":"2023-12-16T20:49:50.062054+0000","last_clean":"2023-12-16T20:49:50.062054+0000","last_became_active":"2023-12-16T20:21:36.542184+0000","last_became_peered":"2023-12-16T20:21:36.542184+0000","last_unstale":"2023-12-16T20:49:50.062054+0000","last_undegraded":"2023-12-16T20:49:50.062054+0000","last_fullsized":"2023-12-16T20:49:50.062054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-16T20:49:50.061973+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-16T20:49:50.061973+0000","last_clean_scrub_stamp":"2023-12-16T20:49:50.061973+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:23:02.132043+0000","scrub_duration":0.0011178239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'32","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:28.026851+0000","last_change":"2023-12-16T20:49:28.026851+0000","last_active":"2023-12-16T20:49:28.026851+0000","last_peered":"2023-12-16T20:49:28.026851+0000","last_clean":"2023-12-16T20:49:28.026851+0000","last_became_active":"2023-12-16T20:21:36.536439+0000","last_became_peered":"2023-12-16T20:21:36.536439+0000","last_unstale":"2023-12-16T20:49:28.026851+0000","last_undegraded":"2023-12-16T20:49:28.026851+0000","last_fullsized":"2023-12-16T20:49:28.026851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2023-12-16T20:49:28.026722+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2023-12-16T20:49:28.026722+0000","last_clean_scrub_stamp":"2023-12-16T20:49:28.026722+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:39:31.846535+0000","scrub_duration":0.0019544250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'33","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:58.621856+0000","last_change":"2023-12-16T20:49:58.621878+0000","last_active":"2023-12-16T20:49:58.621856+0000","last_peered":"2023-12-16T20:49:58.621856+0000","last_clean":"2023-12-16T20:49:58.621856+0000","last_became_active":"2023-12-16T20:21:36.555100+0000","last_became_peered":"2023-12-16T20:21:36.555100+0000","last_unstale":"2023-12-16T20:49:58.621856+0000","last_undegraded":"2023-12-16T20:49:58.621856+0000","last_fullsized":"2023-12-16T20:49:58.621856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:58.621786+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:58.621786+0000","last_clean_scrub_stamp":"2023-12-16T20:49:58.621786+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:08:03.691113+0000","scrub_duration":0.001138752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'45","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:48.927941+0000","last_change":"2023-12-16T20:49:48.927959+0000","last_active":"2023-12-16T20:49:48.927941+0000","last_peered":"2023-12-16T20:49:48.927941+0000","last_clean":"2023-12-16T20:49:48.927941+0000","last_became_active":"2023-12-16T20:21:36.535600+0000","last_became_peered":"2023-12-16T20:21:36.535600+0000","last_unstale":"2023-12-16T20:49:48.927941+0000","last_undegraded":"2023-12-16T20:49:48.927941+0000","last_fullsized":"2023-12-16T20:49:48.927941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-16T20:49:48.927877+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-16T20:49:48.927877+0000","last_clean_scrub_stamp":"2023-12-16T20:49:48.927877+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:42:58.860704+0000","scrub_duration":0.001139078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'38","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:25.854415+0000","last_change":"2023-12-16T20:49:25.854454+0000","last_active":"2023-12-16T20:49:25.854415+0000","last_peered":"2023-12-16T20:49:25.854415+0000","last_clean":"2023-12-16T20:49:25.854415+0000","last_became_active":"2023-12-16T20:21:36.553155+0000","last_became_peered":"2023-12-16T20:21:36.553155+0000","last_unstale":"2023-12-16T20:49:25.854415+0000","last_undegraded":"2023-12-16T20:49:25.854415+0000","last_fullsized":"2023-12-16T20:49:25.854415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:25.854334+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:25.854334+0000","last_clean_scrub_stamp":"2023-12-16T20:49:25.854334+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:47.699873+0000","scrub_duration":0.001008225,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'50","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.280447+0000","last_change":"2023-12-16T20:49:37.280466+0000","last_active":"2023-12-16T20:49:37.280447+0000","last_peered":"2023-12-16T20:49:37.280447+0000","last_clean":"2023-12-16T20:49:37.280447+0000","last_became_active":"2023-12-16T20:21:36.524166+0000","last_became_peered":"2023-12-16T20:21:36.524166+0000","last_unstale":"2023-12-16T20:49:37.280447+0000","last_undegraded":"2023-12-16T20:49:37.280447+0000","last_fullsized":"2023-12-16T20:49:37.280447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2023-12-16T20:49:37.280377+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2023-12-16T20:49:37.280377+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.280377+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:22:49.350447+0000","scrub_duration":0.0010662930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'45","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:58.006262+0000","last_change":"2023-12-16T20:49:58.006282+0000","last_active":"2023-12-16T20:49:58.006262+0000","last_peered":"2023-12-16T20:49:58.006262+0000","last_clean":"2023-12-16T20:49:58.006262+0000","last_became_active":"2023-12-16T20:21:36.542191+0000","last_became_peered":"2023-12-16T20:21:36.542191+0000","last_unstale":"2023-12-16T20:49:58.006262+0000","last_undegraded":"2023-12-16T20:49:58.006262+0000","last_fullsized":"2023-12-16T20:49:58.006262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-16T20:49:58.006139+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-16T20:49:58.006139+0000","last_clean_scrub_stamp":"2023-12-16T20:49:58.006139+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:07:10.295523+0000","scrub_duration":0.0011112299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'35","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:19.988486+0000","last_change":"2023-12-16T20:22:14.772163+0000","last_active":"2023-12-16T20:49:19.988486+0000","last_peered":"2023-12-16T20:49:19.988486+0000","last_clean":"2023-12-16T20:49:19.988486+0000","last_became_active":"2023-12-16T20:22:14.771830+0000","last_became_peered":"2023-12-16T20:22:14.771830+0000","last_unstale":"2023-12-16T20:49:19.988486+0000","last_undegraded":"2023-12-16T20:49:19.988486+0000","last_fullsized":"2023-12-16T20:49:19.988486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T20:21:35.207345+0000","last_clean_scrub_stamp":"2023-12-16T20:21:35.207345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"27'47","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:43.949523+0000","last_change":"2023-12-16T20:49:43.949543+0000","last_active":"2023-12-16T20:49:43.949523+0000","last_peered":"2023-12-16T20:49:43.949523+0000","last_clean":"2023-12-16T20:49:43.949523+0000","last_became_active":"2023-12-16T20:21:36.544225+0000","last_became_peered":"2023-12-16T20:21:36.544225+0000","last_unstale":"2023-12-16T20:49:43.949523+0000","last_undegraded":"2023-12-16T20:49:43.949523+0000","last_fullsized":"2023-12-16T20:49:43.949523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2023-12-16T20:49:43.949450+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2023-12-16T20:49:43.949450+0000","last_clean_scrub_stamp":"2023-12-16T20:49:43.949450+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:10:23.974459+0000","scrub_duration":0.0010557469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'40","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:14.739946+0000","last_change":"2023-12-16T20:50:14.739970+0000","last_active":"2023-12-16T20:50:14.739946+0000","last_peered":"2023-12-16T20:50:14.739946+0000","last_clean":"2023-12-16T20:50:14.739946+0000","last_became_active":"2023-12-16T20:21:36.554130+0000","last_became_peered":"2023-12-16T20:21:36.554130+0000","last_unstale":"2023-12-16T20:50:14.739946+0000","last_undegraded":"2023-12-16T20:50:14.739946+0000","last_fullsized":"2023-12-16T20:50:14.739946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2023-12-16T20:50:14.739857+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2023-12-16T20:50:14.739857+0000","last_clean_scrub_stamp":"2023-12-16T20:50:14.739857+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:30:17.700456+0000","scrub_duration":0.001336949,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'45","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:08.718111+0000","last_change":"2023-12-16T20:50:08.718151+0000","last_active":"2023-12-16T20:50:08.718111+0000","last_peered":"2023-12-16T20:50:08.718111+0000","last_clean":"2023-12-16T20:50:08.718111+0000","last_became_active":"2023-12-16T20:21:36.554772+0000","last_became_peered":"2023-12-16T20:21:36.554772+0000","last_unstale":"2023-12-16T20:50:08.718111+0000","last_undegraded":"2023-12-16T20:50:08.718111+0000","last_fullsized":"2023-12-16T20:50:08.718111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-16T20:50:08.717995+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-16T20:50:08.717995+0000","last_clean_scrub_stamp":"2023-12-16T20:50:08.717995+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:43:18.650821+0000","scrub_duration":0.0013016740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'44","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:01.198151+0000","last_change":"2023-12-16T20:50:01.198172+0000","last_active":"2023-12-16T20:50:01.198151+0000","last_peered":"2023-12-16T20:50:01.198151+0000","last_clean":"2023-12-16T20:50:01.198151+0000","last_became_active":"2023-12-16T20:21:36.534307+0000","last_became_peered":"2023-12-16T20:21:36.534307+0000","last_unstale":"2023-12-16T20:50:01.198151+0000","last_undegraded":"2023-12-16T20:50:01.198151+0000","last_fullsized":"2023-12-16T20:50:01.198151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2023-12-16T20:50:01.198074+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2023-12-16T20:50:01.198074+0000","last_clean_scrub_stamp":"2023-12-16T20:50:01.198074+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:47:37.032895+0000","scrub_duration":0.001109161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'40","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:34.267761+0000","last_change":"2023-12-16T20:49:34.267761+0000","last_active":"2023-12-16T20:49:34.267761+0000","last_peered":"2023-12-16T20:49:34.267761+0000","last_clean":"2023-12-16T20:49:34.267761+0000","last_became_active":"2023-12-16T20:21:36.525427+0000","last_became_peered":"2023-12-16T20:21:36.525427+0000","last_unstale":"2023-12-16T20:49:34.267761+0000","last_undegraded":"2023-12-16T20:49:34.267761+0000","last_fullsized":"2023-12-16T20:49:34.267761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2023-12-16T20:49:34.267634+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2023-12-16T20:49:34.267634+0000","last_clean_scrub_stamp":"2023-12-16T20:49:34.267634+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:39:38.087447+0000","scrub_duration":0.00089495000000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'36","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:42.936238+0000","last_change":"2023-12-16T20:49:42.936276+0000","last_active":"2023-12-16T20:49:42.936238+0000","last_peered":"2023-12-16T20:49:42.936238+0000","last_clean":"2023-12-16T20:49:42.936238+0000","last_became_active":"2023-12-16T20:21:36.542513+0000","last_became_peered":"2023-12-16T20:21:36.542513+0000","last_unstale":"2023-12-16T20:49:42.936238+0000","last_undegraded":"2023-12-16T20:49:42.936238+0000","last_fullsized":"2023-12-16T20:49:42.936238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2023-12-16T20:49:42.936104+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2023-12-16T20:49:42.936104+0000","last_clean_scrub_stamp":"2023-12-16T20:49:42.936104+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:41:03.614700+0000","scrub_duration":0.0018757719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:33.399940+0000","last_change":"2023-12-16T20:49:33.399965+0000","last_active":"2023-12-16T20:49:33.399940+0000","last_peered":"2023-12-16T20:49:33.399940+0000","last_clean":"2023-12-16T20:49:33.399940+0000","last_became_active":"2023-12-16T20:21:36.544492+0000","last_became_peered":"2023-12-16T20:21:36.544492+0000","last_unstale":"2023-12-16T20:49:33.399940+0000","last_undegraded":"2023-12-16T20:49:33.399940+0000","last_fullsized":"2023-12-16T20:49:33.399940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-12-16T20:49:33.399843+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-12-16T20:49:33.399843+0000","last_clean_scrub_stamp":"2023-12-16T20:49:33.399843+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:25:07.939906+0000","scrub_duration":0.0012000960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'38","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:20.960641+0000","last_change":"2023-12-16T20:50:20.960675+0000","last_active":"2023-12-16T20:50:20.960641+0000","last_peered":"2023-12-16T20:50:20.960641+0000","last_clean":"2023-12-16T20:50:20.960641+0000","last_became_active":"2023-12-16T20:22:14.769348+0000","last_became_peered":"2023-12-16T20:22:14.769348+0000","last_unstale":"2023-12-16T20:50:20.960641+0000","last_undegraded":"2023-12-16T20:50:20.960641+0000","last_fullsized":"2023-12-16T20:50:20.960641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:50:20.960512+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:50:20.960512+0000","last_clean_scrub_stamp":"2023-12-16T20:50:20.960512+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:43:30.893339+0000","scrub_duration":0.0014569990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'50","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:52.064542+0000","last_change":"2023-12-16T20:49:52.064563+0000","last_active":"2023-12-16T20:49:52.064542+0000","last_peered":"2023-12-16T20:49:52.064542+0000","last_clean":"2023-12-16T20:49:52.064542+0000","last_became_active":"2023-12-16T20:21:36.550815+0000","last_became_peered":"2023-12-16T20:21:36.550815+0000","last_unstale":"2023-12-16T20:49:52.064542+0000","last_undegraded":"2023-12-16T20:49:52.064542+0000","last_fullsized":"2023-12-16T20:49:52.064542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2023-12-16T20:49:52.064464+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2023-12-16T20:49:52.064464+0000","last_clean_scrub_stamp":"2023-12-16T20:49:52.064464+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:25:38.891898+0000","scrub_duration":0.0011038790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'42","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:14.647934+0000","last_change":"2023-12-16T20:50:14.647960+0000","last_active":"2023-12-16T20:50:14.647934+0000","last_peered":"2023-12-16T20:50:14.647934+0000","last_clean":"2023-12-16T20:50:14.647934+0000","last_became_active":"2023-12-16T20:21:36.553708+0000","last_became_peered":"2023-12-16T20:21:36.553708+0000","last_unstale":"2023-12-16T20:50:14.647934+0000","last_undegraded":"2023-12-16T20:50:14.647934+0000","last_fullsized":"2023-12-16T20:50:14.647934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2023-12-16T20:50:14.647827+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2023-12-16T20:50:14.647827+0000","last_clean_scrub_stamp":"2023-12-16T20:50:14.647827+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:43:44.432912+0000","scrub_duration":0.001343786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'29","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:44.959365+0000","last_change":"2023-12-16T20:49:44.959383+0000","last_active":"2023-12-16T20:49:44.959365+0000","last_peered":"2023-12-16T20:49:44.959365+0000","last_clean":"2023-12-16T20:49:44.959365+0000","last_became_active":"2023-12-16T20:21:36.551066+0000","last_became_peered":"2023-12-16T20:21:36.551066+0000","last_unstale":"2023-12-16T20:49:44.959365+0000","last_undegraded":"2023-12-16T20:49:44.959365+0000","last_fullsized":"2023-12-16T20:49:44.959365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2023-12-16T20:49:44.959299+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2023-12-16T20:49:44.959299+0000","last_clean_scrub_stamp":"2023-12-16T20:49:44.959299+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:55:02.095074+0000","scrub_duration":0.001193115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'37","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:56.736482+0000","last_change":"2023-12-16T20:49:56.736503+0000","last_active":"2023-12-16T20:49:56.736482+0000","last_peered":"2023-12-16T20:49:56.736482+0000","last_clean":"2023-12-16T20:49:56.736482+0000","last_became_active":"2023-12-16T20:21:36.523604+0000","last_became_peered":"2023-12-16T20:21:36.523604+0000","last_unstale":"2023-12-16T20:49:56.736482+0000","last_undegraded":"2023-12-16T20:49:56.736482+0000","last_fullsized":"2023-12-16T20:49:56.736482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2023-12-16T20:49:56.736375+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2023-12-16T20:49:56.736375+0000","last_clean_scrub_stamp":"2023-12-16T20:49:56.736375+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:05:42.874908+0000","scrub_duration":0.0011361520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'39","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:03.666854+0000","last_change":"2023-12-16T20:50:03.666902+0000","last_active":"2023-12-16T20:50:03.666854+0000","last_peered":"2023-12-16T20:50:03.666854+0000","last_clean":"2023-12-16T20:50:03.666854+0000","last_became_active":"2023-12-16T20:21:36.556041+0000","last_became_peered":"2023-12-16T20:21:36.556041+0000","last_unstale":"2023-12-16T20:50:03.666854+0000","last_undegraded":"2023-12-16T20:50:03.666854+0000","last_fullsized":"2023-12-16T20:50:03.666854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-12-16T20:50:03.666750+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-12-16T20:50:03.666750+0000","last_clean_scrub_stamp":"2023-12-16T20:50:03.666750+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:55:20.802526+0000","scrub_duration":0.0013771300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'39","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:15.675904+0000","last_change":"2023-12-16T20:50:15.675943+0000","last_active":"2023-12-16T20:50:15.675904+0000","last_peered":"2023-12-16T20:50:15.675904+0000","last_clean":"2023-12-16T20:50:15.675904+0000","last_became_active":"2023-12-16T20:21:36.518138+0000","last_became_peered":"2023-12-16T20:21:36.518138+0000","last_unstale":"2023-12-16T20:50:15.675904+0000","last_undegraded":"2023-12-16T20:50:15.675904+0000","last_fullsized":"2023-12-16T20:50:15.675904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-12-16T20:50:15.675807+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-12-16T20:50:15.675807+0000","last_clean_scrub_stamp":"2023-12-16T20:50:15.675807+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:31:14.915473+0000","scrub_duration":0.0017056860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'24","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:54.686358+0000","last_change":"2023-12-16T20:49:54.686383+0000","last_active":"2023-12-16T20:49:54.686358+0000","last_peered":"2023-12-16T20:49:54.686358+0000","last_clean":"2023-12-16T20:49:54.686358+0000","last_became_active":"2023-12-16T20:21:36.555041+0000","last_became_peered":"2023-12-16T20:21:36.555041+0000","last_unstale":"2023-12-16T20:49:54.686358+0000","last_undegraded":"2023-12-16T20:49:54.686358+0000","last_fullsized":"2023-12-16T20:49:54.686358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2023-12-16T20:49:54.686275+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2023-12-16T20:49:54.686275+0000","last_clean_scrub_stamp":"2023-12-16T20:49:54.686275+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:09:43.952858+0000","scrub_duration":0.0012757529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'44","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:27.192471+0000","last_change":"2023-12-16T20:49:27.192490+0000","last_active":"2023-12-16T20:49:27.192471+0000","last_peered":"2023-12-16T20:49:27.192471+0000","last_clean":"2023-12-16T20:49:27.192471+0000","last_became_active":"2023-12-16T20:21:36.523784+0000","last_became_peered":"2023-12-16T20:21:36.523784+0000","last_unstale":"2023-12-16T20:49:27.192471+0000","last_undegraded":"2023-12-16T20:49:27.192471+0000","last_fullsized":"2023-12-16T20:49:27.192471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2023-12-16T20:49:27.192403+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2023-12-16T20:49:27.192403+0000","last_clean_scrub_stamp":"2023-12-16T20:49:27.192403+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:22:46.903808+0000","scrub_duration":0.001038298,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'36","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:02.183857+0000","last_change":"2023-12-16T20:50:02.183899+0000","last_active":"2023-12-16T20:50:02.183857+0000","last_peered":"2023-12-16T20:50:02.183857+0000","last_clean":"2023-12-16T20:50:02.183857+0000","last_became_active":"2023-12-16T20:21:36.526151+0000","last_became_peered":"2023-12-16T20:21:36.526151+0000","last_unstale":"2023-12-16T20:50:02.183857+0000","last_undegraded":"2023-12-16T20:50:02.183857+0000","last_fullsized":"2023-12-16T20:50:02.183857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2023-12-16T20:50:02.183789+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2023-12-16T20:50:02.183789+0000","last_clean_scrub_stamp":"2023-12-16T20:50:02.183789+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:07:55.175918+0000","scrub_duration":0.0010376109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'28","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:05.690489+0000","last_change":"2023-12-16T20:50:05.690508+0000","last_active":"2023-12-16T20:50:05.690489+0000","last_peered":"2023-12-16T20:50:05.690489+0000","last_clean":"2023-12-16T20:50:05.690489+0000","last_became_active":"2023-12-16T20:21:36.543306+0000","last_became_peered":"2023-12-16T20:21:36.543306+0000","last_unstale":"2023-12-16T20:50:05.690489+0000","last_undegraded":"2023-12-16T20:50:05.690489+0000","last_fullsized":"2023-12-16T20:50:05.690489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2023-12-16T20:50:05.690413+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2023-12-16T20:50:05.690413+0000","last_clean_scrub_stamp":"2023-12-16T20:50:05.690413+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:55:22.826189+0000","scrub_duration":0.0011935030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4117,"num_write_kb":324188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4666,"ondisk_log_size":4666,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2442,"ondisk_log_size":2442,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40469915,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1038,"num_read_kb":1098,"num_write":9075,"num_write_kb":44922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56229888,"data_stored":80939830,"data_compressed":7486620,"data_compressed_allocated":11714560,"data_compressed_original":36487168,"omap_allocated":0,"internal_metadata":0},"log_size":8644,"ondisk_log_size":8644,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65176,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575201,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84588,"kb_used_data":17316,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94287252,"statfs":{"total":96636764160,"available":96550146048,"internally_reserved":0,"allocated":17731584,"data_stored":25875293,"data_compressed":2385754,"data_compressed_allocated":3723264,"data_compressed_original":12046336,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.41599999999999998,"15min":0.40100000000000002},"min":{"1min":0.26900000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.70499999999999996,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.432,"15min":0.42599999999999999},"min":{"1min":0.313,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.438,"15min":0.42399999999999999},"min":{"1min":0.32000000000000001,"5min":0.24399999999999999,"15min":0.23799999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.41899999999999998},"min":{"1min":0.34799999999999998,"5min":0.27200000000000002,"15min":0.252},"max":{"1min":0.71699999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.52600000000000002}]},{"osd":2,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42199999999999999,"15min":0.41199999999999998},"min":{"1min":0.31,"5min":0.254,"15min":0.254},"max":{"1min":0.66600000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.501},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.44700000000000001},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.29099999999999998},"max":{"1min":0.60599999999999998,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.51600000000000001}]},{"osd":3,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.45100000000000001,"15min":0.434},"min":{"1min":0.34699999999999998,"5min":0.28799999999999998,"15min":0.28000000000000003},"max":{"1min":0.63100000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.379,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.77300000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48199999999999998}]},{"osd":4,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.378,"15min":0.35999999999999999},"min":{"1min":0.27500000000000002,"5min":0.23200000000000001,"15min":0.20499999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38100000000000001,"15min":0.374},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.20899999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.36699999999999999}]},{"osd":5,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38900000000000001,"15min":0.38500000000000001},"min":{"1min":0.25800000000000001,"5min":0.24199999999999999,"15min":0.24099999999999999},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.72099999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.30399999999999999,"5min":0.25900000000000001,"15min":0.255},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.65700000000000003},"last":0.38700000000000001}]},{"osd":6,"last update":"Sat Dec 16 20:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.29399999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.443},"min":{"1min":0.27900000000000003,"5min":0.246,"15min":0.246},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.54900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575201,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61228,"kb_used_data":12004,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94310612,"statfs":{"total":96636764160,"available":96574066688,"internally_reserved":0,"allocated":12292096,"data_stored":16896407,"data_compressed":1393950,"data_compressed_allocated":2220032,"data_compressed_original":7004160,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.39200000000000002,"15min":0.39900000000000002},"min":{"1min":0.31,"5min":0.23200000000000001,"15min":0.217},"max":{"1min":0.57999999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.432,"15min":0.432},"min":{"1min":0.313,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.67100000000000004},"last":0.47799999999999998}]},{"osd":1,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.33800000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.68200000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42999999999999999,"15min":0.42699999999999999},"min":{"1min":0.32600000000000001,"5min":0.26500000000000001,"15min":0.26400000000000001},"max":{"1min":0.65500000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.53900000000000003}]},{"osd":2,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.35899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.65900000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.314,"5min":0.29799999999999999,"15min":0.253},"max":{"1min":0.60799999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56399999999999995}]},{"osd":3,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45500000000000002,"15min":0.44},"min":{"1min":0.35199999999999998,"5min":0.30599999999999999,"15min":0.26500000000000001},"max":{"1min":0.64600000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.623},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.442,"15min":0.44600000000000001},"min":{"1min":0.36299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.52500000000000002}]},{"osd":4,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38400000000000001,"15min":0.373},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.217},"max":{"1min":0.625,"5min":0.625,"15min":0.64000000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.25900000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.35199999999999998}]},{"osd":5,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.38300000000000001,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.26600000000000001,"15min":0.23300000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.42399999999999999},"min":{"1min":0.27900000000000003,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.375}]},{"osd":7,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.42999999999999999},"min":{"1min":0.30299999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.42399999999999999,"15min":0.434},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.747},"last":0.50700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575200,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":118609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.42399999999999999,"15min":0.42699999999999999},"min":{"1min":0.33600000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64200000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.41799999999999998,"15min":0.41399999999999998},"min":{"1min":0.27600000000000002,"5min":0.252,"15min":0.24399999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.64300000000000002}]},{"osd":1,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.34399999999999997,"5min":0.27600000000000002,"15min":0.25600000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.42699999999999999},"min":{"1min":0.32000000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.70099999999999996}]},{"osd":2,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.35199999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.441,"15min":0.434},"min":{"1min":0.33500000000000002,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.628}]},{"osd":3,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29499999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.35699999999999998,"5min":0.312,"15min":0.28199999999999997},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.66800000000000004}]},{"osd":4,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.371,"15min":0.36199999999999999},"min":{"1min":0.26200000000000001,"5min":0.24199999999999999,"15min":0.224},"max":{"1min":0.60099999999999998,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38600000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.22600000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.58899999999999997}]},{"osd":6,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39500000000000002,"15min":0.38500000000000001},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.24199999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.68999999999999995},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.433,"15min":0.41799999999999998},"min":{"1min":0.30199999999999999,"5min":0.28000000000000003,"15min":0.26700000000000002},"max":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.72099999999999997},"last":0.51100000000000001}]},{"osd":7,"last update":"Sat Dec 16 20:49:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.432,"15min":0.432},"min":{"1min":0.27700000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.498},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46200000000000002,"15min":0.44800000000000001},"min":{"1min":0.318,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.53400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575201,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65112,"kb_used_data":7568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94306728,"statfs":{"total":96636764160,"available":96570089472,"internally_reserved":0,"allocated":7749632,"data_stored":11004073,"data_compressed":1082070,"data_compressed_allocated":1703936,"data_compressed_original":5144576,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.45200000000000001,"15min":0.42799999999999999},"min":{"1min":0.34799999999999998,"5min":0.182,"15min":0.182},"max":{"1min":0.72399999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.45800000000000002,"15min":0.437},"min":{"1min":0.34899999999999998,"5min":0.26600000000000001,"15min":0.25600000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.60299999999999998}]},{"osd":1,"last update":"Sat Dec 16 20:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47099999999999997,"15min":0.44400000000000001},"min":{"1min":0.38300000000000001,"5min":0.29799999999999999,"15min":0.27900000000000003},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.44400000000000001,"15min":0.42699999999999999},"min":{"1min":0.38100000000000001,"5min":0.28599999999999998,"15min":0.26600000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.55100000000000005}]},{"osd":2,"last update":"Sat Dec 16 20:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.45700000000000002,"15min":0.437},"min":{"1min":0.39200000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.69899999999999995,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.48799999999999999,"15min":0.46000000000000002},"min":{"1min":0.36799999999999999,"5min":0.311,"15min":0.309},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.442}]},{"osd":3,"last update":"Sat Dec 16 20:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46200000000000002,"15min":0.435},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.27900000000000003},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.46999999999999997},"min":{"1min":0.41299999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.79400000000000004},"last":0.40000000000000002}]},{"osd":5,"last update":"Sat Dec 16 20:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.39100000000000001,"15min":0.38600000000000001},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40500000000000003,"15min":0.39500000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.22},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.63100000000000001},"last":0.34899999999999998}]},{"osd":6,"last update":"Sat Dec 16 20:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.23799999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.75},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.44},"min":{"1min":0.33200000000000002,"5min":0.26400000000000001,"15min":0.22600000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.32700000000000001}]},{"osd":7,"last update":"Sat Dec 16 20:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.443,"15min":0.436},"min":{"1min":0.32000000000000001,"5min":0.28899999999999998,"15min":0.25600000000000001},"max":{"1min":0.61899999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.379},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.47399999999999998,"15min":0.46500000000000002},"min":{"1min":0.33600000000000002,"5min":0.29199999999999998,"15min":0.27000000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.77600000000000002},"last":0.36299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575201,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58848,"kb_used_data":9624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312992,"statfs":{"total":96636764160,"available":96576503808,"internally_reserved":0,"allocated":9854976,"data_stored":12924992,"data_compressed":1002682,"data_compressed_allocated":1646592,"data_compressed_original":4898816,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.29799999999999999,"15min":0.28599999999999998},"min":{"1min":0.20999999999999999,"5min":0.192,"15min":0.17699999999999999},"max":{"1min":0.46300000000000002,"5min":0.48699999999999999,"15min":0.52600000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.312,"15min":0.30099999999999999},"min":{"1min":0.23100000000000001,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.56999999999999995},"last":0.46700000000000003}]},{"osd":1,"last update":"Sat Dec 16 20:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.30299999999999999},"min":{"1min":0.26100000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.58799999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.33300000000000002,"15min":0.32800000000000001},"min":{"1min":0.29399999999999998,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.56100000000000005},"last":0.34899999999999998}]},{"osd":2,"last update":"Sat Dec 16 20:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.33500000000000002},"min":{"1min":0.27400000000000002,"5min":0.23499999999999999,"15min":0.222},"max":{"1min":0.52500000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.501},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.35499999999999998},"min":{"1min":0.27800000000000002,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.45500000000000002}]},{"osd":4,"last update":"Sat Dec 16 20:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.442,"15min":0.42099999999999999},"min":{"1min":0.40899999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.46800000000000003,"15min":0.44700000000000001},"min":{"1min":0.40600000000000003,"5min":0.33700000000000002,"15min":0.30099999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.58999999999999997}]},{"osd":5,"last update":"Sat Dec 16 20:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.45700000000000002,"15min":0.44600000000000001},"min":{"1min":0.435,"5min":0.31900000000000001,"15min":0.313},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.48199999999999998,"15min":0.46300000000000002},"min":{"1min":0.41599999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.57399999999999995}]},{"osd":6,"last update":"Sat Dec 16 20:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.46999999999999997,"15min":0.45300000000000001},"min":{"1min":0.40300000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.73599999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.48399999999999999,"15min":0.46899999999999997},"min":{"1min":0.40500000000000003,"5min":0.35999999999999999,"15min":0.317},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.62}]},{"osd":7,"last update":"Sat Dec 16 20:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.36599999999999999,"5min":0.35899999999999999,"15min":0.34000000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.46100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.60499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575201,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":341408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.317,"15min":0.30499999999999999},"min":{"1min":0.21099999999999999,"5min":0.183,"15min":0.17000000000000001},"max":{"1min":0.54200000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.315,"15min":0.30199999999999999},"min":{"1min":0.255,"5min":0.189,"15min":0.189},"max":{"1min":0.48799999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.253}]},{"osd":1,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34799999999999998,"15min":0.33600000000000002},"min":{"1min":0.28499999999999998,"5min":0.246,"15min":0.193},"max":{"1min":0.56699999999999995,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.255,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.50700000000000001,"5min":0.51400000000000001,"15min":0.54700000000000004},"last":0.32300000000000001}]},{"osd":3,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33400000000000002,"15min":0.32400000000000001},"min":{"1min":0.23899999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.58099999999999996,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.371,"15min":0.36299999999999999},"min":{"1min":0.29899999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.503,"5min":0.57799999999999996,"15min":0.60599999999999998},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.45400000000000001,"15min":0.432},"min":{"1min":0.36499999999999999,"5min":0.29699999999999999,"15min":0.28699999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.45600000000000002,"15min":0.437},"min":{"1min":0.36899999999999999,"5min":0.30599999999999999,"15min":0.29499999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.623}]},{"osd":5,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.47699999999999998,"15min":0.45600000000000002},"min":{"1min":0.40699999999999997,"5min":0.33400000000000002,"15min":0.30299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.47299999999999998,"15min":0.45600000000000002},"min":{"1min":0.42799999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.46800000000000003,"15min":0.45300000000000001},"min":{"1min":0.44,"5min":0.307,"15min":0.307},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.499,"15min":0.47899999999999998},"min":{"1min":0.371,"5min":0.36399999999999999,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.66300000000000003}]},{"osd":7,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.5,"15min":0.47799999999999998},"min":{"1min":0.38200000000000001,"5min":0.35999999999999999,"15min":0.32300000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.48199999999999998,"15min":0.46600000000000003},"min":{"1min":0.436,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.57999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575201,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42460,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329380,"statfs":{"total":96636764160,"available":96593285120,"internally_reserved":0,"allocated":3035136,"data_stored":4312983,"data_compressed":488319,"data_compressed_allocated":745472,"data_compressed_original":2203648,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.28299999999999997,"15min":0.27900000000000003},"min":{"1min":0.22,"5min":0.184,"15min":0.16800000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.61499999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.309,"15min":0.315},"min":{"1min":0.22,"5min":0.218,"15min":0.21199999999999999},"max":{"1min":0.495,"5min":0.495,"15min":0.55500000000000005},"last":0.31900000000000001}]},{"osd":2,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.29199999999999998,"15min":0.29399999999999998},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32100000000000001},"min":{"1min":0.24099999999999999,"5min":0.221,"15min":0.20999999999999999},"max":{"1min":0.502,"5min":0.502,"15min":0.58499999999999996},"last":0.42599999999999999}]},{"osd":3,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34699999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.55800000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.34599999999999997,"15min":0.34200000000000003},"min":{"1min":0.24399999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.59699999999999998},"last":0.27700000000000002}]},{"osd":4,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.40999999999999998},"min":{"1min":0.34799999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.438},"min":{"1min":0.36199999999999999,"5min":0.32100000000000001,"15min":0.307},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60099999999999998}]},{"osd":5,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.434,"15min":0.442},"min":{"1min":0.34499999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.443,"15min":0.44},"min":{"1min":0.39200000000000002,"5min":0.318,"15min":0.28100000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.61599999999999999}]},{"osd":6,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.45800000000000002,"15min":0.46100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.629},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.45600000000000002,"15min":0.44900000000000001},"min":{"1min":0.39300000000000002,"5min":0.33300000000000002,"15min":0.29999999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.58599999999999997}]},{"osd":7,"last update":"Sat Dec 16 20:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.33700000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.47399999999999998,"15min":0.47899999999999998},"min":{"1min":0.372,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.71799999999999997},"last":0.51800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575201,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60428,"kb_used_data":7044,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311412,"statfs":{"total":96636764160,"available":96574885888,"internally_reserved":0,"allocated":7213056,"data_stored":11594953,"data_compressed":1199021,"data_compressed_allocated":1765376,"data_compressed_original":6336512,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.28100000000000003,"15min":0.28399999999999997},"min":{"1min":0.216,"5min":0.17299999999999999,"15min":0.17100000000000001},"max":{"1min":0.432,"5min":0.48299999999999998,"15min":0.56799999999999995},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.31900000000000001,"15min":0.307},"min":{"1min":0.28499999999999998,"5min":0.20699999999999999,"15min":0.19400000000000001},"max":{"1min":0.48099999999999998,"5min":0.504,"15min":0.57899999999999996},"last":0.29199999999999998}]},{"osd":2,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.315,"15min":0.307},"min":{"1min":0.25700000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.47999999999999998,"5min":0.52300000000000002,"15min":0.54900000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32200000000000001},"min":{"1min":0.25600000000000001,"5min":0.218,"15min":0.20300000000000001},"max":{"1min":0.42099999999999999,"5min":0.57899999999999996,"15min":0.66400000000000003},"last":0.312}]},{"osd":3,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.32900000000000001,"15min":0.32600000000000001},"min":{"1min":0.23999999999999999,"5min":0.22600000000000001,"15min":0.20399999999999999},"max":{"1min":0.48099999999999998,"5min":0.52100000000000002,"15min":0.54100000000000004},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.35499999999999998,"15min":0.34100000000000003},"min":{"1min":0.309,"5min":0.23100000000000001,"15min":0.224},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.60999999999999999},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.441,"15min":0.436},"min":{"1min":0.35399999999999998,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.439},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.44800000000000001,"15min":0.439},"min":{"1min":0.375,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.41499999999999998}]},{"osd":5,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46800000000000003,"15min":0.44600000000000001},"min":{"1min":0.35899999999999999,"5min":0.32600000000000001,"15min":0.29999999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.376,"5min":0.307,"15min":0.30199999999999999},"max":{"1min":0.64200000000000002,"5min":0.64500000000000002,"15min":0.70399999999999996},"last":0.38100000000000001}]},{"osd":6,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47999999999999998,"15min":0.47399999999999998},"min":{"1min":0.38100000000000001,"5min":0.35599999999999998,"15min":0.31900000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.71799999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.46200000000000002},"min":{"1min":0.376,"5min":0.32800000000000001,"15min":0.32700000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42799999999999999}]},{"osd":7,"last update":"Sat Dec 16 20:49:27 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.5,"15min":0.49199999999999999},"min":{"1min":0.372,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.40500000000000003,"5min":0.34599999999999997,"15min":0.34000000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6856704,"data_stored":10886066,"data_compressed":1166433,"data_compressed_allocated":1720320,"data_compressed_original":5763072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2744320,"data_stored":4194464,"data_compressed":488319,"data_compressed_allocated":745472,"data_compressed_original":2203648,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":222889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9564160,"data_stored":12806473,"data_compressed":1002682,"data_compressed_allocated":1646592,"data_compressed_original":4898816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7458816,"data_stored":10885554,"data_compressed":1082070,"data_compressed_allocated":1703936,"data_compressed_original":5144576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12001280,"data_stored":16777888,"data_compressed":1393950,"data_compressed_allocated":2220032,"data_compressed_original":7004160,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17375232,"data_stored":25166406,"data_compressed":2353166,"data_compressed_allocated":3678208,"data_compressed_original":11472896,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T20:50:27.079 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:27.080 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-16T20:21:35.207345+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=21, tm_sec=35, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=20, tm_min=49, tm_sec=17, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T20:50:27.080 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T20:50:28.673 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:50:28.676 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:50:47.081 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T20:50:47.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.189+0000 7f6468b73640 1 Processor -- start 2023-12-16T20:50:47.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.189+0000 7f6468b73640 1 -- start start 2023-12-16T20:50:47.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.190+0000 7f6468b73640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f64640728b0 0x7f64640c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:47.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.190+0000 7f6468b73640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64640c5fd0 0x7f6464161c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:47.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.190+0000 7f6468b73640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646415b6e0 con 0x7f6464151510 2023-12-16T20:50:47.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.190+0000 7f6468b73640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646415a880 con 0x7f64640728b0 2023-12-16T20:50:47.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.190+0000 7f6468b73640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64640c6480 con 0x7f64640c5fd0 2023-12-16T20:50:47.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.191+0000 7f6461d9b640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f64640728b0 0x7f64640c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:47.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.191+0000 7f6462d9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64640c5fd0 0x7f6464161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:47.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.191+0000 7f6462d9d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64640c5fd0 0x7f6464161c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:49590/0 (socket says 172.21.15.87:49590) 2023-12-16T20:50:47.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.191+0000 7f6462d9d640 1 -- 172.21.15.87:0/9512813 learned_addr learned my addr 172.21.15.87:0/9512813 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:50:47.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.195+0000 7f6462d9d640 1 -- 172.21.15.87:0/9512813 >> v2:172.21.15.195:3300/0 conn(0x7f64640728b0 msgr2=0x7f64640c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:50:47.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.195+0000 7f6462d9d640 1 --2- 172.21.15.87:0/9512813 >> v2:172.21.15.195:3300/0 conn(0x7f64640728b0 0x7f64640c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:47.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.195+0000 7f6462d9d640 1 -- 172.21.15.87:0/9512813 >> v1:172.21.15.195:6789/0 conn(0x7f6464151510 legacy=0x7f64640cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:47.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.195+0000 7f6462d9d640 1 -- 172.21.15.87:0/9512813 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646406f7e0 con 0x7f64640c5fd0 2023-12-16T20:50:47.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.198+0000 7f6462d9d640 1 --2- 172.21.15.87:0/9512813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64640c5fd0 0x7f6464161c10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f645c009870 tx=0x7f645c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7967a440210440ec server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:47.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.202+0000 7f646159a640 1 -- 172.21.15.87:0/9512813 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c030840 con 0x7f64640c5fd0 2023-12-16T20:50:47.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.202+0000 7f646159a640 1 -- 172.21.15.87:0/9512813 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c0309a0 con 0x7f64640c5fd0 2023-12-16T20:50:47.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.202+0000 7f646159a640 1 -- 172.21.15.87:0/9512813 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c030d30 con 0x7f64640c5fd0 2023-12-16T20:50:47.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.202+0000 7f6468b73640 1 -- 172.21.15.87:0/9512813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64640c5fd0 msgr2=0x7f6464161c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:47.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.202+0000 7f6468b73640 1 --2- 172.21.15.87:0/9512813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64640c5fd0 0x7f6464161c10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f645c009870 tx=0x7f645c02b980 comp rx=0 tx=0).stop 2023-12-16T20:50:47.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.203+0000 7f6468b73640 1 -- 172.21.15.87:0/9512813 shutdown_connections 2023-12-16T20:50:47.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.203+0000 7f6468b73640 1 --2- 172.21.15.87:0/9512813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64640c5fd0 0x7f6464161c10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:47.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.203+0000 7f6468b73640 1 --2- 172.21.15.87:0/9512813 >> v2:172.21.15.195:3300/0 conn(0x7f64640728b0 0x7f64640c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:47.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.203+0000 7f6468b73640 1 -- 172.21.15.87:0/9512813 >> 172.21.15.87:0/9512813 conn(0x7f646406cd60 msgr2=0x7f646406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:47.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.203+0000 7f6468b73640 1 -- 172.21.15.87:0/9512813 shutdown_connections 2023-12-16T20:50:47.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.203+0000 7f6468b73640 1 -- 172.21.15.87:0/9512813 wait complete. 2023-12-16T20:50:47.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.204+0000 7f6468b73640 1 Processor -- start 2023-12-16T20:50:47.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.204+0000 7f6468b73640 1 -- start start 2023-12-16T20:50:47.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.205+0000 7f6468b73640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64640728b0 0x7f64641f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:47.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.205+0000 7f6468b73640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64640c5fd0 0x7f6464159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:47.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.205+0000 7f6468b73640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6464151510 0x7f64641ed4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:47.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.205+0000 7f6468b73640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64641ed020 con 0x7f64640728b0 2023-12-16T20:50:47.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.205+0000 7f6468b73640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64641f10d0 con 0x7f6464151510 2023-12-16T20:50:47.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.205+0000 7f6468b73640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6464158090 con 0x7f64640c5fd0 2023-12-16T20:50:47.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.205+0000 7f646259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64640728b0 0x7f64641f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:47.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.205+0000 7f6461d9b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64640c5fd0 0x7f6464159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:47.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.205+0000 7f6462d9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6464151510 0x7f64641ed4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:47.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.206+0000 7f646259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64640728b0 0x7f64641f0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37916/0 (socket says 172.21.15.87:37916) 2023-12-16T20:50:47.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.206+0000 7f646259c640 1 -- 172.21.15.87:0/3480288150 learned_addr learned my addr 172.21.15.87:0/3480288150 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:50:47.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.209+0000 7f646259c640 1 -- 172.21.15.87:0/3480288150 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64640c5fd0 msgr2=0x7f6464159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:47.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.209+0000 7f646259c640 1 --2- 172.21.15.87:0/3480288150 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64640c5fd0 0x7f6464159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:47.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.209+0000 7f646259c640 1 -- 172.21.15.87:0/3480288150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6464151510 msgr2=0x7f64641ed4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:47.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.209+0000 7f646259c640 1 --2- 172.21.15.87:0/3480288150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6464151510 0x7f64641ed4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:47.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.209+0000 7f646259c640 1 -- 172.21.15.87:0/3480288150 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c0094d0 con 0x7f64640728b0 2023-12-16T20:50:47.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.211+0000 7f646259c640 1 --2- 172.21.15.87:0/3480288150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64640728b0 0x7f64641f0b90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f645400c730 tx=0x7f645400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:47.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.215+0000 7f6452ffd640 1 -- 172.21.15.87:0/3480288150 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454006d50 con 0x7f64640728b0 2023-12-16T20:50:47.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.215+0000 7f6452ffd640 1 -- 172.21.15.87:0/3480288150 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645400ce40 con 0x7f64640728b0 2023-12-16T20:50:47.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.215+0000 7f6452ffd640 1 -- 172.21.15.87:0/3480288150 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454003bb0 con 0x7f64640728b0 2023-12-16T20:50:47.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.215+0000 7f6468b73640 1 -- 172.21.15.87:0/3480288150 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64640cab70 con 0x7f64640728b0 2023-12-16T20:50:47.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.215+0000 7f6468b73640 1 -- 172.21.15.87:0/3480288150 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64640ca820 con 0x7f64640728b0 2023-12-16T20:50:47.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.216+0000 7f6468b73640 1 -- 172.21.15.87:0/3480288150 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64640cb6d0 con 0x7f64640728b0 2023-12-16T20:50:47.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.233+0000 7f6452ffd640 1 -- 172.21.15.87:0/3480288150 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f6454003d10 con 0x7f64640728b0 2023-12-16T20:50:47.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.233+0000 7f6452ffd640 1 --2- 172.21.15.87:0/3480288150 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f644406ae40 0x7f644406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:47.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.234+0000 7f6461d9b640 1 --2- 172.21.15.87:0/3480288150 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f644406ae40 0x7f644406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:47.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.234+0000 7f6461d9b640 1 --2- 172.21.15.87:0/3480288150 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f644406ae40 0x7f644406d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6464154ef0 tx=0x7f6458009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:47.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.237+0000 7f6452ffd640 1 -- 172.21.15.87:0/3480288150 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f6454058cb0 con 0x7f64640728b0 2023-12-16T20:50:47.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.472+0000 7f6452ffd640 1 -- 172.21.15.87:0/3480288150 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f6454058a80 con 0x7f64640728b0 2023-12-16T20:50:47.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.637+0000 7f6468b73640 1 -- 172.21.15.87:0/3480288150 --> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6464067fd0 con 0x7f644406ae40 2023-12-16T20:50:47.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.646+0000 7f6452ffd640 1 -- 172.21.15.87:0/3480288150 <== mgr.4100 v2:172.21.15.87:6800/748553150 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+373900 (secure 0 0 0) 0x7f6464067fd0 con 0x7f644406ae40 2023-12-16T20:50:47.653 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:50:47.657 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-12-16T20:50:47.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.650+0000 7f6468b73640 1 -- 172.21.15.87:0/3480288150 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f644406ae40 msgr2=0x7f644406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:47.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.650+0000 7f6468b73640 1 --2- 172.21.15.87:0/3480288150 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f644406ae40 0x7f644406d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6464154ef0 tx=0x7f6458009190 comp rx=0 tx=0).stop 2023-12-16T20:50:47.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.650+0000 7f6468b73640 1 -- 172.21.15.87:0/3480288150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64640728b0 msgr2=0x7f64641f0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:47.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.650+0000 7f6468b73640 1 --2- 172.21.15.87:0/3480288150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64640728b0 0x7f64641f0b90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f645400c730 tx=0x7f645400cbf0 comp rx=0 tx=0).stop 2023-12-16T20:50:47.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.650+0000 7f6468b73640 1 -- 172.21.15.87:0/3480288150 shutdown_connections 2023-12-16T20:50:47.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.650+0000 7f6468b73640 1 --2- 172.21.15.87:0/3480288150 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f644406ae40 0x7f644406d300 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:47.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.650+0000 7f6468b73640 1 --2- 172.21.15.87:0/3480288150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6464151510 0x7f64641ed4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:47.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.650+0000 7f6468b73640 1 --2- 172.21.15.87:0/3480288150 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64640c5fd0 0x7f6464159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:47.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.650+0000 7f6468b73640 1 --2- 172.21.15.87:0/3480288150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64640728b0 0x7f64641f0b90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:47.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.650+0000 7f6468b73640 1 -- 172.21.15.87:0/3480288150 >> 172.21.15.87:0/3480288150 conn(0x7f646406cd60 msgr2=0x7f646414e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:47.662 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.650+0000 7f6468b73640 1 -- 172.21.15.87:0/3480288150 shutdown_connections 2023-12-16T20:50:47.662 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.650+0000 7f6468b73640 1 -- 172.21.15.87:0/3480288150 wait complete. 2023-12-16T20:50:47.663 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":903,"stamp":"2023-12-16T20:50:46.670418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41060283,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1154,"num_read_kb":1198,"num_write":13351,"num_write_kb":371526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15871,"ondisk_log_size":15871,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":435808,"kb_used_data":57312,"kb_used_omap":12,"kb_used_meta":378419,"kb_avail":754538912,"statfs":{"total":773094113280,"available":772647845888,"internally_reserved":0,"allocated":58687488,"data_stored":83068718,"data_compressed":7551796,"data_compressed_allocated":11804672,"data_compressed_original":37634048,"omap_allocated":12751,"internal_metadata":387501617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003386"},"pg_stats":[{"pgid":"2.1f","version":"27'645","reported_seq":686,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:23.157455+0000","last_change":"2023-12-16T20:49:23.157455+0000","last_active":"2023-12-16T20:49:23.157455+0000","last_peered":"2023-12-16T20:49:23.157455+0000","last_clean":"2023-12-16T20:49:23.157455+0000","last_became_active":"2023-12-16T20:21:35.413075+0000","last_became_peered":"2023-12-16T20:21:35.413075+0000","last_unstale":"2023-12-16T20:49:23.157455+0000","last_undegraded":"2023-12-16T20:49:23.157455+0000","last_fullsized":"2023-12-16T20:49:23.157455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'645","last_scrub_stamp":"2023-12-16T20:49:23.157376+0000","last_deep_scrub":"27'645","last_deep_scrub_stamp":"2023-12-16T20:49:23.157376+0000","last_clean_scrub_stamp":"2023-12-16T20:49:23.157376+0000","objects_scrubbed":3,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:45.002915+0000","scrub_duration":0.012814567000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'31","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:25.961331+0000","last_change":"2023-12-16T20:49:25.961331+0000","last_active":"2023-12-16T20:49:25.961331+0000","last_peered":"2023-12-16T20:49:25.961331+0000","last_clean":"2023-12-16T20:49:25.961331+0000","last_became_active":"2023-12-16T20:21:36.542667+0000","last_became_peered":"2023-12-16T20:21:36.542667+0000","last_unstale":"2023-12-16T20:49:25.961331+0000","last_undegraded":"2023-12-16T20:49:25.961331+0000","last_fullsized":"2023-12-16T20:49:25.961331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2023-12-16T20:49:25.961221+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2023-12-16T20:49:25.961221+0000","last_clean_scrub_stamp":"2023-12-16T20:49:25.961221+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:37:18.758291+0000","scrub_duration":0.001405351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'182","reported_seq":218,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:52.865854+0000","last_change":"2023-12-16T20:49:52.865854+0000","last_active":"2023-12-16T20:49:52.865854+0000","last_peered":"2023-12-16T20:49:52.865854+0000","last_clean":"2023-12-16T20:49:52.865854+0000","last_became_active":"2023-12-16T20:21:41.216062+0000","last_became_peered":"2023-12-16T20:21:41.216062+0000","last_unstale":"2023-12-16T20:49:52.865854+0000","last_undegraded":"2023-12-16T20:49:52.865854+0000","last_fullsized":"2023-12-16T20:49:52.865854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'182","last_scrub_stamp":"2023-12-16T20:49:52.865754+0000","last_deep_scrub":"27'182","last_deep_scrub_stamp":"2023-12-16T20:49:52.865754+0000","last_clean_scrub_stamp":"2023-12-16T20:49:52.865754+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:29:55.826353+0000","scrub_duration":0.001882774,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":13331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'711","reported_seq":752,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.086965+0000","last_change":"2023-12-16T20:49:35.086965+0000","last_active":"2023-12-16T20:49:35.086965+0000","last_peered":"2023-12-16T20:49:35.086965+0000","last_clean":"2023-12-16T20:49:35.086965+0000","last_became_active":"2023-12-16T20:21:35.419745+0000","last_became_peered":"2023-12-16T20:21:35.419745+0000","last_unstale":"2023-12-16T20:49:35.086965+0000","last_undegraded":"2023-12-16T20:49:35.086965+0000","last_fullsized":"2023-12-16T20:49:35.086965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'711","last_scrub_stamp":"2023-12-16T20:49:35.086833+0000","last_deep_scrub":"27'711","last_deep_scrub_stamp":"2023-12-16T20:49:35.086833+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.086833+0000","objects_scrubbed":1,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:55:19.452990+0000","scrub_duration":0.013529074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'38","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:20.169443+0000","last_change":"2023-12-16T20:49:20.169443+0000","last_active":"2023-12-16T20:49:20.169443+0000","last_peered":"2023-12-16T20:49:20.169443+0000","last_clean":"2023-12-16T20:49:20.169443+0000","last_became_active":"2023-12-16T20:21:36.552621+0000","last_became_peered":"2023-12-16T20:21:36.552621+0000","last_unstale":"2023-12-16T20:49:20.169443+0000","last_undegraded":"2023-12-16T20:49:20.169443+0000","last_fullsized":"2023-12-16T20:49:20.169443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:20.169357+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:20.169357+0000","last_clean_scrub_stamp":"2023-12-16T20:49:20.169357+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:05:52.134660+0000","scrub_duration":0.001403729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'122","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:44.472443+0000","last_change":"2023-12-16T20:49:44.472443+0000","last_active":"2023-12-16T20:49:44.472443+0000","last_peered":"2023-12-16T20:49:44.472443+0000","last_clean":"2023-12-16T20:49:44.472443+0000","last_became_active":"2023-12-16T20:21:40.754509+0000","last_became_peered":"2023-12-16T20:21:40.754509+0000","last_unstale":"2023-12-16T20:49:44.472443+0000","last_undegraded":"2023-12-16T20:49:44.472443+0000","last_fullsized":"2023-12-16T20:49:44.472443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'122","last_scrub_stamp":"2023-12-16T20:49:44.472356+0000","last_deep_scrub":"27'122","last_deep_scrub_stamp":"2023-12-16T20:49:44.472356+0000","last_clean_scrub_stamp":"2023-12-16T20:49:44.472356+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:22:56.542426+0000","scrub_duration":0.001614327,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1395","reported_seq":1433,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.931101+0000","last_change":"2023-12-16T20:49:37.931129+0000","last_active":"2023-12-16T20:49:37.931101+0000","last_peered":"2023-12-16T20:49:37.931101+0000","last_clean":"2023-12-16T20:49:37.931101+0000","last_became_active":"2023-12-16T20:21:35.427317+0000","last_became_peered":"2023-12-16T20:21:35.427317+0000","last_unstale":"2023-12-16T20:49:37.931101+0000","last_undegraded":"2023-12-16T20:49:37.931101+0000","last_fullsized":"2023-12-16T20:49:37.931101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1395","last_scrub_stamp":"2023-12-16T20:49:37.931040+0000","last_deep_scrub":"27'1395","last_deep_scrub_stamp":"2023-12-16T20:49:37.931040+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.931040+0000","objects_scrubbed":3,"log_size":1395,"log_dups_size":0,"ondisk_log_size":1395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:22:53.562497+0000","scrub_duration":0.022717590999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":9004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'33","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:46.898286+0000","last_change":"2023-12-16T20:49:46.898318+0000","last_active":"2023-12-16T20:49:46.898286+0000","last_peered":"2023-12-16T20:49:46.898286+0000","last_clean":"2023-12-16T20:49:46.898286+0000","last_became_active":"2023-12-16T20:22:14.768968+0000","last_became_peered":"2023-12-16T20:22:14.768968+0000","last_unstale":"2023-12-16T20:49:46.898286+0000","last_undegraded":"2023-12-16T20:49:46.898286+0000","last_fullsized":"2023-12-16T20:49:46.898286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:46.898186+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:46.898186+0000","last_clean_scrub_stamp":"2023-12-16T20:49:46.898186+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:25:21.438249+0000","scrub_duration":0.00121396,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"27'156","reported_seq":200,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:51.448513+0000","last_change":"2023-12-16T20:49:51.448535+0000","last_active":"2023-12-16T20:49:51.448513+0000","last_peered":"2023-12-16T20:49:51.448513+0000","last_clean":"2023-12-16T20:49:51.448513+0000","last_became_active":"2023-12-16T20:22:14.819924+0000","last_became_peered":"2023-12-16T20:22:14.819924+0000","last_unstale":"2023-12-16T20:49:51.448513+0000","last_undegraded":"2023-12-16T20:49:51.448513+0000","last_fullsized":"2023-12-16T20:49:51.448513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'156","last_scrub_stamp":"2023-12-16T20:49:51.448383+0000","last_deep_scrub":"27'156","last_deep_scrub_stamp":"2023-12-16T20:49:51.448383+0000","last_clean_scrub_stamp":"2023-12-16T20:49:51.448383+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:53:08.749663+0000","scrub_duration":0.001709286,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":12476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:40.919237+0000","last_change":"2023-12-16T20:49:40.919278+0000","last_active":"2023-12-16T20:49:40.919237+0000","last_peered":"2023-12-16T20:49:40.919237+0000","last_clean":"2023-12-16T20:49:40.919237+0000","last_became_active":"2023-12-16T20:21:35.413234+0000","last_became_peered":"2023-12-16T20:21:35.413234+0000","last_unstale":"2023-12-16T20:49:40.919237+0000","last_undegraded":"2023-12-16T20:49:40.919237+0000","last_fullsized":"2023-12-16T20:49:40.919237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-16T20:49:40.919143+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-16T20:49:40.919143+0000","last_clean_scrub_stamp":"2023-12-16T20:49:40.919143+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:18:08.836684+0000","scrub_duration":0.0023112950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'49","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:01.618340+0000","last_change":"2023-12-16T20:50:01.618358+0000","last_active":"2023-12-16T20:50:01.618340+0000","last_peered":"2023-12-16T20:50:01.618340+0000","last_clean":"2023-12-16T20:50:01.618340+0000","last_became_active":"2023-12-16T20:21:36.554014+0000","last_became_peered":"2023-12-16T20:21:36.554014+0000","last_unstale":"2023-12-16T20:50:01.618340+0000","last_undegraded":"2023-12-16T20:50:01.618340+0000","last_fullsized":"2023-12-16T20:50:01.618340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2023-12-16T20:50:01.618277+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2023-12-16T20:50:01.618277+0000","last_clean_scrub_stamp":"2023-12-16T20:50:01.618277+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:41:22.296873+0000","scrub_duration":0.00098290700000000009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'146","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:40.448517+0000","last_change":"2023-12-16T20:49:40.448537+0000","last_active":"2023-12-16T20:49:40.448517+0000","last_peered":"2023-12-16T20:49:40.448517+0000","last_clean":"2023-12-16T20:49:40.448517+0000","last_became_active":"2023-12-16T20:21:40.794471+0000","last_became_peered":"2023-12-16T20:21:40.794471+0000","last_unstale":"2023-12-16T20:49:40.448517+0000","last_undegraded":"2023-12-16T20:49:40.448517+0000","last_fullsized":"2023-12-16T20:49:40.448517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'146","last_scrub_stamp":"2023-12-16T20:49:40.448446+0000","last_deep_scrub":"27'146","last_deep_scrub_stamp":"2023-12-16T20:49:40.448446+0000","last_clean_scrub_stamp":"2023-12-16T20:49:40.448446+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:54:56.914280+0000","scrub_duration":0.0016447670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'39","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:46.102034+0000","last_change":"2023-12-16T20:49:46.102034+0000","last_active":"2023-12-16T20:49:46.102034+0000","last_peered":"2023-12-16T20:49:46.102034+0000","last_clean":"2023-12-16T20:49:46.102034+0000","last_became_active":"2023-12-16T20:21:36.542157+0000","last_became_peered":"2023-12-16T20:21:36.542157+0000","last_unstale":"2023-12-16T20:49:46.102034+0000","last_undegraded":"2023-12-16T20:49:46.102034+0000","last_fullsized":"2023-12-16T20:49:46.102034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-12-16T20:49:46.101940+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-12-16T20:49:46.101940+0000","last_clean_scrub_stamp":"2023-12-16T20:49:46.101940+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:26:58.344405+0000","scrub_duration":0.000980491,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'682","reported_seq":721,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:39.928151+0000","last_change":"2023-12-16T20:49:39.928177+0000","last_active":"2023-12-16T20:49:39.928151+0000","last_peered":"2023-12-16T20:49:39.928151+0000","last_clean":"2023-12-16T20:49:39.928151+0000","last_became_active":"2023-12-16T20:21:35.413400+0000","last_became_peered":"2023-12-16T20:21:35.413400+0000","last_unstale":"2023-12-16T20:49:39.928151+0000","last_undegraded":"2023-12-16T20:49:39.928151+0000","last_fullsized":"2023-12-16T20:49:39.928151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'682","last_scrub_stamp":"2023-12-16T20:49:39.928085+0000","last_deep_scrub":"27'682","last_deep_scrub_stamp":"2023-12-16T20:49:39.928085+0000","last_clean_scrub_stamp":"2023-12-16T20:49:39.928085+0000","objects_scrubbed":2,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:26:52.170550+0000","scrub_duration":0.016337826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":4429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'121","reported_seq":157,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:49.446137+0000","last_change":"2023-12-16T20:49:49.446160+0000","last_active":"2023-12-16T20:49:49.446137+0000","last_peered":"2023-12-16T20:49:49.446137+0000","last_clean":"2023-12-16T20:49:49.446137+0000","last_became_active":"2023-12-16T20:21:40.745544+0000","last_became_peered":"2023-12-16T20:21:40.745544+0000","last_unstale":"2023-12-16T20:49:49.446137+0000","last_undegraded":"2023-12-16T20:49:49.446137+0000","last_fullsized":"2023-12-16T20:49:49.446137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'121","last_scrub_stamp":"2023-12-16T20:49:49.446051+0000","last_deep_scrub":"27'121","last_deep_scrub_stamp":"2023-12-16T20:49:49.446051+0000","last_clean_scrub_stamp":"2023-12-16T20:49:49.446051+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:55:33.812208+0000","scrub_duration":0.0017083669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":10860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'38","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:29.049902+0000","last_change":"2023-12-16T20:49:29.049927+0000","last_active":"2023-12-16T20:49:29.049902+0000","last_peered":"2023-12-16T20:49:29.049902+0000","last_clean":"2023-12-16T20:49:29.049902+0000","last_became_active":"2023-12-16T20:21:36.525983+0000","last_became_peered":"2023-12-16T20:21:36.525983+0000","last_unstale":"2023-12-16T20:49:29.049902+0000","last_undegraded":"2023-12-16T20:49:29.049902+0000","last_fullsized":"2023-12-16T20:49:29.049902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:29.049801+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:29.049801+0000","last_clean_scrub_stamp":"2023-12-16T20:49:29.049801+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:17:56.967342+0000","scrub_duration":0.001151219,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:54.210144+0000","last_change":"2023-12-16T20:49:54.210164+0000","last_active":"2023-12-16T20:49:54.210144+0000","last_peered":"2023-12-16T20:49:54.210144+0000","last_clean":"2023-12-16T20:49:54.210144+0000","last_became_active":"2023-12-16T20:21:35.419731+0000","last_became_peered":"2023-12-16T20:21:35.419731+0000","last_unstale":"2023-12-16T20:49:54.210144+0000","last_undegraded":"2023-12-16T20:49:54.210144+0000","last_fullsized":"2023-12-16T20:49:54.210144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-16T20:49:54.210064+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-16T20:49:54.210064+0000","last_clean_scrub_stamp":"2023-12-16T20:49:54.210064+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:25:41.037499+0000","scrub_duration":0.00090329199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'169","reported_seq":205,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:55.456625+0000","last_change":"2023-12-16T20:49:55.456647+0000","last_active":"2023-12-16T20:49:55.456625+0000","last_peered":"2023-12-16T20:49:55.456625+0000","last_clean":"2023-12-16T20:49:55.456625+0000","last_became_active":"2023-12-16T20:21:40.754829+0000","last_became_peered":"2023-12-16T20:21:40.754829+0000","last_unstale":"2023-12-16T20:49:55.456625+0000","last_undegraded":"2023-12-16T20:49:55.456625+0000","last_fullsized":"2023-12-16T20:49:55.456625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'169","last_scrub_stamp":"2023-12-16T20:49:55.456544+0000","last_deep_scrub":"27'169","last_deep_scrub_stamp":"2023-12-16T20:49:55.456544+0000","last_clean_scrub_stamp":"2023-12-16T20:49:55.456544+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:07:48.448673+0000","scrub_duration":0.0016987910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":10412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'38","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.059222+0000","last_change":"2023-12-16T20:49:37.059222+0000","last_active":"2023-12-16T20:49:37.059222+0000","last_peered":"2023-12-16T20:49:37.059222+0000","last_clean":"2023-12-16T20:49:37.059222+0000","last_became_active":"2023-12-16T20:21:36.518686+0000","last_became_peered":"2023-12-16T20:21:36.518686+0000","last_unstale":"2023-12-16T20:49:37.059222+0000","last_undegraded":"2023-12-16T20:49:37.059222+0000","last_fullsized":"2023-12-16T20:49:37.059222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:37.059110+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:37.059110+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.059110+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:02:40.257888+0000","scrub_duration":0.00095491900000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:38.167525+0000","last_change":"2023-12-16T20:49:38.167525+0000","last_active":"2023-12-16T20:49:38.167525+0000","last_peered":"2023-12-16T20:49:38.167525+0000","last_clean":"2023-12-16T20:49:38.167525+0000","last_became_active":"2023-12-16T20:21:35.416067+0000","last_became_peered":"2023-12-16T20:21:35.416067+0000","last_unstale":"2023-12-16T20:49:38.167525+0000","last_undegraded":"2023-12-16T20:49:38.167525+0000","last_fullsized":"2023-12-16T20:49:38.167525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-12-16T20:49:38.167435+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-12-16T20:49:38.167435+0000","last_clean_scrub_stamp":"2023-12-16T20:49:38.167435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:37:30.964505+0000","scrub_duration":0.0011178469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'126","reported_seq":162,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:20.158849+0000","last_change":"2023-12-16T20:50:20.158895+0000","last_active":"2023-12-16T20:50:20.158849+0000","last_peered":"2023-12-16T20:50:20.158849+0000","last_clean":"2023-12-16T20:50:20.158849+0000","last_became_active":"2023-12-16T20:21:41.214198+0000","last_became_peered":"2023-12-16T20:21:41.214198+0000","last_unstale":"2023-12-16T20:50:20.158849+0000","last_undegraded":"2023-12-16T20:50:20.158849+0000","last_fullsized":"2023-12-16T20:50:20.158849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'126","last_scrub_stamp":"2023-12-16T20:50:20.158751+0000","last_deep_scrub":"27'126","last_deep_scrub_stamp":"2023-12-16T20:50:20.158751+0000","last_clean_scrub_stamp":"2023-12-16T20:50:20.158751+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:20:42.334022+0000","scrub_duration":0.0019180569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":7034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'34","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:34.369486+0000","last_change":"2023-12-16T20:49:34.369486+0000","last_active":"2023-12-16T20:49:34.369486+0000","last_peered":"2023-12-16T20:49:34.369486+0000","last_clean":"2023-12-16T20:49:34.369486+0000","last_became_active":"2023-12-16T20:21:36.536321+0000","last_became_peered":"2023-12-16T20:21:36.536321+0000","last_unstale":"2023-12-16T20:49:34.369486+0000","last_undegraded":"2023-12-16T20:49:34.369486+0000","last_fullsized":"2023-12-16T20:49:34.369486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2023-12-16T20:49:34.369363+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2023-12-16T20:49:34.369363+0000","last_clean_scrub_stamp":"2023-12-16T20:49:34.369363+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:03:30.826563+0000","scrub_duration":0.0011209779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'6","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:36.954785+0000","last_change":"2023-12-16T20:49:36.954785+0000","last_active":"2023-12-16T20:49:36.954785+0000","last_peered":"2023-12-16T20:49:36.954785+0000","last_clean":"2023-12-16T20:49:36.954785+0000","last_became_active":"2023-12-16T20:21:35.420547+0000","last_became_peered":"2023-12-16T20:21:35.420547+0000","last_unstale":"2023-12-16T20:49:36.954785+0000","last_undegraded":"2023-12-16T20:49:36.954785+0000","last_fullsized":"2023-12-16T20:49:36.954785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2023-12-16T20:49:36.954706+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2023-12-16T20:49:36.954706+0000","last_clean_scrub_stamp":"2023-12-16T20:49:36.954706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:06:52.792558+0000","scrub_duration":0.001061644,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'120","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:43.423699+0000","last_change":"2023-12-16T20:49:43.423737+0000","last_active":"2023-12-16T20:49:43.423699+0000","last_peered":"2023-12-16T20:49:43.423699+0000","last_clean":"2023-12-16T20:49:43.423699+0000","last_became_active":"2023-12-16T20:21:40.756997+0000","last_became_peered":"2023-12-16T20:21:40.756997+0000","last_unstale":"2023-12-16T20:49:43.423699+0000","last_undegraded":"2023-12-16T20:49:43.423699+0000","last_fullsized":"2023-12-16T20:49:43.423699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'120","last_scrub_stamp":"2023-12-16T20:49:43.423601+0000","last_deep_scrub":"27'120","last_deep_scrub_stamp":"2023-12-16T20:49:43.423601+0000","last_clean_scrub_stamp":"2023-12-16T20:49:43.423601+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:10:55.959038+0000","scrub_duration":0.0018042889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":6714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'40","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:40.269289+0000","last_change":"2023-12-16T20:49:40.269289+0000","last_active":"2023-12-16T20:49:40.269289+0000","last_peered":"2023-12-16T20:49:40.269289+0000","last_clean":"2023-12-16T20:49:40.269289+0000","last_became_active":"2023-12-16T20:21:36.524703+0000","last_became_peered":"2023-12-16T20:21:36.524703+0000","last_unstale":"2023-12-16T20:49:40.269289+0000","last_undegraded":"2023-12-16T20:49:40.269289+0000","last_fullsized":"2023-12-16T20:49:40.269289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2023-12-16T20:49:40.269176+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2023-12-16T20:49:40.269176+0000","last_clean_scrub_stamp":"2023-12-16T20:49:40.269176+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:25:27.096610+0000","scrub_duration":0.001165059,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'11","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:24.985449+0000","last_change":"2023-12-16T20:49:24.985449+0000","last_active":"2023-12-16T20:49:24.985449+0000","last_peered":"2023-12-16T20:49:24.985449+0000","last_clean":"2023-12-16T20:49:24.985449+0000","last_became_active":"2023-12-16T20:21:35.428465+0000","last_became_peered":"2023-12-16T20:21:35.428465+0000","last_unstale":"2023-12-16T20:49:24.985449+0000","last_undegraded":"2023-12-16T20:49:24.985449+0000","last_fullsized":"2023-12-16T20:49:24.985449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2023-12-16T20:49:24.985368+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2023-12-16T20:49:24.985368+0000","last_clean_scrub_stamp":"2023-12-16T20:49:24.985368+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:46:57.920491+0000","scrub_duration":0.002106316,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'152","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:52.444847+0000","last_change":"2023-12-16T20:49:52.444872+0000","last_active":"2023-12-16T20:49:52.444847+0000","last_peered":"2023-12-16T20:49:52.444847+0000","last_clean":"2023-12-16T20:49:52.444847+0000","last_became_active":"2023-12-16T20:21:41.212976+0000","last_became_peered":"2023-12-16T20:21:41.212976+0000","last_unstale":"2023-12-16T20:49:52.444847+0000","last_undegraded":"2023-12-16T20:49:52.444847+0000","last_fullsized":"2023-12-16T20:49:52.444847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'152","last_scrub_stamp":"2023-12-16T20:49:52.444755+0000","last_deep_scrub":"27'152","last_deep_scrub_stamp":"2023-12-16T20:49:52.444755+0000","last_clean_scrub_stamp":"2023-12-16T20:49:52.444755+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:02:55.643533+0000","scrub_duration":0.001694704,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":10330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'37","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:40.941825+0000","last_change":"2023-12-16T20:49:40.941825+0000","last_active":"2023-12-16T20:49:40.941825+0000","last_peered":"2023-12-16T20:49:40.941825+0000","last_clean":"2023-12-16T20:49:40.941825+0000","last_became_active":"2023-12-16T20:21:36.518673+0000","last_became_peered":"2023-12-16T20:21:36.518673+0000","last_unstale":"2023-12-16T20:49:40.941825+0000","last_undegraded":"2023-12-16T20:49:40.941825+0000","last_fullsized":"2023-12-16T20:49:40.941825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2023-12-16T20:49:40.941728+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2023-12-16T20:49:40.941728+0000","last_clean_scrub_stamp":"2023-12-16T20:49:40.941728+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:05:27.080261+0000","scrub_duration":0.0014944279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'311","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:50.263800+0000","last_change":"2023-12-16T20:49:50.263820+0000","last_active":"2023-12-16T20:49:50.263800+0000","last_peered":"2023-12-16T20:49:50.263800+0000","last_clean":"2023-12-16T20:49:50.263800+0000","last_became_active":"2023-12-16T20:21:35.423045+0000","last_became_peered":"2023-12-16T20:21:35.423045+0000","last_unstale":"2023-12-16T20:49:50.263800+0000","last_undegraded":"2023-12-16T20:49:50.263800+0000","last_fullsized":"2023-12-16T20:49:50.263800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'311","last_scrub_stamp":"2023-12-16T20:49:50.263741+0000","last_deep_scrub":"27'311","last_deep_scrub_stamp":"2023-12-16T20:49:50.263741+0000","last_clean_scrub_stamp":"2023-12-16T20:49:50.263741+0000","objects_scrubbed":1,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:11:02.799178+0000","scrub_duration":0.0034881420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":886,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'156","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:00.890654+0000","last_change":"2023-12-16T20:50:00.890690+0000","last_active":"2023-12-16T20:50:00.890654+0000","last_peered":"2023-12-16T20:50:00.890654+0000","last_clean":"2023-12-16T20:50:00.890654+0000","last_became_active":"2023-12-16T20:21:41.215747+0000","last_became_peered":"2023-12-16T20:21:41.215747+0000","last_unstale":"2023-12-16T20:50:00.890654+0000","last_undegraded":"2023-12-16T20:50:00.890654+0000","last_fullsized":"2023-12-16T20:50:00.890654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'156","last_scrub_stamp":"2023-12-16T20:50:00.890558+0000","last_deep_scrub":"27'156","last_deep_scrub_stamp":"2023-12-16T20:50:00.890558+0000","last_clean_scrub_stamp":"2023-12-16T20:50:00.890558+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:12.602561+0000","scrub_duration":0.001533455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'35","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:05.274219+0000","last_change":"2023-12-16T20:50:05.274219+0000","last_active":"2023-12-16T20:50:05.274219+0000","last_peered":"2023-12-16T20:50:05.274219+0000","last_clean":"2023-12-16T20:50:05.274219+0000","last_became_active":"2023-12-16T20:21:36.451404+0000","last_became_peered":"2023-12-16T20:21:36.451404+0000","last_unstale":"2023-12-16T20:50:05.274219+0000","last_undegraded":"2023-12-16T20:50:05.274219+0000","last_fullsized":"2023-12-16T20:50:05.274219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-12-16T20:50:05.274132+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-12-16T20:50:05.274132+0000","last_clean_scrub_stamp":"2023-12-16T20:50:05.274132+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:34:27.772625+0000","scrub_duration":0.0009829420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:42.928992+0000","last_change":"2023-12-16T20:49:42.929016+0000","last_active":"2023-12-16T20:49:42.928992+0000","last_peered":"2023-12-16T20:49:42.928992+0000","last_clean":"2023-12-16T20:49:42.928992+0000","last_became_active":"2023-12-16T20:21:35.419917+0000","last_became_peered":"2023-12-16T20:21:35.419917+0000","last_unstale":"2023-12-16T20:49:42.928992+0000","last_undegraded":"2023-12-16T20:49:42.928992+0000","last_fullsized":"2023-12-16T20:49:42.928992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-16T20:49:42.928908+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-16T20:49:42.928908+0000","last_clean_scrub_stamp":"2023-12-16T20:49:42.928908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:18:58.804341+0000","scrub_duration":0.001569261,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'136","reported_seq":173,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:02.138808+0000","last_change":"2023-12-16T20:50:02.138830+0000","last_active":"2023-12-16T20:50:02.138808+0000","last_peered":"2023-12-16T20:50:02.138808+0000","last_clean":"2023-12-16T20:50:02.138808+0000","last_became_active":"2023-12-16T20:21:41.212704+0000","last_became_peered":"2023-12-16T20:21:41.212704+0000","last_unstale":"2023-12-16T20:50:02.138808+0000","last_undegraded":"2023-12-16T20:50:02.138808+0000","last_fullsized":"2023-12-16T20:50:02.138808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'136","last_scrub_stamp":"2023-12-16T20:50:02.138728+0000","last_deep_scrub":"27'136","last_deep_scrub_stamp":"2023-12-16T20:50:02.138728+0000","last_clean_scrub_stamp":"2023-12-16T20:50:02.138728+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:15:04.006251+0000","scrub_duration":0.001707783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":9011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'38","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:51.641831+0000","last_change":"2023-12-16T20:49:51.641869+0000","last_active":"2023-12-16T20:49:51.641831+0000","last_peered":"2023-12-16T20:49:51.641831+0000","last_clean":"2023-12-16T20:49:51.641831+0000","last_became_active":"2023-12-16T20:21:36.555011+0000","last_became_peered":"2023-12-16T20:21:36.555011+0000","last_unstale":"2023-12-16T20:49:51.641831+0000","last_undegraded":"2023-12-16T20:49:51.641831+0000","last_fullsized":"2023-12-16T20:49:51.641831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:51.641701+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:51.641701+0000","last_clean_scrub_stamp":"2023-12-16T20:49:51.641701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:07:03.931085+0000","scrub_duration":0.001332794,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'5","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.178126+0000","last_change":"2023-12-16T20:49:37.178126+0000","last_active":"2023-12-16T20:49:37.178126+0000","last_peered":"2023-12-16T20:49:37.178126+0000","last_clean":"2023-12-16T20:49:37.178126+0000","last_became_active":"2023-12-16T20:21:35.417683+0000","last_became_peered":"2023-12-16T20:21:35.417683+0000","last_unstale":"2023-12-16T20:49:37.178126+0000","last_undegraded":"2023-12-16T20:49:37.178126+0000","last_fullsized":"2023-12-16T20:49:37.178126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:37.178026+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:37.178026+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.178026+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:16:43.237442+0000","scrub_duration":0.00095622999999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'180","reported_seq":217,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:07.282336+0000","last_change":"2023-12-16T20:50:07.282372+0000","last_active":"2023-12-16T20:50:07.282336+0000","last_peered":"2023-12-16T20:50:07.282336+0000","last_clean":"2023-12-16T20:50:07.282336+0000","last_became_active":"2023-12-16T20:21:40.793754+0000","last_became_peered":"2023-12-16T20:21:40.793754+0000","last_unstale":"2023-12-16T20:50:07.282336+0000","last_undegraded":"2023-12-16T20:50:07.282336+0000","last_fullsized":"2023-12-16T20:50:07.282336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'180","last_scrub_stamp":"2023-12-16T20:50:07.282242+0000","last_deep_scrub":"27'180","last_deep_scrub_stamp":"2023-12-16T20:50:07.282242+0000","last_clean_scrub_stamp":"2023-12-16T20:50:07.282242+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:24:32.086175+0000","scrub_duration":0.0017886429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":10123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'33","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:31.412901+0000","last_change":"2023-12-16T20:49:31.412901+0000","last_active":"2023-12-16T20:49:31.412901+0000","last_peered":"2023-12-16T20:49:31.412901+0000","last_clean":"2023-12-16T20:49:31.412901+0000","last_became_active":"2023-12-16T20:21:36.533651+0000","last_became_peered":"2023-12-16T20:21:36.533651+0000","last_unstale":"2023-12-16T20:49:31.412901+0000","last_undegraded":"2023-12-16T20:49:31.412901+0000","last_fullsized":"2023-12-16T20:49:31.412901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:31.412729+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:31.412729+0000","last_clean_scrub_stamp":"2023-12-16T20:49:31.412729+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:47:35.138274+0000","scrub_duration":0.0013879739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'7","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.737712+0000","last_change":"2023-12-16T20:49:37.737756+0000","last_active":"2023-12-16T20:49:37.737712+0000","last_peered":"2023-12-16T20:49:37.737712+0000","last_clean":"2023-12-16T20:49:37.737712+0000","last_became_active":"2023-12-16T20:21:35.421875+0000","last_became_peered":"2023-12-16T20:21:35.421875+0000","last_unstale":"2023-12-16T20:49:37.737712+0000","last_undegraded":"2023-12-16T20:49:37.737712+0000","last_fullsized":"2023-12-16T20:49:37.737712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-12-16T20:49:37.737605+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-12-16T20:49:37.737605+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.737605+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:22:53.369062+0000","scrub_duration":0.001373296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'112","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:23.126310+0000","last_change":"2023-12-16T20:50:23.126333+0000","last_active":"2023-12-16T20:50:23.126310+0000","last_peered":"2023-12-16T20:50:23.126310+0000","last_clean":"2023-12-16T20:50:23.126310+0000","last_became_active":"2023-12-16T20:21:40.753994+0000","last_became_peered":"2023-12-16T20:21:40.753994+0000","last_unstale":"2023-12-16T20:50:23.126310+0000","last_undegraded":"2023-12-16T20:50:23.126310+0000","last_fullsized":"2023-12-16T20:50:23.126310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'112","last_scrub_stamp":"2023-12-16T20:50:23.126240+0000","last_deep_scrub":"27'112","last_deep_scrub_stamp":"2023-12-16T20:50:23.126240+0000","last_clean_scrub_stamp":"2023-12-16T20:50:23.126240+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:41:57.836948+0000","scrub_duration":0.0016879600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'33","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:58.278771+0000","last_change":"2023-12-16T20:49:58.278792+0000","last_active":"2023-12-16T20:49:58.278771+0000","last_peered":"2023-12-16T20:49:58.278771+0000","last_clean":"2023-12-16T20:49:58.278771+0000","last_became_active":"2023-12-16T20:21:36.451231+0000","last_became_peered":"2023-12-16T20:21:36.451231+0000","last_unstale":"2023-12-16T20:49:58.278771+0000","last_undegraded":"2023-12-16T20:49:58.278771+0000","last_fullsized":"2023-12-16T20:49:58.278771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:58.278691+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:58.278691+0000","last_clean_scrub_stamp":"2023-12-16T20:49:58.278691+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:50:56.909460+0000","scrub_duration":0.0011625979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'1042","reported_seq":2121,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:26.183411+0000","last_change":"2023-12-16T20:49:26.183411+0000","last_active":"2023-12-16T20:49:26.183411+0000","last_peered":"2023-12-16T20:49:26.183411+0000","last_clean":"2023-12-16T20:49:26.183411+0000","last_became_active":"2023-12-16T20:21:35.420236+0000","last_became_peered":"2023-12-16T20:21:35.420236+0000","last_unstale":"2023-12-16T20:49:26.183411+0000","last_undegraded":"2023-12-16T20:49:26.183411+0000","last_fullsized":"2023-12-16T20:49:26.183411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1042","last_scrub_stamp":"2023-12-16T20:49:26.183300+0000","last_deep_scrub":"27'1042","last_deep_scrub_stamp":"2023-12-16T20:49:26.183300+0000","last_clean_scrub_stamp":"2023-12-16T20:49:26.183300+0000","objects_scrubbed":1,"log_size":1042,"log_dups_size":0,"ondisk_log_size":1042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:27:50.281048+0000","scrub_duration":0.0018598899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222889,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1038,"num_read_kb":1098,"num_write":1039,"num_write_kb":1099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'134","reported_seq":168,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:56.870849+0000","last_change":"2023-12-16T20:49:56.870849+0000","last_active":"2023-12-16T20:49:56.870849+0000","last_peered":"2023-12-16T20:49:56.870849+0000","last_clean":"2023-12-16T20:49:56.870849+0000","last_became_active":"2023-12-16T20:22:14.842220+0000","last_became_peered":"2023-12-16T20:22:14.842220+0000","last_unstale":"2023-12-16T20:49:56.870849+0000","last_undegraded":"2023-12-16T20:49:56.870849+0000","last_fullsized":"2023-12-16T20:49:56.870849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'134","last_scrub_stamp":"2023-12-16T20:49:56.870733+0000","last_deep_scrub":"27'134","last_deep_scrub_stamp":"2023-12-16T20:49:56.870733+0000","last_clean_scrub_stamp":"2023-12-16T20:49:56.870733+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:23:12.502189+0000","scrub_duration":0.0016554510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":9129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"27'27","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:43.234962+0000","last_change":"2023-12-16T20:49:43.234962+0000","last_active":"2023-12-16T20:49:43.234962+0000","last_peered":"2023-12-16T20:49:43.234962+0000","last_clean":"2023-12-16T20:49:43.234962+0000","last_became_active":"2023-12-16T20:21:36.535571+0000","last_became_peered":"2023-12-16T20:21:36.535571+0000","last_unstale":"2023-12-16T20:49:43.234962+0000","last_undegraded":"2023-12-16T20:49:43.234962+0000","last_fullsized":"2023-12-16T20:49:43.234962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2023-12-16T20:49:43.234817+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2023-12-16T20:49:43.234817+0000","last_clean_scrub_stamp":"2023-12-16T20:49:43.234817+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:02:46.433595+0000","scrub_duration":0.001196548,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'545","reported_seq":586,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:48.856264+0000","last_change":"2023-12-16T20:49:48.856285+0000","last_active":"2023-12-16T20:49:48.856264+0000","last_peered":"2023-12-16T20:49:48.856264+0000","last_clean":"2023-12-16T20:49:48.856264+0000","last_became_active":"2023-12-16T20:21:35.418751+0000","last_became_peered":"2023-12-16T20:21:35.418751+0000","last_unstale":"2023-12-16T20:49:48.856264+0000","last_undegraded":"2023-12-16T20:49:48.856264+0000","last_fullsized":"2023-12-16T20:49:48.856264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'545","last_scrub_stamp":"2023-12-16T20:49:48.856178+0000","last_deep_scrub":"27'545","last_deep_scrub_stamp":"2023-12-16T20:49:48.856178+0000","last_clean_scrub_stamp":"2023-12-16T20:49:48.856178+0000","objects_scrubbed":1,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:46:48.769321+0000","scrub_duration":0.013032899000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'129","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:55.975864+0000","last_change":"2023-12-16T20:49:55.975910+0000","last_active":"2023-12-16T20:49:55.975864+0000","last_peered":"2023-12-16T20:49:55.975864+0000","last_clean":"2023-12-16T20:49:55.975864+0000","last_became_active":"2023-12-16T20:21:41.213977+0000","last_became_peered":"2023-12-16T20:21:41.213977+0000","last_unstale":"2023-12-16T20:49:55.975864+0000","last_undegraded":"2023-12-16T20:49:55.975864+0000","last_fullsized":"2023-12-16T20:49:55.975864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'129","last_scrub_stamp":"2023-12-16T20:49:55.975789+0000","last_deep_scrub":"27'129","last_deep_scrub_stamp":"2023-12-16T20:49:55.975789+0000","last_clean_scrub_stamp":"2023-12-16T20:49:55.975789+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:55:13.111565+0000","scrub_duration":0.0016379389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":8382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'30","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:25.008746+0000","last_change":"2023-12-16T20:49:25.008746+0000","last_active":"2023-12-16T20:49:25.008746+0000","last_peered":"2023-12-16T20:49:25.008746+0000","last_clean":"2023-12-16T20:49:25.008746+0000","last_became_active":"2023-12-16T20:21:36.550997+0000","last_became_peered":"2023-12-16T20:21:36.550997+0000","last_unstale":"2023-12-16T20:49:25.008746+0000","last_undegraded":"2023-12-16T20:49:25.008746+0000","last_fullsized":"2023-12-16T20:49:25.008746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-12-16T20:49:25.008610+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-12-16T20:49:25.008610+0000","last_clean_scrub_stamp":"2023-12-16T20:49:25.008610+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:16:31.068027+0000","scrub_duration":0.001488783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:44.635331+0000","last_change":"2023-12-16T20:49:44.635351+0000","last_active":"2023-12-16T20:49:44.635331+0000","last_peered":"2023-12-16T20:49:44.635331+0000","last_clean":"2023-12-16T20:49:44.635331+0000","last_became_active":"2023-12-16T20:21:35.415984+0000","last_became_peered":"2023-12-16T20:21:35.415984+0000","last_unstale":"2023-12-16T20:49:44.635331+0000","last_undegraded":"2023-12-16T20:49:44.635331+0000","last_fullsized":"2023-12-16T20:49:44.635331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2023-12-16T20:49:44.635268+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2023-12-16T20:49:44.635268+0000","last_clean_scrub_stamp":"2023-12-16T20:49:44.635268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:19:00.510701+0000","scrub_duration":0.001090756,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.944057+0000","last_change":"2023-12-16T20:49:35.944081+0000","last_active":"2023-12-16T20:49:35.944057+0000","last_peered":"2023-12-16T20:49:35.944057+0000","last_clean":"2023-12-16T20:49:35.944057+0000","last_became_active":"2023-12-16T20:21:25.195675+0000","last_became_peered":"2023-12-16T20:21:25.195675+0000","last_unstale":"2023-12-16T20:49:35.944057+0000","last_undegraded":"2023-12-16T20:49:35.944057+0000","last_fullsized":"2023-12-16T20:49:35.944057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2023-12-16T20:49:35.944005+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2023-12-16T20:49:35.944005+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.944005+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:22:55.655410+0000","scrub_duration":0.0041226689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'192","reported_seq":229,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:02.942506+0000","last_change":"2023-12-16T20:50:02.942529+0000","last_active":"2023-12-16T20:50:02.942506+0000","last_peered":"2023-12-16T20:50:02.942506+0000","last_clean":"2023-12-16T20:50:02.942506+0000","last_became_active":"2023-12-16T20:21:41.214012+0000","last_became_peered":"2023-12-16T20:21:41.214012+0000","last_unstale":"2023-12-16T20:50:02.942506+0000","last_undegraded":"2023-12-16T20:50:02.942506+0000","last_fullsized":"2023-12-16T20:50:02.942506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'192","last_scrub_stamp":"2023-12-16T20:50:02.942431+0000","last_deep_scrub":"27'192","last_deep_scrub_stamp":"2023-12-16T20:50:02.942431+0000","last_clean_scrub_stamp":"2023-12-16T20:50:02.942431+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:23:46.166218+0000","scrub_duration":0.0017960420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":12745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'36","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:29.998284+0000","last_change":"2023-12-16T20:49:29.998311+0000","last_active":"2023-12-16T20:49:29.998284+0000","last_peered":"2023-12-16T20:49:29.998284+0000","last_clean":"2023-12-16T20:49:29.998284+0000","last_became_active":"2023-12-16T20:21:36.552619+0000","last_became_peered":"2023-12-16T20:21:36.552619+0000","last_unstale":"2023-12-16T20:49:29.998284+0000","last_undegraded":"2023-12-16T20:49:29.998284+0000","last_fullsized":"2023-12-16T20:49:29.998284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2023-12-16T20:49:29.998180+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2023-12-16T20:49:29.998180+0000","last_clean_scrub_stamp":"2023-12-16T20:49:29.998180+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:51.843719+0000","scrub_duration":0.001334638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:30.083872+0000","last_change":"2023-12-16T20:49:30.083904+0000","last_active":"2023-12-16T20:49:30.083872+0000","last_peered":"2023-12-16T20:49:30.083872+0000","last_clean":"2023-12-16T20:49:30.083872+0000","last_became_active":"2023-12-16T20:21:35.413308+0000","last_became_peered":"2023-12-16T20:21:35.413308+0000","last_unstale":"2023-12-16T20:49:30.083872+0000","last_undegraded":"2023-12-16T20:49:30.083872+0000","last_fullsized":"2023-12-16T20:49:30.083872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-16T20:49:30.083795+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-16T20:49:30.083795+0000","last_clean_scrub_stamp":"2023-12-16T20:49:30.083795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:57:33.423790+0000","scrub_duration":0.001344486,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'151","reported_seq":188,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:04.951573+0000","last_change":"2023-12-16T20:50:04.951608+0000","last_active":"2023-12-16T20:50:04.951573+0000","last_peered":"2023-12-16T20:50:04.951573+0000","last_clean":"2023-12-16T20:50:04.951573+0000","last_became_active":"2023-12-16T20:21:41.212608+0000","last_became_peered":"2023-12-16T20:21:41.212608+0000","last_unstale":"2023-12-16T20:50:04.951573+0000","last_undegraded":"2023-12-16T20:50:04.951573+0000","last_fullsized":"2023-12-16T20:50:04.951573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'151","last_scrub_stamp":"2023-12-16T20:50:04.951489+0000","last_deep_scrub":"27'151","last_deep_scrub_stamp":"2023-12-16T20:50:04.951489+0000","last_clean_scrub_stamp":"2023-12-16T20:50:04.951489+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:05:51.090022+0000","scrub_duration":0.0015182559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":6553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'41","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:46.661846+0000","last_change":"2023-12-16T20:49:46.661867+0000","last_active":"2023-12-16T20:49:46.661846+0000","last_peered":"2023-12-16T20:49:46.661846+0000","last_clean":"2023-12-16T20:49:46.661846+0000","last_became_active":"2023-12-16T20:21:36.555631+0000","last_became_peered":"2023-12-16T20:21:36.555631+0000","last_unstale":"2023-12-16T20:49:46.661846+0000","last_undegraded":"2023-12-16T20:49:46.661846+0000","last_fullsized":"2023-12-16T20:49:46.661846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2023-12-16T20:49:46.661779+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2023-12-16T20:49:46.661779+0000","last_clean_scrub_stamp":"2023-12-16T20:49:46.661779+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:25:33.489213+0000","scrub_duration":0.0010676520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:57.264374+0000","last_change":"2023-12-16T20:49:57.264395+0000","last_active":"2023-12-16T20:49:57.264374+0000","last_peered":"2023-12-16T20:49:57.264374+0000","last_clean":"2023-12-16T20:49:57.264374+0000","last_became_active":"2023-12-16T20:21:35.415810+0000","last_became_peered":"2023-12-16T20:21:35.415810+0000","last_unstale":"2023-12-16T20:49:57.264374+0000","last_undegraded":"2023-12-16T20:49:57.264374+0000","last_fullsized":"2023-12-16T20:49:57.264374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:57.264322+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:57.264322+0000","last_clean_scrub_stamp":"2023-12-16T20:49:57.264322+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:07:09.553705+0000","scrub_duration":0.0024946949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'169","reported_seq":214,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:44.222648+0000","last_change":"2023-12-16T20:49:44.222668+0000","last_active":"2023-12-16T20:49:44.222648+0000","last_peered":"2023-12-16T20:49:44.222648+0000","last_clean":"2023-12-16T20:49:44.222648+0000","last_became_active":"2023-12-16T20:22:14.842282+0000","last_became_peered":"2023-12-16T20:22:14.842282+0000","last_unstale":"2023-12-16T20:49:44.222648+0000","last_undegraded":"2023-12-16T20:49:44.222648+0000","last_fullsized":"2023-12-16T20:49:44.222648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'169","last_scrub_stamp":"2023-12-16T20:49:44.222590+0000","last_deep_scrub":"27'169","last_deep_scrub_stamp":"2023-12-16T20:49:44.222590+0000","last_clean_scrub_stamp":"2023-12-16T20:49:44.222590+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:23:27.446377+0000","scrub_duration":0.001449423,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":8236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'35","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:11.713255+0000","last_change":"2023-12-16T20:50:11.713294+0000","last_active":"2023-12-16T20:50:11.713255+0000","last_peered":"2023-12-16T20:50:11.713255+0000","last_clean":"2023-12-16T20:50:11.713255+0000","last_became_active":"2023-12-16T20:21:36.536093+0000","last_became_peered":"2023-12-16T20:21:36.536093+0000","last_unstale":"2023-12-16T20:50:11.713255+0000","last_undegraded":"2023-12-16T20:50:11.713255+0000","last_fullsized":"2023-12-16T20:50:11.713255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-12-16T20:50:11.713146+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-12-16T20:50:11.713146+0000","last_clean_scrub_stamp":"2023-12-16T20:50:11.713146+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:15:13.580669+0000","scrub_duration":0.001350073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'8","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:33.942561+0000","last_change":"2023-12-16T20:49:33.942600+0000","last_active":"2023-12-16T20:49:33.942561+0000","last_peered":"2023-12-16T20:49:33.942561+0000","last_clean":"2023-12-16T20:49:33.942561+0000","last_became_active":"2023-12-16T20:21:35.420074+0000","last_became_peered":"2023-12-16T20:21:35.420074+0000","last_unstale":"2023-12-16T20:49:33.942561+0000","last_undegraded":"2023-12-16T20:49:33.942561+0000","last_fullsized":"2023-12-16T20:49:33.942561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2023-12-16T20:49:33.942494+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2023-12-16T20:49:33.942494+0000","last_clean_scrub_stamp":"2023-12-16T20:49:33.942494+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:52:08.699859+0000","scrub_duration":0.0020749739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'129","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:15.712313+0000","last_change":"2023-12-16T20:50:15.712336+0000","last_active":"2023-12-16T20:50:15.712313+0000","last_peered":"2023-12-16T20:50:15.712313+0000","last_clean":"2023-12-16T20:50:15.712313+0000","last_became_active":"2023-12-16T20:21:41.214939+0000","last_became_peered":"2023-12-16T20:21:41.214939+0000","last_unstale":"2023-12-16T20:50:15.712313+0000","last_undegraded":"2023-12-16T20:50:15.712313+0000","last_fullsized":"2023-12-16T20:50:15.712313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'129","last_scrub_stamp":"2023-12-16T20:50:15.712229+0000","last_deep_scrub":"27'129","last_deep_scrub_stamp":"2023-12-16T20:50:15.712229+0000","last_clean_scrub_stamp":"2023-12-16T20:50:15.712229+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:41:50.422937+0000","scrub_duration":0.001772055,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":12347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'21","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:52.751235+0000","last_change":"2023-12-16T20:49:52.751264+0000","last_active":"2023-12-16T20:49:52.751235+0000","last_peered":"2023-12-16T20:49:52.751235+0000","last_clean":"2023-12-16T20:49:52.751235+0000","last_became_active":"2023-12-16T20:21:36.534064+0000","last_became_peered":"2023-12-16T20:21:36.534064+0000","last_unstale":"2023-12-16T20:49:52.751235+0000","last_undegraded":"2023-12-16T20:49:52.751235+0000","last_fullsized":"2023-12-16T20:49:52.751235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2023-12-16T20:49:52.751136+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2023-12-16T20:49:52.751136+0000","last_clean_scrub_stamp":"2023-12-16T20:49:52.751136+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:50:51.381905+0000","scrub_duration":0.0013552460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:24.454926+0000","last_change":"2023-12-16T20:49:24.454950+0000","last_active":"2023-12-16T20:49:24.454926+0000","last_peered":"2023-12-16T20:49:24.454926+0000","last_clean":"2023-12-16T20:49:24.454926+0000","last_became_active":"2023-12-16T20:21:35.390740+0000","last_became_peered":"2023-12-16T20:21:35.390740+0000","last_unstale":"2023-12-16T20:49:24.454926+0000","last_undegraded":"2023-12-16T20:49:24.454926+0000","last_fullsized":"2023-12-16T20:49:24.454926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:24.454859+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:24.454859+0000","last_clean_scrub_stamp":"2023-12-16T20:49:24.454859+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:46:57.389983+0000","scrub_duration":0.0022306159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'180","reported_seq":217,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:38.446279+0000","last_change":"2023-12-16T20:49:38.446279+0000","last_active":"2023-12-16T20:49:38.446279+0000","last_peered":"2023-12-16T20:49:38.446279+0000","last_clean":"2023-12-16T20:49:38.446279+0000","last_became_active":"2023-12-16T20:21:40.753981+0000","last_became_peered":"2023-12-16T20:21:40.753981+0000","last_unstale":"2023-12-16T20:49:38.446279+0000","last_undegraded":"2023-12-16T20:49:38.446279+0000","last_fullsized":"2023-12-16T20:49:38.446279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'180","last_scrub_stamp":"2023-12-16T20:49:38.446193+0000","last_deep_scrub":"27'180","last_deep_scrub_stamp":"2023-12-16T20:49:38.446193+0000","last_clean_scrub_stamp":"2023-12-16T20:49:38.446193+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:22:54.077650+0000","scrub_duration":0.00173639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":13396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'37","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:55.745796+0000","last_change":"2023-12-16T20:49:55.745832+0000","last_active":"2023-12-16T20:49:55.745796+0000","last_peered":"2023-12-16T20:49:55.745796+0000","last_clean":"2023-12-16T20:49:55.745796+0000","last_became_active":"2023-12-16T20:21:36.536822+0000","last_became_peered":"2023-12-16T20:21:36.536822+0000","last_unstale":"2023-12-16T20:49:55.745796+0000","last_undegraded":"2023-12-16T20:49:55.745796+0000","last_fullsized":"2023-12-16T20:49:55.745796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2023-12-16T20:49:55.745723+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2023-12-16T20:49:55.745723+0000","last_clean_scrub_stamp":"2023-12-16T20:49:55.745723+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:23:38.969510+0000","scrub_duration":0.00092544100000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'13","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:36.010890+0000","last_change":"2023-12-16T20:49:36.010890+0000","last_active":"2023-12-16T20:49:36.010890+0000","last_peered":"2023-12-16T20:49:36.010890+0000","last_clean":"2023-12-16T20:49:36.010890+0000","last_became_active":"2023-12-16T20:21:35.416850+0000","last_became_peered":"2023-12-16T20:21:35.416850+0000","last_unstale":"2023-12-16T20:49:36.010890+0000","last_undegraded":"2023-12-16T20:49:36.010890+0000","last_fullsized":"2023-12-16T20:49:36.010890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2023-12-16T20:49:36.010800+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2023-12-16T20:49:36.010800+0000","last_clean_scrub_stamp":"2023-12-16T20:49:36.010800+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:31:01.472769+0000","scrub_duration":0.0029238240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'159","reported_seq":195,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:46.189393+0000","last_change":"2023-12-16T20:49:46.189393+0000","last_active":"2023-12-16T20:49:46.189393+0000","last_peered":"2023-12-16T20:49:46.189393+0000","last_clean":"2023-12-16T20:49:46.189393+0000","last_became_active":"2023-12-16T20:21:40.755041+0000","last_became_peered":"2023-12-16T20:21:40.755041+0000","last_unstale":"2023-12-16T20:49:46.189393+0000","last_undegraded":"2023-12-16T20:49:46.189393+0000","last_fullsized":"2023-12-16T20:49:46.189393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'159","last_scrub_stamp":"2023-12-16T20:49:46.189303+0000","last_deep_scrub":"27'159","last_deep_scrub_stamp":"2023-12-16T20:49:46.189303+0000","last_clean_scrub_stamp":"2023-12-16T20:49:46.189303+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:05:32.327836+0000","scrub_duration":0.001539393,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":9935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'32","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:47.065132+0000","last_change":"2023-12-16T20:49:47.065175+0000","last_active":"2023-12-16T20:49:47.065132+0000","last_peered":"2023-12-16T20:49:47.065132+0000","last_clean":"2023-12-16T20:49:47.065132+0000","last_became_active":"2023-12-16T20:21:36.540861+0000","last_became_peered":"2023-12-16T20:21:36.540861+0000","last_unstale":"2023-12-16T20:49:47.065132+0000","last_undegraded":"2023-12-16T20:49:47.065132+0000","last_fullsized":"2023-12-16T20:49:47.065132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2023-12-16T20:49:47.065045+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2023-12-16T20:49:47.065045+0000","last_clean_scrub_stamp":"2023-12-16T20:49:47.065045+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:10:59.600482+0000","scrub_duration":0.00123215,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:38.003759+0000","last_change":"2023-12-16T20:49:38.003778+0000","last_active":"2023-12-16T20:49:38.003759+0000","last_peered":"2023-12-16T20:49:38.003759+0000","last_clean":"2023-12-16T20:49:38.003759+0000","last_became_active":"2023-12-16T20:21:35.424822+0000","last_became_peered":"2023-12-16T20:21:35.424822+0000","last_unstale":"2023-12-16T20:49:38.003759+0000","last_undegraded":"2023-12-16T20:49:38.003759+0000","last_fullsized":"2023-12-16T20:49:38.003759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-16T20:49:38.003697+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-16T20:49:38.003697+0000","last_clean_scrub_stamp":"2023-12-16T20:49:38.003697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:03:34.460897+0000","scrub_duration":0.00081691399999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'130","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:03.922658+0000","last_change":"2023-12-16T20:50:03.922658+0000","last_active":"2023-12-16T20:50:03.922658+0000","last_peered":"2023-12-16T20:50:03.922658+0000","last_clean":"2023-12-16T20:50:03.922658+0000","last_became_active":"2023-12-16T20:21:41.215002+0000","last_became_peered":"2023-12-16T20:21:41.215002+0000","last_unstale":"2023-12-16T20:50:03.922658+0000","last_undegraded":"2023-12-16T20:50:03.922658+0000","last_fullsized":"2023-12-16T20:50:03.922658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'130","last_scrub_stamp":"2023-12-16T20:50:03.922571+0000","last_deep_scrub":"27'130","last_deep_scrub_stamp":"2023-12-16T20:50:03.922571+0000","last_clean_scrub_stamp":"2023-12-16T20:50:03.922571+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:30:15.547717+0000","scrub_duration":0.0015362489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":7078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'49","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:10.704079+0000","last_change":"2023-12-16T20:50:10.704102+0000","last_active":"2023-12-16T20:50:10.704079+0000","last_peered":"2023-12-16T20:50:10.704079+0000","last_clean":"2023-12-16T20:50:10.704079+0000","last_became_active":"2023-12-16T20:21:36.535447+0000","last_became_peered":"2023-12-16T20:21:36.535447+0000","last_unstale":"2023-12-16T20:50:10.704079+0000","last_undegraded":"2023-12-16T20:50:10.704079+0000","last_fullsized":"2023-12-16T20:50:10.704079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2023-12-16T20:50:10.704002+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2023-12-16T20:50:10.704002+0000","last_clean_scrub_stamp":"2023-12-16T20:50:10.704002+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:43:20.636829+0000","scrub_duration":0.001344736,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:42.639497+0000","last_change":"2023-12-16T20:49:42.639525+0000","last_active":"2023-12-16T20:49:42.639497+0000","last_peered":"2023-12-16T20:49:42.639497+0000","last_clean":"2023-12-16T20:49:42.639497+0000","last_became_active":"2023-12-16T20:21:35.423275+0000","last_became_peered":"2023-12-16T20:21:35.423275+0000","last_unstale":"2023-12-16T20:49:42.639497+0000","last_undegraded":"2023-12-16T20:49:42.639497+0000","last_fullsized":"2023-12-16T20:49:42.639497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-12-16T20:49:42.639417+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-12-16T20:49:42.639417+0000","last_clean_scrub_stamp":"2023-12-16T20:49:42.639417+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:10:55.174854+0000","scrub_duration":0.0012433469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'115","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:54.883561+0000","last_change":"2023-12-16T20:49:54.883598+0000","last_active":"2023-12-16T20:49:54.883561+0000","last_peered":"2023-12-16T20:49:54.883561+0000","last_clean":"2023-12-16T20:49:54.883561+0000","last_became_active":"2023-12-16T20:21:41.212699+0000","last_became_peered":"2023-12-16T20:21:41.212699+0000","last_unstale":"2023-12-16T20:49:54.883561+0000","last_undegraded":"2023-12-16T20:49:54.883561+0000","last_fullsized":"2023-12-16T20:49:54.883561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'115","last_scrub_stamp":"2023-12-16T20:49:54.883463+0000","last_deep_scrub":"27'115","last_deep_scrub_stamp":"2023-12-16T20:49:54.883463+0000","last_clean_scrub_stamp":"2023-12-16T20:49:54.883463+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:30:54.123130+0000","scrub_duration":0.0019162179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'45","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:42.256750+0000","last_change":"2023-12-16T20:49:42.256769+0000","last_active":"2023-12-16T20:49:42.256750+0000","last_peered":"2023-12-16T20:49:42.256750+0000","last_clean":"2023-12-16T20:49:42.256750+0000","last_became_active":"2023-12-16T20:21:36.523649+0000","last_became_peered":"2023-12-16T20:21:36.523649+0000","last_unstale":"2023-12-16T20:49:42.256750+0000","last_undegraded":"2023-12-16T20:49:42.256750+0000","last_fullsized":"2023-12-16T20:49:42.256750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-16T20:49:42.256681+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-16T20:49:42.256681+0000","last_clean_scrub_stamp":"2023-12-16T20:49:42.256681+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:52:59.557961+0000","scrub_duration":0.0011776029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'263","reported_seq":302,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:21.189639+0000","last_change":"2023-12-16T20:49:21.189639+0000","last_active":"2023-12-16T20:49:21.189639+0000","last_peered":"2023-12-16T20:49:21.189639+0000","last_clean":"2023-12-16T20:49:21.189639+0000","last_became_active":"2023-12-16T20:21:35.388392+0000","last_became_peered":"2023-12-16T20:21:35.388392+0000","last_unstale":"2023-12-16T20:49:21.189639+0000","last_undegraded":"2023-12-16T20:49:21.189639+0000","last_fullsized":"2023-12-16T20:49:21.189639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'263","last_scrub_stamp":"2023-12-16T20:49:21.189550+0000","last_deep_scrub":"27'263","last_deep_scrub_stamp":"2023-12-16T20:49:21.189550+0000","last_clean_scrub_stamp":"2023-12-16T20:49:21.189550+0000","objects_scrubbed":3,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:47:24.915095+0000","scrub_duration":0.0088499110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2496854,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":2582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'142","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:16.673837+0000","last_change":"2023-12-16T20:50:16.673837+0000","last_active":"2023-12-16T20:50:16.673837+0000","last_peered":"2023-12-16T20:50:16.673837+0000","last_clean":"2023-12-16T20:50:16.673837+0000","last_became_active":"2023-12-16T20:21:41.212721+0000","last_became_peered":"2023-12-16T20:21:41.212721+0000","last_unstale":"2023-12-16T20:50:16.673837+0000","last_undegraded":"2023-12-16T20:50:16.673837+0000","last_fullsized":"2023-12-16T20:50:16.673837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'142","last_scrub_stamp":"2023-12-16T20:50:16.673740+0000","last_deep_scrub":"27'142","last_deep_scrub_stamp":"2023-12-16T20:50:16.673740+0000","last_clean_scrub_stamp":"2023-12-16T20:50:16.673740+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:11:07.259861+0000","scrub_duration":0.0018609950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":13674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'36","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:19.718278+0000","last_change":"2023-12-16T20:50:19.718278+0000","last_active":"2023-12-16T20:50:19.718278+0000","last_peered":"2023-12-16T20:50:19.718278+0000","last_clean":"2023-12-16T20:50:19.718278+0000","last_became_active":"2023-12-16T20:21:36.519561+0000","last_became_peered":"2023-12-16T20:21:36.519561+0000","last_unstale":"2023-12-16T20:50:19.718278+0000","last_undegraded":"2023-12-16T20:50:19.718278+0000","last_fullsized":"2023-12-16T20:50:19.718278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2023-12-16T20:50:19.718136+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2023-12-16T20:50:19.718136+0000","last_clean_scrub_stamp":"2023-12-16T20:50:19.718136+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:31.430139+0000","scrub_duration":0.0017545589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'853","reported_seq":892,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:27.001377+0000","last_change":"2023-12-16T20:49:27.001377+0000","last_active":"2023-12-16T20:49:27.001377+0000","last_peered":"2023-12-16T20:49:27.001377+0000","last_clean":"2023-12-16T20:49:27.001377+0000","last_became_active":"2023-12-16T20:21:35.425929+0000","last_became_peered":"2023-12-16T20:21:35.425929+0000","last_unstale":"2023-12-16T20:49:27.001377+0000","last_undegraded":"2023-12-16T20:49:27.001377+0000","last_fullsized":"2023-12-16T20:49:27.001377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'853","last_scrub_stamp":"2023-12-16T20:49:27.001283+0000","last_deep_scrub":"27'853","last_deep_scrub_stamp":"2023-12-16T20:49:27.001283+0000","last_clean_scrub_stamp":"2023-12-16T20:49:27.001283+0000","objects_scrubbed":4,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:45:17.910698+0000","scrub_duration":0.017121821999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":4548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'165","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:17.088382+0000","last_change":"2023-12-16T20:50:17.088403+0000","last_active":"2023-12-16T20:50:17.088382+0000","last_peered":"2023-12-16T20:50:17.088382+0000","last_clean":"2023-12-16T20:50:17.088382+0000","last_became_active":"2023-12-16T20:21:40.753624+0000","last_became_peered":"2023-12-16T20:21:40.753624+0000","last_unstale":"2023-12-16T20:50:17.088382+0000","last_undegraded":"2023-12-16T20:50:17.088382+0000","last_fullsized":"2023-12-16T20:50:17.088382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'165","last_scrub_stamp":"2023-12-16T20:50:17.088309+0000","last_deep_scrub":"27'165","last_deep_scrub_stamp":"2023-12-16T20:50:17.088309+0000","last_clean_scrub_stamp":"2023-12-16T20:50:17.088309+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:43:27.021136+0000","scrub_duration":0.0017766119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":9759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'33","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:32.382521+0000","last_change":"2023-12-16T20:49:32.382521+0000","last_active":"2023-12-16T20:49:32.382521+0000","last_peered":"2023-12-16T20:49:32.382521+0000","last_clean":"2023-12-16T20:49:32.382521+0000","last_became_active":"2023-12-16T20:21:36.533790+0000","last_became_peered":"2023-12-16T20:21:36.533790+0000","last_unstale":"2023-12-16T20:49:32.382521+0000","last_undegraded":"2023-12-16T20:49:32.382521+0000","last_fullsized":"2023-12-16T20:49:32.382521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:32.382392+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:32.382392+0000","last_clean_scrub_stamp":"2023-12-16T20:49:32.382392+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:54.227931+0000","scrub_duration":0.0013665769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'708","reported_seq":747,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:52.273727+0000","last_change":"2023-12-16T20:49:52.273727+0000","last_active":"2023-12-16T20:49:52.273727+0000","last_peered":"2023-12-16T20:49:52.273727+0000","last_clean":"2023-12-16T20:49:52.273727+0000","last_became_active":"2023-12-16T20:21:35.415790+0000","last_became_peered":"2023-12-16T20:21:35.415790+0000","last_unstale":"2023-12-16T20:49:52.273727+0000","last_undegraded":"2023-12-16T20:49:52.273727+0000","last_fullsized":"2023-12-16T20:49:52.273727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'708","last_scrub_stamp":"2023-12-16T20:49:52.273600+0000","last_deep_scrub":"27'708","last_deep_scrub_stamp":"2023-12-16T20:49:52.273600+0000","last_clean_scrub_stamp":"2023-12-16T20:49:52.273600+0000","objects_scrubbed":2,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:19:08.149033+0000","scrub_duration":0.0033982190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":703,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'154","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:54.490333+0000","last_change":"2023-12-16T20:49:54.490356+0000","last_active":"2023-12-16T20:49:54.490333+0000","last_peered":"2023-12-16T20:49:54.490333+0000","last_clean":"2023-12-16T20:49:54.490333+0000","last_became_active":"2023-12-16T20:21:40.793667+0000","last_became_peered":"2023-12-16T20:21:40.793667+0000","last_unstale":"2023-12-16T20:49:54.490333+0000","last_undegraded":"2023-12-16T20:49:54.490333+0000","last_fullsized":"2023-12-16T20:49:54.490333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'154","last_scrub_stamp":"2023-12-16T20:49:54.490252+0000","last_deep_scrub":"27'154","last_deep_scrub_stamp":"2023-12-16T20:49:54.490252+0000","last_clean_scrub_stamp":"2023-12-16T20:49:54.490252+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:47:30.325073+0000","scrub_duration":0.0017958200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":20505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'40","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:41.244938+0000","last_change":"2023-12-16T20:49:41.244938+0000","last_active":"2023-12-16T20:49:41.244938+0000","last_peered":"2023-12-16T20:49:41.244938+0000","last_clean":"2023-12-16T20:49:41.244938+0000","last_became_active":"2023-12-16T20:21:36.552482+0000","last_became_peered":"2023-12-16T20:21:36.552482+0000","last_unstale":"2023-12-16T20:49:41.244938+0000","last_undegraded":"2023-12-16T20:49:41.244938+0000","last_fullsized":"2023-12-16T20:49:41.244938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2023-12-16T20:49:41.244780+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2023-12-16T20:49:41.244780+0000","last_clean_scrub_stamp":"2023-12-16T20:49:41.244780+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T05:46:41.157923+0000","scrub_duration":0.00118479,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:32.853535+0000","last_change":"2023-12-16T20:49:32.853535+0000","last_active":"2023-12-16T20:49:32.853535+0000","last_peered":"2023-12-16T20:49:32.853535+0000","last_clean":"2023-12-16T20:49:32.853535+0000","last_became_active":"2023-12-16T20:21:35.428100+0000","last_became_peered":"2023-12-16T20:21:35.428100+0000","last_unstale":"2023-12-16T20:49:32.853535+0000","last_undegraded":"2023-12-16T20:49:32.853535+0000","last_fullsized":"2023-12-16T20:49:32.853535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-12-16T20:49:32.853418+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-12-16T20:49:32.853418+0000","last_clean_scrub_stamp":"2023-12-16T20:49:32.853418+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:16:38.912835+0000","scrub_duration":0.001267879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'126","reported_seq":162,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:06.853446+0000","last_change":"2023-12-16T20:50:06.853475+0000","last_active":"2023-12-16T20:50:06.853446+0000","last_peered":"2023-12-16T20:50:06.853446+0000","last_clean":"2023-12-16T20:50:06.853446+0000","last_became_active":"2023-12-16T20:21:40.752957+0000","last_became_peered":"2023-12-16T20:21:40.752957+0000","last_unstale":"2023-12-16T20:50:06.853446+0000","last_undegraded":"2023-12-16T20:50:06.853446+0000","last_fullsized":"2023-12-16T20:50:06.853446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'126","last_scrub_stamp":"2023-12-16T20:50:06.853371+0000","last_deep_scrub":"27'126","last_deep_scrub_stamp":"2023-12-16T20:50:06.853371+0000","last_clean_scrub_stamp":"2023-12-16T20:50:06.853371+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:22:51.024082+0000","scrub_duration":0.0017641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":10032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'43","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:55.902407+0000","last_change":"2023-12-16T20:49:55.902427+0000","last_active":"2023-12-16T20:49:55.902407+0000","last_peered":"2023-12-16T20:49:55.902407+0000","last_clean":"2023-12-16T20:49:55.902407+0000","last_became_active":"2023-12-16T20:22:14.840679+0000","last_became_peered":"2023-12-16T20:22:14.840679+0000","last_unstale":"2023-12-16T20:49:55.902407+0000","last_undegraded":"2023-12-16T20:49:55.902407+0000","last_fullsized":"2023-12-16T20:49:55.902407+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2023-12-16T20:49:55.902337+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2023-12-16T20:49:55.902337+0000","last_clean_scrub_stamp":"2023-12-16T20:49:55.902337+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:17:01.961753+0000","scrub_duration":0.0011720260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.961051+0000","last_change":"2023-12-16T20:49:35.961051+0000","last_active":"2023-12-16T20:49:35.961051+0000","last_peered":"2023-12-16T20:49:35.961051+0000","last_clean":"2023-12-16T20:49:35.961051+0000","last_became_active":"2023-12-16T20:21:35.429940+0000","last_became_peered":"2023-12-16T20:21:35.429940+0000","last_unstale":"2023-12-16T20:49:35.961051+0000","last_undegraded":"2023-12-16T20:49:35.961051+0000","last_fullsized":"2023-12-16T20:49:35.961051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:35.960970+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:35.960970+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.960970+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:07:46.264662+0000","scrub_duration":0.00082690499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'174","reported_seq":210,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:51.902166+0000","last_change":"2023-12-16T20:49:51.902204+0000","last_active":"2023-12-16T20:49:51.902166+0000","last_peered":"2023-12-16T20:49:51.902166+0000","last_clean":"2023-12-16T20:49:51.902166+0000","last_became_active":"2023-12-16T20:21:41.215893+0000","last_became_peered":"2023-12-16T20:21:41.215893+0000","last_unstale":"2023-12-16T20:49:51.902166+0000","last_undegraded":"2023-12-16T20:49:51.902166+0000","last_fullsized":"2023-12-16T20:49:51.902166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'174","last_scrub_stamp":"2023-12-16T20:49:51.902070+0000","last_deep_scrub":"27'174","last_deep_scrub_stamp":"2023-12-16T20:49:51.902070+0000","last_clean_scrub_stamp":"2023-12-16T20:49:51.902070+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:14:53.769594+0000","scrub_duration":0.001858784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":9716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'144","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:59.069009+0000","last_change":"2023-12-16T20:49:59.069045+0000","last_active":"2023-12-16T20:49:59.069009+0000","last_peered":"2023-12-16T20:49:59.069009+0000","last_clean":"2023-12-16T20:49:59.069009+0000","last_became_active":"2023-12-16T20:21:41.214950+0000","last_became_peered":"2023-12-16T20:21:41.214950+0000","last_unstale":"2023-12-16T20:49:59.069009+0000","last_undegraded":"2023-12-16T20:49:59.069009+0000","last_fullsized":"2023-12-16T20:49:59.069009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'144","last_scrub_stamp":"2023-12-16T20:49:59.068933+0000","last_deep_scrub":"27'144","last_deep_scrub_stamp":"2023-12-16T20:49:59.068933+0000","last_clean_scrub_stamp":"2023-12-16T20:49:59.068933+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:43:09.001759+0000","scrub_duration":0.0016057809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":7732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'44","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.210624+0000","last_change":"2023-12-16T20:49:35.210624+0000","last_active":"2023-12-16T20:49:35.210624+0000","last_peered":"2023-12-16T20:49:35.210624+0000","last_clean":"2023-12-16T20:49:35.210624+0000","last_became_active":"2023-12-16T20:21:36.519476+0000","last_became_peered":"2023-12-16T20:21:36.519476+0000","last_unstale":"2023-12-16T20:49:35.210624+0000","last_undegraded":"2023-12-16T20:49:35.210624+0000","last_fullsized":"2023-12-16T20:49:35.210624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2023-12-16T20:49:35.210541+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2023-12-16T20:49:35.210541+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.210541+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:05:54.945127+0000","scrub_duration":0.00098724800000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:41.643946+0000","last_change":"2023-12-16T20:49:41.643946+0000","last_active":"2023-12-16T20:49:41.643946+0000","last_peered":"2023-12-16T20:49:41.643946+0000","last_clean":"2023-12-16T20:49:41.643946+0000","last_became_active":"2023-12-16T20:21:35.414846+0000","last_became_peered":"2023-12-16T20:21:35.414846+0000","last_unstale":"2023-12-16T20:49:41.643946+0000","last_undegraded":"2023-12-16T20:49:41.643946+0000","last_fullsized":"2023-12-16T20:49:41.643946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-12-16T20:49:41.643824+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-12-16T20:49:41.643824+0000","last_clean_scrub_stamp":"2023-12-16T20:49:41.643824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:54:58.109657+0000","scrub_duration":0.000945662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'142","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:10.074482+0000","last_change":"2023-12-16T20:50:10.074521+0000","last_active":"2023-12-16T20:50:10.074482+0000","last_peered":"2023-12-16T20:50:10.074482+0000","last_clean":"2023-12-16T20:50:10.074482+0000","last_became_active":"2023-12-16T20:21:40.794073+0000","last_became_peered":"2023-12-16T20:21:40.794073+0000","last_unstale":"2023-12-16T20:50:10.074482+0000","last_undegraded":"2023-12-16T20:50:10.074482+0000","last_fullsized":"2023-12-16T20:50:10.074482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'142","last_scrub_stamp":"2023-12-16T20:50:10.074366+0000","last_deep_scrub":"27'142","last_deep_scrub_stamp":"2023-12-16T20:50:10.074366+0000","last_clean_scrub_stamp":"2023-12-16T20:50:10.074366+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:24:34.878298+0000","scrub_duration":0.0019660390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":21602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'45","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:34.144433+0000","last_change":"2023-12-16T20:50:34.144453+0000","last_active":"2023-12-16T20:50:34.144433+0000","last_peered":"2023-12-16T20:50:34.144433+0000","last_clean":"2023-12-16T20:50:34.144433+0000","last_became_active":"2023-12-16T20:22:14.771747+0000","last_became_peered":"2023-12-16T20:22:14.771747+0000","last_unstale":"2023-12-16T20:50:34.144433+0000","last_undegraded":"2023-12-16T20:50:34.144433+0000","last_fullsized":"2023-12-16T20:50:34.144433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-16T20:50:34.144359+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-16T20:50:34.144359+0000","last_clean_scrub_stamp":"2023-12-16T20:50:34.144359+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:30:45.769504+0000","scrub_duration":0.00095344899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:36.037185+0000","last_change":"2023-12-16T20:49:36.037185+0000","last_active":"2023-12-16T20:49:36.037185+0000","last_peered":"2023-12-16T20:49:36.037185+0000","last_clean":"2023-12-16T20:49:36.037185+0000","last_became_active":"2023-12-16T20:21:35.421982+0000","last_became_peered":"2023-12-16T20:21:35.421982+0000","last_unstale":"2023-12-16T20:49:36.037185+0000","last_undegraded":"2023-12-16T20:49:36.037185+0000","last_fullsized":"2023-12-16T20:49:36.037185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-12-16T20:49:36.037044+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-12-16T20:49:36.037044+0000","last_clean_scrub_stamp":"2023-12-16T20:49:36.037044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:06:48.326428+0000","scrub_duration":0.001104584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'702","reported_seq":740,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:36.983829+0000","last_change":"2023-12-16T20:49:36.983854+0000","last_active":"2023-12-16T20:49:36.983829+0000","last_peered":"2023-12-16T20:49:36.983829+0000","last_clean":"2023-12-16T20:49:36.983829+0000","last_became_active":"2023-12-16T20:21:35.424254+0000","last_became_peered":"2023-12-16T20:21:35.424254+0000","last_unstale":"2023-12-16T20:49:36.983829+0000","last_undegraded":"2023-12-16T20:49:36.983829+0000","last_fullsized":"2023-12-16T20:49:36.983829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'702","last_scrub_stamp":"2023-12-16T20:49:36.983769+0000","last_deep_scrub":"27'702","last_deep_scrub_stamp":"2023-12-16T20:49:36.983769+0000","last_clean_scrub_stamp":"2023-12-16T20:49:36.983769+0000","objects_scrubbed":1,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:05:56.718355+0000","scrub_duration":0.011541968999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'39","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:35.292672+0000","last_change":"2023-12-16T20:49:35.292691+0000","last_active":"2023-12-16T20:49:35.292672+0000","last_peered":"2023-12-16T20:49:35.292672+0000","last_clean":"2023-12-16T20:49:35.292672+0000","last_became_active":"2023-12-16T20:21:36.533574+0000","last_became_peered":"2023-12-16T20:21:36.533574+0000","last_unstale":"2023-12-16T20:49:35.292672+0000","last_undegraded":"2023-12-16T20:49:35.292672+0000","last_fullsized":"2023-12-16T20:49:35.292672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-12-16T20:49:35.292617+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-12-16T20:49:35.292617+0000","last_clean_scrub_stamp":"2023-12-16T20:49:35.292617+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:10:47.828054+0000","scrub_duration":0.0011431620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'88","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:45.947854+0000","last_change":"2023-12-16T20:49:45.947897+0000","last_active":"2023-12-16T20:49:45.947854+0000","last_peered":"2023-12-16T20:49:45.947854+0000","last_clean":"2023-12-16T20:49:45.947854+0000","last_became_active":"2023-12-16T20:21:40.794082+0000","last_became_peered":"2023-12-16T20:21:40.794082+0000","last_unstale":"2023-12-16T20:49:45.947854+0000","last_undegraded":"2023-12-16T20:49:45.947854+0000","last_fullsized":"2023-12-16T20:49:45.947854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'88","last_scrub_stamp":"2023-12-16T20:49:45.947775+0000","last_deep_scrub":"27'88","last_deep_scrub_stamp":"2023-12-16T20:49:45.947775+0000","last_clean_scrub_stamp":"2023-12-16T20:49:45.947775+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:34:07.793315+0000","scrub_duration":0.001508957,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'687","reported_seq":725,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:34.057180+0000","last_change":"2023-12-16T20:49:34.057203+0000","last_active":"2023-12-16T20:49:34.057180+0000","last_peered":"2023-12-16T20:49:34.057180+0000","last_clean":"2023-12-16T20:49:34.057180+0000","last_became_active":"2023-12-16T20:21:35.419409+0000","last_became_peered":"2023-12-16T20:21:35.419409+0000","last_unstale":"2023-12-16T20:49:34.057180+0000","last_undegraded":"2023-12-16T20:49:34.057180+0000","last_fullsized":"2023-12-16T20:49:34.057180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'687","last_scrub_stamp":"2023-12-16T20:49:34.057124+0000","last_deep_scrub":"27'687","last_deep_scrub_stamp":"2023-12-16T20:49:34.057124+0000","last_clean_scrub_stamp":"2023-12-16T20:49:34.057124+0000","objects_scrubbed":1,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:18:49.932557+0000","scrub_duration":0.013116096000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":4443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'33","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:27.400108+0000","last_change":"2023-12-16T20:49:27.400127+0000","last_active":"2023-12-16T20:49:27.400108+0000","last_peered":"2023-12-16T20:49:27.400108+0000","last_clean":"2023-12-16T20:49:27.400108+0000","last_became_active":"2023-12-16T20:21:36.533325+0000","last_became_peered":"2023-12-16T20:21:36.533325+0000","last_unstale":"2023-12-16T20:49:27.400108+0000","last_undegraded":"2023-12-16T20:49:27.400108+0000","last_fullsized":"2023-12-16T20:49:27.400108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:27.400042+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:27.400042+0000","last_clean_scrub_stamp":"2023-12-16T20:49:27.400042+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:05:59.365345+0000","scrub_duration":0.001383497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'165","reported_seq":200,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:04.926738+0000","last_change":"2023-12-16T20:50:04.926772+0000","last_active":"2023-12-16T20:50:04.926738+0000","last_peered":"2023-12-16T20:50:04.926738+0000","last_clean":"2023-12-16T20:50:04.926738+0000","last_became_active":"2023-12-16T20:21:40.744731+0000","last_became_peered":"2023-12-16T20:21:40.744731+0000","last_unstale":"2023-12-16T20:50:04.926738+0000","last_undegraded":"2023-12-16T20:50:04.926738+0000","last_fullsized":"2023-12-16T20:50:04.926738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'165","last_scrub_stamp":"2023-12-16T20:50:04.926655+0000","last_deep_scrub":"27'165","last_deep_scrub_stamp":"2023-12-16T20:50:04.926655+0000","last_clean_scrub_stamp":"2023-12-16T20:50:04.926655+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:19:57.180214+0000","scrub_duration":0.001595499,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":13136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'49","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:00.954235+0000","last_change":"2023-12-16T20:50:00.954235+0000","last_active":"2023-12-16T20:50:00.954235+0000","last_peered":"2023-12-16T20:50:00.954235+0000","last_clean":"2023-12-16T20:50:00.954235+0000","last_became_active":"2023-12-16T20:21:36.542287+0000","last_became_peered":"2023-12-16T20:21:36.542287+0000","last_unstale":"2023-12-16T20:50:00.954235+0000","last_undegraded":"2023-12-16T20:50:00.954235+0000","last_fullsized":"2023-12-16T20:50:00.954235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2023-12-16T20:50:00.954129+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2023-12-16T20:50:00.954129+0000","last_clean_scrub_stamp":"2023-12-16T20:50:00.954129+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:03:04.152907+0000","scrub_duration":0.0011496799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'51","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:38.084340+0000","last_change":"2023-12-16T20:49:38.084340+0000","last_active":"2023-12-16T20:49:38.084340+0000","last_peered":"2023-12-16T20:49:38.084340+0000","last_clean":"2023-12-16T20:49:38.084340+0000","last_became_active":"2023-12-16T20:21:36.550911+0000","last_became_peered":"2023-12-16T20:21:36.550911+0000","last_unstale":"2023-12-16T20:49:38.084340+0000","last_undegraded":"2023-12-16T20:49:38.084340+0000","last_fullsized":"2023-12-16T20:49:38.084340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2023-12-16T20:49:38.084254+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2023-12-16T20:49:38.084254+0000","last_clean_scrub_stamp":"2023-12-16T20:49:38.084254+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T07:53:36.801901+0000","scrub_duration":0.0010491820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'50","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:56.639838+0000","last_change":"2023-12-16T20:49:56.639875+0000","last_active":"2023-12-16T20:49:56.639838+0000","last_peered":"2023-12-16T20:49:56.639838+0000","last_clean":"2023-12-16T20:49:56.639838+0000","last_became_active":"2023-12-16T20:21:36.555822+0000","last_became_peered":"2023-12-16T20:21:36.555822+0000","last_unstale":"2023-12-16T20:49:56.639838+0000","last_undegraded":"2023-12-16T20:49:56.639838+0000","last_fullsized":"2023-12-16T20:49:56.639838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2023-12-16T20:49:56.639706+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2023-12-16T20:49:56.639706+0000","last_clean_scrub_stamp":"2023-12-16T20:49:56.639706+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:23:39.863493+0000","scrub_duration":0.0012747139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'35","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:33.218396+0000","last_change":"2023-12-16T20:49:33.218419+0000","last_active":"2023-12-16T20:49:33.218396+0000","last_peered":"2023-12-16T20:49:33.218396+0000","last_clean":"2023-12-16T20:49:33.218396+0000","last_became_active":"2023-12-16T20:21:36.524747+0000","last_became_peered":"2023-12-16T20:21:36.524747+0000","last_unstale":"2023-12-16T20:49:33.218396+0000","last_undegraded":"2023-12-16T20:49:33.218396+0000","last_fullsized":"2023-12-16T20:49:33.218396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-12-16T20:49:33.218309+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-12-16T20:49:33.218309+0000","last_clean_scrub_stamp":"2023-12-16T20:49:33.218309+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:06:49.056161+0000","scrub_duration":0.001493435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'29","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:39.987522+0000","last_change":"2023-12-16T20:49:39.987522+0000","last_active":"2023-12-16T20:49:39.987522+0000","last_peered":"2023-12-16T20:49:39.987522+0000","last_clean":"2023-12-16T20:49:39.987522+0000","last_became_active":"2023-12-16T20:21:36.533682+0000","last_became_peered":"2023-12-16T20:21:36.533682+0000","last_unstale":"2023-12-16T20:49:39.987522+0000","last_undegraded":"2023-12-16T20:49:39.987522+0000","last_fullsized":"2023-12-16T20:49:39.987522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2023-12-16T20:49:39.987436+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2023-12-16T20:49:39.987436+0000","last_clean_scrub_stamp":"2023-12-16T20:49:39.987436+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:23:23.211223+0000","scrub_duration":0.001185576,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'35","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:32.165280+0000","last_change":"2023-12-16T20:49:32.165280+0000","last_active":"2023-12-16T20:49:32.165280+0000","last_peered":"2023-12-16T20:49:32.165280+0000","last_clean":"2023-12-16T20:49:32.165280+0000","last_became_active":"2023-12-16T20:21:36.519545+0000","last_became_peered":"2023-12-16T20:21:36.519545+0000","last_unstale":"2023-12-16T20:49:32.165280+0000","last_undegraded":"2023-12-16T20:49:32.165280+0000","last_fullsized":"2023-12-16T20:49:32.165280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-12-16T20:49:32.165177+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-12-16T20:49:32.165177+0000","last_clean_scrub_stamp":"2023-12-16T20:49:32.165177+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:54.010717+0000","scrub_duration":0.001316684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'45","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:50.062054+0000","last_change":"2023-12-16T20:49:50.062089+0000","last_active":"2023-12-16T20:49:50.062054+0000","last_peered":"2023-12-16T20:49:50.062054+0000","last_clean":"2023-12-16T20:49:50.062054+0000","last_became_active":"2023-12-16T20:21:36.542184+0000","last_became_peered":"2023-12-16T20:21:36.542184+0000","last_unstale":"2023-12-16T20:49:50.062054+0000","last_undegraded":"2023-12-16T20:49:50.062054+0000","last_fullsized":"2023-12-16T20:49:50.062054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-16T20:49:50.061973+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-16T20:49:50.061973+0000","last_clean_scrub_stamp":"2023-12-16T20:49:50.061973+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:23:02.132043+0000","scrub_duration":0.0011178239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'32","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:28.026851+0000","last_change":"2023-12-16T20:49:28.026851+0000","last_active":"2023-12-16T20:49:28.026851+0000","last_peered":"2023-12-16T20:49:28.026851+0000","last_clean":"2023-12-16T20:49:28.026851+0000","last_became_active":"2023-12-16T20:21:36.536439+0000","last_became_peered":"2023-12-16T20:21:36.536439+0000","last_unstale":"2023-12-16T20:49:28.026851+0000","last_undegraded":"2023-12-16T20:49:28.026851+0000","last_fullsized":"2023-12-16T20:49:28.026851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2023-12-16T20:49:28.026722+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2023-12-16T20:49:28.026722+0000","last_clean_scrub_stamp":"2023-12-16T20:49:28.026722+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:39:31.846535+0000","scrub_duration":0.0019544250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'33","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:58.621856+0000","last_change":"2023-12-16T20:49:58.621878+0000","last_active":"2023-12-16T20:49:58.621856+0000","last_peered":"2023-12-16T20:49:58.621856+0000","last_clean":"2023-12-16T20:49:58.621856+0000","last_became_active":"2023-12-16T20:21:36.555100+0000","last_became_peered":"2023-12-16T20:21:36.555100+0000","last_unstale":"2023-12-16T20:49:58.621856+0000","last_undegraded":"2023-12-16T20:49:58.621856+0000","last_fullsized":"2023-12-16T20:49:58.621856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-12-16T20:49:58.621786+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-12-16T20:49:58.621786+0000","last_clean_scrub_stamp":"2023-12-16T20:49:58.621786+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:08:03.691113+0000","scrub_duration":0.001138752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'45","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:48.927941+0000","last_change":"2023-12-16T20:49:48.927959+0000","last_active":"2023-12-16T20:49:48.927941+0000","last_peered":"2023-12-16T20:49:48.927941+0000","last_clean":"2023-12-16T20:49:48.927941+0000","last_became_active":"2023-12-16T20:21:36.535600+0000","last_became_peered":"2023-12-16T20:21:36.535600+0000","last_unstale":"2023-12-16T20:49:48.927941+0000","last_undegraded":"2023-12-16T20:49:48.927941+0000","last_fullsized":"2023-12-16T20:49:48.927941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-16T20:49:48.927877+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-16T20:49:48.927877+0000","last_clean_scrub_stamp":"2023-12-16T20:49:48.927877+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:42:58.860704+0000","scrub_duration":0.001139078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'38","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:25.854415+0000","last_change":"2023-12-16T20:49:25.854454+0000","last_active":"2023-12-16T20:49:25.854415+0000","last_peered":"2023-12-16T20:49:25.854415+0000","last_clean":"2023-12-16T20:49:25.854415+0000","last_became_active":"2023-12-16T20:21:36.553155+0000","last_became_peered":"2023-12-16T20:21:36.553155+0000","last_unstale":"2023-12-16T20:49:25.854415+0000","last_undegraded":"2023-12-16T20:49:25.854415+0000","last_fullsized":"2023-12-16T20:49:25.854415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:49:25.854334+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:49:25.854334+0000","last_clean_scrub_stamp":"2023-12-16T20:49:25.854334+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:47.699873+0000","scrub_duration":0.001008225,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'50","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:37.280447+0000","last_change":"2023-12-16T20:49:37.280466+0000","last_active":"2023-12-16T20:49:37.280447+0000","last_peered":"2023-12-16T20:49:37.280447+0000","last_clean":"2023-12-16T20:49:37.280447+0000","last_became_active":"2023-12-16T20:21:36.524166+0000","last_became_peered":"2023-12-16T20:21:36.524166+0000","last_unstale":"2023-12-16T20:49:37.280447+0000","last_undegraded":"2023-12-16T20:49:37.280447+0000","last_fullsized":"2023-12-16T20:49:37.280447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2023-12-16T20:49:37.280377+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2023-12-16T20:49:37.280377+0000","last_clean_scrub_stamp":"2023-12-16T20:49:37.280377+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:22:49.350447+0000","scrub_duration":0.0010662930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'45","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:58.006262+0000","last_change":"2023-12-16T20:49:58.006282+0000","last_active":"2023-12-16T20:49:58.006262+0000","last_peered":"2023-12-16T20:49:58.006262+0000","last_clean":"2023-12-16T20:49:58.006262+0000","last_became_active":"2023-12-16T20:21:36.542191+0000","last_became_peered":"2023-12-16T20:21:36.542191+0000","last_unstale":"2023-12-16T20:49:58.006262+0000","last_undegraded":"2023-12-16T20:49:58.006262+0000","last_fullsized":"2023-12-16T20:49:58.006262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-16T20:49:58.006139+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-16T20:49:58.006139+0000","last_clean_scrub_stamp":"2023-12-16T20:49:58.006139+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:07:10.295523+0000","scrub_duration":0.0011112299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'35","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:32.116856+0000","last_change":"2023-12-16T20:50:32.116890+0000","last_active":"2023-12-16T20:50:32.116856+0000","last_peered":"2023-12-16T20:50:32.116856+0000","last_clean":"2023-12-16T20:50:32.116856+0000","last_became_active":"2023-12-16T20:22:14.771830+0000","last_became_peered":"2023-12-16T20:22:14.771830+0000","last_unstale":"2023-12-16T20:50:32.116856+0000","last_undegraded":"2023-12-16T20:50:32.116856+0000","last_fullsized":"2023-12-16T20:50:32.116856+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-12-16T20:50:32.116775+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-12-16T20:50:32.116775+0000","last_clean_scrub_stamp":"2023-12-16T20:50:32.116775+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T22:33:43.828779+0000","scrub_duration":0.001248983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"27'47","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:43.949523+0000","last_change":"2023-12-16T20:49:43.949543+0000","last_active":"2023-12-16T20:49:43.949523+0000","last_peered":"2023-12-16T20:49:43.949523+0000","last_clean":"2023-12-16T20:49:43.949523+0000","last_became_active":"2023-12-16T20:21:36.544225+0000","last_became_peered":"2023-12-16T20:21:36.544225+0000","last_unstale":"2023-12-16T20:49:43.949523+0000","last_undegraded":"2023-12-16T20:49:43.949523+0000","last_fullsized":"2023-12-16T20:49:43.949523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2023-12-16T20:49:43.949450+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2023-12-16T20:49:43.949450+0000","last_clean_scrub_stamp":"2023-12-16T20:49:43.949450+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:10:23.974459+0000","scrub_duration":0.0010557469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'40","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:14.739946+0000","last_change":"2023-12-16T20:50:14.739970+0000","last_active":"2023-12-16T20:50:14.739946+0000","last_peered":"2023-12-16T20:50:14.739946+0000","last_clean":"2023-12-16T20:50:14.739946+0000","last_became_active":"2023-12-16T20:21:36.554130+0000","last_became_peered":"2023-12-16T20:21:36.554130+0000","last_unstale":"2023-12-16T20:50:14.739946+0000","last_undegraded":"2023-12-16T20:50:14.739946+0000","last_fullsized":"2023-12-16T20:50:14.739946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2023-12-16T20:50:14.739857+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2023-12-16T20:50:14.739857+0000","last_clean_scrub_stamp":"2023-12-16T20:50:14.739857+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T00:30:17.700456+0000","scrub_duration":0.001336949,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'45","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:08.718111+0000","last_change":"2023-12-16T20:50:08.718151+0000","last_active":"2023-12-16T20:50:08.718111+0000","last_peered":"2023-12-16T20:50:08.718111+0000","last_clean":"2023-12-16T20:50:08.718111+0000","last_became_active":"2023-12-16T20:21:36.554772+0000","last_became_peered":"2023-12-16T20:21:36.554772+0000","last_unstale":"2023-12-16T20:50:08.718111+0000","last_undegraded":"2023-12-16T20:50:08.718111+0000","last_fullsized":"2023-12-16T20:50:08.718111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2023-12-16T20:50:08.717995+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2023-12-16T20:50:08.717995+0000","last_clean_scrub_stamp":"2023-12-16T20:50:08.717995+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:43:18.650821+0000","scrub_duration":0.0013016740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'44","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:01.198151+0000","last_change":"2023-12-16T20:50:01.198172+0000","last_active":"2023-12-16T20:50:01.198151+0000","last_peered":"2023-12-16T20:50:01.198151+0000","last_clean":"2023-12-16T20:50:01.198151+0000","last_became_active":"2023-12-16T20:21:36.534307+0000","last_became_peered":"2023-12-16T20:21:36.534307+0000","last_unstale":"2023-12-16T20:50:01.198151+0000","last_undegraded":"2023-12-16T20:50:01.198151+0000","last_fullsized":"2023-12-16T20:50:01.198151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2023-12-16T20:50:01.198074+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2023-12-16T20:50:01.198074+0000","last_clean_scrub_stamp":"2023-12-16T20:50:01.198074+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T01:47:37.032895+0000","scrub_duration":0.001109161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'40","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:34.267761+0000","last_change":"2023-12-16T20:49:34.267761+0000","last_active":"2023-12-16T20:49:34.267761+0000","last_peered":"2023-12-16T20:49:34.267761+0000","last_clean":"2023-12-16T20:49:34.267761+0000","last_became_active":"2023-12-16T20:21:36.525427+0000","last_became_peered":"2023-12-16T20:21:36.525427+0000","last_unstale":"2023-12-16T20:49:34.267761+0000","last_undegraded":"2023-12-16T20:49:34.267761+0000","last_fullsized":"2023-12-16T20:49:34.267761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2023-12-16T20:49:34.267634+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2023-12-16T20:49:34.267634+0000","last_clean_scrub_stamp":"2023-12-16T20:49:34.267634+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T06:39:38.087447+0000","scrub_duration":0.00089495000000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'36","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:42.936276+0000","last_change":"2023-12-16T20:49:42.936276+0000","last_active":"2023-12-16T20:49:42.936276+0000","last_peered":"2023-12-16T20:49:42.936276+0000","last_clean":"2023-12-16T20:49:42.936276+0000","last_became_active":"2023-12-16T20:21:36.542513+0000","last_became_peered":"2023-12-16T20:21:36.542513+0000","last_unstale":"2023-12-16T20:49:42.936276+0000","last_undegraded":"2023-12-16T20:49:42.936276+0000","last_fullsized":"2023-12-16T20:49:42.936276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2023-12-16T20:49:42.936104+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2023-12-16T20:49:42.936104+0000","last_clean_scrub_stamp":"2023-12-16T20:49:42.936104+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:41:03.614700+0000","scrub_duration":0.0018757719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'30","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:33.399965+0000","last_change":"2023-12-16T20:49:33.399965+0000","last_active":"2023-12-16T20:49:33.399965+0000","last_peered":"2023-12-16T20:49:33.399965+0000","last_clean":"2023-12-16T20:49:33.399965+0000","last_became_active":"2023-12-16T20:21:36.544492+0000","last_became_peered":"2023-12-16T20:21:36.544492+0000","last_unstale":"2023-12-16T20:49:33.399965+0000","last_undegraded":"2023-12-16T20:49:33.399965+0000","last_fullsized":"2023-12-16T20:49:33.399965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-12-16T20:49:33.399843+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-12-16T20:49:33.399843+0000","last_clean_scrub_stamp":"2023-12-16T20:49:33.399843+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:25:07.939906+0000","scrub_duration":0.0012000960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'38","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:20.960675+0000","last_change":"2023-12-16T20:50:20.960675+0000","last_active":"2023-12-16T20:50:20.960675+0000","last_peered":"2023-12-16T20:50:20.960675+0000","last_clean":"2023-12-16T20:50:20.960675+0000","last_became_active":"2023-12-16T20:22:14.769348+0000","last_became_peered":"2023-12-16T20:22:14.769348+0000","last_unstale":"2023-12-16T20:50:20.960675+0000","last_undegraded":"2023-12-16T20:50:20.960675+0000","last_fullsized":"2023-12-16T20:50:20.960675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-12-16T20:50:20.960512+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-12-16T20:50:20.960512+0000","last_clean_scrub_stamp":"2023-12-16T20:50:20.960512+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:43:30.893339+0000","scrub_duration":0.0014569990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'50","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:52.064563+0000","last_change":"2023-12-16T20:49:52.064563+0000","last_active":"2023-12-16T20:49:52.064563+0000","last_peered":"2023-12-16T20:49:52.064563+0000","last_clean":"2023-12-16T20:49:52.064563+0000","last_became_active":"2023-12-16T20:21:36.550815+0000","last_became_peered":"2023-12-16T20:21:36.550815+0000","last_unstale":"2023-12-16T20:49:52.064563+0000","last_undegraded":"2023-12-16T20:49:52.064563+0000","last_fullsized":"2023-12-16T20:49:52.064563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2023-12-16T20:49:52.064464+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2023-12-16T20:49:52.064464+0000","last_clean_scrub_stamp":"2023-12-16T20:49:52.064464+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:25:38.891898+0000","scrub_duration":0.0011038790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'42","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:14.647960+0000","last_change":"2023-12-16T20:50:14.647960+0000","last_active":"2023-12-16T20:50:14.647960+0000","last_peered":"2023-12-16T20:50:14.647960+0000","last_clean":"2023-12-16T20:50:14.647960+0000","last_became_active":"2023-12-16T20:21:36.553708+0000","last_became_peered":"2023-12-16T20:21:36.553708+0000","last_unstale":"2023-12-16T20:50:14.647960+0000","last_undegraded":"2023-12-16T20:50:14.647960+0000","last_fullsized":"2023-12-16T20:50:14.647960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2023-12-16T20:50:14.647827+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2023-12-16T20:50:14.647827+0000","last_clean_scrub_stamp":"2023-12-16T20:50:14.647827+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T04:43:44.432912+0000","scrub_duration":0.001343786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'29","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:44.959365+0000","last_change":"2023-12-16T20:49:44.959383+0000","last_active":"2023-12-16T20:49:44.959365+0000","last_peered":"2023-12-16T20:49:44.959365+0000","last_clean":"2023-12-16T20:49:44.959365+0000","last_became_active":"2023-12-16T20:21:36.551066+0000","last_became_peered":"2023-12-16T20:21:36.551066+0000","last_unstale":"2023-12-16T20:49:44.959365+0000","last_undegraded":"2023-12-16T20:49:44.959365+0000","last_fullsized":"2023-12-16T20:49:44.959365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2023-12-16T20:49:44.959299+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2023-12-16T20:49:44.959299+0000","last_clean_scrub_stamp":"2023-12-16T20:49:44.959299+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:55:02.095074+0000","scrub_duration":0.001193115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'37","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:56.736482+0000","last_change":"2023-12-16T20:49:56.736503+0000","last_active":"2023-12-16T20:49:56.736482+0000","last_peered":"2023-12-16T20:49:56.736482+0000","last_clean":"2023-12-16T20:49:56.736482+0000","last_became_active":"2023-12-16T20:21:36.523604+0000","last_became_peered":"2023-12-16T20:21:36.523604+0000","last_unstale":"2023-12-16T20:49:56.736482+0000","last_undegraded":"2023-12-16T20:49:56.736482+0000","last_fullsized":"2023-12-16T20:49:56.736482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2023-12-16T20:49:56.736375+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2023-12-16T20:49:56.736375+0000","last_clean_scrub_stamp":"2023-12-16T20:49:56.736375+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T08:05:42.874908+0000","scrub_duration":0.0011361520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'39","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:03.666854+0000","last_change":"2023-12-16T20:50:03.666902+0000","last_active":"2023-12-16T20:50:03.666854+0000","last_peered":"2023-12-16T20:50:03.666854+0000","last_clean":"2023-12-16T20:50:03.666854+0000","last_became_active":"2023-12-16T20:21:36.556041+0000","last_became_peered":"2023-12-16T20:21:36.556041+0000","last_unstale":"2023-12-16T20:50:03.666854+0000","last_undegraded":"2023-12-16T20:50:03.666854+0000","last_fullsized":"2023-12-16T20:50:03.666854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-12-16T20:50:03.666750+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-12-16T20:50:03.666750+0000","last_clean_scrub_stamp":"2023-12-16T20:50:03.666750+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:55:20.802526+0000","scrub_duration":0.0013771300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'39","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:15.675904+0000","last_change":"2023-12-16T20:50:15.675943+0000","last_active":"2023-12-16T20:50:15.675904+0000","last_peered":"2023-12-16T20:50:15.675904+0000","last_clean":"2023-12-16T20:50:15.675904+0000","last_became_active":"2023-12-16T20:21:36.518138+0000","last_became_peered":"2023-12-16T20:21:36.518138+0000","last_unstale":"2023-12-16T20:50:15.675904+0000","last_undegraded":"2023-12-16T20:50:15.675904+0000","last_fullsized":"2023-12-16T20:50:15.675904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-12-16T20:50:15.675807+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-12-16T20:50:15.675807+0000","last_clean_scrub_stamp":"2023-12-16T20:50:15.675807+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T23:31:14.915473+0000","scrub_duration":0.0017056860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'24","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:54.686358+0000","last_change":"2023-12-16T20:49:54.686383+0000","last_active":"2023-12-16T20:49:54.686358+0000","last_peered":"2023-12-16T20:49:54.686358+0000","last_clean":"2023-12-16T20:49:54.686358+0000","last_became_active":"2023-12-16T20:21:36.555041+0000","last_became_peered":"2023-12-16T20:21:36.555041+0000","last_unstale":"2023-12-16T20:49:54.686358+0000","last_undegraded":"2023-12-16T20:49:54.686358+0000","last_fullsized":"2023-12-16T20:49:54.686358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2023-12-16T20:49:54.686275+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2023-12-16T20:49:54.686275+0000","last_clean_scrub_stamp":"2023-12-16T20:49:54.686275+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:09:43.952858+0000","scrub_duration":0.0012757529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'44","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:49:27.192490+0000","last_change":"2023-12-16T20:49:27.192490+0000","last_active":"2023-12-16T20:49:27.192490+0000","last_peered":"2023-12-16T20:49:27.192490+0000","last_clean":"2023-12-16T20:49:27.192490+0000","last_became_active":"2023-12-16T20:21:36.523784+0000","last_became_peered":"2023-12-16T20:21:36.523784+0000","last_unstale":"2023-12-16T20:49:27.192490+0000","last_undegraded":"2023-12-16T20:49:27.192490+0000","last_fullsized":"2023-12-16T20:49:27.192490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2023-12-16T20:49:27.192403+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2023-12-16T20:49:27.192403+0000","last_clean_scrub_stamp":"2023-12-16T20:49:27.192403+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T02:22:46.903808+0000","scrub_duration":0.001038298,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'36","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:02.183899+0000","last_change":"2023-12-16T20:50:02.183899+0000","last_active":"2023-12-16T20:50:02.183899+0000","last_peered":"2023-12-16T20:50:02.183899+0000","last_clean":"2023-12-16T20:50:02.183899+0000","last_became_active":"2023-12-16T20:21:36.526151+0000","last_became_peered":"2023-12-16T20:21:36.526151+0000","last_unstale":"2023-12-16T20:50:02.183899+0000","last_undegraded":"2023-12-16T20:50:02.183899+0000","last_fullsized":"2023-12-16T20:50:02.183899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2023-12-16T20:50:02.183789+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2023-12-16T20:50:02.183789+0000","last_clean_scrub_stamp":"2023-12-16T20:50:02.183789+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T21:07:55.175918+0000","scrub_duration":0.0010376109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'28","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-16T20:50:05.690508+0000","last_change":"2023-12-16T20:50:05.690508+0000","last_active":"2023-12-16T20:50:05.690508+0000","last_peered":"2023-12-16T20:50:05.690508+0000","last_clean":"2023-12-16T20:50:05.690508+0000","last_became_active":"2023-12-16T20:21:36.543306+0000","last_became_peered":"2023-12-16T20:21:36.543306+0000","last_unstale":"2023-12-16T20:50:05.690508+0000","last_undegraded":"2023-12-16T20:50:05.690508+0000","last_fullsized":"2023-12-16T20:50:05.690508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2023-12-16T20:50:05.690413+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2023-12-16T20:50:05.690413+0000","last_clean_scrub_stamp":"2023-12-16T20:50:05.690413+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T03:55:22.826189+0000","scrub_duration":0.0011935030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4117,"num_write_kb":324188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4666,"ondisk_log_size":4666,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2442,"ondisk_log_size":2442,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40469915,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1038,"num_read_kb":1098,"num_write":9075,"num_write_kb":44922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56229888,"data_stored":80939830,"data_compressed":7486620,"data_compressed_allocated":11714560,"data_compressed_original":36487168,"omap_allocated":0,"internal_metadata":0},"log_size":8644,"ondisk_log_size":8644,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65176,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575205,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84588,"kb_used_data":17316,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94287252,"statfs":{"total":96636764160,"available":96550146048,"internally_reserved":0,"allocated":17731584,"data_stored":25875293,"data_compressed":2385754,"data_compressed_allocated":3723264,"data_compressed_original":12046336,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.442,"15min":0.40699999999999997},"min":{"1min":0.36199999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.68700000000000006,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.434},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.45400000000000001,"15min":0.433},"min":{"1min":0.42999999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.74199999999999999,"5min":0.747,"15min":0.747},"last":0.40400000000000003}]},{"osd":1,"last update":"Sat Dec 16 20:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.46000000000000002,"15min":0.42999999999999999},"min":{"1min":0.32300000000000001,"5min":0.24399999999999999,"15min":0.23799999999999999},"max":{"1min":0.69199999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.45600000000000002,"15min":0.42599999999999999},"min":{"1min":0.44500000000000001,"5min":0.27200000000000002,"15min":0.252},"max":{"1min":0.69999999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.47899999999999998}]},{"osd":2,"last update":"Sat Dec 16 20:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.439,"15min":0.41699999999999998},"min":{"1min":0.38700000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.57099999999999995,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.47899999999999998,"15min":0.45400000000000001},"min":{"1min":0.372,"5min":0.34899999999999998,"15min":0.29099999999999998},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.63400000000000001}]},{"osd":3,"last update":"Sat Dec 16 20:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.46500000000000002,"15min":0.439},"min":{"1min":0.38500000000000001,"5min":0.28799999999999998,"15min":0.28000000000000003},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.48399999999999999,"15min":0.46500000000000002},"min":{"1min":0.39100000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71799999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58799999999999997}]},{"osd":4,"last update":"Sat Dec 16 20:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.36599999999999999},"min":{"1min":0.27600000000000002,"5min":0.23200000000000001,"15min":0.20499999999999999},"max":{"1min":0.57299999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.38600000000000001,"15min":0.38},"min":{"1min":0.29699999999999999,"5min":0.219,"15min":0.20899999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.497}]},{"osd":5,"last update":"Sat Dec 16 20:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.40100000000000002,"15min":0.39400000000000002},"min":{"1min":0.29199999999999998,"5min":0.24199999999999999,"15min":0.24099999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.72099999999999997},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.40999999999999998},"min":{"1min":0.313,"5min":0.28799999999999998,"15min":0.255},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.56899999999999995}]},{"osd":6,"last update":"Sat Dec 16 20:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.43099999999999999,"15min":0.42199999999999999},"min":{"1min":0.32600000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.45200000000000001,"15min":0.45100000000000001},"min":{"1min":0.33000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.69799999999999995,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.60799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575205,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61228,"kb_used_data":12004,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94310612,"statfs":{"total":96636764160,"available":96574066688,"internally_reserved":0,"allocated":12292096,"data_stored":16896407,"data_compressed":1393950,"data_compressed_allocated":2220032,"data_compressed_original":7004160,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.39200000000000002,"15min":0.39900000000000002},"min":{"1min":0.31,"5min":0.23200000000000001,"15min":0.217},"max":{"1min":0.57999999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.432,"15min":0.432},"min":{"1min":0.313,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.67100000000000004},"last":0.55400000000000005}]},{"osd":1,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.33800000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.68200000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42999999999999999,"15min":0.42699999999999999},"min":{"1min":0.32600000000000001,"5min":0.26500000000000001,"15min":0.26400000000000001},"max":{"1min":0.65500000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.38100000000000001}]},{"osd":2,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.35899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.65900000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.627},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42399999999999999,"15min":0.41899999999999998},"min":{"1min":0.314,"5min":0.29799999999999999,"15min":0.253},"max":{"1min":0.60799999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.36299999999999999}]},{"osd":3,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45500000000000002,"15min":0.44},"min":{"1min":0.35199999999999998,"5min":0.30599999999999999,"15min":0.26500000000000001},"max":{"1min":0.64600000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.442,"15min":0.44600000000000001},"min":{"1min":0.36299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.60099999999999998}]},{"osd":4,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38400000000000001,"15min":0.373},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.217},"max":{"1min":0.625,"5min":0.625,"15min":0.64000000000000001},"last":0.433},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.25900000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.64900000000000002}]},{"osd":5,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.38300000000000001,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.26600000000000001,"15min":0.23300000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.42399999999999999},"min":{"1min":0.27900000000000003,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.48199999999999998}]},{"osd":7,"last update":"Sat Dec 16 20:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.42999999999999999},"min":{"1min":0.30299999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.42399999999999999,"15min":0.434},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.747},"last":0.58599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575204,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":118609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.432},"min":{"1min":0.33500000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.433,"15min":0.41599999999999998},"min":{"1min":0.34000000000000002,"5min":0.255,"15min":0.24399999999999999},"max":{"1min":0.70499999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.71199999999999997}]},{"osd":1,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.45400000000000001,"15min":0.42499999999999999},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.25600000000000001},"max":{"1min":0.67500000000000004,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.504,"5min":0.438,"15min":0.42999999999999999},"min":{"1min":0.34799999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.61099999999999999}]},{"osd":2,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.45000000000000001,"15min":0.42899999999999999},"min":{"1min":0.35999999999999999,"5min":0.29499999999999998,"15min":0.26000000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.45700000000000002,"15min":0.438},"min":{"1min":0.36399999999999999,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":0.76900000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.63400000000000001}]},{"osd":3,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.45900000000000002,"15min":0.439},"min":{"1min":0.40899999999999997,"5min":0.29999999999999999,"15min":0.29499999999999998},"max":{"1min":0.79400000000000004,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.48899999999999999,"15min":0.46899999999999997},"min":{"1min":0.42099999999999999,"5min":0.312,"15min":0.28199999999999997},"max":{"1min":0.73699999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.59099999999999997}]},{"osd":4,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38300000000000001,"15min":0.36599999999999999},"min":{"1min":0.26900000000000002,"5min":0.24199999999999999,"15min":0.224},"max":{"1min":0.63800000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.40899999999999997,"15min":0.39400000000000002},"min":{"1min":0.312,"5min":0.246,"15min":0.22600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.69499999999999995}]},{"osd":6,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.40799999999999997,"15min":0.39000000000000001},"min":{"1min":0.307,"5min":0.26500000000000001,"15min":0.24199999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.505},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.442,"15min":0.42399999999999999},"min":{"1min":0.313,"5min":0.28000000000000003,"15min":0.26700000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.67600000000000005}]},{"osd":7,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.441,"15min":0.437},"min":{"1min":0.28299999999999997,"5min":0.255,"15min":0.255},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.47299999999999998,"15min":0.45400000000000001},"min":{"1min":0.29599999999999999,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":0.77800000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.74399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575205,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65112,"kb_used_data":7568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94306728,"statfs":{"total":96636764160,"available":96570089472,"internally_reserved":0,"allocated":7749632,"data_stored":11004073,"data_compressed":1082070,"data_compressed_allocated":1703936,"data_compressed_original":5144576,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.45200000000000001,"15min":0.42799999999999999},"min":{"1min":0.34799999999999998,"5min":0.182,"15min":0.182},"max":{"1min":0.72399999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.45800000000000002,"15min":0.437},"min":{"1min":0.34899999999999998,"5min":0.26600000000000001,"15min":0.25600000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.64300000000000002}]},{"osd":1,"last update":"Sat Dec 16 20:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47099999999999997,"15min":0.44400000000000001},"min":{"1min":0.38300000000000001,"5min":0.29799999999999999,"15min":0.27900000000000003},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.44400000000000001,"15min":0.42699999999999999},"min":{"1min":0.38100000000000001,"5min":0.28599999999999998,"15min":0.26600000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.55800000000000005}]},{"osd":2,"last update":"Sat Dec 16 20:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.45700000000000002,"15min":0.437},"min":{"1min":0.39200000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.69899999999999995,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.436},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.48799999999999999,"15min":0.46000000000000002},"min":{"1min":0.36799999999999999,"5min":0.311,"15min":0.309},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.53900000000000003}]},{"osd":3,"last update":"Sat Dec 16 20:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46200000000000002,"15min":0.435},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.27900000000000003},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.46999999999999997},"min":{"1min":0.41299999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.79400000000000004},"last":0.51800000000000002}]},{"osd":5,"last update":"Sat Dec 16 20:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.39100000000000001,"15min":0.38600000000000001},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40500000000000003,"15min":0.39500000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.22},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.63100000000000001},"last":0.61499999999999999}]},{"osd":6,"last update":"Sat Dec 16 20:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.23799999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.75},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.44},"min":{"1min":0.33200000000000002,"5min":0.26400000000000001,"15min":0.22600000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.66500000000000004}]},{"osd":7,"last update":"Sat Dec 16 20:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.443,"15min":0.436},"min":{"1min":0.32000000000000001,"5min":0.28899999999999998,"15min":0.25600000000000001},"max":{"1min":0.61899999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.47399999999999998,"15min":0.46500000000000002},"min":{"1min":0.33600000000000002,"5min":0.29199999999999998,"15min":0.27000000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.77600000000000002},"last":0.63200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575205,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58848,"kb_used_data":9624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312992,"statfs":{"total":96636764160,"available":96576503808,"internally_reserved":0,"allocated":9854976,"data_stored":12924992,"data_compressed":1002682,"data_compressed_allocated":1646592,"data_compressed_original":4898816,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.29799999999999999,"15min":0.28599999999999998},"min":{"1min":0.20999999999999999,"5min":0.192,"15min":0.17699999999999999},"max":{"1min":0.46300000000000002,"5min":0.48699999999999999,"15min":0.52600000000000002},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.312,"15min":0.30099999999999999},"min":{"1min":0.23100000000000001,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.56999999999999995},"last":0.35199999999999998}]},{"osd":1,"last update":"Sat Dec 16 20:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.30299999999999999},"min":{"1min":0.26100000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.58799999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.33300000000000002,"15min":0.32800000000000001},"min":{"1min":0.29399999999999998,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.56100000000000005},"last":0.372}]},{"osd":2,"last update":"Sat Dec 16 20:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.33500000000000002},"min":{"1min":0.27400000000000002,"5min":0.23499999999999999,"15min":0.222},"max":{"1min":0.52500000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.35499999999999998},"min":{"1min":0.27800000000000002,"5min":0.26100000000000001,"15min":0.22600000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.40699999999999997}]},{"osd":4,"last update":"Sat Dec 16 20:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.442,"15min":0.42099999999999999},"min":{"1min":0.40899999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.62},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.46800000000000003,"15min":0.44700000000000001},"min":{"1min":0.40600000000000003,"5min":0.33700000000000002,"15min":0.30099999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.59899999999999998}]},{"osd":5,"last update":"Sat Dec 16 20:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.45700000000000002,"15min":0.44600000000000001},"min":{"1min":0.435,"5min":0.31900000000000001,"15min":0.313},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.48199999999999998,"15min":0.46300000000000002},"min":{"1min":0.41599999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.57299999999999995}]},{"osd":6,"last update":"Sat Dec 16 20:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.46999999999999997,"15min":0.45300000000000001},"min":{"1min":0.40300000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.73599999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.48399999999999999,"15min":0.46899999999999997},"min":{"1min":0.40500000000000003,"5min":0.35999999999999999,"15min":0.317},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.63400000000000001}]},{"osd":7,"last update":"Sat Dec 16 20:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.36599999999999999,"5min":0.35899999999999999,"15min":0.34000000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.46100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.55000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575205,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":341408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.317,"15min":0.30499999999999999},"min":{"1min":0.21099999999999999,"5min":0.183,"15min":0.17000000000000001},"max":{"1min":0.54200000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.315,"15min":0.30199999999999999},"min":{"1min":0.255,"5min":0.189,"15min":0.189},"max":{"1min":0.48799999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.32800000000000001}]},{"osd":1,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34799999999999998,"15min":0.33600000000000002},"min":{"1min":0.28499999999999998,"5min":0.246,"15min":0.193},"max":{"1min":0.56699999999999995,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.251},{"interface":"front","average":{"1min":0.371,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.255,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.50700000000000001,"5min":0.51400000000000001,"15min":0.54700000000000004},"last":0.20000000000000001}]},{"osd":3,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33400000000000002,"15min":0.32400000000000001},"min":{"1min":0.23899999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.58099999999999996,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.371,"15min":0.36299999999999999},"min":{"1min":0.29899999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.503,"5min":0.57799999999999996,"15min":0.60599999999999998},"last":0.315}]},{"osd":4,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.45400000000000001,"15min":0.432},"min":{"1min":0.36499999999999999,"5min":0.29699999999999999,"15min":0.28699999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.45600000000000002,"15min":0.437},"min":{"1min":0.36899999999999999,"5min":0.30599999999999999,"15min":0.29499999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.47699999999999998,"15min":0.45600000000000002},"min":{"1min":0.40699999999999997,"5min":0.33400000000000002,"15min":0.30299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.47299999999999998,"15min":0.45600000000000002},"min":{"1min":0.42799999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42899999999999999}]},{"osd":6,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.46800000000000003,"15min":0.45300000000000001},"min":{"1min":0.44,"5min":0.307,"15min":0.307},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.441},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.499,"15min":0.47899999999999998},"min":{"1min":0.371,"5min":0.36399999999999999,"15min":0.32500000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.497}]},{"osd":7,"last update":"Sat Dec 16 20:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.5,"15min":0.47799999999999998},"min":{"1min":0.38200000000000001,"5min":0.35999999999999999,"15min":0.32300000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.48199999999999998,"15min":0.46600000000000003},"min":{"1min":0.436,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575205,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42460,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329380,"statfs":{"total":96636764160,"available":96593285120,"internally_reserved":0,"allocated":3035136,"data_stored":4312983,"data_compressed":488319,"data_compressed_allocated":745472,"data_compressed_original":2203648,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 20:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.29699999999999999,"15min":0.28199999999999997},"min":{"1min":0.215,"5min":0.188,"15min":0.17399999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.52000000000000002},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.318,"15min":0.31900000000000001},"min":{"1min":0.29599999999999999,"5min":0.218,"15min":0.21199999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.33900000000000002}]},{"osd":2,"last update":"Sat Dec 16 20:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.29799999999999999},"min":{"1min":0.26100000000000001,"5min":0.19700000000000001,"15min":0.19},"max":{"1min":0.51500000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.33600000000000002,"15min":0.32400000000000001},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.20999999999999999},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.35499999999999998}]},{"osd":3,"last update":"Sat Dec 16 20:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.34999999999999998},"min":{"1min":0.251,"5min":0.217,"15min":0.217},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.35599999999999998,"15min":0.34499999999999997},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.54000000000000004,"5min":0.55500000000000005,"15min":0.59699999999999998},"last":0.376}]},{"osd":4,"last update":"Sat Dec 16 20:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.44600000000000001,"15min":0.42099999999999999},"min":{"1min":0.432,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72499999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.48099999999999998,"15min":0.44800000000000001},"min":{"1min":0.46400000000000002,"5min":0.34000000000000002,"15min":0.307},"max":{"1min":0.71899999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.80200000000000005}]},{"osd":5,"last update":"Sat Dec 16 20:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.46600000000000003,"15min":0.45100000000000001},"min":{"1min":0.442,"5min":0.317,"15min":0.308},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.876},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.47299999999999998,"15min":0.44800000000000001},"min":{"1min":0.45300000000000001,"5min":0.318,"15min":0.28100000000000003},"max":{"1min":0.76700000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.63400000000000001}]},{"osd":6,"last update":"Sat Dec 16 20:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.48699999999999999,"15min":0.46800000000000003},"min":{"1min":0.433,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78000000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.48299999999999998,"15min":0.45700000000000002},"min":{"1min":0.45100000000000001,"5min":0.33300000000000002,"15min":0.29999999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.74199999999999999}]},{"osd":7,"last update":"Sat Dec 16 20:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.501,"15min":0.47899999999999998},"min":{"1min":0.41999999999999998,"5min":0.34300000000000003,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.502,"15min":0.48699999999999999},"min":{"1min":0.47199999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.77400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575205,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60428,"kb_used_data":7044,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311412,"statfs":{"total":96636764160,"available":96574885888,"internally_reserved":0,"allocated":7213056,"data_stored":11594953,"data_compressed":1199021,"data_compressed_allocated":1765376,"data_compressed_original":6336512,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 20:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.28999999999999998,"15min":0.28799999999999998},"min":{"1min":0.22900000000000001,"5min":0.187,"15min":0.17100000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.247},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.316,"15min":0.308},"min":{"1min":0.23799999999999999,"5min":0.20699999999999999,"15min":0.19400000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.57899999999999996},"last":0.28799999999999998}]},{"osd":2,"last update":"Sat Dec 16 20:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.318,"15min":0.308},"min":{"1min":0.219,"5min":0.191,"15min":0.191},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.318},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32200000000000001},"min":{"1min":0.26300000000000001,"5min":0.218,"15min":0.20300000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.35899999999999999}]},{"osd":3,"last update":"Sat Dec 16 20:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.33600000000000002,"15min":0.32800000000000001},"min":{"1min":0.28999999999999998,"5min":0.22600000000000001,"15min":0.20399999999999999},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35999999999999999,"15min":0.34499999999999997},"min":{"1min":0.27800000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60999999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Sat Dec 16 20:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.45600000000000002,"15min":0.442},"min":{"1min":0.36499999999999999,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.46899999999999997,"15min":0.44500000000000001},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.28799999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51400000000000001}]},{"osd":5,"last update":"Sat Dec 16 20:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.48599999999999999,"15min":0.45300000000000001},"min":{"1min":0.378,"5min":0.32600000000000001,"15min":0.29999999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.48599999999999999,"15min":0.46999999999999997},"min":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.30199999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.53000000000000003}]},{"osd":6,"last update":"Sat Dec 16 20:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.49399999999999999,"15min":0.47799999999999998},"min":{"1min":0.435,"5min":0.35599999999999998,"15min":0.31900000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.501,"15min":0.46999999999999997},"min":{"1min":0.42799999999999999,"5min":0.375,"15min":0.32700000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.46200000000000002}]},{"osd":7,"last update":"Sat Dec 16 20:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.50700000000000001,"15min":0.49399999999999999},"min":{"1min":0.39100000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78000000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.505},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.499,"15min":0.48399999999999999},"min":{"1min":0.40699999999999997,"5min":0.34599999999999997,"15min":0.34000000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.439}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32588,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6856704,"data_stored":10886066,"data_compressed":1166433,"data_compressed_allocated":1720320,"data_compressed_original":5763072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2744320,"data_stored":4194464,"data_compressed":488319,"data_compressed_allocated":745472,"data_compressed_original":2203648,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":222889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9564160,"data_stored":12806473,"data_compressed":1002682,"data_compressed_allocated":1646592,"data_compressed_original":4898816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7458816,"data_stored":10885554,"data_compressed":1082070,"data_compressed_allocated":1703936,"data_compressed_original":5144576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12001280,"data_stored":16777888,"data_compressed":1393950,"data_compressed_allocated":2220032,"data_compressed_original":7004160,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17375232,"data_stored":25166406,"data_compressed":2353166,"data_compressed_allocated":3678208,"data_compressed_original":11472896,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T20:50:47.675 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-16T20:50:47.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.806+0000 7f8a2dbea640 1 Processor -- start 2023-12-16T20:50:47.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.806+0000 7f8a2dbea640 1 -- start start 2023-12-16T20:50:47.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.807+0000 7f8a2dbea640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a28153890 0x7f8a2815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:47.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.807+0000 7f8a2dbea640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8a28153c70 0x7f8a280c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:47.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.807+0000 7f8a2dbea640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2815a700 con 0x7f8a280ceef0 2023-12-16T20:50:47.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.807+0000 7f8a2dbea640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a280ca870 con 0x7f8a28153890 2023-12-16T20:50:47.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.807+0000 7f8a2dbea640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a28159af0 con 0x7f8a28153c70 2023-12-16T20:50:47.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.819+0000 7f8a277fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a28153890 0x7f8a2815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:47.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.819+0000 7f8a277fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a28153890 0x7f8a2815d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37926/0 (socket says 172.21.15.87:37926) 2023-12-16T20:50:47.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.819+0000 7f8a277fe640 1 -- 172.21.15.87:0/156947220 learned_addr learned my addr 172.21.15.87:0/156947220 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:50:47.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.821+0000 7f8a277fe640 1 -- 172.21.15.87:0/156947220 >> v2:172.21.15.195:3300/0 conn(0x7f8a28153c70 msgr2=0x7f8a280c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:50:47.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.821+0000 7f8a277fe640 1 --2- 172.21.15.87:0/156947220 >> v2:172.21.15.195:3300/0 conn(0x7f8a28153c70 0x7f8a280c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:47.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.821+0000 7f8a277fe640 1 -- 172.21.15.87:0/156947220 >> v1:172.21.15.195:6789/0 conn(0x7f8a280ceef0 legacy=0x7f8a2815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:50:47.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.821+0000 7f8a277fe640 1 -- 172.21.15.87:0/156947220 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a28159dd0 con 0x7f8a28153890 2023-12-16T20:50:47.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.823+0000 7f8a277fe640 1 --2- 172.21.15.87:0/156947220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a28153890 0x7f8a2815d950 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8a280c6290 tx=0x7f8a1802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d519f511e1ec7848 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:47.828 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.827+0000 7f8a26ffd640 1 -- 172.21.15.87:0/156947220 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a18030860 con 0x7f8a28153890 2023-12-16T20:50:47.828 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.827+0000 7f8a26ffd640 1 -- 172.21.15.87:0/156947220 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a180309c0 con 0x7f8a28153890 2023-12-16T20:50:47.828 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.827+0000 7f8a26ffd640 1 -- 172.21.15.87:0/156947220 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a18030d50 con 0x7f8a28153890 2023-12-16T20:50:47.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.828+0000 7f8a2dbea640 1 -- 172.21.15.87:0/156947220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a28153890 msgr2=0x7f8a2815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:47.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.828+0000 7f8a2dbea640 1 --2- 172.21.15.87:0/156947220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a28153890 0x7f8a2815d950 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8a280c6290 tx=0x7f8a1802b9a0 comp rx=0 tx=0).stop 2023-12-16T20:50:47.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.828+0000 7f8a2dbea640 1 -- 172.21.15.87:0/156947220 shutdown_connections 2023-12-16T20:50:47.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.828+0000 7f8a2dbea640 1 --2- 172.21.15.87:0/156947220 >> v2:172.21.15.195:3300/0 conn(0x7f8a28153c70 0x7f8a280c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:47.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.828+0000 7f8a2dbea640 1 --2- 172.21.15.87:0/156947220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a28153890 0x7f8a2815d950 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:47.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.828+0000 7f8a2dbea640 1 -- 172.21.15.87:0/156947220 >> 172.21.15.87:0/156947220 conn(0x7f8a2806ba00 msgr2=0x7f8a2806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:47.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.828+0000 7f8a2dbea640 1 -- 172.21.15.87:0/156947220 shutdown_connections 2023-12-16T20:50:47.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.828+0000 7f8a2dbea640 1 -- 172.21.15.87:0/156947220 wait complete. 2023-12-16T20:50:47.830 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.829+0000 7f8a2dbea640 1 Processor -- start 2023-12-16T20:50:47.830 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.829+0000 7f8a2dbea640 1 -- start start 2023-12-16T20:50:47.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.830+0000 7f8a2dbea640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a280ceef0 0x7f8a280ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:47.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.830+0000 7f8a2dbea640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a28153890 0x7f8a281f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:47.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.830+0000 7f8a2dbea640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a28153c70 0x7f8a28147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:47.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.830+0000 7f8a2dbea640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2814ee50 con 0x7f8a280ceef0 2023-12-16T20:50:47.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.830+0000 7f8a2dbea640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a280b4f90 con 0x7f8a28153890 2023-12-16T20:50:47.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.830+0000 7f8a2dbea640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a281f35c0 con 0x7f8a28153c70 2023-12-16T20:50:47.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.831+0000 7f8a27fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a28153c70 0x7f8a28147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:47.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.831+0000 7f8a27fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a28153c70 0x7f8a28147810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:49604/0 (socket says 172.21.15.87:49604) 2023-12-16T20:50:47.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.831+0000 7f8a27fff640 1 -- 172.21.15.87:0/385820232 learned_addr learned my addr 172.21.15.87:0/385820232 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:50:47.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.831+0000 7f8a277fe640 1 --2- 172.21.15.87:0/385820232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a280ceef0 0x7f8a280ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:47.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.832+0000 7f8a1ffff640 1 --2- 172.21.15.87:0/385820232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a28153890 0x7f8a281f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:47.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.835+0000 7f8a27fff640 1 -- 172.21.15.87:0/385820232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a28153890 msgr2=0x7f8a281f2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:47.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.835+0000 7f8a27fff640 1 --2- 172.21.15.87:0/385820232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a28153890 0x7f8a281f2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:47.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.835+0000 7f8a27fff640 1 -- 172.21.15.87:0/385820232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a280ceef0 msgr2=0x7f8a280ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:47.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.835+0000 7f8a27fff640 1 --2- 172.21.15.87:0/385820232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a280ceef0 0x7f8a280ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:47.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.835+0000 7f8a27fff640 1 -- 172.21.15.87:0/385820232 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a180094d0 con 0x7f8a28153c70 2023-12-16T20:50:47.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.837+0000 7f8a27fff640 1 --2- 172.21.15.87:0/385820232 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a28153c70 0x7f8a28147810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000c780 tx=0x7f8a2000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:47.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.839+0000 7f8a24ff9640 1 -- 172.21.15.87:0/385820232 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a20003d80 con 0x7f8a28153c70 2023-12-16T20:50:47.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.839+0000 7f8a2dbea640 1 -- 172.21.15.87:0/385820232 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a281508e0 con 0x7f8a28153c70 2023-12-16T20:50:47.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.840+0000 7f8a2dbea640 1 -- 172.21.15.87:0/385820232 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a28150ea0 con 0x7f8a28153c70 2023-12-16T20:50:47.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:47.840+0000 7f8a2dbea640 1 -- 172.21.15.87:0/385820232 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2815a350 con 0x7f8a28153c70 2023-12-16T20:50:48.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.084+0000 7f8a24ff9640 1 -- 172.21.15.87:0/385820232 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2000ce90 con 0x7f8a28153c70 2023-12-16T20:50:48.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.084+0000 7f8a24ff9640 1 -- 172.21.15.87:0/385820232 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a20006d30 con 0x7f8a28153c70 2023-12-16T20:50:48.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.084+0000 7f8a24ff9640 1 -- 172.21.15.87:0/385820232 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f8a20005070 con 0x7f8a28153c70 2023-12-16T20:50:48.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.085+0000 7f8a24ff9640 1 --2- 172.21.15.87:0/385820232 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8a0806ae70 0x7f8a0806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:48.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.085+0000 7f8a277fe640 1 --2- 172.21.15.87:0/385820232 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8a0806ae70 0x7f8a0806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:48.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.085+0000 7f8a277fe640 1 --2- 172.21.15.87:0/385820232 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8a0806ae70 0x7f8a0806d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8a18036000 tx=0x7f8a18008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:48.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.088+0000 7f8a24ff9640 1 -- 172.21.15.87:0/385820232 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8a20058090 con 0x7f8a28153c70 2023-12-16T20:50:48.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.098+0000 7f8a24ff9640 1 -- 172.21.15.87:0/385820232 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f8a200543d0 con 0x7f8a28153c70 2023-12-16T20:50:48.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.267+0000 7f8a2dbea640 1 -- 172.21.15.87:0/385820232 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f8a28067500 con 0x7f8a28153c70 2023-12-16T20:50:48.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.451+0000 7f8a24ff9640 1 -- 172.21.15.87:0/385820232 <== mon.2 v2:172.21.15.195:3301/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8a200543d0 con 0x7f8a28153c70 2023-12-16T20:50:48.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.451+0000 7f8a24ff9640 1 -- 172.21.15.87:0/385820232 <== mon.2 v2:172.21.15.195:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f8a200579f0 con 0x7f8a28153c70 2023-12-16T20:50:48.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.453+0000 7f8a2dbea640 1 -- 172.21.15.87:0/385820232 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8a0806ae70 msgr2=0x7f8a0806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:48.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.453+0000 7f8a2dbea640 1 --2- 172.21.15.87:0/385820232 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8a0806ae70 0x7f8a0806d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8a18036000 tx=0x7f8a18008030 comp rx=0 tx=0).stop 2023-12-16T20:50:48.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.453+0000 7f8a2dbea640 1 -- 172.21.15.87:0/385820232 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a28153c70 msgr2=0x7f8a28147810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:48.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.453+0000 7f8a2dbea640 1 --2- 172.21.15.87:0/385820232 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a28153c70 0x7f8a28147810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000c780 tx=0x7f8a2000cc40 comp rx=0 tx=0).stop 2023-12-16T20:50:48.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.453+0000 7f8a2dbea640 1 -- 172.21.15.87:0/385820232 shutdown_connections 2023-12-16T20:50:48.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.453+0000 7f8a2dbea640 1 --2- 172.21.15.87:0/385820232 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a28153c70 0x7f8a28147810 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:48.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.453+0000 7f8a2dbea640 1 --2- 172.21.15.87:0/385820232 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f8a0806ae70 0x7f8a0806d330 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:48.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.453+0000 7f8a2dbea640 1 --2- 172.21.15.87:0/385820232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a28153890 0x7f8a281f2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:48.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.453+0000 7f8a2dbea640 1 --2- 172.21.15.87:0/385820232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a280ceef0 0x7f8a280ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:48.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.453+0000 7f8a2dbea640 1 -- 172.21.15.87:0/385820232 >> 172.21.15.87:0/385820232 conn(0x7f8a2806ba00 msgr2=0x7f8a28149a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:48.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.453+0000 7f8a2dbea640 1 -- 172.21.15.87:0/385820232 shutdown_connections 2023-12-16T20:50:48.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.453+0000 7f8a2dbea640 1 -- 172.21.15.87:0/385820232 wait complete. 2023-12-16T20:50:48.465 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-16T20:50:48.466 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T20:50:48.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.568+0000 7fabef015640 1 Processor -- start 2023-12-16T20:50:48.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.568+0000 7fabef015640 1 -- start start 2023-12-16T20:50:48.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.569+0000 7fabef015640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fabe8153900 0x7fabe80c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:48.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.569+0000 7fabef015640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabe80c6280 0x7fabe80ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:48.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.569+0000 7fabef015640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe80ca460 con 0x7fabe80caea0 2023-12-16T20:50:48.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.569+0000 7fabef015640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe80c8960 con 0x7fabe8153900 2023-12-16T20:50:48.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.569+0000 7fabef015640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe8159a40 con 0x7fabe80c6280 2023-12-16T20:50:48.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.570+0000 7fabe7fff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabe80c6280 0x7fabe80ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:48.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.570+0000 7fabecdb1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fabe8153900 0x7fabe80c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:48.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.570+0000 7fabed5b2640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fabe80caea0 0x7fabe80cb4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46068/0 (socket says 172.21.15.87:46068) 2023-12-16T20:50:48.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.570+0000 7fabed5b2640 1 -- 172.21.15.87:0/529015500 learned_addr learned my addr 172.21.15.87:0/529015500 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:50:48.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.572+0000 7fabe7fff640 1 -- 172.21.15.87:0/529015500 >> v2:172.21.15.87:3300/0 conn(0x7fabe8153900 msgr2=0x7fabe80c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:50:48.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.572+0000 7fabe7fff640 1 --2- 172.21.15.87:0/529015500 >> v2:172.21.15.87:3300/0 conn(0x7fabe8153900 0x7fabe80c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:48.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.572+0000 7fabe7fff640 1 -- 172.21.15.87:0/529015500 >> v1:172.21.15.87:6789/0 conn(0x7fabe80caea0 legacy=0x7fabe80cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:48.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.572+0000 7fabe7fff640 1 -- 172.21.15.87:0/529015500 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe8159d20 con 0x7fabe80c6280 2023-12-16T20:50:48.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.574+0000 7fabe7fff640 1 --2- 172.21.15.87:0/529015500 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabe80c6280 0x7fabe80ca960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009d90 tx=0x7fabd802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adfd3e616222ac58 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:48.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.578+0000 7fabe77fe640 1 -- 172.21.15.87:0/529015500 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd802cbc0 con 0x7fabe80c6280 2023-12-16T20:50:48.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.578+0000 7fabe77fe640 1 -- 172.21.15.87:0/529015500 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fabd802cd20 con 0x7fabe80c6280 2023-12-16T20:50:48.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.578+0000 7fabe77fe640 1 -- 172.21.15.87:0/529015500 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8034680 con 0x7fabe80c6280 2023-12-16T20:50:48.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.578+0000 7fabef015640 1 -- 172.21.15.87:0/529015500 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabe80c6280 msgr2=0x7fabe80ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:48.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.578+0000 7fabef015640 1 --2- 172.21.15.87:0/529015500 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabe80c6280 0x7fabe80ca960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009d90 tx=0x7fabd802be10 comp rx=0 tx=0).stop 2023-12-16T20:50:48.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.578+0000 7fabef015640 1 -- 172.21.15.87:0/529015500 shutdown_connections 2023-12-16T20:50:48.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.578+0000 7fabef015640 1 --2- 172.21.15.87:0/529015500 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabe80c6280 0x7fabe80ca960 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:48.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.578+0000 7fabef015640 1 --2- 172.21.15.87:0/529015500 >> v2:172.21.15.87:3300/0 conn(0x7fabe8153900 0x7fabe80c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:48.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.578+0000 7fabef015640 1 -- 172.21.15.87:0/529015500 >> 172.21.15.87:0/529015500 conn(0x7fabe808afb0 msgr2=0x7fabe808b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:48.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.578+0000 7fabef015640 1 -- 172.21.15.87:0/529015500 shutdown_connections 2023-12-16T20:50:48.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.578+0000 7fabef015640 1 -- 172.21.15.87:0/529015500 wait complete. 2023-12-16T20:50:48.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.580+0000 7fabef015640 1 Processor -- start 2023-12-16T20:50:48.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.580+0000 7fabef015640 1 -- start start 2023-12-16T20:50:48.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.580+0000 7fabef015640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabe80c6280 0x7fabe814c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:48.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.580+0000 7fabef015640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabe80caea0 0x7fabe8154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:48.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.580+0000 7fabef015640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabe8153900 0x7fabe81f2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:48.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.580+0000 7fabef015640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe814cd10 con 0x7fabe80caea0 2023-12-16T20:50:48.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.580+0000 7fabef015640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe81f2ed0 con 0x7fabe80c6280 2023-12-16T20:50:48.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.580+0000 7fabef015640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe81f3100 con 0x7fabe8153900 2023-12-16T20:50:48.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.581+0000 7fabed5b2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabe8153900 0x7fabe81f2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:48.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.581+0000 7fabecdb1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabe80c6280 0x7fabe814c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:48.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.581+0000 7fabed5b2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabe8153900 0x7fabe81f2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:49620/0 (socket says 172.21.15.87:49620) 2023-12-16T20:50:48.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.581+0000 7fabed5b2640 1 -- 172.21.15.87:0/1197081423 learned_addr learned my addr 172.21.15.87:0/1197081423 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:50:48.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.582+0000 7fabe7fff640 1 --2- 172.21.15.87:0/1197081423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabe80caea0 0x7fabe8154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.585+0000 7fabed5b2640 1 -- 172.21.15.87:0/1197081423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabe80c6280 msgr2=0x7fabe814c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.585+0000 7fabed5b2640 1 --2- 172.21.15.87:0/1197081423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabe80c6280 0x7fabe814c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.585+0000 7fabed5b2640 1 -- 172.21.15.87:0/1197081423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabe80caea0 msgr2=0x7fabe8154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.585+0000 7fabed5b2640 1 --2- 172.21.15.87:0/1197081423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabe80caea0 0x7fabe8154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.585+0000 7fabed5b2640 1 -- 172.21.15.87:0/1197081423 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd8009a70 con 0x7fabe8153900 2023-12-16T20:50:48.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.587+0000 7fabed5b2640 1 --2- 172.21.15.87:0/1197081423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabe8153900 0x7fabe81f2610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fabe000c400 tx=0x7fabe000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.591+0000 7fabe57fa640 1 -- 172.21.15.87:0/1197081423 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe0005ce0 con 0x7fabe8153900 2023-12-16T20:50:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.591+0000 7fabe57fa640 1 -- 172.21.15.87:0/1197081423 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fabe0005e40 con 0x7fabe8153900 2023-12-16T20:50:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.591+0000 7fabef015640 1 -- 172.21.15.87:0/1197081423 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe814cf20 con 0x7fabe8153900 2023-12-16T20:50:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.591+0000 7fabe57fa640 1 -- 172.21.15.87:0/1197081423 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe0007330 con 0x7fabe8153900 2023-12-16T20:50:48.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.591+0000 7fabef015640 1 -- 172.21.15.87:0/1197081423 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe80cd7c0 con 0x7fabe8153900 2023-12-16T20:50:48.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.592+0000 7fabef015640 1 -- 172.21.15.87:0/1197081423 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe80728d0 con 0x7fabe8153900 2023-12-16T20:50:48.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.852+0000 7fabe57fa640 1 -- 172.21.15.87:0/1197081423 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fabe0007490 con 0x7fabe8153900 2023-12-16T20:50:48.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.853+0000 7fabe57fa640 1 --2- 172.21.15.87:0/1197081423 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fabc806ae90 0x7fabc806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:48.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.853+0000 7fabecdb1640 1 --2- 172.21.15.87:0/1197081423 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fabc806ae90 0x7fabc806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:48.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.853+0000 7fabecdb1640 1 --2- 172.21.15.87:0/1197081423 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fabc806ae90 0x7fabc806d350 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fabd00079a0 tx=0x7fabd0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:48.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.856+0000 7fabe57fa640 1 -- 172.21.15.87:0/1197081423 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fabe0001120 con 0x7fabe8153900 2023-12-16T20:50:48.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:48.869+0000 7fabe57fa640 1 -- 172.21.15.87:0/1197081423 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fabe0054160 con 0x7fabe8153900 2023-12-16T20:50:49.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.082+0000 7fabef015640 1 -- 172.21.15.87:0/1197081423 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabe8067500 con 0x7fabe8153900 2023-12-16T20:50:49.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.094+0000 7fabe57fa640 1 -- 172.21.15.87:0/1197081423 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6526 (secure 0 0 0) 0x7fabe0057780 con 0x7fabe8153900 2023-12-16T20:50:49.095 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:50:49.095 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2198156124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2198156124},{"type":"v1","addr":"172.21.15.87:6835","nonce":2198156124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3187160209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3187160209},{"type":"v1","addr":"172.21.15.195:6833","nonce":3187160209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3703236183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":3703236183},{"type":"v1","addr":"172.21.15.87:6837","nonce":3703236183}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1942743723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1942743723},{"type":"v1","addr":"172.21.15.87:6839","nonce":1942743723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/3327792325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3327792325},{"type":"v1","addr":"172.21.15.195:6836","nonce":3327792325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T20:21:36.158936+0000","modified":"2023-12-16T20:22:01.721931+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6837/3093855583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3093855583},{"type":"v1","addr":"172.21.15.195:6837","nonce":3093855583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T20:50:49.096 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 10 2023-12-16T20:50:49.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.096+0000 7fabef015640 1 -- 172.21.15.87:0/1197081423 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fabc806ae90 msgr2=0x7fabc806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:49.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.096+0000 7fabef015640 1 --2- 172.21.15.87:0/1197081423 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fabc806ae90 0x7fabc806d350 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fabd00079a0 tx=0x7fabd0008040 comp rx=0 tx=0).stop 2023-12-16T20:50:49.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.096+0000 7fabef015640 1 -- 172.21.15.87:0/1197081423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabe8153900 msgr2=0x7fabe81f2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:49.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.096+0000 7fabef015640 1 --2- 172.21.15.87:0/1197081423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabe8153900 0x7fabe81f2610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fabe000c400 tx=0x7fabe000c8c0 comp rx=0 tx=0).stop 2023-12-16T20:50:49.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.096+0000 7fabef015640 1 -- 172.21.15.87:0/1197081423 shutdown_connections 2023-12-16T20:50:49.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.096+0000 7fabef015640 1 --2- 172.21.15.87:0/1197081423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabe8153900 0x7fabe81f2610 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:49.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.096+0000 7fabef015640 1 --2- 172.21.15.87:0/1197081423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabe80caea0 0x7fabe8154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:49.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.096+0000 7fabef015640 1 --2- 172.21.15.87:0/1197081423 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fabc806ae90 0x7fabc806d350 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:49.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.096+0000 7fabef015640 1 --2- 172.21.15.87:0/1197081423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabe80c6280 0x7fabe814c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:49.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.096+0000 7fabef015640 1 -- 172.21.15.87:0/1197081423 >> 172.21.15.87:0/1197081423 conn(0x7fabe808afb0 msgr2=0x7fabe814dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:49.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.097+0000 7fabef015640 1 -- 172.21.15.87:0/1197081423 shutdown_connections 2023-12-16T20:50:49.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.097+0000 7fabef015640 1 -- 172.21.15.87:0/1197081423 wait complete. 2023-12-16T20:50:49.109 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T20:50:49.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.208+0000 7f4e17b61640 1 Processor -- start 2023-12-16T20:50:49.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.208+0000 7f4e17b61640 1 -- start start 2023-12-16T20:50:49.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.209+0000 7f4e17b61640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e10071c40 0x7f4e10070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:49.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.209+0000 7f4e17b61640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e10071420 con 0x7f4e10159760 2023-12-16T20:50:49.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.209+0000 7f4e17b61640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e101592d0 con 0x7f4e1014fd70 2023-12-16T20:50:49.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.209+0000 7f4e17b61640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e10155b20 con 0x7f4e10071c40 2023-12-16T20:50:49.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.209+0000 7f4e160fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f4e10159760 0x7f4e101604a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46074/0 (socket says 172.21.15.87:46074) 2023-12-16T20:50:49.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.209+0000 7f4e160fe640 1 -- 172.21.15.87:0/4034044670 learned_addr learned my addr 172.21.15.87:0/4034044670 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:50:49.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.210+0000 7f4e150fc640 1 --2- 172.21.15.87:0/4034044670 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e10071c40 0x7f4e10070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:49.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.212+0000 7f4e148fb640 1 -- 172.21.15.87:0/4034044670 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808048241 0 0) 0x7f4e08001110 con 0x7f4e10159760 2023-12-16T20:50:49.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.212+0000 7f4e148fb640 1 -- 172.21.15.87:0/4034044670 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dfc003520 con 0x7f4e10159760 2023-12-16T20:50:49.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.212+0000 7f4e150fc640 1 -- 172.21.15.87:0/4034044670 >> v1:172.21.15.195:6789/0 conn(0x7f4e1014fd70 legacy=0x7f4e100c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:49.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.212+0000 7f4e150fc640 1 -- 172.21.15.87:0/4034044670 >> v1:172.21.15.87:6789/0 conn(0x7f4e10159760 legacy=0x7f4e101604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:49.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.212+0000 7f4e150fc640 1 -- 172.21.15.87:0/4034044670 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e100c65f0 con 0x7f4e10071c40 2023-12-16T20:50:49.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.214+0000 7f4e150fc640 1 --2- 172.21.15.87:0/4034044670 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e10071c40 0x7f4e10070ee0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4e000097d0 tx=0x7f4e0002b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0ca5c4ac7bc2347 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:49.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.218+0000 7f4e148fb640 1 -- 172.21.15.87:0/4034044670 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00031770 con 0x7f4e10071c40 2023-12-16T20:50:49.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.218+0000 7f4e148fb640 1 -- 172.21.15.87:0/4034044670 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4e000318d0 con 0x7f4e10071c40 2023-12-16T20:50:49.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.218+0000 7f4e148fb640 1 -- 172.21.15.87:0/4034044670 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00031c80 con 0x7f4e10071c40 2023-12-16T20:50:49.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.218+0000 7f4e17b61640 1 -- 172.21.15.87:0/4034044670 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e10071c40 msgr2=0x7f4e10070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:49.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.218+0000 7f4e17b61640 1 --2- 172.21.15.87:0/4034044670 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e10071c40 0x7f4e10070ee0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4e000097d0 tx=0x7f4e0002b810 comp rx=0 tx=0).stop 2023-12-16T20:50:49.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.218+0000 7f4e17b61640 1 -- 172.21.15.87:0/4034044670 shutdown_connections 2023-12-16T20:50:49.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.218+0000 7f4e17b61640 1 --2- 172.21.15.87:0/4034044670 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e10071c40 0x7f4e10070ee0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:49.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.218+0000 7f4e17b61640 1 -- 172.21.15.87:0/4034044670 >> 172.21.15.87:0/4034044670 conn(0x7f4e1006cd60 msgr2=0x7f4e1006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:49.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.219+0000 7f4e17b61640 1 -- 172.21.15.87:0/4034044670 shutdown_connections 2023-12-16T20:50:49.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.219+0000 7f4e17b61640 1 -- 172.21.15.87:0/4034044670 wait complete. 2023-12-16T20:50:49.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.220+0000 7f4e17b61640 1 Processor -- start 2023-12-16T20:50:49.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.220+0000 7f4e17b61640 1 -- start start 2023-12-16T20:50:49.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.220+0000 7f4e17b61640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e10071c40 0x7f4e101506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:49.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.220+0000 7f4e17b61640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e1014fd70 0x7f4e10132fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:49.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.220+0000 7f4e17b61640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e10159760 0x7f4e100c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:49.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.220+0000 7f4e17b61640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e10150c10 con 0x7f4e1014fd70 2023-12-16T20:50:49.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.220+0000 7f4e17b61640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1013d070 con 0x7f4e10071c40 2023-12-16T20:50:49.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.220+0000 7f4e17b61640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100caaa0 con 0x7f4e10159760 2023-12-16T20:50:49.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.221+0000 7f4e150fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e1014fd70 0x7f4e10132fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:49.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.221+0000 7f4e160fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e10159760 0x7f4e100c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:49.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.221+0000 7f4e158fd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e10071c40 0x7f4e101506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:49.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.221+0000 7f4e150fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e1014fd70 0x7f4e10132fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37966/0 (socket says 172.21.15.87:37966) 2023-12-16T20:50:49.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.221+0000 7f4e150fc640 1 -- 172.21.15.87:0/3344153082 learned_addr learned my addr 172.21.15.87:0/3344153082 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:50:49.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.224+0000 7f4e150fc640 1 -- 172.21.15.87:0/3344153082 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e10159760 msgr2=0x7f4e100c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:49.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.224+0000 7f4e150fc640 1 --2- 172.21.15.87:0/3344153082 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e10159760 0x7f4e100c9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:49.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.224+0000 7f4e150fc640 1 -- 172.21.15.87:0/3344153082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e10071c40 msgr2=0x7f4e101506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:49.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.224+0000 7f4e150fc640 1 --2- 172.21.15.87:0/3344153082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e10071c40 0x7f4e101506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:49.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.224+0000 7f4e150fc640 1 -- 172.21.15.87:0/3344153082 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e00009400 con 0x7f4e1014fd70 2023-12-16T20:50:49.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.226+0000 7f4e150fc640 1 --2- 172.21.15.87:0/3344153082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e1014fd70 0x7f4e10132fa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4e000097d0 tx=0x7f4e000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:49.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.230+0000 7f4e067fc640 1 -- 172.21.15.87:0/3344153082 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e000328d0 con 0x7f4e1014fd70 2023-12-16T20:50:49.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.230+0000 7f4e067fc640 1 -- 172.21.15.87:0/3344153082 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4e00032a50 con 0x7f4e1014fd70 2023-12-16T20:50:49.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.230+0000 7f4e067fc640 1 -- 172.21.15.87:0/3344153082 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00032e20 con 0x7f4e1014fd70 2023-12-16T20:50:49.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.230+0000 7f4e17b61640 1 -- 172.21.15.87:0/3344153082 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e100c90f0 con 0x7f4e1014fd70 2023-12-16T20:50:49.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.230+0000 7f4e17b61640 1 -- 172.21.15.87:0/3344153082 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e100c8d80 con 0x7f4e1014fd70 2023-12-16T20:50:49.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.231+0000 7f4e17b61640 1 -- 172.21.15.87:0/3344153082 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e10067500 con 0x7f4e1014fd70 2023-12-16T20:50:49.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.473+0000 7f4e067fc640 1 -- 172.21.15.87:0/3344153082 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f4e0004e440 con 0x7f4e1014fd70 2023-12-16T20:50:49.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.473+0000 7f4e067fc640 1 --2- 172.21.15.87:0/3344153082 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f4df406ae90 0x7f4df406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:49.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.473+0000 7f4e158fd640 1 --2- 172.21.15.87:0/3344153082 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f4df406ae90 0x7f4df406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:49.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.473+0000 7f4e158fd640 1 --2- 172.21.15.87:0/3344153082 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f4df406ae90 0x7f4df406d350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0012e0 tx=0x7f4e0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:49.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.486+0000 7f4e067fc640 1 -- 172.21.15.87:0/3344153082 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f4e0007a860 con 0x7f4e1014fd70 2023-12-16T20:50:49.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.486+0000 7f4e067fc640 1 -- 172.21.15.87:0/3344153082 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f4e00076ba0 con 0x7f4e1014fd70 2023-12-16T20:50:49.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.697+0000 7f4e17b61640 1 -- 172.21.15.87:0/3344153082 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e100c5da0 con 0x7f4e1014fd70 2023-12-16T20:50:49.710 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.710+0000 7f4e067fc640 1 -- 172.21.15.87:0/3344153082 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6526 (secure 0 0 0) 0x7f4e0007a1c0 con 0x7f4e1014fd70 2023-12-16T20:50:49.711 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:50:49.711 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2198156124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2198156124},{"type":"v1","addr":"172.21.15.87:6835","nonce":2198156124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3187160209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3187160209},{"type":"v1","addr":"172.21.15.195:6833","nonce":3187160209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3703236183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":3703236183},{"type":"v1","addr":"172.21.15.87:6837","nonce":3703236183}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1942743723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1942743723},{"type":"v1","addr":"172.21.15.87:6839","nonce":1942743723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/3327792325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3327792325},{"type":"v1","addr":"172.21.15.195:6836","nonce":3327792325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T20:21:36.158936+0000","modified":"2023-12-16T20:22:01.721931+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6837/3093855583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3093855583},{"type":"v1","addr":"172.21.15.195:6837","nonce":3093855583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T20:50:49.711 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 10 2023-12-16T20:50:49.713 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.712+0000 7f4e17b61640 1 -- 172.21.15.87:0/3344153082 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f4df406ae90 msgr2=0x7f4df406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:49.713 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.712+0000 7f4e17b61640 1 --2- 172.21.15.87:0/3344153082 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f4df406ae90 0x7f4df406d350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0012e0 tx=0x7f4e0c009040 comp rx=0 tx=0).stop 2023-12-16T20:50:49.713 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.712+0000 7f4e17b61640 1 -- 172.21.15.87:0/3344153082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e1014fd70 msgr2=0x7f4e10132fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:49.713 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.712+0000 7f4e17b61640 1 --2- 172.21.15.87:0/3344153082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e1014fd70 0x7f4e10132fa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4e000097d0 tx=0x7f4e000046c0 comp rx=0 tx=0).stop 2023-12-16T20:50:49.713 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.712+0000 7f4e17b61640 1 -- 172.21.15.87:0/3344153082 shutdown_connections 2023-12-16T20:50:49.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.712+0000 7f4e17b61640 1 --2- 172.21.15.87:0/3344153082 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e10159760 0x7f4e100c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:49.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.712+0000 7f4e17b61640 1 --2- 172.21.15.87:0/3344153082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e1014fd70 0x7f4e10132fa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:49.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.712+0000 7f4e17b61640 1 --2- 172.21.15.87:0/3344153082 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f4df406ae90 0x7f4df406d350 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:49.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.712+0000 7f4e17b61640 1 --2- 172.21.15.87:0/3344153082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e10071c40 0x7f4e101506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:49.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.712+0000 7f4e17b61640 1 -- 172.21.15.87:0/3344153082 >> 172.21.15.87:0/3344153082 conn(0x7f4e1006cd60 msgr2=0x7f4e10154dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:49.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.712+0000 7f4e17b61640 1 -- 172.21.15.87:0/3344153082 shutdown_connections 2023-12-16T20:50:49.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.712+0000 7f4e17b61640 1 -- 172.21.15.87:0/3344153082 wait complete. 2023-12-16T20:50:49.724 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T20:50:49.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.823+0000 7f8856b61640 1 Processor -- start 2023-12-16T20:50:49.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.823+0000 7f8856b61640 1 -- start start 2023-12-16T20:50:49.825 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.824+0000 7f8856b61640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f88500c51c0 0x7f88501514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:49.825 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.824+0000 7f8856b61640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88500c7dd0 con 0x7f88500c4de0 2023-12-16T20:50:49.825 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.824+0000 7f8856b61640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8850158640 con 0x7f8850158100 2023-12-16T20:50:49.825 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.824+0000 7f8856b61640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885006ec40 con 0x7f88500c51c0 2023-12-16T20:50:49.825 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.825+0000 7f884ffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f88500c51c0 0x7f88501514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:49.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.825+0000 7f88548fd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f88500c4de0 0x7f885006f400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46078/0 (socket says 172.21.15.87:46078) 2023-12-16T20:50:49.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.825+0000 7f88548fd640 1 -- 172.21.15.87:0/3769585813 learned_addr learned my addr 172.21.15.87:0/3769585813 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:50:49.828 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.827+0000 7f884f7fe640 1 -- 172.21.15.87:0/3769585813 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861904698 0 0) 0x7f8850158640 con 0x7f8850158100 2023-12-16T20:50:49.828 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.827+0000 7f884f7fe640 1 -- 172.21.15.87:0/3769585813 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f883c003520 con 0x7f8850158100 2023-12-16T20:50:49.830 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.830+0000 7f884ffff640 1 -- 172.21.15.87:0/3769585813 >> v1:172.21.15.195:6789/0 conn(0x7f8850158100 legacy=0x7f8850161fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:49.830 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.830+0000 7f884ffff640 1 -- 172.21.15.87:0/3769585813 >> v1:172.21.15.87:6789/0 conn(0x7f88500c4de0 legacy=0x7f885006f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:49.830 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.830+0000 7f884ffff640 1 -- 172.21.15.87:0/3769585813 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885006fb10 con 0x7f88500c51c0 2023-12-16T20:50:49.833 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.833+0000 7f884ffff640 1 --2- 172.21.15.87:0/3769585813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88500c51c0 0x7f88501514e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f88380097a0 tx=0x7f883802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8552ec69f8f4e8f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:49.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.836+0000 7f884f7fe640 1 -- 172.21.15.87:0/3769585813 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838030610 con 0x7f88500c51c0 2023-12-16T20:50:49.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.836+0000 7f884f7fe640 1 -- 172.21.15.87:0/3769585813 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8838030770 con 0x7f88500c51c0 2023-12-16T20:50:49.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.836+0000 7f884f7fe640 1 -- 172.21.15.87:0/3769585813 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838030b20 con 0x7f88500c51c0 2023-12-16T20:50:49.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.837+0000 7f8856b61640 1 -- 172.21.15.87:0/3769585813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88500c51c0 msgr2=0x7f88501514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:49.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.837+0000 7f8856b61640 1 --2- 172.21.15.87:0/3769585813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88500c51c0 0x7f88501514e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f88380097a0 tx=0x7f883802b960 comp rx=0 tx=0).stop 2023-12-16T20:50:49.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.837+0000 7f8856b61640 1 -- 172.21.15.87:0/3769585813 shutdown_connections 2023-12-16T20:50:49.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.837+0000 7f8856b61640 1 --2- 172.21.15.87:0/3769585813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88500c51c0 0x7f88501514e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:49.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.837+0000 7f8856b61640 1 -- 172.21.15.87:0/3769585813 >> 172.21.15.87:0/3769585813 conn(0x7f88500c7f60 msgr2=0x7f88500c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:49.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.837+0000 7f8856b61640 1 -- 172.21.15.87:0/3769585813 shutdown_connections 2023-12-16T20:50:49.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.837+0000 7f8856b61640 1 -- 172.21.15.87:0/3769585813 wait complete. 2023-12-16T20:50:49.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.838+0000 7f8856b61640 1 Processor -- start 2023-12-16T20:50:49.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.838+0000 7f8856b61640 1 -- start start 2023-12-16T20:50:49.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.839+0000 7f8856b61640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88500c4de0 0x7f8850156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:49.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.839+0000 7f8856b61640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88500c51c0 0x7f8850143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:49.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.839+0000 7f8856b61640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8850158100 0x7f8850144260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:49.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.839+0000 7f8856b61640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8850146370 con 0x7f88500c4de0 2023-12-16T20:50:49.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.839+0000 7f8856b61640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8850145810 con 0x7f8850158100 2023-12-16T20:50:49.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.839+0000 7f8856b61640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88501570f0 con 0x7f88500c51c0 2023-12-16T20:50:49.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.840+0000 7f88548fd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88500c4de0 0x7f8850156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:49.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.840+0000 7f884ffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88500c51c0 0x7f8850143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:49.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.840+0000 7f88550fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8850158100 0x7f8850144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:49.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.840+0000 7f88548fd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88500c4de0 0x7f8850156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37992/0 (socket says 172.21.15.87:37992) 2023-12-16T20:50:49.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.840+0000 7f88548fd640 1 -- 172.21.15.87:0/992207730 learned_addr learned my addr 172.21.15.87:0/992207730 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:50:49.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.843+0000 7f88548fd640 1 -- 172.21.15.87:0/992207730 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88500c51c0 msgr2=0x7f8850143d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:49.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.843+0000 7f88548fd640 1 --2- 172.21.15.87:0/992207730 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88500c51c0 0x7f8850143d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:49.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.843+0000 7f88548fd640 1 -- 172.21.15.87:0/992207730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8850158100 msgr2=0x7f8850144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:49.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.843+0000 7f88548fd640 1 --2- 172.21.15.87:0/992207730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8850158100 0x7f8850144260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:49.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.843+0000 7f88548fd640 1 -- 172.21.15.87:0/992207730 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8838009400 con 0x7f88500c4de0 2023-12-16T20:50:49.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.845+0000 7f88548fd640 1 --2- 172.21.15.87:0/992207730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88500c4de0 0x7f8850156630 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f884000c3c0 tx=0x7f884000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:49.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.849+0000 7f884d7fa640 1 -- 172.21.15.87:0/992207730 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840005ce0 con 0x7f88500c4de0 2023-12-16T20:50:49.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.849+0000 7f884d7fa640 1 -- 172.21.15.87:0/992207730 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8840005e40 con 0x7f88500c4de0 2023-12-16T20:50:49.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.849+0000 7f8856b61640 1 -- 172.21.15.87:0/992207730 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8850148470 con 0x7f88500c4de0 2023-12-16T20:50:49.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.849+0000 7f884d7fa640 1 -- 172.21.15.87:0/992207730 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88400072f0 con 0x7f88500c4de0 2023-12-16T20:50:49.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.849+0000 7f8856b61640 1 -- 172.21.15.87:0/992207730 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88501f03a0 con 0x7f88500c4de0 2023-12-16T20:50:49.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:49.850+0000 7f8856b61640 1 -- 172.21.15.87:0/992207730 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8850148600 con 0x7f88500c4de0 2023-12-16T20:50:50.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.095+0000 7f884d7fa640 1 -- 172.21.15.87:0/992207730 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f8840007510 con 0x7f88500c4de0 2023-12-16T20:50:50.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.095+0000 7f884d7fa640 1 --2- 172.21.15.87:0/992207730 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f883006ae40 0x7f883006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:50.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.095+0000 7f884ffff640 1 --2- 172.21.15.87:0/992207730 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f883006ae40 0x7f883006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:50.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.095+0000 7f884ffff640 1 --2- 172.21.15.87:0/992207730 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f883006ae40 0x7f883006d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8838036000 tx=0x7f8838008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:50.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.109+0000 7f884d7fa640 1 -- 172.21.15.87:0/992207730 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8840057c50 con 0x7f88500c4de0 2023-12-16T20:50:50.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.109+0000 7f884d7fa640 1 -- 172.21.15.87:0/992207730 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f8840053f90 con 0x7f88500c4de0 2023-12-16T20:50:50.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.285+0000 7f8856b61640 1 -- 172.21.15.87:0/992207730 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8850148600 con 0x7f88500c4de0 2023-12-16T20:50:50.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.323+0000 7f884d7fa640 1 -- 172.21.15.87:0/992207730 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18702 (secure 0 0 0) 0x7f8850148600 con 0x7f88500c4de0 2023-12-16T20:50:50.324 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-16T20:50:50.324 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":27,"fsid":"281751e9-025f-43bb-9b42-7cc76907fa5a","created":"2023-12-16T20:21:06.560356+0000","modified":"2023-12-16T20:22:14.653915+0000","last_up_change":"2023-12-16T20:21:20.245627+0000","last_in_change":"2023-12-16T20:21:11.891757+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T20:21:22.654341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T20:21:33.728787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T20:21:34.846119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-16T20:21:38.657738+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"73cae3cf-876f-4902-b7a1-e562f2946ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6811","nonce":2135560294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6813","nonce":2135560294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6817","nonce":2135560294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2135560294},{"type":"v1","addr":"172.21.15.87:6815","nonce":2135560294}]},"public_addr":"172.21.15.87:6811/2135560294","cluster_addr":"172.21.15.87:6813/2135560294","heartbeat_back_addr":"172.21.15.87:6817/2135560294","heartbeat_front_addr":"172.21.15.87:6815/2135560294","state":["exists","up"]},{"osd":1,"uuid":"99320a16-1229-40cc-ad91-52588c0c290b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6827","nonce":1090792588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6829","nonce":1090792588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6833","nonce":1090792588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1090792588},{"type":"v1","addr":"172.21.15.87:6831","nonce":1090792588}]},"public_addr":"172.21.15.87:6827/1090792588","cluster_addr":"172.21.15.87:6829/1090792588","heartbeat_back_addr":"172.21.15.87:6833/1090792588","heartbeat_front_addr":"172.21.15.87:6831/1090792588","state":["exists","up"]},{"osd":2,"uuid":"5ae08722-d336-40c7-9daa-fbc674119491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6803","nonce":2637031951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6805","nonce":2637031951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6809","nonce":2637031951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2637031951},{"type":"v1","addr":"172.21.15.87:6807","nonce":2637031951}]},"public_addr":"172.21.15.87:6803/2637031951","cluster_addr":"172.21.15.87:6805/2637031951","heartbeat_back_addr":"172.21.15.87:6809/2637031951","heartbeat_front_addr":"172.21.15.87:6807/2637031951","state":["exists","up"]},{"osd":3,"uuid":"969d599a-ea7d-4f88-a65c-c3e367c2c27c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6819","nonce":2356258495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6821","nonce":2356258495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6825","nonce":2356258495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2356258495},{"type":"v1","addr":"172.21.15.87:6823","nonce":2356258495}]},"public_addr":"172.21.15.87:6819/2356258495","cluster_addr":"172.21.15.87:6821/2356258495","heartbeat_back_addr":"172.21.15.87:6825/2356258495","heartbeat_front_addr":"172.21.15.87:6823/2356258495","state":["exists","up"]},{"osd":4,"uuid":"43e4ad86-7f30-4b7e-b027-37c7dcb16903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6825","nonce":265859371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6827","nonce":265859371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6831","nonce":265859371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":265859371},{"type":"v1","addr":"172.21.15.195:6829","nonce":265859371}]},"public_addr":"172.21.15.195:6825/265859371","cluster_addr":"172.21.15.195:6827/265859371","heartbeat_back_addr":"172.21.15.195:6831/265859371","heartbeat_front_addr":"172.21.15.195:6829/265859371","state":["exists","up"]},{"osd":5,"uuid":"af2039e7-39f7-496f-9ab3-f32c1bb426f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6801","nonce":264039550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6803","nonce":264039550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6807","nonce":264039550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":264039550},{"type":"v1","addr":"172.21.15.195:6805","nonce":264039550}]},"public_addr":"172.21.15.195:6801/264039550","cluster_addr":"172.21.15.195:6803/264039550","heartbeat_back_addr":"172.21.15.195:6807/264039550","heartbeat_front_addr":"172.21.15.195:6805/264039550","state":["exists","up"]},{"osd":6,"uuid":"c3124a37-4570-4f0e-af2c-cfc0cb49b68d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6817","nonce":2911660280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6819","nonce":2911660280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6823","nonce":2911660280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2911660280},{"type":"v1","addr":"172.21.15.195:6821","nonce":2911660280}]},"public_addr":"172.21.15.195:6817/2911660280","cluster_addr":"172.21.15.195:6819/2911660280","heartbeat_back_addr":"172.21.15.195:6823/2911660280","heartbeat_front_addr":"172.21.15.195:6821/2911660280","state":["exists","up"]},{"osd":7,"uuid":"5ee83620-9e5a-412a-ae7e-1602cd92f1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6809","nonce":529094727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6811","nonce":529094727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6815","nonce":529094727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":529094727},{"type":"v1","addr":"172.21.15.195:6813","nonce":529094727}]},"public_addr":"172.21.15.195:6809/529094727","cluster_addr":"172.21.15.195:6811/529094727","heartbeat_back_addr":"172.21.15.195:6815/529094727","heartbeat_front_addr":"172.21.15.195:6813/529094727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.213392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.102568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.177125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275415+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.077592+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.275084+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T20:21:17.233819+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T20:50:50.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.325+0000 7f8856b61640 1 -- 172.21.15.87:0/992207730 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f883006ae40 msgr2=0x7f883006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:50.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.325+0000 7f8856b61640 1 --2- 172.21.15.87:0/992207730 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f883006ae40 0x7f883006d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8838036000 tx=0x7f8838008030 comp rx=0 tx=0).stop 2023-12-16T20:50:50.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.325+0000 7f8856b61640 1 -- 172.21.15.87:0/992207730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88500c4de0 msgr2=0x7f8850156630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:50.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.325+0000 7f8856b61640 1 --2- 172.21.15.87:0/992207730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88500c4de0 0x7f8850156630 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f884000c3c0 tx=0x7f884000c880 comp rx=0 tx=0).stop 2023-12-16T20:50:50.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.325+0000 7f8856b61640 1 -- 172.21.15.87:0/992207730 shutdown_connections 2023-12-16T20:50:50.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.325+0000 7f8856b61640 1 --2- 172.21.15.87:0/992207730 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f883006ae40 0x7f883006d300 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:50.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.325+0000 7f8856b61640 1 --2- 172.21.15.87:0/992207730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8850158100 0x7f8850144260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:50.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.325+0000 7f8856b61640 1 --2- 172.21.15.87:0/992207730 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88500c51c0 0x7f8850143d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:50.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.325+0000 7f8856b61640 1 --2- 172.21.15.87:0/992207730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88500c4de0 0x7f8850156630 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:50.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.325+0000 7f8856b61640 1 -- 172.21.15.87:0/992207730 >> 172.21.15.87:0/992207730 conn(0x7f88500c7f60 msgr2=0x7f8850073850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:50.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.325+0000 7f8856b61640 1 -- 172.21.15.87:0/992207730 shutdown_connections 2023-12-16T20:50:50.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.325+0000 7f8856b61640 1 -- 172.21.15.87:0/992207730 wait complete. 2023-12-16T20:50:50.337 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-16T20:50:50.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.437+0000 7faed37b0640 1 Processor -- start 2023-12-16T20:50:50.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.438+0000 7faed37b0640 1 -- start start 2023-12-16T20:50:50.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.438+0000 7faed37b0640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7faecc14fd70 0x7faecc070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:50.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.438+0000 7faed37b0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faecc071c40 0x7faecc0c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:50.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.438+0000 7faed37b0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faecc0c7eb0 0x7faecc159760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:50.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.438+0000 7faed37b0640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faecc155b20 con 0x7faecc0c7eb0 2023-12-16T20:50:50.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.438+0000 7faed37b0640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faecc071420 con 0x7faecc14fd70 2023-12-16T20:50:50.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.438+0000 7faed37b0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc1592d0 con 0x7faecc071c40 2023-12-16T20:50:50.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.439+0000 7faed1d4d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faecc0c7eb0 0x7faecc159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:50.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.439+0000 7faed0d4b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faecc071c40 0x7faecc0c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:50.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.439+0000 7faed1d4d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faecc0c7eb0 0x7faecc159760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37998/0 (socket says 172.21.15.87:37998) 2023-12-16T20:50:50.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.439+0000 7faed1d4d640 1 -- 172.21.15.87:0/725562226 learned_addr learned my addr 172.21.15.87:0/725562226 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:50:50.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.439+0000 7faed154c640 1 --2- 172.21.15.87:0/725562226 >> v2:172.21.15.195:3300/0 conn(0x7faecc14fd70 0x7faecc070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:50.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.441+0000 7faed1d4d640 1 -- 172.21.15.87:0/725562226 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faecc071c40 msgr2=0x7faecc0c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:50:50.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.441+0000 7faed1d4d640 1 --2- 172.21.15.87:0/725562226 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faecc071c40 0x7faecc0c7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:50.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.441+0000 7faed1d4d640 1 -- 172.21.15.87:0/725562226 >> v2:172.21.15.195:3300/0 conn(0x7faecc14fd70 msgr2=0x7faecc070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:50:50.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.441+0000 7faed1d4d640 1 --2- 172.21.15.87:0/725562226 >> v2:172.21.15.195:3300/0 conn(0x7faecc14fd70 0x7faecc070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:50.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.441+0000 7faed1d4d640 1 -- 172.21.15.87:0/725562226 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc0c65f0 con 0x7faecc0c7eb0 2023-12-16T20:50:50.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.443+0000 7faed1d4d640 1 --2- 172.21.15.87:0/725562226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faecc0c7eb0 0x7faecc159760 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faecc0c85d0 tx=0x7faec802dfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716b7865c7aebc12 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:50.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.447+0000 7faec3fff640 1 -- 172.21.15.87:0/725562226 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec802e970 con 0x7faecc0c7eb0 2023-12-16T20:50:50.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.447+0000 7faec3fff640 1 -- 172.21.15.87:0/725562226 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faec802ead0 con 0x7faecc0c7eb0 2023-12-16T20:50:50.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.447+0000 7faec3fff640 1 -- 172.21.15.87:0/725562226 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec802ee80 con 0x7faecc0c7eb0 2023-12-16T20:50:50.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.448+0000 7faed37b0640 1 -- 172.21.15.87:0/725562226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faecc0c7eb0 msgr2=0x7faecc159760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.448+0000 7faed37b0640 1 --2- 172.21.15.87:0/725562226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faecc0c7eb0 0x7faecc159760 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faecc0c85d0 tx=0x7faec802dfd0 comp rx=0 tx=0).stop 2023-12-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.448+0000 7faed37b0640 1 -- 172.21.15.87:0/725562226 shutdown_connections 2023-12-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.448+0000 7faed37b0640 1 --2- 172.21.15.87:0/725562226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faecc0c7eb0 0x7faecc159760 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.448+0000 7faed37b0640 1 --2- 172.21.15.87:0/725562226 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faecc071c40 0x7faecc0c7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.448+0000 7faed37b0640 1 --2- 172.21.15.87:0/725562226 >> v2:172.21.15.195:3300/0 conn(0x7faecc14fd70 0x7faecc070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.448+0000 7faed37b0640 1 -- 172.21.15.87:0/725562226 >> 172.21.15.87:0/725562226 conn(0x7faecc06cd60 msgr2=0x7faecc06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.448+0000 7faed37b0640 1 -- 172.21.15.87:0/725562226 shutdown_connections 2023-12-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.448+0000 7faed37b0640 1 -- 172.21.15.87:0/725562226 wait complete. 2023-12-16T20:50:50.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.449+0000 7faed37b0640 1 Processor -- start 2023-12-16T20:50:50.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.449+0000 7faed37b0640 1 -- start start 2023-12-16T20:50:50.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.450+0000 7faed37b0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faecc071c40 0x7faecc1eaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:50.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.450+0000 7faed37b0640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faecc0c7eb0 0x7faecc1e16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:50.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.450+0000 7faed37b0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faecc14fd70 0x7faecc1e1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:50.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.450+0000 7faed37b0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc1448c0 con 0x7faecc14fd70 2023-12-16T20:50:50.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.450+0000 7faed37b0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc144ba0 con 0x7faecc071c40 2023-12-16T20:50:50.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.450+0000 7faed37b0640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc144e80 con 0x7faecc0c7eb0 2023-12-16T20:50:50.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.450+0000 7faed1d4d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faecc14fd70 0x7faecc1e1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:50.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.450+0000 7faed0d4b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faecc0c7eb0 0x7faecc1e16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:50.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.450+0000 7faed154c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faecc071c40 0x7faecc1eaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:50.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.450+0000 7faed1d4d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faecc14fd70 0x7faecc1e1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38008/0 (socket says 172.21.15.87:38008) 2023-12-16T20:50:50.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.450+0000 7faed1d4d640 1 -- 172.21.15.87:0/1704393773 learned_addr learned my addr 172.21.15.87:0/1704393773 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:50:50.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.454+0000 7faed1d4d640 1 -- 172.21.15.87:0/1704393773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faecc0c7eb0 msgr2=0x7faecc1e16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:50.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.454+0000 7faed1d4d640 1 --2- 172.21.15.87:0/1704393773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faecc0c7eb0 0x7faecc1e16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:50.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.454+0000 7faed1d4d640 1 -- 172.21.15.87:0/1704393773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faecc071c40 msgr2=0x7faecc1eaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:50.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.454+0000 7faed1d4d640 1 --2- 172.21.15.87:0/1704393773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faecc071c40 0x7faecc1eaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:50.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.454+0000 7faed1d4d640 1 -- 172.21.15.87:0/1704393773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec800bd40 con 0x7faecc14fd70 2023-12-16T20:50:50.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.456+0000 7faed1d4d640 1 --2- 172.21.15.87:0/1704393773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faecc14fd70 0x7faecc1e1bf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faec8038040 tx=0x7faec8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:50.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.459+0000 7faec1ffb640 1 -- 172.21.15.87:0/1704393773 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8040450 con 0x7faecc14fd70 2023-12-16T20:50:50.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.459+0000 7faec1ffb640 1 -- 172.21.15.87:0/1704393773 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faec80405f0 con 0x7faecc14fd70 2023-12-16T20:50:50.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.459+0000 7faec1ffb640 1 -- 172.21.15.87:0/1704393773 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec80409c0 con 0x7faecc14fd70 2023-12-16T20:50:50.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.459+0000 7faed37b0640 1 -- 172.21.15.87:0/1704393773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faecc1ee630 con 0x7faecc14fd70 2023-12-16T20:50:50.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.460+0000 7faed37b0640 1 -- 172.21.15.87:0/1704393773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faecc1eebf0 con 0x7faecc14fd70 2023-12-16T20:50:50.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.460+0000 7faed37b0640 1 -- 172.21.15.87:0/1704393773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faecc1ee490 con 0x7faecc14fd70 2023-12-16T20:50:50.702 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.702+0000 7faec1ffb640 1 -- 172.21.15.87:0/1704393773 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7faec8040b20 con 0x7faecc14fd70 2023-12-16T20:50:50.702 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.702+0000 7faec1ffb640 1 --2- 172.21.15.87:0/1704393773 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7faeb006ae90 0x7faeb006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:50.703 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.702+0000 7faed154c640 1 --2- 172.21.15.87:0/1704393773 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7faeb006ae90 0x7faeb006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:50.703 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.703+0000 7faed154c640 1 --2- 172.21.15.87:0/1704393773 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7faeb006ae90 0x7faeb006d350 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faec4009b40 tx=0x7faec4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:50.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.715+0000 7faec1ffb640 1 -- 172.21.15.87:0/1704393773 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7faec807da90 con 0x7faecc14fd70 2023-12-16T20:50:50.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.715+0000 7faec1ffb640 1 -- 172.21.15.87:0/1704393773 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7faec8079d40 con 0x7faecc14fd70 2023-12-16T20:50:50.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:50.934+0000 7faed37b0640 1 -- 172.21.15.87:0/1704393773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7faecc1ee490 con 0x7faecc14fd70 2023-12-16T20:50:51.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.102+0000 7faec1ffb640 1 -- 172.21.15.87:0/1704393773 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v11) v1 ==== 161+0+0 (secure 0 0 0) 0x7faecc1ee490 con 0x7faecc14fd70 2023-12-16T20:50:51.103 INFO:teuthology.orchestra.run.smithi087.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-16T20:50:51.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.105+0000 7faed37b0640 1 -- 172.21.15.87:0/1704393773 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7faeb006ae90 msgr2=0x7faeb006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:51.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.105+0000 7faed37b0640 1 --2- 172.21.15.87:0/1704393773 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7faeb006ae90 0x7faeb006d350 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faec4009b40 tx=0x7faec4009190 comp rx=0 tx=0).stop 2023-12-16T20:50:51.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.105+0000 7faed37b0640 1 -- 172.21.15.87:0/1704393773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faecc14fd70 msgr2=0x7faecc1e1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:51.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.105+0000 7faed37b0640 1 --2- 172.21.15.87:0/1704393773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faecc14fd70 0x7faecc1e1bf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faec8038040 tx=0x7faec8004a40 comp rx=0 tx=0).stop 2023-12-16T20:50:51.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.105+0000 7faed37b0640 1 -- 172.21.15.87:0/1704393773 shutdown_connections 2023-12-16T20:50:51.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.105+0000 7faed37b0640 1 --2- 172.21.15.87:0/1704393773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faecc14fd70 0x7faecc1e1bf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:51.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.105+0000 7faed37b0640 1 --2- 172.21.15.87:0/1704393773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faecc0c7eb0 0x7faecc1e16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:51.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.105+0000 7faed37b0640 1 --2- 172.21.15.87:0/1704393773 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7faeb006ae90 0x7faeb006d350 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:51.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.105+0000 7faed37b0640 1 --2- 172.21.15.87:0/1704393773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faecc071c40 0x7faecc1eaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:51.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.105+0000 7faed37b0640 1 -- 172.21.15.87:0/1704393773 >> 172.21.15.87:0/1704393773 conn(0x7faecc06cd60 msgr2=0x7faecc153830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:51.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.105+0000 7faed37b0640 1 -- 172.21.15.87:0/1704393773 shutdown_connections 2023-12-16T20:50:51.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.105+0000 7faed37b0640 1 -- 172.21.15.87:0/1704393773 wait complete. 2023-12-16T20:50:51.118 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-16T20:50:51.176 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:29:56.416 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:50:51.181 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:29:56.422 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:50:51.187 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:29:56.381 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:50:51.188 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:29:56.382 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:50:51.190 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:29:56.384 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:50:51.190 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:29:56.385 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:50:51.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.225+0000 7fd1d3f73640 1 Processor -- start 2023-12-16T20:50:51.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.225+0000 7fd1d3f73640 1 -- start start 2023-12-16T20:50:51.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.226+0000 7fd1d3f73640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd1cc070d00 0x7fd1cc15d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:51.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.226+0000 7fd1d3f73640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1cc0710e0 0x7fd1cc153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:51.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.226+0000 7fd1d3f73640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1cc0ca6c0 con 0x7fd1cc0c7700 2023-12-16T20:50:51.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.226+0000 7fd1d3f73640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1cc15da60 con 0x7fd1cc070d00 2023-12-16T20:50:51.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.226+0000 7fd1d3f73640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc159880 con 0x7fd1cc0710e0 2023-12-16T20:50:51.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.256+0000 7fd1d1d0f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd1cc070d00 0x7fd1cc15d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:51.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.257+0000 7fd1d1d0f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd1cc070d00 0x7fd1cc15d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49328/0 (socket says 172.21.15.87:49328) 2023-12-16T20:50:51.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.257+0000 7fd1d1d0f640 1 -- 172.21.15.87:0/4146519125 learned_addr learned my addr 172.21.15.87:0/4146519125 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:50:51.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.263+0000 7fd1d1d0f640 1 -- 172.21.15.87:0/4146519125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1cc0710e0 msgr2=0x7fd1cc153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:50:51.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.263+0000 7fd1d1d0f640 1 --2- 172.21.15.87:0/4146519125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1cc0710e0 0x7fd1cc153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:51.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.263+0000 7fd1d1d0f640 1 -- 172.21.15.87:0/4146519125 >> v1:172.21.15.195:6789/0 conn(0x7fd1cc0c7700 legacy=0x7fd1cc0c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:50:51.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.263+0000 7fd1d1d0f640 1 -- 172.21.15.87:0/4146519125 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc159b60 con 0x7fd1cc070d00 2023-12-16T20:50:51.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.267+0000 7fd1d1d0f640 1 --2- 172.21.15.87:0/4146519125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1cc070d00 0x7fd1cc15d520 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009870 tx=0x7fd1c802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc14b17bf4d1968d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:51.271 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:29:56.512 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:50:51.278 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:29:56.473 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:50:51.295 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:29:56.489 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:50:51.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.470+0000 7fd1d0d0d640 1 -- 172.21.15.87:0/4146519125 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8030840 con 0x7fd1cc070d00 2023-12-16T20:50:51.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.470+0000 7fd1d0d0d640 1 -- 172.21.15.87:0/4146519125 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd1c80309a0 con 0x7fd1cc070d00 2023-12-16T20:50:51.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.470+0000 7fd1d0d0d640 1 -- 172.21.15.87:0/4146519125 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8030d50 con 0x7fd1cc070d00 2023-12-16T20:50:51.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.470+0000 7fd1d3f73640 1 -- 172.21.15.87:0/4146519125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1cc070d00 msgr2=0x7fd1cc15d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:51.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.470+0000 7fd1d3f73640 1 --2- 172.21.15.87:0/4146519125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1cc070d00 0x7fd1cc15d520 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009870 tx=0x7fd1c802b980 comp rx=0 tx=0).stop 2023-12-16T20:50:51.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.470+0000 7fd1d3f73640 1 -- 172.21.15.87:0/4146519125 shutdown_connections 2023-12-16T20:50:51.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.470+0000 7fd1d3f73640 1 --2- 172.21.15.87:0/4146519125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1cc0710e0 0x7fd1cc153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:51.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.470+0000 7fd1d3f73640 1 --2- 172.21.15.87:0/4146519125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1cc070d00 0x7fd1cc15d520 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:51.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.470+0000 7fd1d3f73640 1 -- 172.21.15.87:0/4146519125 >> 172.21.15.87:0/4146519125 conn(0x7fd1cc06ab30 msgr2=0x7fd1cc06ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:51.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.471+0000 7fd1d3f73640 1 -- 172.21.15.87:0/4146519125 shutdown_connections 2023-12-16T20:50:51.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.471+0000 7fd1d3f73640 1 -- 172.21.15.87:0/4146519125 wait complete. 2023-12-16T20:50:51.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.472+0000 7fd1d3f73640 1 Processor -- start 2023-12-16T20:50:51.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.472+0000 7fd1d3f73640 1 -- start start 2023-12-16T20:50:51.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.472+0000 7fd1d3f73640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1cc070d00 0x7fd1cc14e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:51.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.472+0000 7fd1d3f73640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1cc0710e0 0x7fd1cc0c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:51.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.472+0000 7fd1d3f73640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1cc0c7700 0x7fd1cc0c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:51.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.472+0000 7fd1d3f73640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0c5ab0 con 0x7fd1cc070d00 2023-12-16T20:50:51.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.472+0000 7fd1d3f73640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0c5d50 con 0x7fd1cc0710e0 2023-12-16T20:50:51.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.472+0000 7fd1d3f73640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc1efef0 con 0x7fd1cc0c7700 2023-12-16T20:50:51.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.474+0000 7fd1d1d0f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1cc070d00 0x7fd1cc14e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:51.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.476+0000 7fd1d1d0f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1cc070d00 0x7fd1cc14e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49344/0 (socket says 172.21.15.87:49344) 2023-12-16T20:50:51.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.476+0000 7fd1d1d0f640 1 -- 172.21.15.87:0/213486563 learned_addr learned my addr 172.21.15.87:0/213486563 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:50:51.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.481+0000 7fd1d1d0f640 1 -- 172.21.15.87:0/213486563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1cc0c7700 msgr2=0x7fd1cc0c51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:51.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.481+0000 7fd1d1d0f640 1 --2- 172.21.15.87:0/213486563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1cc0c7700 0x7fd1cc0c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:51.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.481+0000 7fd1d1d0f640 1 -- 172.21.15.87:0/213486563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1cc0710e0 msgr2=0x7fd1cc0c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:51.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.481+0000 7fd1d1d0f640 1 --2- 172.21.15.87:0/213486563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1cc0710e0 0x7fd1cc0c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:51.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.481+0000 7fd1d1d0f640 1 -- 172.21.15.87:0/213486563 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c80094d0 con 0x7fd1cc070d00 2023-12-16T20:50:51.485 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.485+0000 7fd1d1d0f640 1 --2- 172.21.15.87:0/213486563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1cc070d00 0x7fd1cc14e9f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009990 tx=0x7fd1c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.493+0000 7fd1c27fc640 1 -- 172.21.15.87:0/213486563 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8039e20 con 0x7fd1cc070d00 2023-12-16T20:50:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.493+0000 7fd1c27fc640 1 -- 172.21.15.87:0/213486563 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd1c8043400 con 0x7fd1cc070d00 2023-12-16T20:50:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.493+0000 7fd1d3f73640 1 -- 172.21.15.87:0/213486563 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1cc0cd330 con 0x7fd1cc070d00 2023-12-16T20:50:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.493+0000 7fd1c27fc640 1 -- 172.21.15.87:0/213486563 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80437d0 con 0x7fd1cc070d00 2023-12-16T20:50:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.493+0000 7fd1d3f73640 1 -- 172.21.15.87:0/213486563 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1cc0cd8f0 con 0x7fd1cc070d00 2023-12-16T20:50:51.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.494+0000 7fd1d3f73640 1 -- 172.21.15.87:0/213486563 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1cc0cdae0 con 0x7fd1cc070d00 2023-12-16T20:50:51.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.749+0000 7fd1c27fc640 1 -- 172.21.15.87:0/213486563 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fd1c8043930 con 0x7fd1cc070d00 2023-12-16T20:50:51.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.749+0000 7fd1c27fc640 1 --2- 172.21.15.87:0/213486563 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd1b006ae90 0x7fd1b006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:51.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.749+0000 7fd1d150e640 1 --2- 172.21.15.87:0/213486563 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd1b006ae90 0x7fd1b006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:51.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.750+0000 7fd1d150e640 1 --2- 172.21.15.87:0/213486563 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd1b006ae90 0x7fd1b006d350 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0b1ff0 tx=0x7fd1bc006c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:51.765 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.765+0000 7fd1c27fc640 1 -- 172.21.15.87:0/213486563 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6778+0+0 (secure 0 0 0) 0x7fd1c803e070 con 0x7fd1cc070d00 2023-12-16T20:50:51.766 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:51.765+0000 7fd1c27fc640 1 -- 172.21.15.87:0/213486563 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fd1c80783e0 con 0x7fd1cc070d00 2023-12-16T20:50:52.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:52.001+0000 7fd1d3f73640 1 -- 172.21.15.87:0/213486563 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd1cc067500 con 0x7fd1cc070d00 2023-12-16T20:50:52.201 INFO:tasks.ceph.mds.f.smithi195.stderr:==00:00:29:30.818 92530== 2023-12-16T20:50:52.201 INFO:tasks.ceph.mds.f.smithi195.stderr:==00:00:29:30.818 92530== Exit program on first error (--exit-on-first-error=yes) 2023-12-16T20:50:52.383 INFO:tasks.ceph.mds.f.smithi195.stderr:daemon-helper: command failed with exit status 42 2023-12-16T20:50:52.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:52.905+0000 7fd1c27fc640 1 -- 172.21.15.87:0/213486563 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd1c8034070 con 0x7fd1cc070d00 2023-12-16T20:50:52.908 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:52.907+0000 7fd1d3f73640 1 -- 172.21.15.87:0/213486563 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd1b006ae90 msgr2=0x7fd1b006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:52.908 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:52.907+0000 7fd1d3f73640 1 --2- 172.21.15.87:0/213486563 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd1b006ae90 0x7fd1b006d350 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0b1ff0 tx=0x7fd1bc006c90 comp rx=0 tx=0).stop 2023-12-16T20:50:52.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:52.907+0000 7fd1d3f73640 1 -- 172.21.15.87:0/213486563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1cc070d00 msgr2=0x7fd1cc14e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:52.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:52.907+0000 7fd1d3f73640 1 --2- 172.21.15.87:0/213486563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1cc070d00 0x7fd1cc14e9f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009990 tx=0x7fd1c8004730 comp rx=0 tx=0).stop 2023-12-16T20:50:52.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:52.908+0000 7fd1d3f73640 1 -- 172.21.15.87:0/213486563 shutdown_connections 2023-12-16T20:50:52.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:52.908+0000 7fd1d3f73640 1 --2- 172.21.15.87:0/213486563 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1cc0c7700 0x7fd1cc0c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:52.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:52.908+0000 7fd1d3f73640 1 --2- 172.21.15.87:0/213486563 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd1b006ae90 0x7fd1b006d350 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:52.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:52.908+0000 7fd1d3f73640 1 --2- 172.21.15.87:0/213486563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1cc0710e0 0x7fd1cc0c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:52.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:52.908+0000 7fd1d3f73640 1 --2- 172.21.15.87:0/213486563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1cc070d00 0x7fd1cc14e9f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:52.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:52.908+0000 7fd1d3f73640 1 -- 172.21.15.87:0/213486563 >> 172.21.15.87:0/213486563 conn(0x7fd1cc06ab30 msgr2=0x7fd1cc152c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:52.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:52.908+0000 7fd1d3f73640 1 -- 172.21.15.87:0/213486563 shutdown_connections 2023-12-16T20:50:52.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:52.908+0000 7fd1d3f73640 1 -- 172.21.15.87:0/213486563 wait complete. 2023-12-16T20:50:52.919 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-16T20:50:53.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.023+0000 7f9647e44640 1 Processor -- start 2023-12-16T20:50:53.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.023+0000 7f9647e44640 1 -- start start 2023-12-16T20:50:53.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.024+0000 7f9647e44640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f964015aa50 0x7f964015d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:53.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.024+0000 7f9647e44640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964006b970 con 0x7f96400cafa0 2023-12-16T20:50:53.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.024+0000 7f9647e44640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96400cb600 con 0x7f9640153900 2023-12-16T20:50:53.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.024+0000 7f9647e44640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9640153ce0 con 0x7f964015aa50 2023-12-16T20:50:53.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.025+0000 7f96463e1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f964015aa50 0x7f964015d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:53.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.025+0000 7f9645be0640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f9640153900 0x7f964006c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.87:59182/0 (socket says 172.21.15.87:59182) 2023-12-16T20:50:53.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.025+0000 7f9645be0640 1 -- 172.21.15.87:0/1655203813 learned_addr learned my addr 172.21.15.87:0/1655203813 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:50:53.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.027+0000 7f9644bde640 1 -- 172.21.15.87:0/1655203813 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437892875 0 0) 0x7f96400cb600 con 0x7f9640153900 2023-12-16T20:50:53.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.027+0000 7f9644bde640 1 -- 172.21.15.87:0/1655203813 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f962c003520 con 0x7f9640153900 2023-12-16T20:50:53.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.028+0000 7f96463e1640 1 -- 172.21.15.87:0/1655203813 >> v1:172.21.15.195:6789/0 conn(0x7f9640153900 legacy=0x7f964006c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:53.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.028+0000 7f96463e1640 1 -- 172.21.15.87:0/1655203813 >> v1:172.21.15.87:6789/0 conn(0x7f96400cafa0 legacy=0x7f96400cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:53.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.028+0000 7f96463e1640 1 -- 172.21.15.87:0/1655203813 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96400c9cc0 con 0x7f964015aa50 2023-12-16T20:50:53.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.032+0000 7f96463e1640 1 --2- 172.21.15.87:0/1655203813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f964015aa50 0x7f964015d530 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f96380097a0 tx=0x7f963802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67863e119ec6e85 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:53.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.036+0000 7f9644bde640 1 -- 172.21.15.87:0/1655203813 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9638030610 con 0x7f964015aa50 2023-12-16T20:50:53.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.036+0000 7f9644bde640 1 -- 172.21.15.87:0/1655203813 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9638030770 con 0x7f964015aa50 2023-12-16T20:50:53.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.036+0000 7f9644bde640 1 -- 172.21.15.87:0/1655203813 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9638030b20 con 0x7f964015aa50 2023-12-16T20:50:53.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.037+0000 7f9647e44640 1 -- 172.21.15.87:0/1655203813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f964015aa50 msgr2=0x7f964015d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:53.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.037+0000 7f9647e44640 1 --2- 172.21.15.87:0/1655203813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f964015aa50 0x7f964015d530 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f96380097a0 tx=0x7f963802b960 comp rx=0 tx=0).stop 2023-12-16T20:50:53.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.037+0000 7f9647e44640 1 -- 172.21.15.87:0/1655203813 shutdown_connections 2023-12-16T20:50:53.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.037+0000 7f9647e44640 1 --2- 172.21.15.87:0/1655203813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f964015aa50 0x7f964015d530 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:53.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.037+0000 7f9647e44640 1 -- 172.21.15.87:0/1655203813 >> 172.21.15.87:0/1655203813 conn(0x7f9640061100 msgr2=0x7f9640061510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:53.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.037+0000 7f9647e44640 1 -- 172.21.15.87:0/1655203813 shutdown_connections 2023-12-16T20:50:53.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.037+0000 7f9647e44640 1 -- 172.21.15.87:0/1655203813 wait complete. 2023-12-16T20:50:53.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.038+0000 7f9647e44640 1 Processor -- start 2023-12-16T20:50:53.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.038+0000 7f9647e44640 1 -- start start 2023-12-16T20:50:53.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.039+0000 7f9647e44640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96400cafa0 0x7f96400c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:53.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.039+0000 7f9647e44640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9640153900 0x7f96401f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:53.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.039+0000 7f9647e44640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f964015aa50 0x7f96401ef310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:53.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.039+0000 7f9647e44640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96400c7330 con 0x7f96400cafa0 2023-12-16T20:50:53.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.039+0000 7f9647e44640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96401f1ee0 con 0x7f9640153900 2023-12-16T20:50:53.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.039+0000 7f9647e44640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96401ef850 con 0x7f964015aa50 2023-12-16T20:50:53.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.040+0000 7f9645be0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96400cafa0 0x7f96400c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:53.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.040+0000 7f9645be0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96400cafa0 0x7f96400c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49364/0 (socket says 172.21.15.87:49364) 2023-12-16T20:50:53.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.040+0000 7f9645be0640 1 -- 172.21.15.87:0/2380816306 learned_addr learned my addr 172.21.15.87:0/2380816306 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:50:53.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.040+0000 7f96453df640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9640153900 0x7f96401f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:53.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.040+0000 7f96463e1640 1 --2- 172.21.15.87:0/2380816306 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f964015aa50 0x7f96401ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:53.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.043+0000 7f9645be0640 1 -- 172.21.15.87:0/2380816306 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f964015aa50 msgr2=0x7f96401ef310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:53.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.043+0000 7f9645be0640 1 --2- 172.21.15.87:0/2380816306 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f964015aa50 0x7f96401ef310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:53.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.043+0000 7f9645be0640 1 -- 172.21.15.87:0/2380816306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9640153900 msgr2=0x7f96401f2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:53.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.043+0000 7f9645be0640 1 --2- 172.21.15.87:0/2380816306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9640153900 0x7f96401f2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:53.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.043+0000 7f9645be0640 1 -- 172.21.15.87:0/2380816306 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9638009400 con 0x7f96400cafa0 2023-12-16T20:50:53.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.045+0000 7f9645be0640 1 --2- 172.21.15.87:0/2380816306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96400cafa0 0x7f96400c6310 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f963c00cbf0 tx=0x7f963c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.048+0000 7f96367fc640 1 -- 172.21.15.87:0/2380816306 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c00ad40 con 0x7f96400cafa0 2023-12-16T20:50:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.049+0000 7f96367fc640 1 -- 172.21.15.87:0/2380816306 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f963c012400 con 0x7f96400cafa0 2023-12-16T20:50:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.049+0000 7f9647e44640 1 -- 172.21.15.87:0/2380816306 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96400c7ba0 con 0x7f96400cafa0 2023-12-16T20:50:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.049+0000 7f96367fc640 1 -- 172.21.15.87:0/2380816306 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c00aea0 con 0x7f96400cafa0 2023-12-16T20:50:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.049+0000 7f9647e44640 1 -- 172.21.15.87:0/2380816306 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96401f2150 con 0x7f96400cafa0 2023-12-16T20:50:53.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.050+0000 7f9647e44640 1 -- 172.21.15.87:0/2380816306 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96400c52e0 con 0x7f96400cafa0 2023-12-16T20:50:53.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.289+0000 7f96367fc640 1 -- 172.21.15.87:0/2380816306 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7f963c007070 con 0x7f96400cafa0 2023-12-16T20:50:53.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.289+0000 7f96367fc640 1 --2- 172.21.15.87:0/2380816306 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f962406aec0 0x7f962406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:53.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.290+0000 7f96453df640 1 --2- 172.21.15.87:0/2380816306 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f962406aec0 0x7f962406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:53.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.290+0000 7f96453df640 1 --2- 172.21.15.87:0/2380816306 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f962406aec0 0x7f962406d380 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f96400c4910 tx=0x7f9630009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:53.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.302+0000 7f96367fc640 1 -- 172.21.15.87:0/2380816306 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f963c0588f0 con 0x7f96400cafa0 2023-12-16T20:50:53.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.302+0000 7f96367fc640 1 -- 172.21.15.87:0/2380816306 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7f963c054ba0 con 0x7f96400cafa0 2023-12-16T20:50:53.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.468+0000 7f9647e44640 1 -- 172.21.15.87:0/2380816306 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f96400ca6f0 con 0x7f96400cafa0 2023-12-16T20:50:53.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.932+0000 7f96367fc640 1 -- 172.21.15.87:0/2380816306 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f963c017030 con 0x7f96400cafa0 2023-12-16T20:50:53.933 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_metadata' removed 2023-12-16T20:50:53.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.934+0000 7f9647e44640 1 -- 172.21.15.87:0/2380816306 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f962406aec0 msgr2=0x7f962406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:53.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.934+0000 7f9647e44640 1 --2- 172.21.15.87:0/2380816306 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f962406aec0 0x7f962406d380 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f96400c4910 tx=0x7f9630009040 comp rx=0 tx=0).stop 2023-12-16T20:50:53.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.934+0000 7f9647e44640 1 -- 172.21.15.87:0/2380816306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96400cafa0 msgr2=0x7f96400c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:53.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.934+0000 7f9647e44640 1 --2- 172.21.15.87:0/2380816306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96400cafa0 0x7f96400c6310 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f963c00cbf0 tx=0x7f963c00a430 comp rx=0 tx=0).stop 2023-12-16T20:50:53.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.934+0000 7f9647e44640 1 -- 172.21.15.87:0/2380816306 shutdown_connections 2023-12-16T20:50:53.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.934+0000 7f9647e44640 1 --2- 172.21.15.87:0/2380816306 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f964015aa50 0x7f96401ef310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:53.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.934+0000 7f9647e44640 1 --2- 172.21.15.87:0/2380816306 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7f962406aec0 0x7f962406d380 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:53.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.934+0000 7f9647e44640 1 --2- 172.21.15.87:0/2380816306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9640153900 0x7f96401f2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:53.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.934+0000 7f9647e44640 1 --2- 172.21.15.87:0/2380816306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96400cafa0 0x7f96400c6310 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:53.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.934+0000 7f9647e44640 1 -- 172.21.15.87:0/2380816306 >> 172.21.15.87:0/2380816306 conn(0x7f9640061100 msgr2=0x7f96400cbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:53.937 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.935+0000 7f9647e44640 1 -- 172.21.15.87:0/2380816306 shutdown_connections 2023-12-16T20:50:53.937 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:53.935+0000 7f9647e44640 1 -- 172.21.15.87:0/2380816306 wait complete. 2023-12-16T20:50:53.949 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-16T20:50:54.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.056+0000 7ff273215640 1 Processor -- start 2023-12-16T20:50:54.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.056+0000 7ff273215640 1 -- start start 2023-12-16T20:50:54.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.057+0000 7ff273215640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff26c0c9200 0x7ff26c0ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:54.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.057+0000 7ff273215640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff26c070990 0x7ff26c070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:54.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.057+0000 7ff273215640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26c0ca6a0 con 0x7ff26c151530 2023-12-16T20:50:54.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.057+0000 7ff273215640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26c15b4e0 con 0x7ff26c0c9200 2023-12-16T20:50:54.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.057+0000 7ff273215640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26c15b7a0 con 0x7ff26c070990 2023-12-16T20:50:54.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.065+0000 7ff2717b2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff26c070990 0x7ff26c070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:54.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.065+0000 7ff26bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff26c0c9200 0x7ff26c0ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:54.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.065+0000 7ff2717b2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff26c070990 0x7ff26c070de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.87:49918/0 (socket says 172.21.15.87:49918) 2023-12-16T20:50:54.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.065+0000 7ff2717b2640 1 -- 172.21.15.87:0/1037629056 learned_addr learned my addr 172.21.15.87:0/1037629056 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:50:54.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.069+0000 7ff2717b2640 1 -- 172.21.15.87:0/1037629056 >> v2:172.21.15.87:3300/0 conn(0x7ff26c0c9200 msgr2=0x7ff26c0ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T20:50:54.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.069+0000 7ff2717b2640 1 --2- 172.21.15.87:0/1037629056 >> v2:172.21.15.87:3300/0 conn(0x7ff26c0c9200 0x7ff26c0ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:54.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.069+0000 7ff2717b2640 1 -- 172.21.15.87:0/1037629056 >> v1:172.21.15.87:6789/0 conn(0x7ff26c151530 legacy=0x7ff26c0c1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:54.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.069+0000 7ff2717b2640 1 -- 172.21.15.87:0/1037629056 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c157690 con 0x7ff26c070990 2023-12-16T20:50:54.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.071+0000 7ff2717b2640 1 --2- 172.21.15.87:0/1037629056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff26c070990 0x7ff26c070de0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0ca0f0 tx=0x7ff26402bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53bf63faa57d7269 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:54.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.075+0000 7ff26b7fe640 1 -- 172.21.15.87:0/1037629056 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26402cb20 con 0x7ff26c070990 2023-12-16T20:50:54.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.075+0000 7ff26b7fe640 1 -- 172.21.15.87:0/1037629056 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff26402cc80 con 0x7ff26c070990 2023-12-16T20:50:54.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.075+0000 7ff26b7fe640 1 -- 172.21.15.87:0/1037629056 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2640343f0 con 0x7ff26c070990 2023-12-16T20:50:54.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.076+0000 7ff273215640 1 -- 172.21.15.87:0/1037629056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff26c070990 msgr2=0x7ff26c070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:54.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.076+0000 7ff273215640 1 --2- 172.21.15.87:0/1037629056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff26c070990 0x7ff26c070de0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0ca0f0 tx=0x7ff26402bf80 comp rx=0 tx=0).stop 2023-12-16T20:50:54.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.076+0000 7ff273215640 1 -- 172.21.15.87:0/1037629056 shutdown_connections 2023-12-16T20:50:54.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.076+0000 7ff273215640 1 --2- 172.21.15.87:0/1037629056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff26c070990 0x7ff26c070de0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:54.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.076+0000 7ff273215640 1 --2- 172.21.15.87:0/1037629056 >> v2:172.21.15.87:3300/0 conn(0x7ff26c0c9200 0x7ff26c0ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:54.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.076+0000 7ff273215640 1 -- 172.21.15.87:0/1037629056 >> 172.21.15.87:0/1037629056 conn(0x7ff26c06ab30 msgr2=0x7ff26c06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:54.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.076+0000 7ff273215640 1 -- 172.21.15.87:0/1037629056 shutdown_connections 2023-12-16T20:50:54.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.076+0000 7ff273215640 1 -- 172.21.15.87:0/1037629056 wait complete. 2023-12-16T20:50:54.078 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.077+0000 7ff273215640 1 Processor -- start 2023-12-16T20:50:54.078 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.077+0000 7ff273215640 1 -- start start 2023-12-16T20:50:54.079 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.078+0000 7ff273215640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff26c070990 0x7ff26c14c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:54.079 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.078+0000 7ff273215640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff26c0c9200 0x7ff26c0c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:54.079 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.078+0000 7ff273215640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff26c151530 0x7ff26c0cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:54.079 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.078+0000 7ff273215640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c1f03c0 con 0x7ff26c070990 2023-12-16T20:50:54.079 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.078+0000 7ff273215640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c14a8b0 con 0x7ff26c0c9200 2023-12-16T20:50:54.079 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.078+0000 7ff273215640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c1eca00 con 0x7ff26c151530 2023-12-16T20:50:54.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.079+0000 7ff2717b2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff26c151530 0x7ff26c0cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:54.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.079+0000 7ff26bfff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff26c0c9200 0x7ff26c0c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:54.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.079+0000 7ff2717b2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff26c151530 0x7ff26c0cbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:60618/0 (socket says 172.21.15.87:60618) 2023-12-16T20:50:54.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.079+0000 7ff2717b2640 1 -- 172.21.15.87:0/3645875214 learned_addr learned my addr 172.21.15.87:0/3645875214 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:50:54.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.082+0000 7ff26bfff640 1 -- 172.21.15.87:0/3645875214 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff26c151530 msgr2=0x7ff26c0cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:54.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.082+0000 7ff26bfff640 1 --2- 172.21.15.87:0/3645875214 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff26c151530 0x7ff26c0cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:54.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.082+0000 7ff26bfff640 1 -- 172.21.15.87:0/3645875214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff26c070990 msgr2=0x7ff26c14c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:54.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.082+0000 7ff26bfff640 1 --2- 172.21.15.87:0/3645875214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff26c070990 0x7ff26c14c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:54.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.082+0000 7ff26bfff640 1 -- 172.21.15.87:0/3645875214 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff264009b30 con 0x7ff26c0c9200 2023-12-16T20:50:54.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.085+0000 7ff26bfff640 1 --2- 172.21.15.87:0/3645875214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff26c0c9200 0x7ff26c0c5630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff25800e880 tx=0x7ff25800ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:54.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.088+0000 7ff2697fa640 1 -- 172.21.15.87:0/3645875214 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25800c940 con 0x7ff26c0c9200 2023-12-16T20:50:54.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.088+0000 7ff2697fa640 1 -- 172.21.15.87:0/3645875214 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff25800caa0 con 0x7ff26c0c9200 2023-12-16T20:50:54.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.088+0000 7ff273215640 1 -- 172.21.15.87:0/3645875214 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26c1f0100 con 0x7ff26c0c9200 2023-12-16T20:50:54.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.088+0000 7ff2697fa640 1 -- 172.21.15.87:0/3645875214 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25800ce70 con 0x7ff26c0c9200 2023-12-16T20:50:54.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.088+0000 7ff273215640 1 -- 172.21.15.87:0/3645875214 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26c1ecef0 con 0x7ff26c0c9200 2023-12-16T20:50:54.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.089+0000 7ff273215640 1 -- 172.21.15.87:0/3645875214 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26c067570 con 0x7ff26c0c9200 2023-12-16T20:50:54.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.107+0000 7ff2697fa640 1 -- 172.21.15.87:0/3645875214 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7ff258013470 con 0x7ff26c0c9200 2023-12-16T20:50:54.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.108+0000 7ff2697fa640 1 --2- 172.21.15.87:0/3645875214 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff25006ae90 0x7ff25006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:54.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.108+0000 7ff270fb1640 1 --2- 172.21.15.87:0/3645875214 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff25006ae90 0x7ff25006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:54.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.108+0000 7ff270fb1640 1 --2- 172.21.15.87:0/3645875214 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff25006ae90 0x7ff25006d350 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff260000f60 tx=0x7ff2600079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:54.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.330+0000 7ff2697fa640 1 -- 172.21.15.87:0/3645875214 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6340+0+0 (secure 0 0 0) 0x7ff258058e00 con 0x7ff26c0c9200 2023-12-16T20:50:54.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.340+0000 7ff2697fa640 1 -- 172.21.15.87:0/3645875214 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7ff2580550b0 con 0x7ff26c0c9200 2023-12-16T20:50:54.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:54.506+0000 7ff273215640 1 -- 172.21.15.87:0/3645875214 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff26c158070 con 0x7ff26c0c9200 2023-12-16T20:50:55.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2023-12-16T20:50:55.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.326+0000 7ff2697fa640 1 -- 172.21.15.87:0/3645875214 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff258021020 con 0x7ff26c0c9200 2023-12-16T20:50:55.326 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data' removed 2023-12-16T20:50:55.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.327+0000 7ff273215640 1 -- 172.21.15.87:0/3645875214 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff25006ae90 msgr2=0x7ff25006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:55.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.327+0000 7ff273215640 1 --2- 172.21.15.87:0/3645875214 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff25006ae90 0x7ff25006d350 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff260000f60 tx=0x7ff2600079b0 comp rx=0 tx=0).stop 2023-12-16T20:50:55.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.327+0000 7ff273215640 1 -- 172.21.15.87:0/3645875214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff26c0c9200 msgr2=0x7ff26c0c5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:55.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.327+0000 7ff273215640 1 --2- 172.21.15.87:0/3645875214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff26c0c9200 0x7ff26c0c5630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff25800e880 tx=0x7ff25800ed40 comp rx=0 tx=0).stop 2023-12-16T20:50:55.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.327+0000 7ff273215640 1 -- 172.21.15.87:0/3645875214 shutdown_connections 2023-12-16T20:50:55.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.327+0000 7ff273215640 1 --2- 172.21.15.87:0/3645875214 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff26c151530 0x7ff26c0cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:55.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.327+0000 7ff273215640 1 --2- 172.21.15.87:0/3645875214 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7ff25006ae90 0x7ff25006d350 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:55.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.327+0000 7ff273215640 1 --2- 172.21.15.87:0/3645875214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff26c0c9200 0x7ff26c0c5630 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:55.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.327+0000 7ff273215640 1 --2- 172.21.15.87:0/3645875214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff26c070990 0x7ff26c14c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:55.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.327+0000 7ff273215640 1 -- 172.21.15.87:0/3645875214 >> 172.21.15.87:0/3645875214 conn(0x7ff26c06ab30 msgr2=0x7ff26c073850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:55.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.327+0000 7ff273215640 1 -- 172.21.15.87:0/3645875214 shutdown_connections 2023-12-16T20:50:55.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.327+0000 7ff273215640 1 -- 172.21.15.87:0/3645875214 wait complete. 2023-12-16T20:50:55.339 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-16T20:50:55.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.442+0000 7fd0df7c9640 1 Processor -- start 2023-12-16T20:50:55.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.442+0000 7fd0df7c9640 1 -- start start 2023-12-16T20:50:55.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.443+0000 7fd0df7c9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d8072530 0x7fd0d80c7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:55.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.443+0000 7fd0df7c9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d8150a80 con 0x7fd0d81506a0 2023-12-16T20:50:55.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.443+0000 7fd0df7c9640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d80c6870 con 0x7fd0d80bff00 2023-12-16T20:50:55.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.443+0000 7fd0df7c9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d8071dd0 con 0x7fd0d8072530 2023-12-16T20:50:55.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.443+0000 7fd0dd565640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd0d81506a0 0x7fd0d80cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:52630/0 (socket says 172.21.15.87:52630) 2023-12-16T20:50:55.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.443+0000 7fd0dd565640 1 -- 172.21.15.87:0/3983299990 learned_addr learned my addr 172.21.15.87:0/3983299990 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-12-16T20:50:55.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.443+0000 7fd0ddd66640 1 --2- 172.21.15.87:0/3983299990 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d8072530 0x7fd0d80c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:55.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.446+0000 7fd0cffff640 1 -- 172.21.15.87:0/3983299990 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194946326 0 0) 0x7fd0d8150a80 con 0x7fd0d81506a0 2023-12-16T20:50:55.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.446+0000 7fd0cffff640 1 -- 172.21.15.87:0/3983299990 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0c4003520 con 0x7fd0d81506a0 2023-12-16T20:50:55.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.446+0000 7fd0ddd66640 1 -- 172.21.15.87:0/3983299990 >> v1:172.21.15.195:6789/0 conn(0x7fd0d80bff00 legacy=0x7fd0d815ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:55.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.446+0000 7fd0ddd66640 1 -- 172.21.15.87:0/3983299990 >> v1:172.21.15.87:6789/0 conn(0x7fd0d81506a0 legacy=0x7fd0d80cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:55.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.446+0000 7fd0ddd66640 1 -- 172.21.15.87:0/3983299990 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d80c6b10 con 0x7fd0d8072530 2023-12-16T20:50:55.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.448+0000 7fd0ddd66640 1 --2- 172.21.15.87:0/3983299990 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d8072530 0x7fd0d80c7310 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009dc0 tx=0x7fd0d002be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97534d535ea8fec server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:55.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.452+0000 7fd0cffff640 1 -- 172.21.15.87:0/3983299990 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d002cc40 con 0x7fd0d8072530 2023-12-16T20:50:55.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.452+0000 7fd0cffff640 1 -- 172.21.15.87:0/3983299990 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd0d002cda0 con 0x7fd0d8072530 2023-12-16T20:50:55.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.452+0000 7fd0cffff640 1 -- 172.21.15.87:0/3983299990 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0034680 con 0x7fd0d8072530 2023-12-16T20:50:55.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.452+0000 7fd0df7c9640 1 -- 172.21.15.87:0/3983299990 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d8072530 msgr2=0x7fd0d80c7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:55.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.452+0000 7fd0df7c9640 1 --2- 172.21.15.87:0/3983299990 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d8072530 0x7fd0d80c7310 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009dc0 tx=0x7fd0d002be90 comp rx=0 tx=0).stop 2023-12-16T20:50:55.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.452+0000 7fd0df7c9640 1 -- 172.21.15.87:0/3983299990 shutdown_connections 2023-12-16T20:50:55.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.452+0000 7fd0df7c9640 1 --2- 172.21.15.87:0/3983299990 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d8072530 0x7fd0d80c7310 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:55.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.452+0000 7fd0df7c9640 1 -- 172.21.15.87:0/3983299990 >> 172.21.15.87:0/3983299990 conn(0x7fd0d806cd60 msgr2=0x7fd0d806d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:55.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.452+0000 7fd0df7c9640 1 -- 172.21.15.87:0/3983299990 shutdown_connections 2023-12-16T20:50:55.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.452+0000 7fd0df7c9640 1 -- 172.21.15.87:0/3983299990 wait complete. 2023-12-16T20:50:55.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.454+0000 7fd0df7c9640 1 Processor -- start 2023-12-16T20:50:55.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.454+0000 7fd0df7c9640 1 -- start start 2023-12-16T20:50:55.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.454+0000 7fd0df7c9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0d8072530 0x7fd0d8153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:55.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.454+0000 7fd0df7c9640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d80bff00 0x7fd0d814b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:55.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.454+0000 7fd0df7c9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0d81506a0 0x7fd0d814f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:55.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.454+0000 7fd0df7c9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d8157ef0 con 0x7fd0d8072530 2023-12-16T20:50:55.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.454+0000 7fd0df7c9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d8150c30 con 0x7fd0d81506a0 2023-12-16T20:50:55.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.454+0000 7fd0df7c9640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d8151440 con 0x7fd0d80bff00 2023-12-16T20:50:55.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.455+0000 7fd0dd565640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0d8072530 0x7fd0d8153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:55.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.455+0000 7fd0dcd64640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d80bff00 0x7fd0d814b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:55.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.455+0000 7fd0ddd66640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0d81506a0 0x7fd0d814f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:55.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.455+0000 7fd0dcd64640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d80bff00 0x7fd0d814b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.87:60632/0 (socket says 172.21.15.87:60632) 2023-12-16T20:50:55.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.455+0000 7fd0dcd64640 1 -- 172.21.15.87:0/164511562 learned_addr learned my addr 172.21.15.87:0/164511562 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-12-16T20:50:55.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.458+0000 7fd0dd565640 1 -- 172.21.15.87:0/164511562 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d80bff00 msgr2=0x7fd0d814b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:55.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.458+0000 7fd0dd565640 1 --2- 172.21.15.87:0/164511562 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d80bff00 0x7fd0d814b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:55.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.458+0000 7fd0dd565640 1 -- 172.21.15.87:0/164511562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0d81506a0 msgr2=0x7fd0d814f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:55.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.458+0000 7fd0dd565640 1 --2- 172.21.15.87:0/164511562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0d81506a0 0x7fd0d814f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:55.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.458+0000 7fd0dd565640 1 -- 172.21.15.87:0/164511562 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d0009a70 con 0x7fd0d8072530 2023-12-16T20:50:55.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.460+0000 7fd0dd565640 1 --2- 172.21.15.87:0/164511562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0d8072530 0x7fd0d8153820 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400c3c0 tx=0x7fd0d4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:55.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.463+0000 7fd0cdffb640 1 -- 172.21.15.87:0/164511562 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4005ce0 con 0x7fd0d8072530 2023-12-16T20:50:55.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.463+0000 7fd0cdffb640 1 -- 172.21.15.87:0/164511562 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd0d4005e40 con 0x7fd0d8072530 2023-12-16T20:50:55.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.463+0000 7fd0df7c9640 1 -- 172.21.15.87:0/164511562 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d8158d40 con 0x7fd0d8072530 2023-12-16T20:50:55.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.464+0000 7fd0cdffb640 1 -- 172.21.15.87:0/164511562 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40072f0 con 0x7fd0d8072530 2023-12-16T20:50:55.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.464+0000 7fd0df7c9640 1 -- 172.21.15.87:0/164511562 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d8151160 con 0x7fd0d8072530 2023-12-16T20:50:55.465 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.465+0000 7fd0df7c9640 1 -- 172.21.15.87:0/164511562 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d806ee60 con 0x7fd0d8072530 2023-12-16T20:50:55.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.482+0000 7fd0cdffb640 1 -- 172.21.15.87:0/164511562 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 89233+0+0 (secure 0 0 0) 0x7fd0d4007450 con 0x7fd0d8072530 2023-12-16T20:50:55.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.483+0000 7fd0cdffb640 1 --2- 172.21.15.87:0/164511562 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd0bc06aec0 0x7fd0bc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T20:50:55.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.483+0000 7fd0dcd64640 1 --2- 172.21.15.87:0/164511562 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd0bc06aec0 0x7fd0bc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T20:50:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.483+0000 7fd0dcd64640 1 --2- 172.21.15.87:0/164511562 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd0bc06aec0 0x7fd0bc06d380 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8150040 tx=0x7fd0c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T20:50:55.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.717+0000 7fd0cdffb640 1 -- 172.21.15.87:0/164511562 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5781+0+0 (secure 0 0 0) 0x7fd0d4057de0 con 0x7fd0d8072530 2023-12-16T20:50:55.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.717+0000 7fd0cdffb640 1 -- 172.21.15.87:0/164511562 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (secure 0 0 0) 0x7fd0d4054120 con 0x7fd0d8072530 2023-12-16T20:50:55.890 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:55.889+0000 7fd0df7c9640 1 -- 172.21.15.87:0/164511562 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd0d80c1f80 con 0x7fd0d8072530 2023-12-16T20:50:56.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:56.278+0000 7fd0cdffb640 1 -- 172.21.15.87:0/164511562 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7fd0d4057740 con 0x7fd0d8072530 2023-12-16T20:50:56.279 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data_ec' removed 2023-12-16T20:50:56.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:56.281+0000 7fd0df7c9640 1 -- 172.21.15.87:0/164511562 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd0bc06aec0 msgr2=0x7fd0bc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:56.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:56.281+0000 7fd0df7c9640 1 --2- 172.21.15.87:0/164511562 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd0bc06aec0 0x7fd0bc06d380 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8150040 tx=0x7fd0c8009040 comp rx=0 tx=0).stop 2023-12-16T20:50:56.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:56.281+0000 7fd0df7c9640 1 -- 172.21.15.87:0/164511562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0d8072530 msgr2=0x7fd0d8153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T20:50:56.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:56.281+0000 7fd0df7c9640 1 --2- 172.21.15.87:0/164511562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0d8072530 0x7fd0d8153820 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400c3c0 tx=0x7fd0d4001e70 comp rx=0 tx=0).stop 2023-12-16T20:50:56.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:56.281+0000 7fd0df7c9640 1 -- 172.21.15.87:0/164511562 shutdown_connections 2023-12-16T20:50:56.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:56.281+0000 7fd0df7c9640 1 --2- 172.21.15.87:0/164511562 >> [v2:172.21.15.87:6800/748553150,v1:172.21.15.87:6801/748553150] conn(0x7fd0bc06aec0 0x7fd0bc06d380 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:56.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:56.281+0000 7fd0df7c9640 1 --2- 172.21.15.87:0/164511562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0d81506a0 0x7fd0d814f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:56.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:56.281+0000 7fd0df7c9640 1 --2- 172.21.15.87:0/164511562 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd0d80bff00 0x7fd0d814b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:56.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:56.281+0000 7fd0df7c9640 1 --2- 172.21.15.87:0/164511562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0d8072530 0x7fd0d8153820 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T20:50:56.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:56.281+0000 7fd0df7c9640 1 -- 172.21.15.87:0/164511562 >> 172.21.15.87:0/164511562 conn(0x7fd0d806cd60 msgr2=0x7fd0d8156d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T20:50:56.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:56.281+0000 7fd0df7c9640 1 -- 172.21.15.87:0/164511562 shutdown_connections 2023-12-16T20:50:56.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-12-16T20:50:56.281+0000 7fd0df7c9640 1 -- 172.21.15.87:0/164511562 wait complete. 2023-12-16T20:50:56.295 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-16T20:50:56.296 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-16T20:50:56.296 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:50:56.309 INFO:tasks.ceph.mds.a.smithi087.stderr:2023-12-16T20:50:56.299+0000 b5b0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 92618) UID: 0 2023-12-16T20:50:56.310 INFO:tasks.ceph.mds.a.smithi087.stderr:2023-12-16T20:50:56.301+0000 b5b0640 -1 mds.a *** got signal Terminated *** 2023-12-16T20:50:58.745 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:50:58.748 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:51:01.806 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-12-16T20:51:01.806 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~7s 2023-12-16T20:51:02.397 INFO:tasks.ceph.mds.a:Stopped 2023-12-16T20:51:02.400 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-16T20:51:02.400 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:51:02.416 INFO:tasks.ceph.mds.c.smithi087.stderr:2023-12-16T20:51:02.403+0000 b5b0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c (PID: 92622) UID: 0 2023-12-16T20:51:02.416 INFO:tasks.ceph.mds.c.smithi087.stderr:2023-12-16T20:51:02.405+0000 b5b0640 -1 mds.c *** got signal Terminated *** 2023-12-16T20:51:08.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-12-16T20:51:08.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~14s 2023-12-16T20:51:08.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-12-16T20:51:08.501 INFO:tasks.ceph.mds.c:Stopped 2023-12-16T20:51:08.502 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-12-16T20:51:08.502 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:51:08.517 INFO:tasks.ceph.mds.e.smithi087.stderr:2023-12-16T20:51:08.506+0000 b5b0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e (PID: 92624) UID: 0 2023-12-16T20:51:08.518 INFO:tasks.ceph.mds.e.smithi087.stderr:2023-12-16T20:51:08.508+0000 b5b0640 -1 mds.e *** got signal Terminated *** 2023-12-16T20:51:14.603 INFO:tasks.ceph.mds.e:Stopped 2023-12-16T20:51:14.604 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-16T20:51:14.604 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:51:14.619 INFO:tasks.ceph.mds.b.smithi195.stderr:2023-12-16T20:51:14.607+0000 b5b0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 92522) UID: 0 2023-12-16T20:51:14.620 INFO:tasks.ceph.mds.b.smithi195.stderr:2023-12-16T20:51:14.609+0000 b5b0640 -1 mds.b *** got signal Terminated *** 2023-12-16T20:51:14.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2023-12-16T20:51:14.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~20s 2023-12-16T20:51:14.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-12-16T20:51:20.706 INFO:tasks.ceph.mds.b:Stopped 2023-12-16T20:51:20.706 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-16T20:51:20.706 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:51:20.727 INFO:tasks.ceph.mds.d.smithi195.stderr:2023-12-16T20:51:20.711+0000 b5b0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d (PID: 92523) UID: 0 2023-12-16T20:51:20.728 INFO:tasks.ceph.mds.d.smithi195.stderr:2023-12-16T20:51:20.713+0000 b5b0640 -1 mds.d *** got signal Terminated *** 2023-12-16T20:51:21.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~27s 2023-12-16T20:51:21.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2023-12-16T20:51:27.752 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~33s 2023-12-16T20:51:28.835 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:51:28.837 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:51:32.911 INFO:tasks.ceph.mds.d:Stopped 2023-12-16T20:51:32.911 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2023-12-16T20:51:32.911 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:51:32.911 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-16T20:51:32.911 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi195 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f" 2023-12-16T20:51:32.912 INFO:tasks.ceph.mds.f:Stopped 2023-12-16T20:51:32.912 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-16T20:51:32.913 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-16T20:51:32.913 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:51:32.914 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-12-16T20:51:32.913+0000 7fad5540e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 88791) UID: 0 2023-12-16T20:51:32.914 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-12-16T20:51:32.913+0000 7fad5540e640 -1 osd.0 36 *** Got signal Terminated *** 2023-12-16T20:51:34.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2023-12-16T20:51:39.014 INFO:tasks.ceph.osd.0:Stopped 2023-12-16T20:51:39.014 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-16T20:51:39.015 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:51:39.015 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-12-16T20:51:39.015+0000 7f3d4c872640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 88799) UID: 0 2023-12-16T20:51:39.015 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-12-16T20:51:39.015+0000 7f3d4c872640 -1 osd.1 38 *** Got signal Terminated *** 2023-12-16T20:51:45.116 INFO:tasks.ceph.osd.1:Stopped 2023-12-16T20:51:45.117 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-16T20:51:45.117 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:51:45.118 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-12-16T20:51:45.118+0000 7f271708b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 88802) UID: 0 2023-12-16T20:51:45.118 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-12-16T20:51:45.118+0000 7f271708b640 -1 osd.2 39 *** Got signal Terminated *** 2023-12-16T20:51:51.218 INFO:tasks.ceph.osd.2:Stopped 2023-12-16T20:51:51.219 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-16T20:51:51.219 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:51:51.220 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-12-16T20:51:51.219+0000 7fbc37601640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 88806) UID: 0 2023-12-16T20:51:51.220 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-12-16T20:51:51.219+0000 7fbc37601640 -1 osd.3 40 *** Got signal Terminated *** 2023-12-16T20:51:57.321 INFO:tasks.ceph.osd.3:Stopped 2023-12-16T20:51:57.321 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-16T20:51:57.321 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:51:57.322 INFO:tasks.ceph.osd.4.smithi195.stderr:2023-12-16T20:51:57.322+0000 7f7c13b50640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 89010) UID: 0 2023-12-16T20:51:57.322 INFO:tasks.ceph.osd.4.smithi195.stderr:2023-12-16T20:51:57.322+0000 7f7c13b50640 -1 osd.4 41 *** Got signal Terminated *** 2023-12-16T20:51:58.975 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:51:58.978 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:52:03.423 INFO:tasks.ceph.osd.4:Stopped 2023-12-16T20:52:03.424 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-16T20:52:03.424 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:52:03.425 INFO:tasks.ceph.osd.5.smithi195.stderr:2023-12-16T20:52:03.425+0000 7fc8bfa25640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 89014) UID: 0 2023-12-16T20:52:03.425 INFO:tasks.ceph.osd.5.smithi195.stderr:2023-12-16T20:52:03.425+0000 7fc8bfa25640 -1 osd.5 42 *** Got signal Terminated *** 2023-12-16T20:52:04.106 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-12-16T20:52:09.526 INFO:tasks.ceph.osd.5:Stopped 2023-12-16T20:52:09.526 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-16T20:52:09.526 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:52:09.527 INFO:tasks.ceph.osd.6.smithi195.stderr:2023-12-16T20:52:09.527+0000 7f77600ed640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 89016) UID: 0 2023-12-16T20:52:09.527 INFO:tasks.ceph.osd.6.smithi195.stderr:2023-12-16T20:52:09.527+0000 7f77600ed640 -1 osd.6 43 *** Got signal Terminated *** 2023-12-16T20:52:09.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-12-16T20:52:09.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-12-16T20:52:14.323 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:31:19.563 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:52:14.327 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:31:19.567 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:52:14.373 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:31:19.611 88517== Warning: unimplemented fcntl command: 1036 2023-12-16T20:52:14.389 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:31:19.582 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:52:14.390 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:31:19.585 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:52:14.424 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:31:19.618 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:52:14.425 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:31:19.620 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:52:14.438 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:31:19.633 88438== Warning: unimplemented fcntl command: 1036 2023-12-16T20:52:14.469 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:31:19.663 88439== Warning: unimplemented fcntl command: 1036 2023-12-16T20:52:15.417 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-12-16T20:52:15.417 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-12-16T20:52:15.628 INFO:tasks.ceph.osd.6:Stopped 2023-12-16T20:52:15.628 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-16T20:52:15.628 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:52:15.629 INFO:tasks.ceph.osd.7.smithi195.stderr:2023-12-16T20:52:15.628+0000 7f965c0ac640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 89018) UID: 0 2023-12-16T20:52:15.629 INFO:tasks.ceph.osd.7.smithi195.stderr:2023-12-16T20:52:15.628+0000 7f965c0ac640 -1 osd.7 43 *** Got signal Terminated *** 2023-12-16T20:52:20.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-12-16T20:52:20.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-12-16T20:52:21.730 INFO:tasks.ceph.osd.7:Stopped 2023-12-16T20:52:21.730 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-16T20:52:21.731 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-16T20:52:21.731 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:52:21.732 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-12-16T20:52:21.732+0000 7f320940e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 88543) UID: 0 2023-12-16T20:52:21.760 INFO:tasks.ceph.mgr.y:Stopped 2023-12-16T20:52:21.760 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-16T20:52:21.760 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:52:21.787 INFO:tasks.ceph.mgr.x:Stopped 2023-12-16T20:52:21.787 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-16T20:52:21.787 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-16T20:52:21.787 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:52:21.816 INFO:tasks.ceph.mon.a.smithi087.stderr:2023-12-16T20:52:21.804+0000 9f5a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 88507) UID: 0 2023-12-16T20:52:21.816 INFO:tasks.ceph.mon.a.smithi087.stderr:2023-12-16T20:52:21.806+0000 9f5a640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-16T20:52:22.292 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:31:27.533 88517== 2023-12-16T20:52:22.293 INFO:tasks.ceph.mon.a.smithi087.stderr:==00:00:31:27.533 88517== Exit program on first error (--exit-on-first-error=yes) 2023-12-16T20:52:22.305 INFO:tasks.ceph.mon.a.smithi087.stderr:daemon-helper: command failed with exit status 42 2023-12-16T20:52:26.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-12-16T20:52:26.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-12-16T20:52:27.889 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-16T20:52:27.889 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi087 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2023-12-16T20:52:27.890 INFO:tasks.ceph.mon.a:Stopped 2023-12-16T20:52:27.890 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-16T20:52:27.890 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:52:27.905 INFO:tasks.ceph.mon.b.smithi195.stderr:2023-12-16T20:52:27.894+0000 9f5a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 88431) UID: 0 2023-12-16T20:52:27.906 INFO:tasks.ceph.mon.b.smithi195.stderr:2023-12-16T20:52:27.896+0000 9f5a640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-12-16T20:52:28.488 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:31:33.683 88438== 2023-12-16T20:52:28.489 INFO:tasks.ceph.mon.b.smithi195.stderr:==00:00:31:33.683 88438== Exit program on first error (--exit-on-first-error=yes) 2023-12-16T20:52:28.500 INFO:tasks.ceph.mon.b.smithi195.stderr:daemon-helper: command failed with exit status 42 2023-12-16T20:52:29.059 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:52:29.062 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:52:31.227 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-12-16T20:52:31.227 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-12-16T20:52:33.992 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-16T20:52:33.992 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi195 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2023-12-16T20:52:33.993 INFO:tasks.ceph.mon.b:Stopped 2023-12-16T20:52:33.993 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-16T20:52:33.993 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T20:52:34.013 INFO:tasks.ceph.mon.c.smithi195.stderr:2023-12-16T20:52:33.997+0000 9f5a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 88433) UID: 0 2023-12-16T20:52:34.013 INFO:tasks.ceph.mon.c.smithi195.stderr:2023-12-16T20:52:33.999+0000 9f5a640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2023-12-16T20:52:34.641 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:31:39.836 88439== 2023-12-16T20:52:34.641 INFO:tasks.ceph.mon.c.smithi195.stderr:==00:00:31:39.836 88439== Exit program on first error (--exit-on-first-error=yes) 2023-12-16T20:52:34.652 INFO:tasks.ceph.mon.c.smithi195.stderr:daemon-helper: command failed with exit status 42 2023-12-16T20:52:36.228 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-12-16T20:52:36.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-12-16T20:52:40.094 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-16T20:52:40.094 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi195 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2023-12-16T20:52:40.095 INFO:tasks.ceph.mon.c:Stopped 2023-12-16T20:52:40.095 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-16T20:52:40.095 DEBUG:teuthology.orchestra.run.smithi087:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2023-12-16T20:52:40.195 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi087.front.sepia.ceph.com 2023-12-16T20:52:40.195 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-16T20:52:40.283 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi087.front.sepia.ceph.com 2023-12-16T20:52:40.283 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-16T20:52:40.364 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi087.front.sepia.ceph.com 2023-12-16T20:52:40.365 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-16T20:52:40.421 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi087.front.sepia.ceph.com 2023-12-16T20:52:40.421 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-16T20:52:40.483 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi195.front.sepia.ceph.com 2023-12-16T20:52:40.483 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-16T20:52:40.585 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi195.front.sepia.ceph.com 2023-12-16T20:52:40.585 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-16T20:52:40.640 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi195.front.sepia.ceph.com 2023-12-16T20:52:40.641 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-16T20:52:40.702 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi195.front.sepia.ceph.com 2023-12-16T20:52:40.703 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-16T20:52:40.761 INFO:tasks.ceph:Archiving mon data... 2023-12-16T20:52:40.763 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494750/data/mon.a.tgz 2023-12-16T20:52:40.763 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2023-12-16T20:52:40.779 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.GhCZR8dKBo 2023-12-16T20:52:40.780 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.GhCZR8dKBo 2023-12-16T20:52:40.913 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.GhCZR8dKBo 2023-12-16T20:52:40.997 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.GhCZR8dKBo is 297KB 2023-12-16T20:52:41.065 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.GhCZR8dKBo 2023-12-16T20:52:41.080 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494750/data/mon.b.tgz 2023-12-16T20:52:41.080 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2023-12-16T20:52:41.097 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.L7as5DhleR 2023-12-16T20:52:41.098 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.L7as5DhleR 2023-12-16T20:52:41.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-12-16T20:52:41.231 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.L7as5DhleR 2023-12-16T20:52:41.317 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.L7as5DhleR is 297KB 2023-12-16T20:52:41.412 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.L7as5DhleR 2023-12-16T20:52:41.427 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494750/data/mon.c.tgz 2023-12-16T20:52:41.427 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2023-12-16T20:52:41.481 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.K4SR0iaV7Q 2023-12-16T20:52:41.481 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.K4SR0iaV7Q 2023-12-16T20:52:41.602 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.K4SR0iaV7Q 2023-12-16T20:52:41.686 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.K4SR0iaV7Q is 298KB 2023-12-16T20:52:41.781 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.K4SR0iaV7Q 2023-12-16T20:52:41.796 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-16T20:52:41.796 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-16T20:52:41.798 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-16T20:52:42.134 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc strdup 2023-12-16T20:52:42.402 INFO:tasks.ceph:Archiving crash dumps... 2023-12-16T20:52:42.404 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494750/remote/smithi087/crash 2023-12-16T20:52:42.405 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T20:52:42.433 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494750/remote/smithi195/crash 2023-12-16T20:52:42.434 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T20:52:42.461 INFO:tasks.ceph:Shutting down logrotate 2023-12-16T20:52:42.461 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:52:42.479 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T20:52:42.584 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-16T20:52:42.612 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-16T20:52:42.638 INFO:tasks.ceph:Compressing logs... 2023-12-16T20:52:42.638 DEBUG:teuthology.orchestra.run.smithi087:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T20:52:42.654 DEBUG:teuthology.orchestra.run.smithi195:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T20:52:42.678 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88811.log 2023-12-16T20:52:42.730 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-16T20:52:42.730 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88630.log 2023-12-16T20:52:42.730 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88750.log 2023-12-16T20:52:42.730 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.88630.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2023-12-16T20:52:42.730 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.88750.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.88630.log.gz 2023-12-16T20:52:42.730 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2023-12-16T20:52:42.730 INFO:teuthology.orchestra.run.smithi195.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88750.log.gz 2023-12-16T20:52:42.730 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2023-12-16T20:52:42.730 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/valgrind/mon.c.log: /var/log/ceph/valgrind/mds.f.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2023-12-16T20:52:42.730 INFO:teuthology.orchestra.run.smithi195.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2023-12-16T20:52:42.730 INFO:teuthology.orchestra.run.smithi195.stderr: 74.7% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2023-12-16T20:52:42.730 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2023-12-16T20:52:42.731 INFO:teuthology.orchestra.run.smithi195.stderr: 57.3% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2023-12-16T20:52:42.731 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88830.log 2023-12-16T20:52:42.731 INFO:teuthology.orchestra.run.smithi195.stderr: 74.7% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2023-12-16T20:52:42.731 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/valgrind/mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88670.log 2023-12-16T20:52:42.731 INFO:teuthology.orchestra.run.smithi195.stderr: 57.4% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2023-12-16T20:52:42.731 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.88830.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-16T20:52:42.731 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.88670.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88830.log.gz 2023-12-16T20:52:42.731 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-16T20:52:42.731 INFO:teuthology.orchestra.run.smithi195.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88670.log.gz 2023-12-16T20:52:42.731 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-16T20:52:42.731 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88710.log 2023-12-16T20:52:42.731 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-16T20:52:42.731 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.88710.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-16T20:52:42.731 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.7.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88710.log.gz 2023-12-16T20:52:42.732 INFO:teuthology.orchestra.run.smithi195.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-16T20:52:42.732 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2023-12-16T20:52:42.732 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-16T20:52:42.732 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88790.log 2023-12-16T20:52:42.732 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-16T20:52:42.732 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.88790.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88790.log.gz 2023-12-16T20:52:42.732 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88921.log 2023-12-16T20:52:42.732 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-16T20:52:42.732 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-16T20:52:42.732 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.88921.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.88921.log.gz 2023-12-16T20:52:42.732 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-16T20:52:42.732 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mon.b.log: 93.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-16T20:52:42.732 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88870.log 2023-12-16T20:52:42.735 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mds.d.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-16T20:52:42.735 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-16T20:52:42.736 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.88870.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.88870.log.gz 2023-12-16T20:52:42.741 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mon.c.log: 94.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-16T20:52:42.760 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101436.log 2023-12-16T20:52:42.760 INFO:teuthology.orchestra.run.smithi087.stderr:gzip/var/log/ceph/ceph-client.admin.88811.log: -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-16T20:52:42.760 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.101436.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88811.log.gz 2023-12-16T20:52:42.760 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92716.log 2023-12-16T20:52:42.760 INFO:teuthology.orchestra.run.smithi087.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.101436.log.gz 2023-12-16T20:52:42.760 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97060.log 2023-12-16T20:52:42.760 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.92716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94047.log 2023-12-16T20:52:42.761 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.97060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95504.log 2023-12-16T20:52:42.761 INFO:teuthology.orchestra.run.smithi087.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92716.log.gz 2023-12-16T20:52:42.761 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.94047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94576.log 2023-12-16T20:52:42.761 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97060.log.gz 2023-12-16T20:52:42.761 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93030.log 2023-12-16T20:52:42.761 INFO:teuthology.orchestra.run.smithi087.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95504.log.gz 2023-12-16T20:52:42.761 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96976.log 2023-12-16T20:52:42.761 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.94576.log: /var/log/ceph/ceph-client.admin.93030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99628.log 2023-12-16T20:52:42.761 INFO:teuthology.orchestra.run.smithi087.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94576.log.gz 2023-12-16T20:52:42.761 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96976.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93030.log.gz 2023-12-16T20:52:42.761 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101184.log 2023-12-16T20:52:42.761 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96976.log.gz 2023-12-16T20:52:42.761 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.99628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96808.log 2023-12-16T20:52:42.762 INFO:teuthology.orchestra.run.smithi087.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.94047.log.gz 2023-12-16T20:52:42.762 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99628.log.gz 2023-12-16T20:52:42.762 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.101184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95074.log 2023-12-16T20:52:42.762 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101184.log.gz 2023-12-16T20:52:42.762 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2023-12-16T20:52:42.762 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96808.log: /var/log/ceph/ceph-client.admin.95074.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2023-12-16T20:52:42.762 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96808.log.gz 2023-12-16T20:52:42.762 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/valgrind/mds.c.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95074.log.gz 2023-12-16T20:52:42.762 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2023-12-16T20:52:42.762 INFO:teuthology.orchestra.run.smithi087.stderr: 57.4% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2023-12-16T20:52:42.762 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/valgrind/mds.a.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2023-12-16T20:52:42.762 INFO:teuthology.orchestra.run.smithi087.stderr: 57.2% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2023-12-16T20:52:42.762 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/valgrind/client.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2023-12-16T20:52:42.762 INFO:teuthology.orchestra.run.smithi087.stderr: 76.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2023-12-16T20:52:42.762 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88546.log 2023-12-16T20:52:42.763 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/valgrind/mds.e.log: 74.7% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2023-12-16T20:52:42.763 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96279.log 2023-12-16T20:52:42.763 INFO:teuthology.orchestra.run.smithi087.stderr: 57.3% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2023-12-16T20:52:42.763 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.88546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94744.log 2023-12-16T20:52:42.763 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96556.log 2023-12-16T20:52:42.763 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.94744.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96279.log.gz 2023-12-16T20:52:42.763 INFO:teuthology.orchestra.run.smithi087.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.88546.log.gz 2023-12-16T20:52:42.763 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94290.log 2023-12-16T20:52:42.763 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94744.log.gz 2023-12-16T20:52:42.763 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96850.log 2023-12-16T20:52:42.763 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96556.log: /var/log/ceph/ceph-client.admin.94290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100117.log 2023-12-16T20:52:42.763 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96556.log.gz 2023-12-16T20:52:42.763 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94906.log 2023-12-16T20:52:42.764 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94290.log.gz 2023-12-16T20:52:42.764 INFO:teuthology.orchestra.run.smithi087.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96850.log.gz 2023-12-16T20:52:42.764 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96934.log 2023-12-16T20:52:42.764 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.94906.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100117.log.gz 2023-12-16T20:52:42.764 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95784.log 2023-12-16T20:52:42.764 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1%/var/log/ceph/ceph-client.admin.96934.log: -- replaced with /var/log/ceph/ceph-client.admin.94906.log.gz 2023-12-16T20:52:42.764 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100244.log 2023-12-16T20:52:42.764 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96934.log.gz 2023-12-16T20:52:42.764 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95784.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.82530.log 2023-12-16T20:52:42.764 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100244.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95784.log.gz 2023-12-16T20:52:42.764 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97248.log 2023-12-16T20:52:42.764 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.tmp-client.admin.82530.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100244.log.gz 2023-12-16T20:52:42.764 INFO:teuthology.orchestra.run.smithi087.stderr:gzip 0.0% -5 -- replaced with /var/log/ceph/ceph.tmp-client.admin.82530.log.gz 2023-12-16T20:52:42.764 INFO:teuthology.orchestra.run.smithi087.stderr: --verbose -- /var/log/ceph/ceph-client.admin.100538.log 2023-12-16T20:52:42.764 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.97248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99838.log 2023-12-16T20:52:42.765 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100538.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97248.log.gz 2023-12-16T20:52:42.765 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94332.log 2023-12-16T20:52:42.765 INFO:teuthology.orchestra.run.smithi087.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100538.log.gz 2023-12-16T20:52:42.765 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.99838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95032.log 2023-12-16T20:52:42.765 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.94332.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99838.log.gz 2023-12-16T20:52:42.765 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100664.log 2023-12-16T20:52:42.765 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100160.log 88.4% 2023-12-16T20:52:42.765 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94332.log.gz 2023-12-16T20:52:42.765 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100664.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95032.log.gz 2023-12-16T20:52:42.765 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100412.log 2023-12-16T20:52:42.765 INFO:teuthology.orchestra.run.smithi087.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.100664.log.gz 2023-12-16T20:52:42.765 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101000.log 2023-12-16T20:52:42.765 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95505.log 2023-12-16T20:52:42.766 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100160.log.gz 2023-12-16T20:52:42.766 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.101000.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100412.log.gz 2023-12-16T20:52:42.766 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100832.log 2023-12-16T20:52:42.766 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101000.log.gz 2023-12-16T20:52:42.766 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96472.log 2023-12-16T20:52:42.766 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95505.log: /var/log/ceph/ceph-client.admin.100832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92629.log 2023-12-16T20:52:42.766 INFO:teuthology.orchestra.run.smithi087.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95505.log.gz 2023-12-16T20:52:42.766 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96472.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100832.log.gz 2023-12-16T20:52:42.766 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96598.log 2023-12-16T20:52:42.766 INFO:teuthology.orchestra.run.smithi087.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96472.log.gz 2023-12-16T20:52:42.766 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.92629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97018.log 2023-12-16T20:52:42.766 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96598.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.92629.log.gz 2023-12-16T20:52:42.766 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96514.log 2023-12-16T20:52:42.766 INFO:teuthology.orchestra.run.smithi087.stderr: 87.4%/var/log/ceph/ceph-client.admin.97018.log: -- replaced with /var/log/ceph/ceph-client.admin.96598.log.gz 2023-12-16T20:52:42.767 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93114.log 2023-12-16T20:52:42.767 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97018.log.gz 2023-12-16T20:52:42.767 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95693.log 2023-12-16T20:52:42.767 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.93114.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96514.log.gz 2023-12-16T20:52:42.767 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96040.log 2023-12-16T20:52:42.767 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95693.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93114.log.gz 2023-12-16T20:52:42.767 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93198.log 2023-12-16T20:52:42.767 INFO:teuthology.orchestra.run.smithi087.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95693.log.gz 2023-12-16T20:52:42.767 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96090.log 2023-12-16T20:52:42.767 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.93198.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96040.log.gz 2023-12-16T20:52:42.767 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95798.log 2023-12-16T20:52:42.767 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96090.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93198.log.gz 2023-12-16T20:52:42.767 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99402.log 2023-12-16T20:52:42.767 INFO:teuthology.orchestra.run.smithi087.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96090.log.gz 2023-12-16T20:52:42.768 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95798.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-16T20:52:42.768 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.99402.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95798.log.gz 2023-12-16T20:52:42.768 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93642.log 2023-12-16T20:52:42.768 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.audit.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.99402.log.gz 2023-12-16T20:52:42.768 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101310.log 2023-12-16T20:52:42.768 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.93642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101226.log 2023-12-16T20:52:42.768 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.101310.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93642.log.gz 2023-12-16T20:52:42.768 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99796.log 2023-12-16T20:52:42.768 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-16T20:52:42.768 INFO:teuthology.orchestra.run.smithi087.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101310.log.gz 2023-12-16T20:52:42.768 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99486.log 2023-12-16T20:52:42.768 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.101226.log: /var/log/ceph/ceph-client.admin.99796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94476.log 2023-12-16T20:52:42.768 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101226.log.gz 2023-12-16T20:52:42.768 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.99486.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99796.log.gz 2023-12-16T20:52:42.768 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100370.log 2023-12-16T20:52:42.769 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.94476.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99486.log.gz 2023-12-16T20:52:42.769 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93240.log 2023-12-16T20:52:42.769 INFO:teuthology.orchestra.run.smithi087.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94476.log.gz 2023-12-16T20:52:42.769 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95500.log 2023-12-16T20:52:42.769 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.93240.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100370.log.gz 2023-12-16T20:52:42.769 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95843.log 2023-12-16T20:52:42.769 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95500.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93240.log.gz 2023-12-16T20:52:42.769 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94392.log 2023-12-16T20:52:42.769 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95500.log.gz 2023-12-16T20:52:42.769 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93492.log 2023-12-16T20:52:42.769 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.94392.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95843.log.gz 2023-12-16T20:52:42.769 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93366.log 2023-12-16T20:52:42.769 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.93492.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94392.log.gz 2023-12-16T20:52:42.769 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95812.log 2023-12-16T20:52:42.769 INFO:teuthology.orchestra.run.smithi087.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93492.log.gz 2023-12-16T20:52:42.770 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.93366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101100.log 2023-12-16T20:52:42.770 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95812.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93366.log.gz 2023-12-16T20:52:42.770 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94990.log 2023-12-16T20:52:42.770 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.101100.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95812.log.gz 2023-12-16T20:52:42.770 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96429.log 2023-12-16T20:52:42.770 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101100.log.gz 2023-12-16T20:52:42.770 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.94990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100956.log 2023-12-16T20:52:42.770 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96429.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94990.log.gz 2023-12-16T20:52:42.770 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92830.log 2023-12-16T20:52:42.770 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100956.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96429.log.gz 2023-12-16T20:52:42.770 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-16T20:52:42.770 INFO:teuthology.orchestra.run.smithi087.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.100956.log.gz 2023-12-16T20:52:42.770 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.92830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99980.log 2023-12-16T20:52:42.770 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.1.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92830.log.gz 2023-12-16T20:52:42.770 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92496.log 2023-12-16T20:52:42.771 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.99980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93072.log 2023-12-16T20:52:42.771 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99980.log.gz 2023-12-16T20:52:42.771 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.92496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93282.log 2023-12-16T20:52:42.771 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92496.log.gz 2023-12-16T20:52:42.771 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94518.log 2023-12-16T20:52:42.771 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.93072.log: /var/log/ceph/ceph-client.admin.93282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95793.log 2023-12-16T20:52:42.771 INFO:teuthology.orchestra.run.smithi087.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93072.log.gz 2023-12-16T20:52:42.771 INFO:teuthology.orchestra.run.smithi087.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.93282.log.gz 2023-12-16T20:52:42.771 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.94518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96178.log 2023-12-16T20:52:42.771 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94518.log.gz 2023-12-16T20:52:42.771 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101060.log 2023-12-16T20:52:42.771 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95793.log: /var/log/ceph/ceph-client.admin.96178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100328.log 2023-12-16T20:52:42.771 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95793.log.gz 2023-12-16T20:52:42.771 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.101060.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96178.log.gz 2023-12-16T20:52:42.771 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95503.log 2023-12-16T20:52:42.771 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101060.log.gz 2023-12-16T20:52:42.772 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96169.log 2023-12-16T20:52:42.772 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100328.log: /var/log/ceph/ceph-client.admin.95503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94786.log 2023-12-16T20:52:42.772 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100328.log.gz 2023-12-16T20:52:42.772 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95503.log.gz 2023-12-16T20:52:42.772 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96060.log 2023-12-16T20:52:42.772 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-16T20:52:42.772 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.94786.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96169.log.gz 2023-12-16T20:52:42.772 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96060.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.100286.log 2023-12-16T20:52:42.772 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94786.log.gz 2023-12-16T20:52:42.772 INFO:teuthology.orchestra.run.smithi087.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96060.log.gz 2023-12-16T20:52:42.772 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100706.log 2023-12-16T20:52:42.772 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.100286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100895.log 2023-12-16T20:52:42.772 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100706.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100286.log.gz 2023-12-16T20:52:42.772 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95508.log 2023-12-16T20:52:42.772 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100895.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.100706.log.gz 2023-12-16T20:52:42.773 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94948.log 2023-12-16T20:52:42.773 INFO:teuthology.orchestra.run.smithi087.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100895.log.gz 2023-12-16T20:52:42.773 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95501.log 2023-12-16T20:52:42.773 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95508.log: /var/log/ceph/ceph-client.admin.94948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92674.log 2023-12-16T20:52:42.773 INFO:teuthology.orchestra.run.smithi087.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.95508.log.gz 2023-12-16T20:52:42.773 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95501.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.94948.log.gz 2023-12-16T20:52:42.773 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100748.log 2023-12-16T20:52:42.773 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.92674.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95501.log.gz 2023-12-16T20:52:42.773 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99754.log 2023-12-16T20:52:42.773 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92674.log.gz 2023-12-16T20:52:42.773 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94434.log 2023-12-16T20:52:42.773 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100748.log: /var/log/ceph/ceph-client.admin.99754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92946.log 2023-12-16T20:52:42.773 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100748.log.gz 2023-12-16T20:52:42.774 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99754.log.gz 2023-12-16T20:52:42.774 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.94434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94702.log 2023-12-16T20:52:42.774 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93324.log 2023-12-16T20:52:42.774 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.92946.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94434.log.gz 2023-12-16T20:52:42.774 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.94702.log: gzip 88.1% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.92946.log.gz 2023-12-16T20:52:42.774 INFO:teuthology.orchestra.run.smithi087.stderr: /var/log/ceph/ceph-client.admin.100622.log 2023-12-16T20:52:42.774 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95116.log 2023-12-16T20:52:42.774 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.93324.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94702.log.gz 2023-12-16T20:52:42.774 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100622.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93324.log.gz 2023-12-16T20:52:42.774 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100022.log 2023-12-16T20:52:42.774 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100622.log.gz 2023-12-16T20:52:42.774 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93408.log 2023-12-16T20:52:42.774 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95116.log: /var/log/ceph/ceph-client.admin.100022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101142.log 2023-12-16T20:52:42.774 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95116.log.gz 2023-12-16T20:52:42.775 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100022.log.gz 2023-12-16T20:52:42.775 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.93408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95284.log 2023-12-16T20:52:42.775 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94660.log 2023-12-16T20:52:42.775 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.101142.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93408.log.gz 2023-12-16T20:52:42.775 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95284.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101142.log.gz 2023-12-16T20:52:42.775 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2023-12-16T20:52:42.775 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95284.log.gz 2023-12-16T20:52:42.775 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-16T20:52:42.775 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.94660.log: /var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97634.log 2023-12-16T20:52:42.775 INFO:teuthology.orchestra.run.smithi087.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94660.log.gz 2023-12-16T20:52:42.775 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96724.log 2023-12-16T20:52:42.775 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.97634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95499.log 2023-12-16T20:52:42.775 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100790.log 2023-12-16T20:52:42.775 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96724.log.gz 2023-12-16T20:52:42.776 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101352.log 2023-12-16T20:52:42.776 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100790.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95499.log.gz 2023-12-16T20:52:42.776 INFO:teuthology.orchestra.run.smithi087.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.100790.log.gz 2023-12-16T20:52:42.776 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99444.log 2023-12-16T20:52:42.776 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95737.log 2023-12-16T20:52:42.776 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.99444.log: /var/log/ceph/ceph-client.admin.101352.log: 87.8% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101352.log.gz 2023-12-16T20:52:42.776 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.99444.log.gz 2023-12-16T20:52:42.776 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99712.log 2023-12-16T20:52:42.776 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100496.log 2023-12-16T20:52:42.776 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95737.log: /var/log/ceph/ceph-client.admin.99712.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.95737.log.gz 2023-12-16T20:52:42.776 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99712.log.gz 2023-12-16T20:52:42.776 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96385.log 2023-12-16T20:52:42.776 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96682.log 2023-12-16T20:52:42.776 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100496.log: /var/log/ceph/ceph-client.admin.96385.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100496.log.gz 2023-12-16T20:52:42.776 INFO:teuthology.orchestra.run.smithi087.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96385.log.gz 2023-12-16T20:52:42.777 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96313.log 2023-12-16T20:52:42.777 INFO:teuthology.orchestra.run.smithi087.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2023-12-16T20:52:42.777 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99670.log 2023-12-16T20:52:42.777 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96682.log: /var/log/ceph/ceph-client.admin.96313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99360.log 2023-12-16T20:52:42.777 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.99670.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96682.log.gz 2023-12-16T20:52:42.777 INFO:teuthology.orchestra.run.smithi087.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96313.log.gz 2023-12-16T20:52:42.777 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94864.log 2023-12-16T20:52:42.777 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99670.log.gz 2023-12-16T20:52:42.777 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5/var/log/ceph/ceph-client.admin.99360.log: --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-16T20:52:42.777 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.94864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93534.log 2023-12-16T20:52:42.777 INFO:teuthology.orchestra.run.smithi087.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99360.log.gz 2023-12-16T20:52:42.777 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94864.log.gz/var/log/ceph/ceph-osd.0.log: 2023-12-16T20:52:42.777 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95242.log 2023-12-16T20:52:42.777 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.93534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93450.log 2023-12-16T20:52:42.778 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95242.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93534.log.gz 2023-12-16T20:52:42.778 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95242.log.gz 2023-12-16T20:52:42.778 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100202.log 2023-12-16T20:52:42.778 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.93450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96640.log 2023-12-16T20:52:42.778 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100202.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93450.log.gz 2023-12-16T20:52:42.778 INFO:teuthology.orchestra.run.smithi087.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100202.log.gz 2023-12-16T20:52:42.778 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-16T20:52:42.778 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96640.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-16T20:52:42.778 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96640.log.gz 2023-12-16T20:52:42.778 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92904.log 2023-12-16T20:52:42.778 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.2.log: 87.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-16T20:52:42.778 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95200.log 2023-12-16T20:52:42.778 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.92904.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92904.log.gz 2023-12-16T20:52:42.778 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95326.log 2023-12-16T20:52:42.779 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95200.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95200.log.gz 2023-12-16T20:52:42.779 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-16T20:52:42.779 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95326.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95326.log.gz 2023-12-16T20:52:42.779 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94618.log 2023-12-16T20:52:42.779 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mds.c.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-16T20:52:42.779 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93576.log 2023-12-16T20:52:42.779 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.94618.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94618.log.gz 2023-12-16T20:52:42.779 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100580.log 2023-12-16T20:52:42.779 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.93576.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.93576.log.gz 2023-12-16T20:52:42.779 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95158.log 2023-12-16T20:52:42.779 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100580.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.100580.log.gz 2023-12-16T20:52:42.779 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97120.log 2023-12-16T20:52:42.779 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95158.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.95158.log.gz 2023-12-16T20:52:42.779 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99570.log 2023-12-16T20:52:42.779 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.97120.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.97120.log.gz 2023-12-16T20:52:42.779 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95874.log 2023-12-16T20:52:42.780 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.99570.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99570.log.gz 2023-12-16T20:52:42.780 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99528.log 2023-12-16T20:52:42.780 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95874.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95874.log.gz 2023-12-16T20:52:42.780 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101268.log 2023-12-16T20:52:42.780 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.99528.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99528.log.gz 2023-12-16T20:52:42.780 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96766.log 2023-12-16T20:52:42.780 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.101268.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101268.log.gz 2023-12-16T20:52:42.780 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100454.log 2023-12-16T20:52:42.780 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96766.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96766.log.gz 2023-12-16T20:52:42.780 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101394.log 2023-12-16T20:52:42.780 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100454.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.100454.log.gz 2023-12-16T20:52:42.780 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96892.log 2023-12-16T20:52:42.780 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.101394.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101394.log.gz 2023-12-16T20:52:42.780 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93156.log 2023-12-16T20:52:42.780 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96892.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96892.log.gz 2023-12-16T20:52:42.781 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100065.log 2023-12-16T20:52:42.781 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.93156.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93156.log.gz 2023-12-16T20:52:42.781 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89001.log 2023-12-16T20:52:42.781 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.100065.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100065.log.gz 2023-12-16T20:52:42.781 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92988.log 2023-12-16T20:52:42.781 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.89001.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89001.log.gz 2023-12-16T20:52:42.781 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-12-16T20:52:42.781 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.92988.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92988.log.gz 2023-12-16T20:52:42.781 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95502.log 2023-12-16T20:52:42.781 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mds.a.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-16T20:52:42.781 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96218.log 2023-12-16T20:52:42.781 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.95502.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95502.log.gz 2023-12-16T20:52:42.782 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.96218.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96218.log.gz 2023-12-16T20:52:42.992 INFO:teuthology.orchestra.run.smithi087.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-16T20:52:43.321 INFO:teuthology.orchestra.run.smithi195.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-16T20:52:43.369 INFO:teuthology.orchestra.run.smithi195.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-16T20:52:44.035 INFO:teuthology.orchestra.run.smithi087.stderr: 89.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-16T20:52:45.110 INFO:teuthology.orchestra.run.smithi195.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-16T20:52:45.817 INFO:teuthology.orchestra.run.smithi087.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-16T20:52:46.050 INFO:teuthology.orchestra.run.smithi195.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-16T20:52:46.173 INFO:teuthology.orchestra.run.smithi087.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-16T20:52:46.726 INFO:teuthology.orchestra.run.smithi087.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-16T20:52:46.967 INFO:teuthology.orchestra.run.smithi195.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-16T20:52:47.093 INFO:teuthology.orchestra.run.smithi195.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-16T20:52:47.130 INFO:teuthology.orchestra.run.smithi087.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-16T20:52:54.369 INFO:teuthology.orchestra.run.smithi087.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.97634.log.gz 2023-12-16T20:52:54.371 INFO:teuthology.orchestra.run.smithi087.stderr: 2023-12-16T20:52:54.371 INFO:teuthology.orchestra.run.smithi087.stderr:real 0m11.705s 2023-12-16T20:52:54.371 INFO:teuthology.orchestra.run.smithi087.stderr:user 0m27.532s 2023-12-16T20:52:54.371 INFO:teuthology.orchestra.run.smithi087.stderr:sys 0m0.905s 2023-12-16T20:53:02.022 INFO:teuthology.orchestra.run.smithi195.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2023-12-16T20:53:02.024 INFO:teuthology.orchestra.run.smithi195.stderr: 2023-12-16T20:53:02.024 INFO:teuthology.orchestra.run.smithi195.stderr:real 0m19.325s 2023-12-16T20:53:02.024 INFO:teuthology.orchestra.run.smithi195.stderr:user 0m33.760s 2023-12-16T20:53:02.024 INFO:teuthology.orchestra.run.smithi195.stderr:sys 0m1.126s 2023-12-16T20:53:02.024 INFO:tasks.ceph:Archiving logs... 2023-12-16T20:53:02.024 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494750/remote/smithi087/log 2023-12-16T20:53:02.025 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T20:53:06.433 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494750/remote/smithi195/log 2023-12-16T20:53:06.433 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T20:53:11.491 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2023-12-16T20:53:11.492 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-16T20:53:11.502 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2023-12-16T20:53:11.503 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-16T20:53:11.503 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T20:53:11.506 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T20:53:11.583 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-16T20:53:11.594 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-16T20:53:11.594 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T20:53:11.597 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T20:53:11.611 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2023-12-16T20:53:11.613 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2023-12-16T20:53:11.616 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T20:53:11.616 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2023-12-16T20:53:11.616 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 13 -215us[ -191us] +/- 77ms 2023-12-16T20:53:11.616 INFO:teuthology.orchestra.run.smithi087.stdout:^* hv02.front.sepia.ceph.com 3 6 377 13 +106us[ +130us] +/- 48ms 2023-12-16T20:53:11.616 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 205 -2952ns[ +11us] +/- 69ms 2023-12-16T20:53:11.616 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:53:11.618 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T20:53:11.618 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2023-12-16T20:53:11.618 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 9 -181us[ -181us] +/- 77ms 2023-12-16T20:53:11.618 INFO:teuthology.orchestra.run.smithi195.stdout:^* hv02.front.sepia.ceph.com 3 6 377 10 +143us[ +193us] +/- 48ms 2023-12-16T20:53:11.618 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +24us[ +73us] +/- 72ms 2023-12-16T20:53:11.618 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T20:53:11.618 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-16T20:53:11.627 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-16T20:53:11.628 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-16T20:53:11.636 DEBUG:teuthology.orchestra.run.smithi087:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-16T20:53:11.759 DEBUG:teuthology.orchestra.run.smithi195:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-16T20:53:11.858 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T20:53:11.890 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T20:53:11.890 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T20:53:11.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T20:53:11.923 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-16T20:53:11.934 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-16T20:53:11.942 INFO:teuthology.task.internal:Duration was 2814.753823 seconds 2023-12-16T20:53:11.942 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-16T20:53:11.952 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-16T20:53:11.952 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T20:53:11.954 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T20:53:11.997 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T20:53:12.007 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T20:53:12.342 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-16T20:53:12.343 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2023-12-16T20:53:12.343 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T20:53:12.405 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2023-12-16T20:53:12.405 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T20:53:12.435 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-16T20:53:12.435 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T20:53:12.444 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T20:53:12.503 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-16T20:53:12.504 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T20:53:12.512 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T20:53:12.651 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-16T20:53:12.662 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-16T20:53:12.662 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T20:53:12.689 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T20:53:12.716 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-16T20:53:12.726 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T20:53:12.732 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T20:53:12.754 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2023-12-16T20:53:12.781 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2023-12-16T20:53:12.807 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T20:53:12.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T20:53:12.824 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T20:53:12.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T20:53:12.862 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-16T20:53:12.873 INFO:teuthology.task.internal:Transferring archived files... 2023-12-16T20:53:12.873 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494750/remote/smithi087 2023-12-16T20:53:12.874 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T20:53:12.910 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494750/remote/smithi195 2023-12-16T20:53:12.910 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T20:53:12.946 INFO:teuthology.task.internal:Removing archive directory... 2023-12-16T20:53:12.946 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T20:53:12.949 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T20:53:12.996 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-16T20:53:13.007 INFO:teuthology.task.internal:Not uploading archives. 2023-12-16T20:53:13.007 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-16T20:53:13.019 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-16T20:53:13.019 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T20:53:13.025 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T20:53:13.033 INFO:teuthology.orchestra.run.smithi087.stdout: 265984 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 20:53 /home/ubuntu/cephtest 2023-12-16T20:53:13.050 INFO:teuthology.orchestra.run.smithi195.stdout: 265244 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 20:53 /home/ubuntu/cephtest 2023-12-16T20:53:13.051 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-16T20:53:13.062 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-16T20:53:13.073 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2023-12-16T20:53:13.073 INFO:teuthology.nuke:Checking targets against current locks 2023-12-16T20:53:13.093 DEBUG:teuthology.nuke:shortname: smithi087 2023-12-16T20:53:13.094 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T20:53:13.118 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494750', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 19:58:23.039712', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE8IaRhqnFsfjORsL88XrUajDD+7iM2CtXcgqXVyXcph/SyzSRgHkjytgzBDQpdTqcSlM0p5u7d85wvJCRozKpc='} 2023-12-16T20:53:13.122 DEBUG:teuthology.nuke:shortname: smithi195 2023-12-16T20:53:13.122 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T20:53:13.148 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_15:45:14-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494750', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 19:58:23.038121', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBhvuffNgRWHW3O4nRlKM77Upb3PLN91wIhtrzCOIupJyg2xpAzZ9SqJrDvC8H/kpuFTfmm/KwVKIEPZrbc6RPI='} 2023-12-16T20:53:13.174 INFO:teuthology.orchestra.console.smithi087:Power off 2023-12-16T20:53:13.175 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T20:53:13.198 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off 2023-12-16T20:53:13.199 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T20:53:13.214 INFO:teuthology.orchestra.console.smithi195:Power off 2023-12-16T20:53:13.214 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T20:53:13.222 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2023-12-16T20:53:13.235 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-12-16T20:53:13.235 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T20:53:13.258 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-16T20:53:17.224 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T20:53:17.259 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T20:53:17.335 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2023-12-16T20:53:17.369 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-16T20:53:21.336 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T20:53:21.370 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T20:53:21.445 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2023-12-16T20:53:21.480 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-16T20:53:21.546 INFO:teuthology.orchestra.console.smithi087:Power off completed 2023-12-16T20:53:21.581 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-12-16T20:53:21.685 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} duration: 2814.753823041916 failure_reason: 'valgrind error: Leak_StillReachable malloc malloc strdup' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2023-12-16T20:53:21.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:53:21.779 INFO:teuthology.run:FAIL